-- Logs begin at Thu 2022-11-03 02:57:47 UTC, end at Thu 2022-11-03 05:56:54 UTC. -- Nov 03 03:39:45.075140 n-d-854653-7 systemd[1]: Starting Devstack devstack@n-api.service... Nov 03 03:39:45.083744 n-d-854653-7 devstack@n-api.service[111734]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 3 03:39:45 2022] *** Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: nodename: n-d-854653-7 Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: machine: x86_64 Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: clock source: unix Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: pcre jit disabled Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: detected number of CPU cores: 4 Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: current working directory: / Nov 03 03:39:45.085734 n-d-854653-7 devstack@n-api.service[111734]: detected binary path: /usr/bin/uwsgi-core Nov 03 03:39:45.086378 n-d-854653-7 devstack@n-api.service[111734]: your processes number limit is 47680 Nov 03 03:39:45.086378 n-d-854653-7 devstack@n-api.service[111734]: your memory page size is 4096 bytes Nov 03 03:39:45.086378 n-d-854653-7 devstack@n-api.service[111734]: detected max file descriptor number: 2048 Nov 03 03:39:45.086378 n-d-854653-7 devstack@n-api.service[111734]: lock engine: pthread robust mutexes Nov 03 03:39:45.086378 n-d-854653-7 devstack@n-api.service[111734]: thunder lock: enabled Nov 03 03:39:45.086378 n-d-854653-7 devstack@n-api.service[111734]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 03 03:39:45.086378 n-d-854653-7 devstack@n-api.service[111734]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 03 03:39:45.125277 n-d-854653-7 devstack@n-api.service[111734]: Python main interpreter initialized at 0x556934e1c9c0 Nov 03 03:39:45.125277 n-d-854653-7 devstack@n-api.service[111734]: python threads support enabled Nov 03 03:39:45.125277 n-d-854653-7 devstack@n-api.service[111734]: your server socket listen backlog is limited to 100 connections Nov 03 03:39:45.125277 n-d-854653-7 devstack@n-api.service[111734]: your mercy for graceful operations on workers is 90 seconds Nov 03 03:39:45.125615 n-d-854653-7 devstack@n-api.service[111734]: mapped 403077 bytes (393 KB) for 2 cores Nov 03 03:39:45.125691 n-d-854653-7 devstack@n-api.service[111734]: *** Operational MODE: preforking *** Nov 03 03:39:45.125933 n-d-854653-7 devstack@n-api.service[111734]: *** uWSGI is running in multiple interpreter mode *** Nov 03 03:39:45.125933 n-d-854653-7 devstack@n-api.service[111734]: spawned uWSGI master process (pid: 111734) Nov 03 03:39:45.126131 n-d-854653-7 systemd[1]: Started Devstack devstack@n-api.service. Nov 03 03:39:45.126700 n-d-854653-7 devstack@n-api.service[111734]: spawned uWSGI worker 1 (pid: 111735, cores: 1) Nov 03 03:39:45.127866 n-d-854653-7 devstack@n-api.service[111734]: spawned uWSGI worker 2 (pid: 111736, cores: 1) Nov 03 03:39:45.127866 n-d-854653-7 devstack@n-api.service[111734]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 03 03:39:45.773443 n-d-854653-7 devstack@n-api.service[111736]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 03 03:39:45.778634 n-d-854653-7 devstack@n-api.service[111735]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 03 03:39:46.845336 n-d-854653-7 devstack@n-api.service[111736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:39:46.845336 n-d-854653-7 devstack@n-api.service[111736]: from cryptography.utils import int_from_bytes Nov 03 03:39:46.845964 n-d-854653-7 devstack@n-api.service[111736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:39:46.845964 n-d-854653-7 devstack@n-api.service[111736]: from cryptography.utils import int_from_bytes Nov 03 03:39:46.847826 n-d-854653-7 devstack@n-api.service[111735]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:39:46.847826 n-d-854653-7 devstack@n-api.service[111735]: from cryptography.utils import int_from_bytes Nov 03 03:39:46.848252 n-d-854653-7 devstack@n-api.service[111735]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:39:46.848252 n-d-854653-7 devstack@n-api.service[111735]: from cryptography.utils import int_from_bytes Nov 03 03:39:49.337282 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 03:39:49.337856 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 03:39:49.338038 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 03:39:49.338326 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 03:39:49.338681 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 03:39:49.338789 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 03:39:49.338880 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 03:39:49.338973 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.339090 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 03:39:49.339294 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.339444 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 03:39:49.339624 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.339714 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 03:39:49.339910 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.340093 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.340231 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.340414 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.340532 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.340734 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.340843 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.341072 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.341183 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.341400 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.341489 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.341707 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.341794 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.342024 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.342125 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.342339 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854653-7 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.342433 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.342651 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.342740 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.342906 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.343002 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.343218 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.343306 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.343535 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.343628 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854653-7 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.343831 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.343927 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.344144 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.344247 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.344444 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.344608 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.344745 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.344925 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.346174 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.346174 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.346441 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.346576 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.346701 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.346701 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.346947 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347091 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347219 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347352 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347476 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347600 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347728 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347852 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.347976 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.348108 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.348243 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.348381 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.348512 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.348642 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.348779 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.348904 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854653-7 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.349072 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.349205 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.349341 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.349466 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.349637 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.349827 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.349977 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854653-7 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.350105 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.350238 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.350365 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.350497 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.350641 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.350780 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.350906 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351031 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351165 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351300 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351438 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351572 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351698 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351821 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.351951 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.352090 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.352224 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.352350 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.352485 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.352618 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.352753 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.352920 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.353073 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.353257 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.353394 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.353569 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.353709 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.353867 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.353997 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.354167 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.354296 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.354420 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.354668 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.354808 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.354934 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355059 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355184 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355323 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355450 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355597 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355738 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355864 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.355996 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.356130 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.356257 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.356389 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.356515 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.356668 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.356808 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.356969 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.357395 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.357552 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.357686 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.357855 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.358006 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.358157 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.358295 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.358457 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.358588 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.358758 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.358889 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.359062 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.359198 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.359364 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.359464 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.359667 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.359782 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.359970 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.360065 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.360273 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.360414 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.360573 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.360660 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.360885 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.360971 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.361219 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.361308 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.361539 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.361627 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.361839 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.361923 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.362153 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.362254 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.362467 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.362554 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.362768 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.362852 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.363071 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.363164 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.363382 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.363467 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.363682 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.363767 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.363979 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.364073 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.364277 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.364362 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.364589 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.364674 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.364901 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.365105 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.365781 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.365877 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.365988 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.366074 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.366283 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.366370 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.366580 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.366666 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.366889 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.366976 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.367183 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.367268 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.367480 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.367578 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.367780 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.367864 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.368070 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.368156 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.368370 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.368467 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.368667 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.368760 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.368965 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.369083 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.369287 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.369373 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.369587 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.369679 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.369886 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.369967 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.370184 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.370269 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.370484 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.370578 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.370780 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.370865 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.371076 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.371167 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.371375 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.371474 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.371676 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.371770 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.371975 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.372060 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.372272 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.372372 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.372572 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.372660 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.372870 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.372955 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.373204 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.373309 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.373504 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.373589 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.373899 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374214 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374294 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374369 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374444 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374520 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374685 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374777 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.374994 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.375097 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.375294 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.375379 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.375592 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.375677 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.375892 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.375986 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.376182 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.376266 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.376480 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.376566 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.376784 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.376877 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.377102 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.377190 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.377400 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.377486 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.377699 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.377786 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.377992 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.378083 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.378287 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.378373 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.378582 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.378680 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.378874 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.378960 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.379168 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.379253 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.379458 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.379546 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.379755 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.379852 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.380052 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.380137 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.380348 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.380434 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.380640 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.380725 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.381525 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.381634 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.381841 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.381935 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.382145 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.382231 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.382450 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.382562 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.382752 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.382848 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.383066 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:39:49.383152 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.383394 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.383491 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.383715 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.383800 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.384025 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.384116 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.384329 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.384423 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.384637 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.384722 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.384955 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.385072 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.385298 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.385387 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.385602 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.385687 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.385906 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.385997 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.386218 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.386304 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.386524 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.386609 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.386833 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.386941 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.387138 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.387225 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.387445 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.387530 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.387758 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.387841 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.388059 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.388158 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.388369 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.388456 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.388677 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.388762 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.388990 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.389120 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.389312 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.389400 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.389624 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.389710 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.389951 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.390075 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.390263 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.390362 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.390565 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.390665 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.390876 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.390961 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.391177 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.391263 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.391478 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.391571 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.391779 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.391866 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.392109 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.392194 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.392415 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.392509 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.392717 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.392802 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.393046 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.393147 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.393350 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.393445 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.393665 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.393752 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.393968 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.394061 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.394271 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.394358 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.394575 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.394661 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.394877 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.394963 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.395185 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.395289 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.395489 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.395583 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.395796 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.395890 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.396104 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.396205 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.396431 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.396525 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.396756 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.396856 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.397088 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.397182 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.397397 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.397490 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.397709 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.397831 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398013 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398107 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398309 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398402 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398624 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398728 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398903 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.398996 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.399203 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.399304 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.399499 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.399602 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.399797 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.399888 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.400095 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.400196 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.400398 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.400500 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.400698 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.400791 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.401001 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.401136 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.401322 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.401429 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.401624 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.401724 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.401926 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.402019 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.402224 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.402316 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.402528 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.402619 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.402829 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.402927 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.403125 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.403225 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.403424 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.403525 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.403728 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.403821 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.404123 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.404220 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.404327 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.404433 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.404624 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.404710 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.404921 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.405028 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.405254 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.405366 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.405556 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.405660 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.405859 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.405952 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.406161 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.406254 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.406464 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.406566 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.406769 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.406924 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.407080 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.407230 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.407370 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.407527 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.407687 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.407827 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.407965 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.408104 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.408273 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.408420 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.408567 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.408706 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.408899 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.409071 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.409236 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.409376 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.409536 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.409675 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.409820 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.409959 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.410106 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.410246 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.410383 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.410520 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.410667 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.410806 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.410952 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.411099 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.411283 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.411446 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.411586 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.411724 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.411871 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412011 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412149 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412287 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412424 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412569 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412708 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412852 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.412991 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.413177 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.413339 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.413497 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.413637 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.413783 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.413921 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.414059 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.414196 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.414420 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.414569 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.414715 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.414859 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.415002 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.415146 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.415398 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.415554 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.415709 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.415856 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.416000 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.416153 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.416300 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.416445 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.416590 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.416734 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.416879 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.417084 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.417250 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.417413 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.417561 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.417705 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.417850 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.418004 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.418149 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.418294 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.418439 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.418584 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.418729 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.418887 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.419033 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.419188 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.419333 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.419477 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.419632 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.419777 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.419928 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.420074 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.420219 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.420363 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.420516 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.420670 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.420815 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.420959 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.421146 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.421304 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.421502 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.421655 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.421802 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.421946 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.422098 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.422249 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.422404 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.422550 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.422695 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.422839 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.422990 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.423155 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.423301 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.423446 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.423590 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.423735 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.423879 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.424032 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.424177 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.424322 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.424467 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.424611 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.424762 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.424922 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.425100 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.425249 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.425412 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.425641 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.425794 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.425950 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.426096 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.426240 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.426385 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.426529 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.426680 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.426834 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.426997 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.427153 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.427299 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.427443 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.427597 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.428229 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.428375 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.428526 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.428672 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.428816 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.428969 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.429164 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.429322 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.429485 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.429485 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.429761 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.429914 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.430061 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.430205 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.430348 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.430492 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.430636 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.430788 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.430943 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.431089 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.431240 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.431403 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.431557 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.431702 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.431854 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.431998 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.432144 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.432289 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.432447 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.432600 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.432746 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.432889 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.433051 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.433203 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.433381 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.433529 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.433673 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.433817 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.434144 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.434298 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.434454 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.434600 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.434746 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.434891 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.435044 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.435205 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.435353 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.435508 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.435669 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.435818 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.435971 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.436126 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.436272 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.436418 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.436564 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.436708 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.436853 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.437006 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.437191 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.437349 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.437495 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.437639 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.437783 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.437946 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.438093 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.438239 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.438384 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.438529 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.438683 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.438829 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.438981 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.439126 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.439281 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.439426 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.439586 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.439739 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.439885 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.440029 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.440173 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.440318 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.440475 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.440621 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.440767 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.440911 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.441073 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.441235 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.441393 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.441538 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.441684 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.441828 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.441981 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.442136 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.442290 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.442435 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.442580 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.442726 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.442877 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.443100 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.443259 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.443259 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.444085 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.444230 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.444381 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.444536 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.444682 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.444833 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.444979 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.445179 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.445326 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.445326 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.445647 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.445796 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.445941 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.446084 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.446228 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.446373 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.446530 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.446676 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.446821 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.446975 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.447146 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.447294 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.447439 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.447607 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.447760 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.447908 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.448052 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.448197 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.448341 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.448494 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.448640 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.448792 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.448946 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.449115 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.449264 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.449421 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.449578 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.449723 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.449867 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.450019 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.450174 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.450319 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.450464 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.450614 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.450759 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.450904 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.451058 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.451203 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.451347 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.451509 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.451662 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.451806 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.451965 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.452118 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.452263 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.452408 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.452551 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.452695 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.452848 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.452993 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.453255 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.453412 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.453569 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.453729 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.453875 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.454019 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.454166 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.454309 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.454459 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.454613 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.454760 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.454905 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.455050 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.455195 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.455350 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.455507 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.455653 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.455798 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.455798 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.456080 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.456233 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.456392 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.456548 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.456695 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.456840 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.456984 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.457170 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.457343 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.457497 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.457643 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.457787 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.457931 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.458084 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.458230 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.458375 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.458530 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.458677 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.458822 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.459014 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.459206 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.459357 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.459512 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.459658 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.459812 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.459965 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.460112 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.460263 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.460421 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.460575 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.460734 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.460881 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.461066 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.461232 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.461378 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.461565 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.461723 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.461869 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.462015 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.462160 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.462312 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.462457 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.462612 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.462758 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.462910 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.463055 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.463210 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.463364 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.463519 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.463666 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.463811 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.463955 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.464099 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.464253 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.464399 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.464544 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.464689 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.464833 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.464977 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.465175 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.465324 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.465469 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.465621 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.465768 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.465912 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.466072 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.466218 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.466363 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.466507 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.466651 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.466871 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.467020 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.467186 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.467332 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.467476 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.467619 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.467772 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.467925 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.468070 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.468221 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.468366 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.468511 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.468511 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.468794 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.468950 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.469146 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.469294 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.469439 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.469596 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.469743 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.469888 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.470032 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.470175 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.470329 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.470474 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.470627 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.470773 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.470936 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.471082 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.471235 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.471381 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.471525 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.471669 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.471814 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.471957 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.472111 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.472257 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.472402 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.472553 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.472698 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.472698 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.472991 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.473177 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.473326 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.473470 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.473615 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.473768 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.473914 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.474058 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.474204 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.474204 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.474476 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.474476 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.475315 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.475315 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.475591 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.475742 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.475888 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.476046 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.476201 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.476347 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.476491 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.476636 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.476779 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.476932 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.477141 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.477302 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.477458 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.477610 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.477759 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.477916 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.478063 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.478214 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.478361 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.478506 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.478660 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.478805 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.478957 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.479113 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.479258 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.479403 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.479561 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.479708 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.479853 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.480004 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.480149 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.480293 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.480448 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.480593 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.480738 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.480882 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.481073 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.481227 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.481383 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.481529 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.481674 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.481819 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.481972 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.482377 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.482526 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.482706 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.482856 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.483000 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.483145 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.483317 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.483465 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.483619 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.483775 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.483928 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.484081 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.484238 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.484383 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.484527 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.484673 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.484818 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.484962 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.485158 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.485326 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.485480 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.485626 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.485771 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.485925 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486071 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486226 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486336 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486424 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486506 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486602 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486686 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486767 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486857 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.486940 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487019 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487112 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487193 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487272 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487350 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487436 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487516 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487604 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487686 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487765 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487843 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.487931 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488021 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488102 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488188 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488268 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488347 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488434 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488524 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488718 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488809 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488889 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.488968 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.489116 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.489234 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.489426 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.489532 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.489738 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.489840 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.490044 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.490174 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.490891 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.490984 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.491195 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.491357 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.491514 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.491672 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.491828 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.491983 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.492129 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.492274 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.492428 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.492574 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.492719 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.492864 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.493009 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.493202 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.493365 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.493522 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.493666 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.493819 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.493964 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.494111 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.494330 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.494501 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.494660 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.494808 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.494960 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.495108 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.495254 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.495399 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.495564 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.495711 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.495856 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.496002 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.496148 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.496303 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.496449 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.496594 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.496740 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.496893 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.497058 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.497235 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.497384 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.497541 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.497687 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.497846 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.498000 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.498155 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.498303 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.498449 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.498594 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.498739 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.498884 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.499038 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.499185 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.499342 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.499487 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.499639 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.499795 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.499959 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.500106 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.500251 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.500396 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.500540 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.500699 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.500846 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.500991 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.501160 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.501320 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.501467 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.501625 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.501772 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.501917 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.502070 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.502224 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.502371 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.502526 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.502672 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.502817 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.502970 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.503116 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.503284 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.503433 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.503578 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.503723 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.503867 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.504030 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.504296 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.504449 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.504596 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.504742 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.504886 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.505076 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.505242 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.505401 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.505548 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.505693 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.505867 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.506014 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.506167 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.506313 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.506458 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.506604 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.506749 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.506902 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.507049 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.507217 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.507364 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.507508 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.507654 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.507808 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.507954 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.508099 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.508244 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.508388 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.508540 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.508696 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.508852 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.509008 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.509201 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.509349 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.509501 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.509661 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.509809 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.509966 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.510122 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.510269 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.510423 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.510569 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.510714 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.510860 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.511012 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.511169 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.511363 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.511515 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.511661 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.511806 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.511959 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.512105 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.512258 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.512404 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.512404 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.512680 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.512824 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.512990 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.513185 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.513334 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.513478 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.513623 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.513623 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.513915 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.514062 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.514208 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.514352 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.514496 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.514648 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.514803 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.514961 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.515114 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.515259 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.515403 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.515548 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.515701 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.515847 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.515998 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.516145 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.516290 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.516435 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.516593 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.516747 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.516903 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.517067 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.517230 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.517390 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.517537 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.517681 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.517833 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.517985 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.518140 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.518294 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.518441 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.518586 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.518731 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.518894 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.519041 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.519200 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.519347 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.519491 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.519636 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.519780 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.519934 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.520090 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.520237 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.520383 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.520528 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.520690 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.520844 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.520991 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.521187 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.521347 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.521529 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.521684 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.521839 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.521986 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.522130 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.522275 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.522422 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.522567 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.522732 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.522888 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.523034 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.523034 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.523309 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.523468 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.523617 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.523762 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.523907 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.524052 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.524197 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.524351 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.524521 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.524668 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.524814 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.524959 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.525136 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.525296 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.525444 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.525591 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.525737 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.525890 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.526055 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.526203 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.526364 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.526512 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.526657 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.526802 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.526957 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.527103 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.527249 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.527403 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.527551 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.527710 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.527863 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.528017 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.528173 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.528320 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.528466 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.528621 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.528768 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.528913 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.529112 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.529268 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.529432 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.529589 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.529737 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.529889 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.530053 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.530199 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.530364 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.530518 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.530665 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.530811 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.530957 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.531112 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.531268 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.531414 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.531560 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.531712 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.531859 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.532015 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.532238 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.532238 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.532518 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.532663 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.532816 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.532976 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.533153 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.533302 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.533448 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.533593 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.533739 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.533739 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.534059 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.534206 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.534352 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.534505 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.534652 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.534807 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.534954 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.535100 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.535245 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.535389 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.535534 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.535688 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.535845 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.536000 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.536147 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.536300 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.536300 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.536586 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.536740 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.536886 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.537563 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.537718 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.537877 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.538032 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.538032 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.538338 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.538497 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.538644 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.538804 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.538951 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.539109 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.539255 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.539401 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.539546 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.539701 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.539847 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.539999 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.540157 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.540304 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.540468 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.540615 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.540760 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.540911 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.541080 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.541080 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.541381 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.541530 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.541683 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.541829 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.541974 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.542129 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.542284 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.542438 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.542585 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.542738 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.542884 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.543039 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.543185 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.543332 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.543485 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.543632 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.543778 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.543942 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.544096 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.544243 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.544389 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.544541 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.544687 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.544846 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.544993 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.545259 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.545410 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.545557 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.545703 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.545858 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.546016 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.546162 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.546307 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.546452 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.546611 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.546757 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.546910 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.547056 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.547201 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.547347 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.547502 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.547649 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.547794 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.547950 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.548102 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.548250 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.548405 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.548553 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.548699 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.548845 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.548991 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.549161 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.549321 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.549476 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.549624 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.549770 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.549926 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.550072 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.550227 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.550379 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.550529 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.550675 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.550820 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.550975 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.551122 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.551267 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.551413 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.551558 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.551704 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.551869 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.552016 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.552162 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.552308 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.552460 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.552627 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553342 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553442 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553528 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553612 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553612 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553759 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553850 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.553932 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554012 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554092 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554092 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554245 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554326 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554406 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554615 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554707 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.554920 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.555165 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.555259 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.555500 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.555607 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.555800 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.555891 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.556102 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.556193 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.556403 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.556492 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.556703 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.556814 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.557007 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.557146 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.557324 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.557414 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.557624 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.557724 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.557926 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.558015 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.558225 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.558324 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.558525 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.558624 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.558830 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.558918 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.559140 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.559351 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.559515 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.559663 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.559809 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.559962 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.560109 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.560255 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.560485 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.560635 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.560781 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.560926 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.561103 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.561269 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.561426 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.561606 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.561756 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.561902 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.562046 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.562192 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.562350 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.562507 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.562655 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.562800 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.562800 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.563093 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.563093 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.563380 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.563523 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.563676 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.563821 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.563984 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.564131 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.564285 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.564440 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.564586 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.564731 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.564885 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.565075 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.565230 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.565376 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.565522 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.565681 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.565827 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.565973 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.566118 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.566262 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.566422 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.566640 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.566795 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.566957 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.567104 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.567250 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.567396 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.567551 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.567703 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.567849 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.567995 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.568139 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.568314 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.568477 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.568624 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.568770 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.568926 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.569106 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.569273 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.569428 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.569583 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.569730 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.569875 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.570020 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.570174 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.570328 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.570483 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.570630 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.570786 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.570941 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.571088 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.571240 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.571387 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.571532 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.571686 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.571842 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.571989 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.572134 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.572279 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.572424 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.572577 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.572743 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.572890 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.573078 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.573078 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.573374 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.573528 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.573684 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.573832 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.573983 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.574131 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.574277 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.574432 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.574579 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.574736 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.574881 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.575025 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.575169 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.575169 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.575454 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.575600 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.575744 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.575889 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.576033 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.576191 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.576338 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.576483 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.576638 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.576783 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.576928 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.577109 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.577261 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.577407 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.577552 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.577698 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.577881 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.578044 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.578191 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.578337 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.578498 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.578645 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.578799 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.578948 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.579093 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.579238 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.579384 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.579530 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.579684 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.579831 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.579977 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.580122 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.580268 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.580427 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.580582 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.580729 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.580883 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.581082 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.581236 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.581396 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.581550 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.581696 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.581842 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.581987 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.582132 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.582302 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.582449 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.582594 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.582775 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.582927 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.583073 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.583228 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.583374 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.583519 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.583663 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.583808 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.583996 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.584148 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.584306 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.584452 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.584596 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.584596 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.584882 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.585052 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.585205 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.585352 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.585497 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.585642 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.585804 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.585952 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.586108 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.586254 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.586407 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.586562 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.586708 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.586853 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.587005 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.587151 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.587349 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.587519 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.587667 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.587667 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.587950 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.588106 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.588251 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.588476 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.588632 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.588780 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.588924 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.589117 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.589282 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.589432 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.589578 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.589731 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.589877 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.590034 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.590189 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.590189 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 03:39:49.590483 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.590483 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.590759 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.590978 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.591298 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.591640 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.591950 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.592301 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.592640 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.592952 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.593294 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.593620 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:39:49.593862 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 03:39:49.743647 n-d-854653-7 devstack@n-api.service[111736]: INFO dbcounter [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Registered counter for database nova_api Nov 03 03:39:49.747004 n-d-854653-7 devstack@n-api.service[111735]: INFO dbcounter [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Registered counter for database nova_api Nov 03 03:39:49.764436 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_db.sqlalchemy.engines [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:49.768543 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_db.sqlalchemy.engines [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:49.771430 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writer thread running {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:49.775228 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writer thread running {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:49.828516 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.context [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=111736) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 03:39:49.830882 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.context [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=111735) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 03:39:49.832404 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:39:49.832875 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:39:49.834514 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:39:49.834728 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_concurrency.lockutils [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:39:49.835192 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_concurrency.lockutils [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:39:49.835284 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:39:49.835663 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:39:49.836776 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_concurrency.lockutils [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:39:49.837552 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_concurrency.lockutils [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:39:49.837719 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:39:49.837940 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_concurrency.lockutils [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:39:49.839719 n-d-854653-7 devstack@n-api.service[111736]: INFO dbcounter [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Registered counter for database nova_cell0 Nov 03 03:39:49.839929 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_concurrency.lockutils [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:39:49.841906 n-d-854653-7 devstack@n-api.service[111735]: INFO dbcounter [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Registered counter for database nova_cell0 Nov 03 03:39:49.843875 n-d-854653-7 devstack@n-api.service[111736]: INFO dbcounter [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Registered counter for database nova_cell1 Nov 03 03:39:49.845893 n-d-854653-7 devstack@n-api.service[111735]: INFO dbcounter [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Registered counter for database nova_cell1 Nov 03 03:39:49.851519 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_db.sqlalchemy.engines [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:49.853787 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_db.sqlalchemy.engines [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:49.856304 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_db.sqlalchemy.engines [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:49.857905 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_db.sqlalchemy.engines [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:49.858309 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writer thread running {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:49.866224 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writer thread running {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:49.866564 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writer thread running {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:49.998407 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writer thread running {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:50.008636 n-d-854653-7 devstack@n-api.service[111736]: INFO dbcounter [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Registered counter for database nova_cell0 Nov 03 03:39:50.012984 n-d-854653-7 devstack@n-api.service[111735]: INFO dbcounter [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Registered counter for database nova_cell0 Nov 03 03:39:50.017449 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_db.sqlalchemy.engines [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:50.022247 n-d-854653-7 devstack@n-api.service[111735]: DEBUG oslo_db.sqlalchemy.engines [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:39:50.022804 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writer thread running {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:50.028365 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writer thread running {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:39:50.414368 n-d-854653-7 devstack@n-api.service[111736]: WARNING keystonemiddleware.auth_token [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:39:50.421637 n-d-854653-7 devstack@n-api.service[111736]: WARNING keystonemiddleware.auth_token [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:39:50.463878 n-d-854653-7 devstack@n-api.service[111735]: WARNING keystonemiddleware.auth_token [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:39:50.471037 n-d-854653-7 devstack@n-api.service[111735]: WARNING keystonemiddleware.auth_token [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:39:50.761600 n-d-854653-7 devstack@n-api.service[111736]: WARNING keystonemiddleware.auth_token [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:39:50.767588 n-d-854653-7 devstack@n-api.service[111736]: WARNING keystonemiddleware.auth_token [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:39:50.773408 n-d-854653-7 devstack@n-api.service[111736]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556934e1c9c0 pid: 111736 (default app) Nov 03 03:39:50.775471 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:39:50.776648 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Nov 03 03:39:50.777083 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Thu Nov 3 03:39:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:39:50.811768 n-d-854653-7 devstack@n-api.service[111735]: WARNING keystonemiddleware.auth_token [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:39:50.817767 n-d-854653-7 devstack@n-api.service[111735]: WARNING keystonemiddleware.auth_token [None req-af9cb4b8-c3d6-4a70-93f0-e9b65280be53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:39:50.823536 n-d-854653-7 devstack@n-api.service[111735]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556934e1c9c0 pid: 111735 (default app) Nov 03 03:41:14.826829 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:14.827825 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 03 03:41:14.828211 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:14.839913 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_api:SELECT=3 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:14.843844 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_cell1:SELECT=3 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:14.843844 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_cell0:SELECT=3 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:14.844469 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:15.747393 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-df3030c8-2198-4315-a41c-507b4af179a3 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:15.781116 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-df3030c8-2198-4315-a41c-507b4af179a3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.946161 Nov 03 03:41:15.781990 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 03:41:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:18.409442 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:18.410459 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-6944d00b-0fb8-4cea-a7c3-703366c228e9 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Nov 03 03:41:18.411119 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:18.857550 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-284f9c4e-7353-41c5-9c41-6088fcf7d729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "name": "cirros256"}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:18.960710 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-284f9c4e-7353-41c5-9c41-6088fcf7d729 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.542516 Nov 03 03:41:18.961324 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 03:41:18.976187 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_api:SELECT=3 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:18.977111 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_cell1:SELECT=3 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:18.979035 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_cell0:SELECT=3 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:18.979778 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:19.184429 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-b0dd3ffa-ce2e-4db1-85c9-06b46f130a16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:19.347411 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-b0dd3ffa-ce2e-4db1-85c9-06b46f130a16 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.376270 Nov 03 03:41:19.348059 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Nov 3 03:41:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:22.014406 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-284f9c4e-7353-41c5-9c41-6088fcf7d729 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:22.022625 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-284f9c4e-7353-41c5-9c41-6088fcf7d729 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002333 Nov 03 03:41:22.022625 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:22.838260 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-1ae4680c-4f35-47ed-833f-54f74ca94906 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:23.000708 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-1ae4680c-4f35-47ed-833f-54f74ca94906 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.975726 Nov 03 03:41:23.001888 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:23.018986 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-b5f12422-489f-43ed-ad4c-0efb78f018eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:23.197859 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-b5f12422-489f-43ed-ad4c-0efb78f018eb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.187225 Nov 03 03:41:23.199477 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Nov 3 03:41:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:26.151395 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-1ae4680c-4f35-47ed-833f-54f74ca94906 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:26.152398 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-1ae4680c-4f35-47ed-833f-54f74ca94906 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 03 03:41:26.152804 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:41:26.593413 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-815e4ca0-bec7-4521-b7ae-808b5202650e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "ram": 1024}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:26.671977 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-815e4ca0-bec7-4521-b7ae-808b5202650e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513047 Nov 03 03:41:26.672763 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:26.685510 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-d01b1525-905e-4c1b-bd34-748a89465aac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:26.773525 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-d01b1525-905e-4c1b-bd34-748a89465aac admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091610 Nov 03 03:41:26.774046 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Nov 3 03:41:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:29.396225 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-815e4ca0-bec7-4521-b7ae-808b5202650e admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:29.397257 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-815e4ca0-bec7-4521-b7ae-808b5202650e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 03 03:41:29.397655 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:29.867447 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-fe4e9417-500b-4405-b47f-fda4059edbea admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:29.939770 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-fe4e9417-500b-4405-b47f-fda4059edbea admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535861 Nov 03 03:41:29.943726 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:29.952732 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-f151bf90-188f-4395-ad6d-e40fe4f88801 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:30.077093 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-f151bf90-188f-4395-ad6d-e40fe4f88801 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127935 Nov 03 03:41:30.077673 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Nov 3 03:41:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:32.802651 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-fe4e9417-500b-4405-b47f-fda4059edbea admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:32.804925 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-fe4e9417-500b-4405-b47f-fda4059edbea admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002716 Nov 03 03:41:32.806070 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:33.239707 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-5c62f569-bb7d-4732-b58a-972a12f78573 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:33.307717 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-5c62f569-bb7d-4732-b58a-972a12f78573 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495901 Nov 03 03:41:33.322590 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-992c4335-253e-491d-bf71-557689ab7b7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:33.328981 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:33.418724 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-992c4335-253e-491d-bf71-557689ab7b7d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100158 Nov 03 03:41:33.420240 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Nov 3 03:41:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:36.080473 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-5c62f569-bb7d-4732-b58a-972a12f78573 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:36.081525 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-5c62f569-bb7d-4732-b58a-972a12f78573 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Nov 03 03:41:36.081930 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:36.490590 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-93a293f1-227d-4dbd-9c78-6140a613fcf8 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:36.514769 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-93a293f1-227d-4dbd-9c78-6140a613fcf8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.426699 Nov 03 03:41:36.515239 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 03:41:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:41:39.166635 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-5c62f569-bb7d-4732-b58a-972a12f78573 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:39.167699 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-5c62f569-bb7d-4732-b58a-972a12f78573 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 03 03:41:39.168096 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:39.592904 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-1fe96e0a-3e23-4e46-8669-220179537cb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "disk": 1}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:39.700356 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-1fe96e0a-3e23-4e46-8669-220179537cb0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.525081 Nov 03 03:41:39.700858 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:39.713651 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-d8d9c695-a927-4fb0-86a2-a4b97729640d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:39.778739 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-d8d9c695-a927-4fb0-86a2-a4b97729640d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068659 Nov 03 03:41:39.779380 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Nov 3 03:41:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:42.498693 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-1fe96e0a-3e23-4e46-8669-220179537cb0 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:42.499703 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-1fe96e0a-3e23-4e46-8669-220179537cb0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Nov 03 03:41:42.500100 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:42.899526 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-c56c4a2e-f1cc-4c3f-b27e-8168444f76fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:42.972976 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-c56c4a2e-f1cc-4c3f-b27e-8168444f76fd admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466861 Nov 03 03:41:42.973552 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:42.985534 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-6d5ac02d-c6db-47d3-b430-c37b91d1d87d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:43.075412 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-6d5ac02d-c6db-47d3-b430-c37b91d1d87d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093661 Nov 03 03:41:43.077381 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Nov 3 03:41:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:45.701269 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-c56c4a2e-f1cc-4c3f-b27e-8168444f76fd admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:45.702278 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-c56c4a2e-f1cc-4c3f-b27e-8168444f76fd admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 03 03:41:45.702706 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:46.050949 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-4a965fc2-d651-48c1-8b6d-cfb5b482d06b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:46.129007 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-4a965fc2-d651-48c1-8b6d-cfb5b482d06b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.419688 Nov 03 03:41:46.129606 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:46.142039 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-4f467320-002d-4ac5-84df-f0bfc084691c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:46.146309 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:46.217818 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-4f467320-002d-4ac5-84df-f0bfc084691c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079827 Nov 03 03:41:46.229203 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Nov 3 03:41:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:48.963855 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-4a965fc2-d651-48c1-8b6d-cfb5b482d06b admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:48.964977 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-4a965fc2-d651-48c1-8b6d-cfb5b482d06b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 03 03:41:48.965394 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:49.414091 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-c5029e1f-56bb-4e56-9156-96fa490b23aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "disk": 80, "ram": 8192, "id": "4", "os-flavor-access:is_public": true}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:49.489074 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-c5029e1f-56bb-4e56-9156-96fa490b23aa admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.516991 Nov 03 03:41:49.490572 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:49.502113 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-f0b3e2a6-dac0-4b81-8f5f-fe2bd3996fa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:49.507079 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:41:49.606100 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-f0b3e2a6-dac0-4b81-8f5f-fe2bd3996fa7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107258 Nov 03 03:41:49.606606 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Nov 3 03:41:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:41:52.213088 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-c5029e1f-56bb-4e56-9156-96fa490b23aa admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:41:52.214112 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-c5029e1f-56bb-4e56-9156-96fa490b23aa admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Nov 03 03:41:52.214799 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:41:52.658960 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-8354fc77-5759-403d-8cc2-7bacf87776e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "name": "m1.xlarge", "swap": 0, "ram": 16384, "vcpus": 8}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:52.745163 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-8354fc77-5759-403d-8cc2-7bacf87776e9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.524570 Nov 03 03:41:52.746316 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Nov 3 03:41:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:41:52.758036 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-2851360c-e786-4cb4-a2de-e6b6d63a0ee4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:41:52.834615 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-2851360c-e786-4cb4-a2de-e6b6d63a0ee4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080163 Nov 03 03:41:52.841163 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Nov 3 03:41:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:42:13.493665 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-8354fc77-5759-403d-8cc2-7bacf87776e9 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:13.495860 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-8354fc77-5759-403d-8cc2-7bacf87776e9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 03 03:42:13.495860 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:42:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:13.505391 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:42:13.886703 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-2d0085df-40e4-4211-ad05-5c65b82b95a9 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:13.905368 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-2d0085df-40e4-4211-ad05-5c65b82b95a9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404381 Nov 03 03:42:13.905903 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 03:42:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:42:15.211080 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-8354fc77-5759-403d-8cc2-7bacf87776e9 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:15.212090 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-8354fc77-5759-403d-8cc2-7bacf87776e9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 03 03:42:15.212488 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:15.748508 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-b5739f18-8ff7-4d3a-a3de-6244dcb55926 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:15.753842 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.wsgi [None req-b5739f18-8ff7-4d3a-a3de-6244dcb55926 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-b5739f18-8ff7-4d3a-a3de-6244dcb55926 admin admin] Request method failure captured: Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: Accept: application/json Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: Accept-Encoding: gzip, deflate Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: Connection: keep-alive Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: Content-Length: 0 Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: Host: 10.222.0.30 Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: Openstack-Api-Version: compute 2.92 Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: Openstack-System-Scope: None Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: User-Agent: python-novaclient Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Auth-Token: gAAAAABjYziXkHapBS8ANZr3jer_OQnl_52_yIIkjJ8TCkhVays2EuJ4S2bxXK5tKADhrLdncexoqbwYdK38yjllD2DSb7KpKOOjlqwdOXs59cBip-e5osjJ8vd0em-U_mv_pI0mrtj0QMqq9hy1uK2AY4TDyBwWegukNgKuM_A89wNlahH8_c8 Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Domain-Id: None Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Domain-Name: None Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Identity-Status: Confirmed Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Is-Admin-Project: True Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Openstack-Nova-Api-Version: 2.92 Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Domain-Id: default Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Domain-Name: Default Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Name: admin Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Role: admin,reader,member Nov 03 03:42:15.757069 n-d-854653-7 devstack@n-api.service[111735]: X-Roles: admin,reader,member Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43e03011771f46c3ae7fd2c336d63080", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43e03011771f46c3ae7fd2c336d63080"}]}] Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant: admin Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant-Name: admin Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-User: admin Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-User-Domain-Id: default Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-User-Domain-Name: Default Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-User-Id: 3cd1f499c9fb44aba579b66ba69c98f6 Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: X-User-Name: admin Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: method: > Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: exception: Flavor 42 could not be found. Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: action_args: {'id': '42'} Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:42:15.758809 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:15.759867 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.761479 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-b5739f18-8ff7-4d3a-a3de-6244dcb55926 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:42:15.762774 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-b5739f18-8ff7-4d3a-a3de-6244dcb55926 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391410 Nov 03 03:42:15.762774 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Nov 3 03:42:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:42:15.768102 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-769dd0b9-34e0-43c4-be9d-35d0ef8ef5ba admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:15.772256 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:42:15.790864 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-769dd0b9-34e0-43c4-be9d-35d0ef8ef5ba admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026448 Nov 03 03:42:15.791397 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Nov 3 03:42:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:42:15.812749 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-30ef0f78-0451-45a9-baa0-0ffc3a1fba9a admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:15.833978 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-30ef0f78-0451-45a9-baa0-0ffc3a1fba9a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025685 Nov 03 03:42:15.834509 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Nov 3 03:42:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:42:15.843963 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-0c408340-444a-40dc-91ee-5c9c4379ac25 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:15.849834 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.wsgi [None req-0c408340-444a-40dc-91ee-5c9c4379ac25 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-0c408340-444a-40dc-91ee-5c9c4379ac25 admin admin] Request method failure captured: Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: Accept: application/json Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: Accept-Encoding: gzip, deflate Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: Connection: keep-alive Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: Content-Length: 0 Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: Host: 10.222.0.30 Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: Openstack-Api-Version: compute 2.92 Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: Openstack-System-Scope: None Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: User-Agent: python-novaclient Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Auth-Token: gAAAAABjYziXkHapBS8ANZr3jer_OQnl_52_yIIkjJ8TCkhVays2EuJ4S2bxXK5tKADhrLdncexoqbwYdK38yjllD2DSb7KpKOOjlqwdOXs59cBip-e5osjJ8vd0em-U_mv_pI0mrtj0QMqq9hy1uK2AY4TDyBwWegukNgKuM_A89wNlahH8_c8 Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Domain-Id: None Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Domain-Name: None Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Identity-Status: Confirmed Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Is-Admin-Project: True Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Openstack-Nova-Api-Version: 2.92 Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Domain-Id: default Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Domain-Name: Default Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Name: admin Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Role: admin,reader,member Nov 03 03:42:15.853099 n-d-854653-7 devstack@n-api.service[111736]: X-Roles: admin,reader,member Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43e03011771f46c3ae7fd2c336d63080", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43e03011771f46c3ae7fd2c336d63080"}]}] Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant: admin Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant-Name: admin Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-User: admin Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-User-Domain-Id: default Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-User-Domain-Name: Default Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-User-Id: 3cd1f499c9fb44aba579b66ba69c98f6 Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: X-User-Name: admin Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: method: > Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: exception: Flavor 42 could not be found. Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: action_args: {'id': '42'} Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:42:15.854643 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:15.855617 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:15.856958 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-0c408340-444a-40dc-91ee-5c9c4379ac25 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:42:15.861232 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-0c408340-444a-40dc-91ee-5c9c4379ac25 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014339 Nov 03 03:42:15.861232 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Nov 3 03:42:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 03 03:42:17.059013 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-30ef0f78-0451-45a9-baa0-0ffc3a1fba9a admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:17.060046 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-30ef0f78-0451-45a9-baa0-0ffc3a1fba9a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 03 03:42:17.060442 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:17.578310 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-a440707d-2eb2-491b-a141-3cf6d0cc45b5 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:17.583868 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.wsgi [None req-a440707d-2eb2-491b-a141-3cf6d0cc45b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-a440707d-2eb2-491b-a141-3cf6d0cc45b5 admin admin] Request method failure captured: Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: Accept: application/json Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: Accept-Encoding: gzip, deflate Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: Connection: keep-alive Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: Content-Length: 0 Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: Host: 10.222.0.30 Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: Openstack-Api-Version: compute 2.92 Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: Openstack-System-Scope: None Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: User-Agent: python-novaclient Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Auth-Token: gAAAAABjYziYEaAuPKd9iSsXnzyCwCPFZN86ygQNoCOep_M0riS0_SVEunBU5CSoFx54rTMPstaRFaqiU5azvkN8R5nRWBZlhUJjloYHFEd1_EdWKwa2QyX2fpIsVzYn-yUNLt8_80KHuZOogS7Fp9DE2zYZVgvk7UHCA1LEhKOWyCc301m-rLo Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Domain-Id: None Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Domain-Name: None Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Identity-Status: Confirmed Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Is-Admin-Project: True Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Openstack-Nova-Api-Version: 2.92 Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Domain-Id: default Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Domain-Name: Default Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Name: admin Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Role: admin,reader,member Nov 03 03:42:17.585399 n-d-854653-7 devstack@n-api.service[111736]: X-Roles: admin,reader,member Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43e03011771f46c3ae7fd2c336d63080", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43e03011771f46c3ae7fd2c336d63080"}]}] Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant: admin Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant-Name: admin Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-User: admin Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-User-Domain-Id: default Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-User-Domain-Name: Default Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-User-Id: 3cd1f499c9fb44aba579b66ba69c98f6 Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: X-User-Name: admin Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: method: > Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: exception: Flavor 84 could not be found. Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: action_args: {'id': '84'} Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:42:17.586979 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:17.588988 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.590322 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-a440707d-2eb2-491b-a141-3cf6d0cc45b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:42:17.591542 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-a440707d-2eb2-491b-a141-3cf6d0cc45b5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.390306 Nov 03 03:42:17.591542 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Nov 3 03:42:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:42:17.596572 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-d2888366-046c-4630-89d0-853aa08e4755 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:17.611948 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-d2888366-046c-4630-89d0-853aa08e4755 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018977 Nov 03 03:42:17.612470 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Nov 3 03:42:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:42:17.621781 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-cbb8bee8-1008-4014-bde4-eb6d0419fc0c admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:17.637355 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-cbb8bee8-1008-4014-bde4-eb6d0419fc0c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019074 Nov 03 03:42:17.637920 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Nov 3 03:42:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:42:17.646765 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-eb4ff82f-ba17-4471-bcc3-acfe1c7a4d3b admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:17.651610 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.wsgi [None req-eb4ff82f-ba17-4471-bcc3-acfe1c7a4d3b admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-eb4ff82f-ba17-4471-bcc3-acfe1c7a4d3b admin admin] Request method failure captured: Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: Accept: application/json Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: Accept-Encoding: gzip, deflate Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: Connection: keep-alive Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: Content-Length: 0 Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: Host: 10.222.0.30 Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: Openstack-Api-Version: compute 2.92 Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: Openstack-System-Scope: None Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: User-Agent: python-novaclient Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Auth-Token: gAAAAABjYziYEaAuPKd9iSsXnzyCwCPFZN86ygQNoCOep_M0riS0_SVEunBU5CSoFx54rTMPstaRFaqiU5azvkN8R5nRWBZlhUJjloYHFEd1_EdWKwa2QyX2fpIsVzYn-yUNLt8_80KHuZOogS7Fp9DE2zYZVgvk7UHCA1LEhKOWyCc301m-rLo Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Domain-Id: None Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Domain-Name: None Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Identity-Status: Confirmed Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Is-Admin-Project: True Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Openstack-Nova-Api-Version: 2.92 Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Domain-Id: default Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Domain-Name: Default Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Name: admin Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Role: admin,reader,member Nov 03 03:42:17.653121 n-d-854653-7 devstack@n-api.service[111735]: X-Roles: admin,reader,member Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43e03011771f46c3ae7fd2c336d63080", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43e03011771f46c3ae7fd2c336d63080"}]}] Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant: admin Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant-Name: admin Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-User: admin Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-User-Domain-Id: default Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-User-Domain-Name: Default Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-User-Id: 3cd1f499c9fb44aba579b66ba69c98f6 Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: X-User-Name: admin Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: method: > Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: exception: Flavor 84 could not be found. Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: action_args: {'id': '84'} Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:42:17.654630 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:17.655483 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:17.656545 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-eb4ff82f-ba17-4471-bcc3-acfe1c7a4d3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:42:17.657608 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-eb4ff82f-ba17-4471-bcc3-acfe1c7a4d3b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011136 Nov 03 03:42:17.657608 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Nov 3 03:42:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 03 03:42:18.855068 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-cbb8bee8-1008-4014-bde4-eb6d0419fc0c admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:18.856061 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-cbb8bee8-1008-4014-bde4-eb6d0419fc0c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Nov 03 03:42:18.856455 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:19.369402 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-b367e39f-9cc5-4182-9b84-5277cad81e87 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:19.375120 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.wsgi [None req-b367e39f-9cc5-4182-9b84-5277cad81e87 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-b367e39f-9cc5-4182-9b84-5277cad81e87 admin admin] Request method failure captured: Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: Accept: application/json Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: Accept-Encoding: gzip, deflate Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: Connection: keep-alive Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: Content-Length: 0 Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: Host: 10.222.0.30 Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: Openstack-Api-Version: compute 2.92 Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: Openstack-System-Scope: None Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: User-Agent: python-novaclient Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Auth-Token: gAAAAABjYziaJwsISGrhml5zC_G5yK9JRa2MQrowgVK6uZ46Zf8oMMsy5zmlrtDKYyYmNN22XV2G9aqrcNKHDfdI5rPQQjh4jqTwwX04Rcm76W2Z84qjUtqt8CQObNuMog63T-WjA3iivUvPH_f47QMkHKXajP5DFYc0NNXptvcpSKs8T2CXUuM Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Domain-Id: None Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Domain-Name: None Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Identity-Status: Confirmed Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Is-Admin-Project: True Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Openstack-Nova-Api-Version: 2.92 Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Domain-Id: default Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Domain-Name: Default Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Project-Name: admin Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Role: admin,reader,member Nov 03 03:42:19.377260 n-d-854653-7 devstack@n-api.service[111735]: X-Roles: admin,reader,member Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43e03011771f46c3ae7fd2c336d63080", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43e03011771f46c3ae7fd2c336d63080"}]}] Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant: admin Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-Tenant-Name: admin Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-User: admin Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-User-Domain-Id: default Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-User-Domain-Name: Default Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-User-Id: 3cd1f499c9fb44aba579b66ba69c98f6 Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: X-User-Name: admin Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: method: > Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: exception: Flavor 451 could not be found. Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: action_args: {'id': '451'} Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:42:19.378817 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:19.379818 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.381213 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-b367e39f-9cc5-4182-9b84-5277cad81e87 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:42:19.382434 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-b367e39f-9cc5-4182-9b84-5277cad81e87 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385897 Nov 03 03:42:19.382434 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 03:42:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:42:19.388094 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-a12dc86f-807d-46bb-a33b-572d6bd55ecd admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:19.402583 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-a12dc86f-807d-46bb-a33b-572d6bd55ecd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018032 Nov 03 03:42:19.403103 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Nov 3 03:42:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:42:19.412009 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:19.427238 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018569 Nov 03 03:42:19.427769 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Nov 3 03:42:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:42:19.436707 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-963f7260-4e45-4028-b9f5-2bcc3d625cdd admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:19.442228 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.wsgi [None req-963f7260-4e45-4028-b9f5-2bcc3d625cdd admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-963f7260-4e45-4028-b9f5-2bcc3d625cdd admin admin] Request method failure captured: Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: Accept: application/json Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: Accept-Encoding: gzip, deflate Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: Connection: keep-alive Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: Content-Length: 0 Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: Host: 10.222.0.30 Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: Openstack-Api-Version: compute 2.92 Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: Openstack-System-Scope: None Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: User-Agent: python-novaclient Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Auth-Token: gAAAAABjYziaJwsISGrhml5zC_G5yK9JRa2MQrowgVK6uZ46Zf8oMMsy5zmlrtDKYyYmNN22XV2G9aqrcNKHDfdI5rPQQjh4jqTwwX04Rcm76W2Z84qjUtqt8CQObNuMog63T-WjA3iivUvPH_f47QMkHKXajP5DFYc0NNXptvcpSKs8T2CXUuM Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Domain-Id: None Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Domain-Name: None Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Identity-Status: Confirmed Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Is-Admin-Project: True Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Openstack-Nova-Api-Version: 2.92 Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Domain-Id: default Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Domain-Name: Default Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Project-Name: admin Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Role: admin,reader,member Nov 03 03:42:19.443715 n-d-854653-7 devstack@n-api.service[111736]: X-Roles: admin,reader,member Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_43e03011771f46c3ae7fd2c336d63080", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/43e03011771f46c3ae7fd2c336d63080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/43e03011771f46c3ae7fd2c336d63080"}]}] Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant: admin Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant-Id: 43e03011771f46c3ae7fd2c336d63080 Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-Tenant-Name: admin Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-User: admin Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-User-Domain-Id: default Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-User-Domain-Name: Default Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-User-Id: 3cd1f499c9fb44aba579b66ba69c98f6 Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: X-User-Name: admin Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: method: > Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: exception: Flavor 451 could not be found. Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: action_args: {'id': '451'} Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:42:19.445345 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:19.446299 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: ERROR nova.api.openstack.wsgi Nov 03 03:42:19.447614 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-963f7260-4e45-4028-b9f5-2bcc3d625cdd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:42:19.448884 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-963f7260-4e45-4028-b9f5-2bcc3d625cdd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011817 Nov 03 03:42:19.448884 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 03:42:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:42:20.649449 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:20.650451 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 03 03:42:20.650842 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:21.172075 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-f47802a3-5945-4db3-aaf6-d2dbc23cc4de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:42:21.268508 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-f47802a3-5945-4db3-aaf6-d2dbc23cc4de admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.476616 Nov 03 03:42:21.269673 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Nov 3 03:42:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:42:22.464256 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:22.465340 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Nov 03 03:42:22.465736 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:22.984346 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-22480a71-bd7d-421b-abd2-c33290d80eda admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:42:23.051557 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-22480a71-bd7d-421b-abd2-c33290d80eda admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.448886 Nov 03 03:42:23.052105 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Nov 3 03:42:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:42:24.288359 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:24.289385 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 03 03:42:24.289785 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:24.822918 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-7b9583e9-4e6a-4921-b8ac-a5f0641e35a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:42:24.910144 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-7b9583e9-4e6a-4921-b8ac-a5f0641e35a9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.483044 Nov 03 03:42:24.910690 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Nov 3 03:42:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:42:26.111112 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:26.112160 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Nov 03 03:42:26.112550 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:42:26.625755 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-9c35200c-6f34-452a-b412-c7ed0558a3a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:42:26.709997 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-9c35200c-6f34-452a-b412-c7ed0558a3a4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.459935 Nov 03 03:42:26.710549 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Nov 3 03:42:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:42:27.918409 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:27.919414 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 03 03:42:27.920053 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:42:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:42:28.436567 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-cfe57544-9c55-4e73-a9de-81d3b9d723b7 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:42:28.456853 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-cfe57544-9c55-4e73-a9de-81d3b9d723b7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397619 Nov 03 03:42:28.457400 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Thu Nov 3 03:42:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:43:24.818692 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:43:24.819692 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-da701951-9b38-42c8-8a01-9b8b3e60fb6c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 03 03:43:24.820093 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Thu Nov 3 03:43:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:43:24.831227 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:43:25.215176 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-2587268a-2097-4f19-a9ab-f40ad5876c0a admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:43:25.235866 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-2587268a-2097-4f19-a9ab-f40ad5876c0a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409830 Nov 03 03:43:25.236411 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 03:43:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:43:25.258293 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_api:SELECT=14 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:43:25.261995 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-7b2ef648-4128-48cb-bab4-ace0b6c98745 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:43:25.269110 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-7b2ef648-4128-48cb-bab4-ace0b6c98745 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012192 Nov 03 03:43:25.269622 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Thu Nov 3 03:43:25 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:43:25.281007 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-4f73db33-aedd-4293-97bc-5fdb7f068633 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:43:25.288211 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-4f73db33-aedd-4293-97bc-5fdb7f068633 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010839 Nov 03 03:43:25.289714 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Thu Nov 3 03:43:25 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:43:25.300450 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-ae2cce06-4151-4535-8d66-cae31728d421 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:43:25.307601 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-ae2cce06-4151-4535-8d66-cae31728d421 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010702 Nov 03 03:43:25.308110 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Thu Nov 3 03:43:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:43:25.319820 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-bf3857df-f0dd-44e6-ac77-7041fa06cf88 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:43:25.327190 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-bf3857df-f0dd-44e6-ac77-7041fa06cf88 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010887 Nov 03 03:43:25.327711 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Thu Nov 3 03:43:25 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:49:09.816511 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-ae2cce06-4151-4535-8d66-cae31728d421 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:49:09.817545 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-ae2cce06-4151-4535-8d66-cae31728d421 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 03 03:49:09.817935 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:49:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:49:09.959220 n-d-854653-7 devstack@n-api.service[111736]: DEBUG dbcounter [-] [111736] Writing DB stats nova_api:SELECT=6 {{(pid=111736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:49:10.104576 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:49:10.110282 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:49:10.110760 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:49:10.111188 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:49:10.111914 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:49:10.112361 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:49:10.112775 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:49:10.150099 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-18af6721-a71d-43d3-959b-859f63f63eb2 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.192004 Nov 03 03:49:10.150645 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 03:49:09 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:49:11.211392 n-d-854653-7 devstack@n-api.service[111735]: DEBUG nova.api.openstack.wsgi [None req-ae2cce06-4151-4535-8d66-cae31728d421 admin admin] Calling method '>' {{(pid=111735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:49:11.212395 n-d-854653-7 devstack@n-api.service[111735]: INFO nova.api.openstack.requestlog [None req-ae2cce06-4151-4535-8d66-cae31728d421 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 03 03:49:11.212793 n-d-854653-7 devstack@n-api.service[111735]: [pid: 111735|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Nov 3 03:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:49:11.403903 n-d-854653-7 devstack@n-api.service[111736]: DEBUG nova.api.openstack.wsgi [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] Calling method '>' {{(pid=111736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:49:11.407342 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:49:11.407810 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:49:11.408262 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:49:11.408961 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:49:11.409428 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:49:11.409835 n-d-854653-7 devstack@n-api.service[111736]: DEBUG oslo_concurrency.lockutils [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:49:11.432611 n-d-854653-7 devstack@n-api.service[111736]: INFO nova.api.openstack.requestlog [None req-533d1a49-9a9c-4252-87d1-0848b5a4b11d admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.080380 Nov 03 03:49:11.433103 n-d-854653-7 devstack@n-api.service[111736]: [pid: 111736|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 03:49:11 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:49:56.375151 n-d-854653-7 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 03 03:49:56.375895 n-d-854653-7 devstack@n-api.service[111734]: Thu Nov 3 03:49:56 2022 - graceful shutdown triggered... Nov 03 03:49:56.376408 n-d-854653-7 devstack@n-api.service[111735]: Gracefully killing worker 1 (pid: 111735)... Nov 03 03:49:56.376784 n-d-854653-7 devstack@n-api.service[111736]: Gracefully killing worker 2 (pid: 111736)... Nov 03 03:49:56.502462 n-d-854653-7 devstack@n-api.service[111735]: DEBUG dbcounter [-] [111735] Writing DB stats nova_api:SELECT=4 {{(pid=111735) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:49:57.376665 n-d-854653-7 devstack@n-api.service[111734]: worker 1 buried after 1 seconds Nov 03 03:49:57.377097 n-d-854653-7 devstack@n-api.service[111734]: worker 2 buried after 1 seconds Nov 03 03:49:57.377097 n-d-854653-7 devstack@n-api.service[111734]: goodbye to uWSGI. Nov 03 03:49:57.378223 n-d-854653-7 systemd[1]: devstack@n-api.service: Succeeded. Nov 03 03:49:57.378777 n-d-854653-7 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 03 03:49:57.381556 n-d-854653-7 systemd[1]: Starting Devstack devstack@n-api.service... Nov 03 03:49:57.396475 n-d-854653-7 devstack@n-api.service[127586]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Nov 3 03:49:57 2022] *** Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: nodename: n-d-854653-7 Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: machine: x86_64 Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: clock source: unix Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: pcre jit disabled Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: detected number of CPU cores: 4 Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: current working directory: / Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: detected binary path: /usr/bin/uwsgi-core Nov 03 03:49:57.425405 n-d-854653-7 devstack@n-api.service[127586]: your processes number limit is 47680 Nov 03 03:49:57.426413 n-d-854653-7 devstack@n-api.service[127586]: your memory page size is 4096 bytes Nov 03 03:49:57.426413 n-d-854653-7 devstack@n-api.service[127586]: detected max file descriptor number: 2048 Nov 03 03:49:57.426413 n-d-854653-7 devstack@n-api.service[127586]: lock engine: pthread robust mutexes Nov 03 03:49:57.426413 n-d-854653-7 devstack@n-api.service[127586]: thunder lock: enabled Nov 03 03:49:57.426413 n-d-854653-7 devstack@n-api.service[127586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 03 03:49:57.426413 n-d-854653-7 devstack@n-api.service[127586]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 03 03:49:57.466760 n-d-854653-7 devstack@n-api.service[127586]: Python main interpreter initialized at 0x55f14fc8f9c0 Nov 03 03:49:57.466760 n-d-854653-7 devstack@n-api.service[127586]: python threads support enabled Nov 03 03:49:57.466760 n-d-854653-7 devstack@n-api.service[127586]: your server socket listen backlog is limited to 100 connections Nov 03 03:49:57.466760 n-d-854653-7 devstack@n-api.service[127586]: your mercy for graceful operations on workers is 90 seconds Nov 03 03:49:57.467204 n-d-854653-7 devstack@n-api.service[127586]: mapped 403077 bytes (393 KB) for 2 cores Nov 03 03:49:57.467204 n-d-854653-7 devstack@n-api.service[127586]: *** Operational MODE: preforking *** Nov 03 03:49:57.467454 n-d-854653-7 devstack@n-api.service[127586]: *** uWSGI is running in multiple interpreter mode *** Nov 03 03:49:57.467454 n-d-854653-7 devstack@n-api.service[127586]: spawned uWSGI master process (pid: 127586) Nov 03 03:49:57.467665 n-d-854653-7 systemd[1]: Started Devstack devstack@n-api.service. Nov 03 03:49:57.468936 n-d-854653-7 devstack@n-api.service[127586]: spawned uWSGI worker 1 (pid: 127593, cores: 1) Nov 03 03:49:57.468936 n-d-854653-7 devstack@n-api.service[127586]: spawned uWSGI worker 2 (pid: 127594, cores: 1) Nov 03 03:49:57.468936 n-d-854653-7 devstack@n-api.service[127586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 03 03:49:58.129439 n-d-854653-7 devstack@n-api.service[127594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 03 03:49:58.130054 n-d-854653-7 devstack@n-api.service[127593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 03 03:49:59.379204 n-d-854653-7 devstack@n-api.service[127593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:49:59.379204 n-d-854653-7 devstack@n-api.service[127593]: from cryptography.utils import int_from_bytes Nov 03 03:49:59.379931 n-d-854653-7 devstack@n-api.service[127594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:49:59.379931 n-d-854653-7 devstack@n-api.service[127594]: from cryptography.utils import int_from_bytes Nov 03 03:49:59.380353 n-d-854653-7 devstack@n-api.service[127593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:49:59.380353 n-d-854653-7 devstack@n-api.service[127593]: from cryptography.utils import int_from_bytes Nov 03 03:49:59.380560 n-d-854653-7 devstack@n-api.service[127594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 03 03:49:59.380560 n-d-854653-7 devstack@n-api.service[127594]: from cryptography.utils import int_from_bytes Nov 03 03:50:01.801612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 03:50:01.802223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 03:50:01.802400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 03:50:01.802767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 03:50:01.803026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 03:50:01.803417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.803747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.804095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.804402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.804737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.805072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.805402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.805727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.806059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.806319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.807249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.807583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854653-7 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.807909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.808220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.808534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.808854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.809189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.809516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.809823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.810330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.811393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.811393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.811393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.811718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.812046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.812357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.812694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.813005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.813340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.813654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.814063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854653-7 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.814379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.814696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.815013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.815427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.815740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.816053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.816378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.816700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.817031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.817375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.817698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.818018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.818341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.818645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.818953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.819265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.819584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.819890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.820196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.820453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.820757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.821094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.821420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.821742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.821997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.822275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.822595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.822918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.823163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 03 03:50:01.823590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.823732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 03 03:50:01.823881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.823881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.824161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 03 03:50:01.824299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.824430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 03 03:50:01.824567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.824714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 03 03:50:01.824855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.824993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.825150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.825292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.825430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.825578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.825725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.825857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.825986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.826187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.826337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.826541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.826675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.826820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.826961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.827116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.827259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.827443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.827586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.827724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.827854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.827983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.828125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.828308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854653-7 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.828452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.828627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.828769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.828935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.829111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.829256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.829395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.829575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.829722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.829863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.830010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.830188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.830337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.830508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.830644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.830882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.831040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.831200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.831339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.831492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.831624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.831761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.831892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.832021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.832203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.832355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.832518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.832667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.832829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.832971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.833166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.833309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.833453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.833591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.833790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.833938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.834077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.834216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.834361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.834492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854653-7 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.834662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.834804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.834970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.835114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.835276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.835425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.835584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.835782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.835916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.836131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.836280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.836480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.836627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.836833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.836967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.837193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.837337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.837475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.837605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.837741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.838527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.838664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.838794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.838939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.839071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.839208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.839339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.839468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.839604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.839744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.839873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.840960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.841232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.841375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.841519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.841650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.841788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.841918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.842058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.842205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.842524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.842669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.842808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.842808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.843067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.843211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.843349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.843479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.843618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.843757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.843902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.844993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.845177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.845390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.845524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.845701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.845843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.846011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.846153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.846376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.846589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.846739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.846959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.847085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.847222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.847353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.847492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.847630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.847761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.847901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.848038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.848168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.848308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.848439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.848567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.848766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.848902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.849117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.849273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.849413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.849551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.849737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.849872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.850056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.850209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.850352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.850491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.850654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.850795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.850941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.851072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.851263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.851417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.851628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.851767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.851913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.852052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.852182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.852316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.852453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.852612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.852756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.852931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.853087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.853276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.853424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.854205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.854353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.854483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.854621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.854773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.854905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.855081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.855225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.855387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.855533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.855690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.855824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.855997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.856141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.856302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.856444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.856590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.856789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.856955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.857255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.857402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.857533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.857670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.857814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.857954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.858085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.858222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.858352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.858481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.858624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.858765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.858895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.859032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.859169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.859561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.859724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.859867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.860052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.860206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.860372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.860508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.860687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.860826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.861003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.861175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.861338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.861478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.861706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.861848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.861978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.862123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.862255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.862393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.862550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.862691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.862869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.863085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.863219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.863363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.863526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.863659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.863845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.863979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.864191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.864358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.864480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.864669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.864796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.864977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.865138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.865341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.865474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.865664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.865785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.865972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.866100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.866276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.866403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.866580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.866708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.866927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.867055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.867269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.867406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.867519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.867630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.867806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.867926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.868113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.868233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.868419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.868538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.868728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.868847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 03 03:50:01.870030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.870216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.870333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.870454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.870590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.870730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.870864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.870994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.871125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.871251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.871392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.871535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.871668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.871668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.872977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.873142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.873282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.873414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.873543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.873687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.873819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.873957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.874094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.874236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.874373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.874517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.874655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.874785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.874914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.875044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.875181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.875325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.875455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.875584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.875725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.875863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.876002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.876141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.876278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.876415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.876553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.876683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.876827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.877060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.877210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.877363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.877571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.877707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.877851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.877989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.878122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.878251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.878380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.878516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.878661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.878798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.878928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.879105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.879242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.879433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.879570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.879749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.879892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.880059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.880202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.880369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.880513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.880681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.880824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.881046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.881185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.881361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.881505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.881708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.881855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.882085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.882229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.882375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.882520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.882685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.882820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.883003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.883147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.883325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.883462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.883641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.883786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.883957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.884100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.884269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.884403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.884579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.884712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.884913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.885078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.885250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.885384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.885563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.885696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.885869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.886013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.886173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.886315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.886476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.886611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.886785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.886929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.887080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.887290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.887434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.887580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.887789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.887923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.888053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.888183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.888320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.888459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.888602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.888733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.888965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.889178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.889316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.889462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.889634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.889769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.889949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.890100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.890264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.890419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.890579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.890778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.890897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.891085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.891205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.891402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.891517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.891710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.891828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.892017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.892154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.892366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.892484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.892640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.892761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.892948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.893088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.893310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.893439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.893815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.893973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.894107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.900063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.900219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.900308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.900900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.900984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.901981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.902941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.903924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.904989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.905085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.905171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.905255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.905749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.905858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.905951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.906959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.907988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.908993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.909182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.909305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.909418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.909537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.909659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.909808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.909974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.910110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.910228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.910349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.911290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.911415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.911544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.911667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.911779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.911890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.912950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.913098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.913098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.913369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.913501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.913645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.913779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.913919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.914059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.914200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.914340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.914472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.914603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.914733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.914864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.915009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.915149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.915281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.915421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.915553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.915685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.916925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.917953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.918823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.919014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.919127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.919318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.919421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.919627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.919720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.919942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.920107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.920249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.920342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.920557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.920659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.920881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.921064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.921307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.921418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.921541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.921638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.921848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.921941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.922154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.922257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.922466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.922566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.922789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.922899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.923105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.923207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.923426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.923520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.923745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.923848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.924048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.924141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.924352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.924460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.924665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.924766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.924973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.925321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.925321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.925517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.925613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.925700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.925909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.926003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.926218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.926324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.926532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.926627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.926841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.926943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.927156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.927260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.927463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.927557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.927769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.927863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.928079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.928172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.928387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.928480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.928689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.928791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.929005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.929132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.929337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.929440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.929643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.929738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.929951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.930045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.930257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.930355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.930565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.930667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.930870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.930989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.931180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.931316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.931490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.931607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.931814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.931907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.932124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.932217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.932424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.932531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.932734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.932828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.933072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.933186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.933378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.933645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.933754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.933983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.934084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.934286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.934380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.934594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.934698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.934907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.935002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.935230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.935371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.935551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.935645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.935859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.936021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.936171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.936313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.936478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.936619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.936786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.936936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.937114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.937359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.937457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.937670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.937765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.938012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.938096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.938318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.938404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.938626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.938727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.938934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.939026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.939258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.939342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.939570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.939664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.939876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.939959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.940180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.940262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.940487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.940583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.940806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.940897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.941382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.941533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.941747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.941869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.941989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.942943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.943055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.943212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.943327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.943553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.943682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.943857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.943979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.944195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.944343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.944557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.944656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.944870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.944978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.945205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.945341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.945536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.945671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.945853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.946002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.946172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.946430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.946543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.946741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.946881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.947132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.947272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.947469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.947572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.947785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.947878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.948091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.948187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.948402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.948502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.948711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.948813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.949063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.949223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.949371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.949466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.949688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.949900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.950009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.950220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.950313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.950676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.950778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.950987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.951075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.951252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.951383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.951571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.951774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.951892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.952046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.952196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.952359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.952511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.952671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.952819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.952975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.953161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.953328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.953471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.953636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.953786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.953959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.954142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.954381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.954783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.954913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.955108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.955208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.955429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.955597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.955737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.955982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.956192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.956363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.956723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.956857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.957059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.957179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.957376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.957623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.957806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.957931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.958125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.958315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.961998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.962742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.963981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.964072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.964346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.964466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.964655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.964799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.964945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.965177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.965332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.965532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.965680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.965870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.966045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.966189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.966288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.966537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.966683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.966833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.966977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.967136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.967288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.967440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.967588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.967752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.967906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.968119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.968270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.968416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.968567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.968709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.968856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.969006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.969187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.969331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.969502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.969648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.969841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.970012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.970163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.970313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.970462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.970606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.970782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.970941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.971083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.971243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.971387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.971530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.971711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.971856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.972097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.972245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.972389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.972541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.972693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.972835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.972976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.973139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.973285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.973441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.973594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.973775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.973937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.974088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.974229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.974395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.974567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.974700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.974790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.975017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.975172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.975379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.975524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.975667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.975806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.975958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.976100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.976237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.976378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.977958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.978119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.978267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.978534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.979142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.979334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.979427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.979666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.979827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.979988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.980195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.980299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.980618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.980935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.981082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.981369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.981694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.981860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.982008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.982333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.982630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.982746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.982962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.983282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.983507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.983623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.984002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.984540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.984674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.984956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.985130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.985214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.985288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.985508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.985603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.985817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.985941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.986127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.986219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.986453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.986555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.986766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.986871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.987090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.987192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.987481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.987583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.987695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.987832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.988053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.988156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.988512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.988608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.988788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.988893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.989134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.989234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.989452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.989547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.989768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.989943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.990081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.990262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.990400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.990579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.990714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.990907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.991009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.991235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.991337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.991564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.991657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.991876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.991980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.992197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.992300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.992512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.992608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.992840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.992942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.993172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.993268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.993487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.993584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.993813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.993922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.994145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.994257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.994480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.994598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.994807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.994927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.995144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.995251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.995427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.995522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.995745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.995847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.996069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.996178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.996392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.996487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.996715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.996825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.997068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.997191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.997382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.997479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.997689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.997789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.998004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.998101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.998313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.998408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.998622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.998718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.998947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.999188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.999288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.999532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.999628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:01.999853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.000013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.000165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.000272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.000472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.000566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.000779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.000883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.001123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.001231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.001432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.001525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.001755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.001849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.002072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.002173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.002389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.002499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.002700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.002794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.003006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.003108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.003328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.003423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.003638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.003742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.003948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.004042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.004255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.004369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.004562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.004676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.004909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.005056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.005253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.005371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.005573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.005670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.005906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.006009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.006230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.006341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.006540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.006638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.006865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.006968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.007185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.007301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.007533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.007641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.007823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.007927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.008145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.008249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.008464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.008634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.008781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.008946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.009350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.009438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.009520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.009594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.010477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.010572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.010665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.010742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.010814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.010886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.010965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.011048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.011129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.011202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.011344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.011430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.011724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.011874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.012045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.012196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.012355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.012538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.012678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.012868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.013094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.013334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.013643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.013954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.014300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.014606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.014935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.015246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.015573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.015890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.016206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.016524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.016839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.017183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.017407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.017528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.021897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.022868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.023263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.023453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.023566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.023798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.023910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.024137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.024238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.024460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.024558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.024803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.024907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.025172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.025285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.026019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.026127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.026363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.026484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.026770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.026868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.027036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.027140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.027391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.027501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.027688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.027810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.028115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.028229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.028307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.028380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.028633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.028733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.028953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.029087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.029321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.029417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.029645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.029801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.029961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.030113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.030266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.030413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.030588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.030739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.030894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.031038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.031216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.031367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.031529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.031673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.031827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.031979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.032135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.032291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.032436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.032579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.032754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.032906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.033109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.033275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.033517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.033747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.033894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.034085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.034231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.034384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.034538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.034693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.034865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.035086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.035245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.035397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.035543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.035700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.035856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.036149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.036149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.036475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.036629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.037006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.037199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.037353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.037581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.037733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.037889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.038052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.038368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.038520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.038675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.038675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.038974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.039128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.039279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.039433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.039578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.039739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.039895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.040040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.040190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.040346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.040498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.040644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.040797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.040942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.041716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.041874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.042019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.042019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.042322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.042322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.042604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.042750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.042950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.043111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.043263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.043408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.043644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.043797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.043942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.044275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.044429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.044575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.044726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.044873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.045158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.045325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.045472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.045616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.045760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.045914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.046067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.046255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.046412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.046564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.046717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.046880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.046880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.047404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.047720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.047872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.048019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.048178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.048411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.048570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.048743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.048979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.049154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.049314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.049460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.049616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.049769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.049913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.050058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.050213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.050358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.050502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.050660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.050819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.051010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.051176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.051330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.051488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.051701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.051862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.052024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.052024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.052338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.052490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.052647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.052806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.052972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.053152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.053315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.053466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.053634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.053869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.054375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.054541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.054541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.054830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.054991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.055142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.055399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.055557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.055709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.055867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.056026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.056199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.056398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.056576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.056743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.056903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.057324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.057503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.057503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.057881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.058046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.058199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.058357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.058609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.058777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.058930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.059191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.059348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.059518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.059673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.059830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.059983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.060140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.060293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.060457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.060624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.060788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.060939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.061111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.061278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.061440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.061599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.061751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.061902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.062053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.062210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.062210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.062511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.062662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.062825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.062984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.063149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.063308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.063459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.063619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.063771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.064005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.064173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.064326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.064476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.064627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.064786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.064956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.065149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.065311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.065551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.065717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.065879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.066111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.066273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.066468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.066625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.066776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.066928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.067101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.067471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.067630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.067782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.068018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.068177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.068342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.068503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.068738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.068903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.069118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.069379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.069548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.069548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.069866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.070027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.070179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.070179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.070475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.070475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.070777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.070936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.071095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.071262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.071413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.071582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.071733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.071884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.072033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.072230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.072434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.072643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.072801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.072961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.073157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.073312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.073460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.073609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.073776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.073937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.074190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.074350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.074507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.074657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.074852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.075002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.075164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.075316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.075470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.075729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.075899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.076059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.076208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.076366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.076562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.076717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.076872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.077052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.077208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.077587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.077766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.077918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.078160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.078328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.078328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.078612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.078785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.079002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.079158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.079322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.079583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.079740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.079900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.080057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.080221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.080385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.080535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.080690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.080849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.080849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.081168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.081329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.081488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.081640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.081787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.081943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.082101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.082261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.082422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.082571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.082719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.082867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.083027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.083183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.083332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.083480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.083629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.083791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.083940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.084097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.085414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.086915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.086915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.086915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.086915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.086915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.086915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.088587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.088587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.088587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.088587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.089336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.089336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.089755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.090028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.090255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.090568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.090881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.091199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.091517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.091844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.092176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.092490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.092818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.093169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.093523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.093846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.094185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.094518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.094834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.095142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.095452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 03 03:50:02.095694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 03 03:50:02.146085 n-d-854653-7 devstack@n-api.service[127593]: INFO dbcounter [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Registered counter for database nova_api Nov 03 03:50:02.158316 n-d-854653-7 devstack@n-api.service[127594]: INFO dbcounter [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Registered counter for database nova_api Nov 03 03:50:02.168185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.175599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writer thread running {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.178623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_db.sqlalchemy.engines [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.185832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writer thread running {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.234945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.context [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=127593) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 03:50:02.239206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:02.239702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:02.241352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:02.242117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:02.242634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:02.244090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.context [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=127594) load_cells /opt/stack/nova/nova/context.py:464}} Nov 03 03:50:02.244844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:02.247033 n-d-854653-7 devstack@n-api.service[127593]: INFO dbcounter [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Registered counter for database nova_cell0 Nov 03 03:50:02.248508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:02.249084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:02.250797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:02.251441 n-d-854653-7 devstack@n-api.service[127593]: INFO dbcounter [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Registered counter for database nova_cell1 Nov 03 03:50:02.251545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:02.251956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:02.253992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:02.256016 n-d-854653-7 devstack@n-api.service[127594]: INFO dbcounter [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Registered counter for database nova_cell0 Nov 03 03:50:02.258920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.260799 n-d-854653-7 devstack@n-api.service[127594]: INFO dbcounter [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Registered counter for database nova_cell1 Nov 03 03:50:02.262138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.266587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writer thread running {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.268292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_db.sqlalchemy.engines [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.270260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_db.sqlalchemy.engines [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.272781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writer thread running {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.274874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writer thread running {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.286136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writer thread running {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.422141 n-d-854653-7 devstack@n-api.service[127593]: INFO dbcounter [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Registered counter for database nova_cell0 Nov 03 03:50:02.429354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_db.sqlalchemy.engines [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.434591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writer thread running {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.434898 n-d-854653-7 devstack@n-api.service[127594]: INFO dbcounter [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Registered counter for database nova_cell0 Nov 03 03:50:02.442048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_db.sqlalchemy.engines [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 03 03:50:02.446803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writer thread running {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 03 03:50:02.758945 n-d-854653-7 devstack@n-api.service[127593]: WARNING keystonemiddleware.auth_token [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:50:02.766845 n-d-854653-7 devstack@n-api.service[127594]: WARNING keystonemiddleware.auth_token [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:50:02.767789 n-d-854653-7 devstack@n-api.service[127593]: WARNING keystonemiddleware.auth_token [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:50:02.774082 n-d-854653-7 devstack@n-api.service[127594]: WARNING keystonemiddleware.auth_token [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:50:03.113249 n-d-854653-7 devstack@n-api.service[127593]: WARNING keystonemiddleware.auth_token [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:50:03.119869 n-d-854653-7 devstack@n-api.service[127593]: WARNING keystonemiddleware.auth_token [None req-7d9fe75c-845c-477d-abce-723b076b5306 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:50:03.122953 n-d-854653-7 devstack@n-api.service[127594]: WARNING keystonemiddleware.auth_token [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 03 03:50:03.125253 n-d-854653-7 devstack@n-api.service[127593]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f14fc8f9c0 pid: 127593 (default app) Nov 03 03:50:03.128941 n-d-854653-7 devstack@n-api.service[127594]: WARNING keystonemiddleware.auth_token [None req-ab36d5fe-a067-4128-a012-3eb03cf274a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 03 03:50:03.134660 n-d-854653-7 devstack@n-api.service[127594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f14fc8f9c0 pid: 127594 (default app) Nov 03 03:50:45.865811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:45.867362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:45.872818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:45.885989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:46.195820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:46.196678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:46.198914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:46.199884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:47.086949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '.version_select at 0x7ff7fad96940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:47.099706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=127593) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 03 03:50:47.100690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:47.101529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:47.102110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:47.142037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:47.144103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:47.145363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:47.171440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:47.171607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:47.172175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:47.179425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a99f4c8-61d0-4441-a17e-4d68af7a8208 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.329915 Nov 03 03:50:47.195459 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Nov 3 03:50:45 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:47.414790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9cdc9c5-a772-4a2c-a048-9e3643107e1f tempest-AZAdminNegativeTestJSON-1491178339 tempest-AZAdminNegativeTestJSON-1491178339-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:47.416528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9cdc9c5-a772-4a2c-a048-9e3643107e1f tempest-AZAdminNegativeTestJSON-1491178339 tempest-AZAdminNegativeTestJSON-1491178339-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '2b52dda4f50f47d68493d39265c51034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7c3672758de4e2aa1bc4ddb8775a167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9cdc9c5-a772-4a2c-a048-9e3643107e1f tempest-AZAdminNegativeTestJSON-1491178339 tempest-AZAdminNegativeTestJSON-1491178339-project] Request method failure captured: Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqS5WwcjqNQyYn-aHm1Yv3fmqtg7-TQk4W2iG59DUm4CytHZhwtJCAWeW2S8FH87mXCq36IsBX8C0iKxLH840tzzNZ_rut3EhwizkucIGR6HTZif2cqY_NGR-jbNzfQxnx5OYrP_UrBlSZAKvNmyxq5gBg6Jq5o6GyoSiyDmIa1R-w Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e7c3672758de4e2aa1bc4ddb8775a167 Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1491178339 Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:50:47.420163 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7c3672758de4e2aa1bc4ddb8775a167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e7c3672758de4e2aa1bc4ddb8775a167", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e7c3672758de4e2aa1bc4ddb8775a167"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e7c3672758de4e2aa1bc4ddb8775a167"}]}] Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AZAdminNegativeTestJSON-1491178339 Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e7c3672758de4e2aa1bc4ddb8775a167 Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1491178339 Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AZAdminNegativeTestJSON-1491178339-project Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 2b52dda4f50f47d68493d39265c51034 Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AZAdminNegativeTestJSON-1491178339-project Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 03 03:50:47.421255 n-d-854653-7 devstack@n-api.service[127593]: action_args: {} Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:47.422337 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:47.423401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9cdc9c5-a772-4a2c-a048-9e3643107e1f tempest-AZAdminNegativeTestJSON-1491178339 tempest-AZAdminNegativeTestJSON-1491178339-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:47.425132 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9cdc9c5-a772-4a2c-a048-9e3643107e1f tempest-AZAdminNegativeTestJSON-1491178339 tempest-AZAdminNegativeTestJSON-1491178339-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.225145 Nov 03 03:50:47.425744 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2/2] 10.222.0.30 () {58 vars in 1185 bytes} [Thu Nov 3 03:50:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:47.538714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3616ccae-2dca-4488-affd-7fc44b83b160 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-204491937", "id": 261399866, "os-flavor-access:is_public": "True"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:47.631814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a9ca8d3-346d-4a65-ad26-50a133c74962 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-920781357", "id": 2141821046, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:47.667720 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3616ccae-2dca-4488-affd-7fc44b83b160 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 1.492561 Nov 03 03:50:47.669794 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:46 2022] POST /compute/v2.1/flavors => generated 426 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:47.800982 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a9ca8d3-346d-4a65-ad26-50a133c74962 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.374064 Nov 03 03:50:47.804280 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3/4] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 03:50:47 2022] POST /compute/v2.1/flavors => generated 448 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:50:47.815233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6759043a-77c0-4f0e-8367-f67e4b160b83 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-543747403", "name": "tempest-test_aggregate-1528518745"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:47.839767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-6759043a-77c0-4f0e-8367-f67e4b160b83 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid a6e9222d-060f-4b85-8fae-d82d14185b6c for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:50:47.921067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Calling method '.version_select at 0x7ff7fad31ca0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:47.940936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=127594) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 03 03:50:47.941791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:47.945591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:47.946232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:47.998592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:48.000211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:48.000871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:48.020077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:48.020569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:48.021006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:48.028044 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-930c14a9-0cd6-44f8-8cee-a4afb0f37485 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.355784 Nov 03 03:50:48.028504 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2/5] 10.222.0.30 () {60 vars in 1208 bytes} [Thu Nov 3 03:50:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:50:48.033137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5c9b8b4-2d7f-4649-acef-181281ffccc5 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:48.130351 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b5c9b8b4-2d7f-4649-acef-181281ffccc5 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/261399866" status: 202 len: 0 microversion: 2.1 time: 0.100766 Nov 03 03:50:48.132136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:48 2022] DELETE /compute/v2.1/flavors/261399866 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:48.136851 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6759043a-77c0-4f0e-8367-f67e4b160b83 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.330379 Nov 03 03:50:48.139994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4/7] 10.222.0.30 () {60 vars in 1165 bytes} [Thu Nov 3 03:50:47 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:48.146841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4fbb5e63-32a1-4a36-95a2-10564e30f8b9 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:48.202495 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4fbb5e63-32a1-4a36-95a2-10564e30f8b9 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.059919 Nov 03 03:50:48.209360 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:48 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:48.216219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-735eb81a-8cdd-460d-9913-ddc8a169900e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:48.247636 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-735eb81a-8cdd-460d-9913-ddc8a169900e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.036387 Nov 03 03:50:48.248371 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 6/9] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:50:48 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:48.256672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-858d061a-857c-4310-8b3b-b048491b1234 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1553005006", "id": 1589615925, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:48.357903 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-858d061a-857c-4310-8b3b-b048491b1234 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.108120 Nov 03 03:50:48.359138 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 7/10] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:48 2022] POST /compute/v2.1/flavors => generated 417 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:48.364633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-098ef25d-9cf6-45df-8710-cf355f1cbaee tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:48.377858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-098ef25d-9cf6-45df-8710-cf355f1cbaee tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:48.378642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-098ef25d-9cf6-45df-8710-cf355f1cbaee tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:48.379857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-098ef25d-9cf6-45df-8710-cf355f1cbaee tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:48.440973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b5ec436-758d-4e38-8f22-42b740fb9aac tempest-FlavorsV255TestJSON-666961501 tempest-FlavorsV255TestJSON-666961501-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:48.482992 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b5ec436-758d-4e38-8f22-42b740fb9aac tempest-FlavorsV255TestJSON-666961501 tempest-FlavorsV255TestJSON-666961501-project] 10.222.0.30 "GET /compute/v2.1/flavors/2141821046" status: 200 len: 448 microversion: 2.55 time: 0.348177 Nov 03 03:50:48.482992 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4/11] 10.222.0.30 () {60 vars in 1199 bytes} [Thu Nov 3 03:50:48 2022] GET /compute/v2.1/flavors/2141821046 => generated 448 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:50:48.496857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3e7d8696-b2b6-40a8-a15e-f304cb532abd tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:48.543810 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3e7d8696-b2b6-40a8-a15e-f304cb532abd tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.059170 Nov 03 03:50:48.545528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 5/12] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:48 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:48.550945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10cdf034-da24-4766-bd2b-2437a8173607 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] Action: 'update', calling method: .version_select at 0x7ff7fb0e15e0>, body: {"flavor": {"description": "new"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:48.709091 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10cdf034-da24-4766-bd2b-2437a8173607 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/2141821046" status: 200 len: 449 microversion: 2.55 time: 0.161462 Nov 03 03:50:48.709606 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 6/13] 10.222.0.30 () {62 vars in 1219 bytes} [Thu Nov 3 03:50:48 2022] PUT /compute/v2.1/flavors/2141821046 => generated 449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:50:48.716391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-38df1b6b-59b3-49f9-9325-7ae645bf6454 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:48.852554 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-38df1b6b-59b3-49f9-9325-7ae645bf6454 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1589615925" status: 202 len: 0 microversion: 2.1 time: 0.141713 Nov 03 03:50:48.853208 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 7/14] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:50:48 2022] DELETE /compute/v2.1/flavors/1589615925 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:48.862906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e9d0b5b-bb88-489c-af2c-ef33923adf8d tempest-FlavorsV255TestJSON-666961501 tempest-FlavorsV255TestJSON-666961501-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:48.964244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e9d0b5b-bb88-489c-af2c-ef33923adf8d tempest-FlavorsV255TestJSON-666961501 tempest-FlavorsV255TestJSON-666961501-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.103875 Nov 03 03:50:48.968810 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 8/15] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:50:48 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:50:49.322993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1d662116-66f1-4aef-8a85-c3d708a10a72 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-791398963", "id": 112646856, "os-flavor-access:is_public": "False"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:49.417759 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1d662116-66f1-4aef-8a85-c3d708a10a72 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.447312 Nov 03 03:50:49.428003 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 9/16] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:48 2022] POST /compute/v2.1/flavors => generated 435 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:49.435631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-34b9a1bd-086d-4add-a1ff-a89aee564e80 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:49.463330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-34b9a1bd-086d-4add-a1ff-a89aee564e80 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.033844 Nov 03 03:50:49.466343 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 10/17] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:49.482556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16d9574c-1140-46b0-a08f-47c2fe9480ea tempest-FlavorsV255TestJSON-666961501 tempest-FlavorsV255TestJSON-666961501-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:49.509491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16d9574c-1140-46b0-a08f-47c2fe9480ea tempest-FlavorsV255TestJSON-666961501 tempest-FlavorsV255TestJSON-666961501-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.043662 Nov 03 03:50:49.511018 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 11/18] 10.222.0.30 () {60 vars in 1166 bytes} [Thu Nov 3 03:50:49 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:50:49.515890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ba87a71-79c7-4fe7-94b0-468b1de6d4aa tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:49.611725 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-098ef25d-9cf6-45df-8710-cf355f1cbaee tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.250821 Nov 03 03:50:49.613379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 8/19] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:50:48 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:49.631603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3fd91db-a203-43f2-b5bd-30028a7f8782 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1933450101", "id": 1224148458, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:49.699612 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3fd91db-a203-43f2-b5bd-30028a7f8782 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.084472 Nov 03 03:50:49.702108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 9/20] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:49 2022] POST /compute/v2.1/flavors => generated 429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:49.712706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d021e577-2737-4124-ad51-5ae2d8895598 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:49.813320 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d021e577-2737-4124-ad51-5ae2d8895598 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2141821046" status: 202 len: 0 microversion: 2.55 time: 0.110061 Nov 03 03:50:49.815933 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 10/21] 10.222.0.30 () {60 vars in 1202 bytes} [Thu Nov 3 03:50:49 2022] DELETE /compute/v2.1/flavors/2141821046 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:50:49.822687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-63011ab9-7b12-4523-88e1-95b42de489af tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:49.909556 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-63011ab9-7b12-4523-88e1-95b42de489af tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1224148458" status: 202 len: 0 microversion: 2.1 time: 0.092115 Nov 03 03:50:49.910498 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 11/22] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:50:49 2022] DELETE /compute/v2.1/flavors/1224148458 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:49.918841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f73006ad-d7d5-4040-b03a-6204abcc0d83 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:49.948201 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f73006ad-d7d5-4040-b03a-6204abcc0d83 tempest-FlavorsV255TestJSON-798346154 tempest-FlavorsV255TestJSON-798346154-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.030683 Nov 03 03:50:49.948201 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 12/23] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:50:50.157328 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ba87a71-79c7-4fe7-94b0-468b1de6d4aa tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/112646856/action" status: 200 len: 96 microversion: 2.1 time: 0.645061 Nov 03 03:50:50.164252 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 12/24] 10.222.0.30 () {60 vars in 1197 bytes} [Thu Nov 3 03:50:49 2022] POST /compute/v2.1/flavors/112646856/action => generated 96 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:50:50.169552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fd305781-9dbd-454f-8426-c00437cc42ca tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:50.192048 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fd305781-9dbd-454f-8426-c00437cc42ca tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026306 Nov 03 03:50:50.206237 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:50.214488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a133c3d8-9969-4b3a-9cee-48fba6f034d6 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:50.311988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-390900692", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "availability_zone": "tempest-test_az-543747403"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:50.347257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:50.347933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:50.348811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:50.350046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:50.355317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:50.360236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:51.012633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a133c3d8-9969-4b3a-9cee-48fba6f034d6 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project 88e6898dd0a44876b1049b0ce43b8ed5 combination. Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a133c3d8-9969-4b3a-9cee-48fba6f034d6 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Request method failure captured: Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/flavors/112646856/action HTTP/1.1 Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 67 Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqWQOT5Fa17FlcaSYYRhifLGinR7Iy1h-Icpmq66tQbkxmnn24s68EAem5uBO4H25pxUiUIv6bQGlwZ9vSAOmJ7uPjtOL0hKRZ39TBgu3M9wruqNU3wvQsLYntq8E38QtIDwlXBG7D0m6bUyP-fcVzFvhwSvUhcWE1_P-XcJ1y6VI8 Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 618be2dbc75844b89e37b4ab0c0686b7 Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:51.029459 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/618be2dbc75844b89e37b4ab0c0686b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_618be2dbc75844b89e37b4ab0c0686b7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/618be2dbc75844b89e37b4ab0c0686b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/618be2dbc75844b89e37b4ab0c0686b7"}]}] Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 618be2dbc75844b89e37b4ab0c0686b7 Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5ac8190a3b5349fbb7b1f11fa2df975b Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: {"addTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} Nov 03 03:50:51.030723 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: exception: Flavor access already exists for flavor 18 and project 88e6898dd0a44876b1049b0ce43b8ed5 combination. Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '112646856', 'body': {'addTenantAccess': {'tenant': '88e6898dd0a44876b1049b0ce43b8ed5'}}} Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result.read() Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 03 03:50:51.031446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-88e6898dd0a44876b1049b0ce43b8ed5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi session.flush() Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 03 03:50:51.032500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 03 03:50:51.033823 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 03 03:50:51.034851 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result.read() Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-88e6898dd0a44876b1049b0ce43b8ed5' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 3, 3, 50, 50, 960846), 'updated_at': None, 'flavor_id': 18, 'project_id': '88e6898dd0a44876b1049b0ce43b8ed5'}] Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:51.035933 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project 88e6898dd0a44876b1049b0ce43b8ed5 combination. Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:51.036918 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project 88e6898dd0a44876b1049b0ce43b8ed5 combination. Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:51.038418 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:51.039528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project 88e6898dd0a44876b1049b0ce43b8ed5 combination. Nov 03 03:50:51.039528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:51.040836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a133c3d8-9969-4b3a-9cee-48fba6f034d6 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project 88e6898dd0a44876b1049b0ce43b8ed5 combination. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:51.041878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a133c3d8-9969-4b3a-9cee-48fba6f034d6 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/112646856/action" status: 409 len: 152 microversion: 2.1 time: 0.834570 Nov 03 03:50:51.042697 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 14/26] 10.222.0.30 () {60 vars in 1197 bytes} [Thu Nov 3 03:50:50 2022] POST /compute/v2.1/flavors/112646856/action => generated 152 bytes in 836 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:50:51.047692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-578889fa-760c-4def-b928-9bdb3366d2e7 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1462133533", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:51.151575 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-578889fa-760c-4def-b928-9bdb3366d2e7 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.106133 Nov 03 03:50:51.153638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 15/27] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:51 2022] POST /compute/v2.1/flavors => generated 507 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:51.237374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:50:51.363017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e417d32a-c460-4adf-987d-2e7bc94db348 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-659070687", "id": 649813087, "os-flavor-access:is_public": "False"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:51.467605 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e417d32a-c460-4adf-987d-2e7bc94db348 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.312750 Nov 03 03:50:51.468433 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 16/28] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:51 2022] POST /compute/v2.1/flavors => generated 427 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:51.485545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-54c659f8-6454-4e11-b230-575b342564ef tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:51.607214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:50:51.607543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:50:51.608036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:50:51.608466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:50:51.608890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:50:51.645797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:51.646834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:51.647553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:51.648880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:51.649659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:51.651158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:51.722885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Getting quotas for project 75ede494be4a4f58a3df4212ef360327. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:50:51.730652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Getting quotas for user 4b5717a94b93410b92e4229ccee24bb6 and project 75ede494be4a4f58a3df4212ef360327. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:50:51.744976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:50:51.748443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:50:51.879040 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-54c659f8-6454-4e11-b230-575b342564ef tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/112646856/action" status: 200 len: 21 microversion: 2.1 time: 0.409390 Nov 03 03:50:51.879809 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 17/29] 10.222.0.30 () {60 vars in 1197 bytes} [Thu Nov 3 03:50:51 2022] POST /compute/v2.1/flavors/112646856/action => generated 21 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:50:51.888259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e29ab7fc-25d8-4b9b-82c8-4f7d6a4f963b tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:51.903940 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84db8308-7f35-4784-b20b-da2e6219f519 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.958904 Nov 03 03:50:51.904798 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 13/30] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:50:51.919721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a498059-f0ad-4a00-ac19-932ee41aaea1 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "07ecb9ce88134263bedc34c3b7881189"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:51.983995 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e29ab7fc-25d8-4b9b-82c8-4f7d6a4f963b tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/42753b79-1e25-4e7c-81fb-326d54375a9e" status: 202 len: 0 microversion: 2.1 time: 0.102366 Nov 03 03:50:51.985263 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 18/31] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:50:51 2022] DELETE /compute/v2.1/flavors/42753b79-1e25-4e7c-81fb-326d54375a9e => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:51.995287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c087574-8851-448a-9230-fdb4009b4ca4 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:52.130423 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c087574-8851-448a-9230-fdb4009b4ca4 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/112646856" status: 202 len: 0 microversion: 2.1 time: 0.142936 Nov 03 03:50:52.131188 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 19/32] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:51 2022] DELETE /compute/v2.1/flavors/112646856 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:52.137051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c9e67f0-b474-4784-ad47-d63171779792 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:52.138047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c9e67f0-b474-4784-ad47-d63171779792 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:52.566532 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a498059-f0ad-4a00-ac19-932ee41aaea1 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/649813087/action" status: 200 len: 96 microversion: 2.1 time: 0.659769 Nov 03 03:50:52.567466 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 14/33] 10.222.0.30 () {60 vars in 1197 bytes} [Thu Nov 3 03:50:51 2022] POST /compute/v2.1/flavors/649813087/action => generated 96 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:50:52.572071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-09a655a1-ccd0-448d-967d-202a8dc49103 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:52.592332 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-09a655a1-ccd0-448d-967d-202a8dc49103 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023618 Nov 03 03:50:52.596025 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 15/34] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:52.600774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6f92573-b0ba-4dc7-a508-b7d7c2db7b39 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:52.622161 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6f92573-b0ba-4dc7-a508-b7d7c2db7b39 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024921 Nov 03 03:50:52.622666 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 16/35] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:53.130071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f03d70bf-96e6-4cfc-a992-cf6bf55e2459 tempest-FlavorsAccessTestJSON-208544381 tempest-FlavorsAccessTestJSON-208544381-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:53.202506 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f03d70bf-96e6-4cfc-a992-cf6bf55e2459 tempest-FlavorsAccessTestJSON-208544381 tempest-FlavorsAccessTestJSON-208544381-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.578574 Nov 03 03:50:53.203556 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 17/36] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:52 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:53.208646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6430a36d-a21c-4f47-9723-78f3317ad729 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1546829783", "id": "3aaf687b-7146-4299-99ce-801f9dfafdc6", "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:53.309827 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6430a36d-a21c-4f47-9723-78f3317ad729 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.104991 Nov 03 03:50:53.310426 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:53 2022] POST /compute/v2.1/flavors => generated 507 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:53.331867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c717bc94-0226-420b-9163-245677b50c93 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1034238987", "id": 447843857, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:53.435801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c9e67f0-b474-4784-ad47-d63171779792 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:53.451202 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c9e67f0-b474-4784-ad47-d63171779792 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1241 microversion: 2.1 time: 1.318699 Nov 03 03:50:53.451846 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 20/38] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:52 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1241 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:53.459770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-652f5827-b3ee-4e5b-8177-2f5f6e4f087c tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "07ecb9ce88134263bedc34c3b7881189"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:53.476740 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c717bc94-0226-420b-9163-245677b50c93 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.165039 Nov 03 03:50:53.477491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:53.485635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70205547-1984-42ff-8ace-cb827f4fa991 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:53.520491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=12,nova_api:DELETE=7 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:53.624490 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70205547-1984-42ff-8ace-cb827f4fa991 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/3aaf687b-7146-4299-99ce-801f9dfafdc6" status: 202 len: 0 microversion: 2.1 time: 0.145320 Nov 03 03:50:53.627316 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 20/40] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:50:53 2022] DELETE /compute/v2.1/flavors/3aaf687b-7146-4299-99ce-801f9dfafdc6 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:53.632638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e2c7df4-62a9-4f25-b04c-12ade73ee201 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:53.661525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-1e2c7df4-62a9-4f25-b04c-12ade73ee201 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e2c7df4-62a9-4f25-b04c-12ade73ee201 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Request method failure captured: Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/flavors/447843857/os-flavor-access HTTP/1.1 Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqWQOT5Fa17FlcaSYYRhifLGinR7Iy1h-Icpmq66tQbkxmnn24s68EAem5uBO4H25pxUiUIv6bQGlwZ9vSAOmJ7uPjtOL0hKRZ39TBgu3M9wruqNU3wvQsLYntq8E38QtIDwlXBG7D0m6bUyP-fcVzFvhwSvUhcWE1_P-XcJ1y6VI8 Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 618be2dbc75844b89e37b4ab0c0686b7 Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:50:53.666660 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/618be2dbc75844b89e37b4ab0c0686b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_618be2dbc75844b89e37b4ab0c0686b7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/618be2dbc75844b89e37b4ab0c0686b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/618be2dbc75844b89e37b4ab0c0686b7"}]}] Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 618be2dbc75844b89e37b4ab0c0686b7 Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 5ac8190a3b5349fbb7b1f11fa2df975b Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: exception: Access list not available for public flavors. Nov 03 03:50:53.667722 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'flavor_id': '447843857'} Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 03 03:50:53.668467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:53.670922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e2c7df4-62a9-4f25-b04c-12ade73ee201 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:53.674205 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1e2c7df4-62a9-4f25-b04c-12ade73ee201 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/447843857/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.046892 Nov 03 03:50:53.676923 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 21/41] 10.222.0.30 () {58 vars in 1206 bytes} [Thu Nov 3 03:50:53 2022] GET /compute/v2.1/flavors/447843857/os-flavor-access => generated 91 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:50:53.684140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc435818-92bd-4f56-a0f9-0a8da4652286 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:53.707531 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc435818-92bd-4f56-a0f9-0a8da4652286 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5416 microversion: 2.1 time: 0.029251 Nov 03 03:50:53.717069 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 22/42] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:53 2022] GET /compute/v2.1/flavors/detail => generated 5416 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:53.724363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e932915-6687-4d00-b820-f2b3602f2149 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:53.852523 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e932915-6687-4d00-b820-f2b3602f2149 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/447843857" status: 202 len: 0 microversion: 2.1 time: 0.136750 Nov 03 03:50:53.853049 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 23/43] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:53 2022] DELETE /compute/v2.1/flavors/447843857 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:53.862559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b872fdb9-d699-46d3-9bf2-c993607cee24 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1949963021", "id": 715932113, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:53.907812 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-652f5827-b3ee-4e5b-8177-2f5f6e4f087c tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/649813087/action" status: 200 len: 21 microversion: 2.1 time: 0.452057 Nov 03 03:50:53.911651 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 21/44] 10.222.0.30 () {60 vars in 1197 bytes} [Thu Nov 3 03:50:53 2022] POST /compute/v2.1/flavors/649813087/action => generated 21 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:50:53.923378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-352d367b-b2b7-49cb-9699-eece41178a3f tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:53.972544 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-352d367b-b2b7-49cb-9699-eece41178a3f tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058937 Nov 03 03:50:53.973161 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 22/45] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:53.986276 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b872fdb9-d699-46d3-9bf2-c993607cee24 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.114246 Nov 03 03:50:53.986276 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:53 2022] POST /compute/v2.1/flavors => generated 411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:53.987881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a8ffc0eb-d54f-43fa-b7dd-efeaacd14a2d tempest-FlavorsAccessTestJSON-208544381 tempest-FlavorsAccessTestJSON-208544381-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.005336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8cce8468-0c82-43aa-b221-1925af743d87 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.011232 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a8ffc0eb-d54f-43fa-b7dd-efeaacd14a2d tempest-FlavorsAccessTestJSON-208544381 tempest-FlavorsAccessTestJSON-208544381-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.036849 Nov 03 03:50:54.012161 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 23/47] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:53 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:54.016649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ae0e430-25d9-486b-b7f0-3da533d66006 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-118760043", "id": 116608072, "os-flavor-access:is_public": "False"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:54.022399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=14,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:54.024286 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8cce8468-0c82-43aa-b221-1925af743d87 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/715932113" status: 200 len: 411 microversion: 2.1 time: 0.035487 Nov 03 03:50:54.024917 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 25/48] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:50:53 2022] GET /compute/v2.1/flavors/715932113 => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:54.037507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f2eb058-0c60-4770-8c92-aa3921d60971 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.126553 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f2eb058-0c60-4770-8c92-aa3921d60971 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/649813087" status: 202 len: 0 microversion: 2.1 time: 0.097607 Nov 03 03:50:54.127138 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 26/49] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:54 2022] DELETE /compute/v2.1/flavors/649813087 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:54.138183 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ae0e430-25d9-486b-b7f0-3da533d66006 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.123738 Nov 03 03:50:54.148052 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 24/50] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:54 2022] POST /compute/v2.1/flavors => generated 435 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:54.155596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-590631c6-80cb-420e-8fda-549380bd096a tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.181241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-590631c6-80cb-420e-8fda-549380bd096a tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.031622 Nov 03 03:50:54.184060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 25/51] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:54.423039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f602480c-560d-4b98-91f8-af1a613d576c tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.466590 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f602480c-560d-4b98-91f8-af1a613d576c tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.338050 Nov 03 03:50:54.468864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 27/52] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:54 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:54.493187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-278542e6-8923-4f86-9573-b72ba3d45c61 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-875255739", "id": 296829624, "os-flavor-access:is_public": "False"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:54.581376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-392da11c-d4e8-4aca-9ab5-a889bb4368c8 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:54.585006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-392da11c-d4e8-4aca-9ab5-a889bb4368c8 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '7f9e438eafdf449f891b906baee9864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e6898dd0a44876b1049b0ce43b8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:54.590313 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-278542e6-8923-4f86-9573-b72ba3d45c61 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.120151 Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-392da11c-d4e8-4aca-9ab5-a889bb4368c8 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Request method failure captured: Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/flavors/116608072/action HTTP/1.1 Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 67 Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqTNB5x2ueUQZzB4dJhyx5UitL9dtUg3p8lVsSwGydX-ytA6YZGrzPEvlVCfKBt83JNG1yXlLSk1JdTQHM3rs4RjNBRBTRYGFNnounp3VZzHN1QE-RSCHoUDDnBoOTXIX2WvFZ3EhYaMoSKNMdx8WdLbNgVmI_Z0DccvL1crJEF71Q Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 88e6898dd0a44876b1049b0ce43b8ed5 Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1823361380 Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:50:54.590465 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88e6898dd0a44876b1049b0ce43b8ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88e6898dd0a44876b1049b0ce43b8ed5", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88e6898dd0a44876b1049b0ce43b8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88e6898dd0a44876b1049b0ce43b8ed5"}]}] Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1823361380 Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 88e6898dd0a44876b1049b0ce43b8ed5 Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1823361380 Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FlavorsAccessNegativeTestJSON-1823361380-project Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7f9e438eafdf449f891b906baee9864c Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1823361380-project Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: {"addTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} Nov 03 03:50:54.600304 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '116608072', 'body': {'addTenantAccess': {'tenant': '88e6898dd0a44876b1049b0ce43b8ed5'}}} Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:54.601065 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 03 03:50:54.601992 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:54.608448 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 28/53] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:54 2022] POST /compute/v2.1/flavors => generated 427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:54.608601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-392da11c-d4e8-4aca-9ab5-a889bb4368c8 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:54.608601 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-392da11c-d4e8-4aca-9ab5-a889bb4368c8 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] 10.222.0.30 "POST /compute/v2.1/flavors/116608072/action" status: 403 len: 130 microversion: 2.1 time: 0.416509 Nov 03 03:50:54.608871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd4e7d5b-6da3-43ac-a5fe-c3cc426191a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.608871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd4e7d5b-6da3-43ac-a5fe-c3cc426191a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:54.609438 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 26/54] 10.222.0.30 () {60 vars in 1197 bytes} [Thu Nov 3 03:50:54 2022] POST /compute/v2.1/flavors/116608072/action => generated 130 bytes in 423 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:54.613628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-81b113d1-208d-42d4-861f-372460141ace tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.709863 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-81b113d1-208d-42d4-861f-372460141ace tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/715932113" status: 202 len: 0 microversion: 2.1 time: 0.100368 Nov 03 03:50:54.713594 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 27/55] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:54 2022] DELETE /compute/v2.1/flavors/715932113 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:54.720282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec51db0b-c477-4caa-b8dc-6c8cf6b08c67 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.727649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dd4e7d5b-6da3-43ac-a5fe-c3cc426191a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:54.740654 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec51db0b-c477-4caa-b8dc-6c8cf6b08c67 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/296829624/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.025806 Nov 03 03:50:54.742045 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 28/56] 10.222.0.30 () {58 vars in 1206 bytes} [Thu Nov 3 03:50:54 2022] GET /compute/v2.1/flavors/296829624/os-flavor-access => generated 21 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:50:54.747447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c0f71341-8609-4eb6-a2fb-6b5e8bca0c1e tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.757408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd4e7d5b-6da3-43ac-a5fe-c3cc426191a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1241 microversion: 2.1 time: 0.164544 Nov 03 03:50:54.758720 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 29/57] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:54 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1241 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:54.765686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11deca5f-c46d-4466-b172-a2f1c8369288 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.809421 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11deca5f-c46d-4466-b172-a2f1c8369288 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048133 Nov 03 03:50:54.810948 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 30/58] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:54.825319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d16c3ae-59af-491c-bc41-357bc2d20aab tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.862705 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c0f71341-8609-4eb6-a2fb-6b5e8bca0c1e tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/116608072" status: 202 len: 0 microversion: 2.1 time: 0.119403 Nov 03 03:50:54.864071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 29/59] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:54 2022] DELETE /compute/v2.1/flavors/116608072 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:54.871196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6391a9de-1f3f-4f87-b162-aeb637a3d822 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1919037754", "id": 11076377, "os-flavor-access:is_public": "False"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:54.955169 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d16c3ae-59af-491c-bc41-357bc2d20aab tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/296829624" status: 202 len: 0 microversion: 2.1 time: 0.142688 Nov 03 03:50:54.956386 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 31/60] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:54 2022] DELETE /compute/v2.1/flavors/296829624 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:54.966217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ee3583d-06ed-4318-8d45-7c0100540b6c tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.989314 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ee3583d-06ed-4318-8d45-7c0100540b6c tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027866 Nov 03 03:50:54.989899 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 32/61] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:54.997102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ff3d479-28e4-436e-b3b2-d4fb52f01b61 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:54.999185 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6391a9de-1f3f-4f87-b162-aeb637a3d822 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.133916 Nov 03 03:50:55.000181 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 30/62] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:54 2022] POST /compute/v2.1/flavors => generated 424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:55.020334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-574b2d3d-8c7b-4279-bd17-29a565bfa419 tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "11076377"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:55.023489 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ff3d479-28e4-436e-b3b2-d4fb52f01b61 tempest-FlavorsAccessTestJSON-60664864 tempest-FlavorsAccessTestJSON-60664864-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032545 Nov 03 03:50:55.024305 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 33/63] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:55.030831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff28dc52-ad27-49be-ae4d-2b1a76f14a82 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1675961918", "id": 1834431028, "os-flavor-access:is_public": "False"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:55.042767 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-574b2d3d-8c7b-4279-bd17-29a565bfa419 tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] HTTP exception thrown: Flavor 11076377 could not be found. Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-574b2d3d-8c7b-4279-bd17-29a565bfa419 tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] Request method failure captured: Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 105 Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqS1P_6fnHp4Npp4hLuSeQQkkM8ozW3A18cypwKpgaiXWyRp1CqfjlH9wfGPWKd8yUcqSrPPkvdT10e7P-Y7ExH2OMPQKvjnrKs167JiSzhyYISk0bNHn5w3_Tna1-wiSIxFhFiC0uM9hRfQT8VpG9TvH0Q7Ew-cMlqm6Dx96EdLMg Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: fbf0d55004094a6fb09c8c1008cb4c8a Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FlavorsAdminTestJSON-1025742851 Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:50:55.047948 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbf0d55004094a6fb09c8c1008cb4c8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fbf0d55004094a6fb09c8c1008cb4c8a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fbf0d55004094a6fb09c8c1008cb4c8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fbf0d55004094a6fb09c8c1008cb4c8a"}]}] Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FlavorsAdminTestJSON-1025742851 Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: fbf0d55004094a6fb09c8c1008cb4c8a Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1025742851 Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FlavorsAdminTestJSON-1025742851-project Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 060c0a23eabc45fbb084f0489d470952 Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FlavorsAdminTestJSON-1025742851-project Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "test", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "11076377"}} Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:50:55.049104 n-d-854653-7 devstack@n-api.service[127594]: exception: Flavor 11076377 could not be found. Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '11076377'}}} Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 11076377 could not be found. Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:55.049979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 11076377 could not be found. Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:55.050898 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 11076377 could not be found. Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-574b2d3d-8c7b-4279-bd17-29a565bfa419 tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] Returning 400 to user: Flavor 11076377 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-574b2d3d-8c7b-4279-bd17-29a565bfa419 tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.037472 Nov 03 03:50:55.051885 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 31/64] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:55 2022] POST /compute/v2.1/servers => generated 79 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:50:55.059797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25c32bb3-0d48-4c82-ab18-135d50fc36d3 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:55.138601 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-25c32bb3-0d48-4c82-ab18-135d50fc36d3 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/11076377" status: 202 len: 0 microversion: 2.1 time: 0.084041 Nov 03 03:50:55.139482 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 32/65] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:50:55 2022] DELETE /compute/v2.1/flavors/11076377 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:50:55.148559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ed15966-e148-4b05-b08f-a21227143cf5 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:55.149211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff28dc52-ad27-49be-ae4d-2b1a76f14a82 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.123522 Nov 03 03:50:55.150006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:55 2022] POST /compute/v2.1/flavors => generated 439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:55.163730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c4d2569-f362-443b-b5f1-79363737c84f tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:55.181894 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ed15966-e148-4b05-b08f-a21227143cf5 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035297 Nov 03 03:50:55.194078 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 33/67] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:55.203322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9dd095a0-01e0-41cc-8b69-00c7dc89eea7 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-455379660", "id": 691540150, "os-flavor-access:is_public": "False"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:55.320586 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9dd095a0-01e0-41cc-8b69-00c7dc89eea7 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.120996 Nov 03 03:50:55.346842 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 34/68] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:55 2022] POST /compute/v2.1/flavors => generated 411 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:50:55.370909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1cfddd9-e0b5-4129-8709-c92037302663 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1304782398", "id": 1717483882, "os-flavor-access:is_public": "True"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:55.496855 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1cfddd9-e0b5-4129-8709-c92037302663 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.151580 Nov 03 03:50:55.497575 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 35/69] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:55.927465 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c4d2569-f362-443b-b5f1-79363737c84f tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1834431028/action" status: 200 len: 97 microversion: 2.1 time: 0.761602 Nov 03 03:50:55.927465 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 35/70] 10.222.0.30 () {60 vars in 1200 bytes} [Thu Nov 3 03:50:55 2022] POST /compute/v2.1/flavors/1834431028/action => generated 97 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:50:55.929333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b803612-41b0-4b92-91b7-57368d57b1ad tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:55.952273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b803612-41b0-4b92-91b7-57368d57b1ad tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 843 microversion: 2.1 time: 0.026233 Nov 03 03:50:55.952897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 36/71] 10.222.0.30 () {58 vars in 1169 bytes} [Thu Nov 3 03:50:55 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 843 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:55.969880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:55.971017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:55.979172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:55.979917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:55.980505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:55.983488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:55.983488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:55.983488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:56.012700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1277170654", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:56.146386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:50:56.238089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:56.256660 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d0c61a90-b4d7-4302-8ae5-4734289f0210 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1233 microversion: 2.1 time: 0.293056 Nov 03 03:50:56.257437 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 37/72] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:55 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1233 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:56.263563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68ed5b85-a8a5-44bb-89af-c00d90e93d48 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:56.267078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68ed5b85-a8a5-44bb-89af-c00d90e93d48 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '7f9e438eafdf449f891b906baee9864c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88e6898dd0a44876b1049b0ce43b8ed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68ed5b85-a8a5-44bb-89af-c00d90e93d48 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Request method failure captured: Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/flavors/1834431028/action HTTP/1.1 Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 70 Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqTNB5x2ueUQZzB4dJhyx5UitL9dtUg3p8lVsSwGydX-ytA6YZGrzPEvlVCfKBt83JNG1yXlLSk1JdTQHM3rs4RjNBRBTRYGFNnounp3VZzHN1QE-RSCHoUDDnBoOTXIX2WvFZ3EhYaMoSKNMdx8WdLbNgVmI_Z0DccvL1crJEF71Q Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 88e6898dd0a44876b1049b0ce43b8ed5 Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1823361380 Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:50:56.269128 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88e6898dd0a44876b1049b0ce43b8ed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_88e6898dd0a44876b1049b0ce43b8ed5", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/88e6898dd0a44876b1049b0ce43b8ed5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/88e6898dd0a44876b1049b0ce43b8ed5"}]}] Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1823361380 Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 88e6898dd0a44876b1049b0ce43b8ed5 Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1823361380 Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsAccessNegativeTestJSON-1823361380-project Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7f9e438eafdf449f891b906baee9864c Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1823361380-project Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: {"removeTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} Nov 03 03:50:56.270356 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1834431028', 'body': {'removeTenantAccess': {'tenant': '88e6898dd0a44876b1049b0ce43b8ed5'}}} Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can( Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:56.270955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 03 03:50:56.271899 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:56.272835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68ed5b85-a8a5-44bb-89af-c00d90e93d48 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:56.272835 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68ed5b85-a8a5-44bb-89af-c00d90e93d48 tempest-FlavorsAccessNegativeTestJSON-1823361380 tempest-FlavorsAccessNegativeTestJSON-1823361380-project] 10.222.0.30 "POST /compute/v2.1/flavors/1834431028/action" status: 403 len: 133 microversion: 2.1 time: 0.012142 Nov 03 03:50:56.276006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 38/73] 10.222.0.30 () {60 vars in 1200 bytes} [Thu Nov 3 03:50:56 2022] POST /compute/v2.1/flavors/1834431028/action => generated 133 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:56.281664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-942d23a2-3241-413b-a3da-57d3c32a5fc0 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:56.308247 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-942d23a2-3241-413b-a3da-57d3c32a5fc0 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 843 microversion: 2.1 time: 0.030971 Nov 03 03:50:56.318758 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 39/74] 10.222.0.30 () {58 vars in 1177 bytes} [Thu Nov 3 03:50:56 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 843 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:56.328224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-281555a9-4eb5-4622-9ac8-89898759c525 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88e6898dd0a44876b1049b0ce43b8ed5"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:56.740114 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-281555a9-4eb5-4622-9ac8-89898759c525 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1834431028/action" status: 200 len: 21 microversion: 2.1 time: 0.419891 Nov 03 03:50:56.740984 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 40/75] 10.222.0.30 () {60 vars in 1200 bytes} [Thu Nov 3 03:50:56 2022] POST /compute/v2.1/flavors/1834431028/action => generated 21 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:50:56.758708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-647b5e22-3136-4b91-8ef8-aad887ceb1ff tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:56.770684 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-647b5e22-3136-4b91-8ef8-aad887ceb1ff tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 843 microversion: 2.1 time: 0.015763 Nov 03 03:50:56.779471 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 41/76] 10.222.0.30 () {58 vars in 1171 bytes} [Thu Nov 3 03:50:56 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 843 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:56.785824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba89ab0b-8b9f-4253-852d-63df0777b1ad tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:56.787447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:50:56.791931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:50:56.791931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:50:56.792701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:50:56.793223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:50:56.817604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:56.818308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:56.818953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:56.819858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:56.820314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:56.820735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:56.853495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Getting quotas for project fb5ff2c8e85d4bf3b7a2cc8afdab08f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:50:56.860155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Getting quotas for user f26c2f5a00a74611948ce866f62ee39d and project fb5ff2c8e85d4bf3b7a2cc8afdab08f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:50:56.872869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:50:56.875753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:50:56.882027 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba89ab0b-8b9f-4253-852d-63df0777b1ad tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1834431028" status: 202 len: 0 microversion: 2.1 time: 0.100508 Nov 03 03:50:56.890106 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 42/77] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:50:56 2022] DELETE /compute/v2.1/flavors/1834431028 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:56.945856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70d6820d-0be5-4b32-a4c1-be3aff3b2e7e tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:56.970905 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70d6820d-0be5-4b32-a4c1-be3aff3b2e7e tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.082446 Nov 03 03:50:56.972204 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 43/78] 10.222.0.30 () {58 vars in 1169 bytes} [Thu Nov 3 03:50:56 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:56.980148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-708a03c2-8dd9-4f45-9d92-55179f855883 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:57.008794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-708a03c2-8dd9-4f45-9d92-55179f855883 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.034772 Nov 03 03:50:57.009672 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 44/79] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:56 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:57.015980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da583c0c-90e3-4aca-aaa3-0aab7f62762f tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:57.071166 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-635ff797-fb92-4953-8175-a6946a1e8f88 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.572446 Nov 03 03:50:57.081989 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 36/80] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:50:57.082714 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da583c0c-90e3-4aca-aaa3-0aab7f62762f tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.051283 Nov 03 03:50:57.087837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3307378-aaf1-4b4a-aaa6-dacaa5ec6968 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1022597385", "id": 721924569, "os-flavor-access:is_public": "False"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:57.089682 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 45/81] 10.222.0.30 () {58 vars in 1169 bytes} [Thu Nov 3 03:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:57.108440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6b1a094-8ab2-407d-aafa-87859c1e4d72 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:57.111030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6b1a094-8ab2-407d-aafa-87859c1e4d72 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:57.216172 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3307378-aaf1-4b4a-aaa6-dacaa5ec6968 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.132117 Nov 03 03:50:57.218573 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 37/82] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:57 2022] POST /compute/v2.1/flavors => generated 436 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:57.233986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a3b1b8a-b2c6-4d84-ab1a-b5138fc4c560 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:57.285665 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1a3b1b8a-b2c6-4d84-ab1a-b5138fc4c560 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.067691 Nov 03 03:50:57.287365 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 38/83] 10.222.0.30 () {58 vars in 1175 bytes} [Thu Nov 3 03:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:57.306910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ccc7cb8-74da-40f8-9f81-8793203f4e42 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "64f64548eed14ab181524d28aade72d4"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:57.325205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f6b1a094-8ab2-407d-aafa-87859c1e4d72 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:57.338203 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6b1a094-8ab2-407d-aafa-87859c1e4d72 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1220 microversion: 2.1 time: 0.246017 Nov 03 03:50:57.343178 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 46/84] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:57 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1220 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:57.375962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:57.377268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:57.406043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:57.407122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:57.407786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:57.410581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:57.414957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:57.417827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:57.710928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:57.723008 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6fab7492-d4d0-4bd3-baaa-786b993e0c4c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1307 microversion: 2.1 time: 0.378545 Nov 03 03:50:57.727163 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 47/85] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:57 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1307 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:57.743951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6ba930e-98b6-4d33-9e2c-dbcb821b19b1 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:57.807259 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6ba930e-98b6-4d33-9e2c-dbcb821b19b1 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.078272 Nov 03 03:50:57.823214 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 48/86] 10.222.0.30 () {58 vars in 1173 bytes} [Thu Nov 3 03:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:57.958083 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-8ccc7cb8-74da-40f8-9f81-8793203f4e42 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] HTTP exception thrown: Flavor access not found for 31 / 64f64548eed14ab181524d28aade72d4 combination. Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ccc7cb8-74da-40f8-9f81-8793203f4e42 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Request method failure captured: Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/flavors/721924569/action HTTP/1.1 Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 70 Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqWQOT5Fa17FlcaSYYRhifLGinR7Iy1h-Icpmq66tQbkxmnn24s68EAem5uBO4H25pxUiUIv6bQGlwZ9vSAOmJ7uPjtOL0hKRZ39TBgu3M9wruqNU3wvQsLYntq8E38QtIDwlXBG7D0m6bUyP-fcVzFvhwSvUhcWE1_P-XcJ1y6VI8 Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 618be2dbc75844b89e37b4ab0c0686b7 Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:57.961473 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/618be2dbc75844b89e37b4ab0c0686b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_618be2dbc75844b89e37b4ab0c0686b7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/618be2dbc75844b89e37b4ab0c0686b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/618be2dbc75844b89e37b4ab0c0686b7"}]}] Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 618be2dbc75844b89e37b4ab0c0686b7 Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933 Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5ac8190a3b5349fbb7b1f11fa2df975b Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: {"removeTenantAccess": {"tenant": "64f64548eed14ab181524d28aade72d4"}} Nov 03 03:50:57.963452 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: exception: Flavor access not found for 31 / 64f64548eed14ab181524d28aade72d4 combination. Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '721924569', 'body': {'removeTenantAccess': {'tenant': '64f64548eed14ab181524d28aade72d4'}}} Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 03 03:50:57.964163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 64f64548eed14ab181524d28aade72d4 combination. Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 64f64548eed14ab181524d28aade72d4 combination. Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:57.965051 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 64f64548eed14ab181524d28aade72d4 combination. Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ccc7cb8-74da-40f8-9f81-8793203f4e42 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Returning 404 to user: Flavor access not found for 31 / 64f64548eed14ab181524d28aade72d4 combination. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:57.968391 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ccc7cb8-74da-40f8-9f81-8793203f4e42 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/721924569/action" status: 404 len: 124 microversion: 2.1 time: 0.676471 Nov 03 03:50:57.971857 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 39/87] 10.222.0.30 () {60 vars in 1197 bytes} [Thu Nov 3 03:50:57 2022] POST /compute/v2.1/flavors/721924569/action => generated 124 bytes in 683 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:57.991844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fce477f3-0df1-4ae1-aa8c-f542d5213a02 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.023817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Calling method '.version_select at 0x7ff7fa10a8b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.033820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:58.034761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:58.040076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:58.040076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:58.040076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:58.042646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:58.056727 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fce477f3-0df1-4ae1-aa8c-f542d5213a02 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.081178 Nov 03 03:50:58.067141 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 40/88] 10.222.0.30 () {58 vars in 1169 bytes} [Thu Nov 3 03:50:57 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:58.084390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfd37b94-3d0e-47ab-880c-f7c1d6449849 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.127196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:50:58.144290 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36e53f04-0350-417c-9464-db700c975da6 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.319563 Nov 03 03:50:58.144887 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 49/89] 10.222.0.30 () {58 vars in 1128 bytes} [Thu Nov 3 03:50:57 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:58.150214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f92356e-a886-48f0-bde1-a38f0177a228 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.230443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bfd37b94-3d0e-47ab-880c-f7c1d6449849 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/721924569" status: 202 len: 0 microversion: 2.1 time: 0.161198 Nov 03 03:50:58.235869 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 41/90] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:58 2022] DELETE /compute/v2.1/flavors/721924569 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:58.267601 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f92356e-a886-48f0-bde1-a38f0177a228 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1717483882" status: 202 len: 0 microversion: 2.1 time: 0.121076 Nov 03 03:50:58.271074 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 50/91] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:50:58 2022] DELETE /compute/v2.1/flavors/1717483882 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:58.275636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1cb0696d-2e25-4195-9e2e-89618acca096 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.312438 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1cb0696d-2e25-4195-9e2e-89618acca096 tempest-FlavorsAccessNegativeTestJSON-1026212933 tempest-FlavorsAccessNegativeTestJSON-1026212933-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042421 Nov 03 03:50:58.313528 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 51/92] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:58.320055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dfd3e228-a1a2-4f53-9135-151412879097 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.349324 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dfd3e228-a1a2-4f53-9135-151412879097 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034099 Nov 03 03:50:58.350541 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 52/93] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:58.371365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80c42cc3-5674-4fad-8740-eb52a4e37e00 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.374169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80c42cc3-5674-4fad-8740-eb52a4e37e00 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:58.581907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80c42cc3-5674-4fad-8740-eb52a4e37e00 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:58.590735 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80c42cc3-5674-4fad-8740-eb52a4e37e00 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1220 microversion: 2.1 time: 0.223748 Nov 03 03:50:58.595127 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 53/94] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1220 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:50:58.609092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1023003-29e9-414a-8dab-4bbc688da39c tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.710508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e107478c-3833-4fab-8d26-dd9aeaaf31e8 tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Calling method '.version_select at 0x7ff7fa7e8f70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.714182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e107478c-3833-4fab-8d26-dd9aeaaf31e8 tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7ea96ae54eb049cb8fa307c7d83ae012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a640ef1a6eec4d609f2f7fa57a303176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e107478c-3833-4fab-8d26-dd9aeaaf31e8 tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Request method failure captured: Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqgdVGzG3HNG3gSUaaAz4V2t14K127lc5D__b0fY4AaJoO4fuOSBsA9hU7hi5sOAScGI_ufQX0jXB9QeFTCVa7ERdDj11EAcHYorWUB3R3BKxdF5RB083S2GjtYzLH7ZLhLz6ganOJKQ2lgYvY2HY8ddQ4ZLESGy8X6GjSCAZKusa4 Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:50:58.716161 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a640ef1a6eec4d609f2f7fa57a303176", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a640ef1a6eec4d609f2f7fa57a303176"}]}] Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ea96ae54eb049cb8fa307c7d83ae012 Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: action_args: {} Nov 03 03:50:58.717281 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:58.717946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 03 03:50:58.718884 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.719877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e107478c-3833-4fab-8d26-dd9aeaaf31e8 tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:58.719877 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e107478c-3833-4fab-8d26-dd9aeaaf31e8 tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.480684 Nov 03 03:50:58.723723 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 42/95] 10.222.0.30 () {58 vars in 1128 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 487 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:58.725727 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1023003-29e9-414a-8dab-4bbc688da39c tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/691540150" status: 202 len: 0 microversion: 2.1 time: 0.128073 Nov 03 03:50:58.726707 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 54/96] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:50:58 2022] DELETE /compute/v2.1/flavors/691540150 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:58.731517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab6ff072-60c8-4460-a46f-b8d97ea0715c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Calling method '.version_select at 0x7ff7f9f913a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.733579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab6ff072-60c8-4460-a46f-b8d97ea0715c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7ea96ae54eb049cb8fa307c7d83ae012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a640ef1a6eec4d609f2f7fa57a303176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab6ff072-60c8-4460-a46f-b8d97ea0715c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Request method failure captured: Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hosts/n-d-854653-7/reboot HTTP/1.1 Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqgdVGzG3HNG3gSUaaAz4V2t14K127lc5D__b0fY4AaJoO4fuOSBsA9hU7hi5sOAScGI_ufQX0jXB9QeFTCVa7ERdDj11EAcHYorWUB3R3BKxdF5RB083S2GjtYzLH7ZLhLz6ganOJKQ2lgYvY2HY8ddQ4ZLESGy8X6GjSCAZKusa4 Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:50:58.735458 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a640ef1a6eec4d609f2f7fa57a303176", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a640ef1a6eec4d609f2f7fa57a303176"}]}] Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ea96ae54eb049cb8fa307c7d83ae012 Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'n-d-854653-7'} Nov 03 03:50:58.736649 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:58.737385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 03 03:50:58.738366 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.740844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab6ff072-60c8-4460-a46f-b8d97ea0715c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:58.740844 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab6ff072-60c8-4460-a46f-b8d97ea0715c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854653-7/reboot" status: 403 len: 111 microversion: 2.1 time: 0.012065 Nov 03 03:50:58.742353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-66ee50a2-0074-4a90-a8f5-839985219f21 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.743136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 43/97] 10.222.0.30 () {58 vars in 1188 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/os-hosts/n-d-854653-7/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:58.750829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-baecb5c5-ff35-4526-8fd7-ec4a206f9c9b tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Calling method '.version_select at 0x7ff7f9f7a0d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.777432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-baecb5c5-ff35-4526-8fd7-ec4a206f9c9b tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-baecb5c5-ff35-4526-8fd7-ec4a206f9c9b tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:58.782057 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'nonexistent_hostname'} Nov 03 03:50:58.783166 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:50:58.783824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 03 03:50:58.785323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:58.786324 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.788622 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-66ee50a2-0074-4a90-a8f5-839985219f21 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053298 Nov 03 03:50:58.788933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-baecb5c5-ff35-4526-8fd7-ec4a206f9c9b tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:58.792099 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-baecb5c5-ff35-4526-8fd7-ec4a206f9c9b tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.044953 Nov 03 03:50:58.795209 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 44/98] 10.222.0.30 () {58 vars in 1212 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:50:58.801123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 55/99] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:58.813715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b2a3118-cf7a-468e-b205-4d7718840f5d tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Calling method '.version_select at 0x7ff7f9ffb940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.813906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:58.814576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:58.815572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b2a3118-cf7a-468e-b205-4d7718840f5d tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7ea96ae54eb049cb8fa307c7d83ae012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a640ef1a6eec4d609f2f7fa57a303176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b2a3118-cf7a-468e-b205-4d7718840f5d tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Request method failure captured: Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hosts/n-d-854653-7 HTTP/1.1 Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqgdVGzG3HNG3gSUaaAz4V2t14K127lc5D__b0fY4AaJoO4fuOSBsA9hU7hi5sOAScGI_ufQX0jXB9QeFTCVa7ERdDj11EAcHYorWUB3R3BKxdF5RB083S2GjtYzLH7ZLhLz6ganOJKQ2lgYvY2HY8ddQ4ZLESGy8X6GjSCAZKusa4 Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:50:58.817512 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a640ef1a6eec4d609f2f7fa57a303176", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a640ef1a6eec4d609f2f7fa57a303176"}]}] Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ea96ae54eb049cb8fa307c7d83ae012 Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'n-d-854653-7'} Nov 03 03:50:58.818863 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:58.819672 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 03 03:50:58.820835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:58.828206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b2a3118-cf7a-468e-b205-4d7718840f5d tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:58.828206 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b2a3118-cf7a-468e-b205-4d7718840f5d tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854653-7" status: 403 len: 109 microversion: 2.1 time: 0.015967 Nov 03 03:50:58.828206 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 56/100] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/os-hosts/n-d-854653-7 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:58.828206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11eb5b82-9b1f-4cd1-a1bc-37ff16847fde tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-945925772", "id": 2127706009, "os-flavor-access:is_public": "False"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:58.831420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:58.832037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:58.833045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:58.833604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:58.834194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:58.834756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:58.979966 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11eb5b82-9b1f-4cd1-a1bc-37ff16847fde tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.158975 Nov 03 03:50:58.980805 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 57/101] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:58.999048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1017d3ad-b577-4c25-b5f8-bca1b7cbab86 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Calling method '.version_select at 0x7ff7fa10a8b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.015986 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-1017d3ad-b577-4c25-b5f8-bca1b7cbab86 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1017d3ad-b577-4c25-b5f8-bca1b7cbab86 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:50:59.020815 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'nonexistent_hostname'} Nov 03 03:50:59.021967 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.022846 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.024003 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.028809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1017d3ad-b577-4c25-b5f8-bca1b7cbab86 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.031419 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1017d3ad-b577-4c25-b5f8-bca1b7cbab86 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.047249 Nov 03 03:50:59.035590 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 58/102] 10.222.0.30 () {58 vars in 1191 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:50:59.043949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9f80ade-a31c-4862-bede-7c03c73a53b4 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.094066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c9f80ade-a31c-4862-bede-7c03c73a53b4 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056977 Nov 03 03:50:59.094888 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 59/103] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:59.100597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba9d9f20-26a2-4261-8b21-4736ae64677b tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Calling method '.version_select at 0x7ff7fa0479d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.107382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba9d9f20-26a2-4261-8b21-4736ae64677b tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7ea96ae54eb049cb8fa307c7d83ae012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a640ef1a6eec4d609f2f7fa57a303176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba9d9f20-26a2-4261-8b21-4736ae64677b tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Request method failure captured: Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hosts/n-d-854653-7/shutdown HTTP/1.1 Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqgdVGzG3HNG3gSUaaAz4V2t14K127lc5D__b0fY4AaJoO4fuOSBsA9hU7hi5sOAScGI_ufQX0jXB9QeFTCVa7ERdDj11EAcHYorWUB3R3BKxdF5RB083S2GjtYzLH7ZLhLz6ganOJKQ2lgYvY2HY8ddQ4ZLESGy8X6GjSCAZKusa4 Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:50:59.112312 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a640ef1a6eec4d609f2f7fa57a303176", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a640ef1a6eec4d609f2f7fa57a303176"}]}] Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ea96ae54eb049cb8fa307c7d83ae012 Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'n-d-854653-7'} Nov 03 03:50:59.113577 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:59.114234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 03 03:50:59.115240 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.117569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba9d9f20-26a2-4261-8b21-4736ae64677b tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.118647 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba9d9f20-26a2-4261-8b21-4736ae64677b tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854653-7/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.022636 Nov 03 03:50:59.119551 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 60/104] 10.222.0.30 () {58 vars in 1194 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/os-hosts/n-d-854653-7/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:59.131679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f978913-41f1-4d85-be1d-6782eedc627f tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.185135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f978913-41f1-4d85-be1d-6782eedc627f tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061719 Nov 03 03:50:59.190825 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 61/105] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:59.207248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5027f437-3595-45d5-bc14-b7cbbce9a2ce tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Calling method '.version_select at 0x7ff7f9fbb280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.232748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-5027f437-3595-45d5-bc14-b7cbbce9a2ce tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5027f437-3595-45d5-bc14-b7cbbce9a2ce tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:50:59.239039 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'nonexistent_hostname'} Nov 03 03:50:59.248389 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:50:59.249550 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 03 03:50:59.250523 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5027f437-3595-45d5-bc14-b7cbbce9a2ce tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5027f437-3595-45d5-bc14-b7cbbce9a2ce tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.050468 Nov 03 03:50:59.251458 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 62/106] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:50:59.259743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:59.260301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e5cd8058-f410-46b3-b426-b7d94505bda3 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.300230 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91186acc-e6ca-4de7-a00f-a042f5489d71 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1295 microversion: 2.1 time: 0.503673 Nov 03 03:50:59.309220 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 45/107] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:58 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1295 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:59.332127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b2f0e2f-f0a8-426b-835d-4d6e0284ab1c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Calling method '.version_select at 0x7ff7f9f1e820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.338230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0b2f0e2f-f0a8-426b-835d-4d6e0284ab1c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7ea96ae54eb049cb8fa307c7d83ae012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a640ef1a6eec4d609f2f7fa57a303176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b2f0e2f-f0a8-426b-835d-4d6e0284ab1c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Request method failure captured: Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hosts/n-d-854653-7/startup HTTP/1.1 Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqgdVGzG3HNG3gSUaaAz4V2t14K127lc5D__b0fY4AaJoO4fuOSBsA9hU7hi5sOAScGI_ufQX0jXB9QeFTCVa7ERdDj11EAcHYorWUB3R3BKxdF5RB083S2GjtYzLH7ZLhLz6ganOJKQ2lgYvY2HY8ddQ4ZLESGy8X6GjSCAZKusa4 Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:50:59.342579 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a640ef1a6eec4d609f2f7fa57a303176", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a640ef1a6eec4d609f2f7fa57a303176"}]}] Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ea96ae54eb049cb8fa307c7d83ae012 Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'n-d-854653-7'} Nov 03 03:50:59.343724 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:59.344391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 03 03:50:59.345395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.349900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b2f0e2f-f0a8-426b-835d-4d6e0284ab1c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.351713 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b2f0e2f-f0a8-426b-835d-4d6e0284ab1c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-d-854653-7/startup" status: 403 len: 110 microversion: 2.1 time: 0.040608 Nov 03 03:50:59.354378 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 46/108] 10.222.0.30 () {58 vars in 1191 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/os-hosts/n-d-854653-7/startup => generated 110 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:59.377587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdcceb17-ac9c-40c8-8ccd-4bbbafe47d06 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Calling method '.version_select at 0x7ff7f9e6f820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.383827 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e5cd8058-f410-46b3-b426-b7d94505bda3 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2127706009" status: 202 len: 0 microversion: 2.1 time: 0.138963 Nov 03 03:50:59.393162 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 63/109] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:50:59 2022] DELETE /compute/v2.1/flavors/2127706009 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:50:59.401107 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-cdcceb17-ac9c-40c8-8ccd-4bbbafe47d06 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.401506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44973198-bb39-4784-afb6-f27cb1f40b25 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdcceb17-ac9c-40c8-8ccd-4bbbafe47d06 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:59.403520 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'nonexistent_hostname'} Nov 03 03:50:59.404648 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:50:59.405490 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 03 03:50:59.406420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.407344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.409040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdcceb17-ac9c-40c8-8ccd-4bbbafe47d06 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.410053 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cdcceb17-ac9c-40c8-8ccd-4bbbafe47d06 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.052011 Nov 03 03:50:59.412723 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 47/110] 10.222.0.30 () {58 vars in 1215 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:50:59.423183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61c20ebc-f7d5-4393-805c-e189482fe6f8 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9f1e9d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61c20ebc-f7d5-4393-805c-e189482fe6f8 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-hosts/n-d-854653-7 HTTP/1.1 Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 51 Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:59.432717 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: {"status": "enable", "maintenance_mode": "invalid"} Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:59.439882 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'n-d-854653-7', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'disable', Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'Enable', Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'Disable', Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance: Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'invalid' Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.440842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.442554 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.444302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.444302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:50:59.444302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:50:59.444302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.444302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.444302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61c20ebc-f7d5-4393-805c-e189482fe6f8 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.450923 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61c20ebc-f7d5-4393-805c-e189482fe6f8 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854653-7" status: 400 len: 199 microversion: 2.1 time: 0.032013 Nov 03 03:50:59.453208 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 48/111] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:50:59 2022] PUT /compute/v2.1/os-hosts/n-d-854653-7 => generated 199 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:50:59.472897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c04537b-e188-4b8f-87e7-da6e49c16564 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9dc0550>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:59.491834 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44973198-bb39-4784-afb6-f27cb1f40b25 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.092936 Nov 03 03:50:59.492722 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 64/112] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c04537b-e188-4b8f-87e7-da6e49c16564 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-hosts/n-d-854653-7 HTTP/1.1 Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 51 Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:59.495127 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: {"status": "invalid", "maintenance_mode": "enable"} Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:59.496241 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'n-d-854653-7', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'disable', Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'Enable', Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'Disable', Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance: Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'invalid' Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.496909 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.498338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.500346 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.500346 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:50:59.500346 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:50:59.500346 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 03 03:50:59.500346 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.503517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c04537b-e188-4b8f-87e7-da6e49c16564 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.505457 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c04537b-e188-4b8f-87e7-da6e49c16564 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854653-7" status: 400 len: 189 microversion: 2.1 time: 0.043956 Nov 03 03:50:59.512782 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 49/113] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:50:59 2022] PUT /compute/v2.1/os-hosts/n-d-854653-7 => generated 189 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:50:59.525640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eebc195d-b099-4ea7-86d2-98b5dbc9880c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Action: 'update', calling method: .version_select at 0x7ff7f9f1e670>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:59.525827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1537b3ab-448b-4113-b689-3bd33f3270a2 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-422906536", "id": 1371716637, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:59.542468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eebc195d-b099-4ea7-86d2-98b5dbc9880c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7ea96ae54eb049cb8fa307c7d83ae012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a640ef1a6eec4d609f2f7fa57a303176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eebc195d-b099-4ea7-86d2-98b5dbc9880c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Request method failure captured: Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-hosts/n-d-854653-7 HTTP/1.1 Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 50 Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqgdVGzG3HNG3gSUaaAz4V2t14K127lc5D__b0fY4AaJoO4fuOSBsA9hU7hi5sOAScGI_ufQX0jXB9QeFTCVa7ERdDj11EAcHYorWUB3R3BKxdF5RB083S2GjtYzLH7ZLhLz6ganOJKQ2lgYvY2HY8ddQ4ZLESGy8X6GjSCAZKusa4 Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:50:59.544644 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a640ef1a6eec4d609f2f7fa57a303176", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a640ef1a6eec4d609f2f7fa57a303176"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a640ef1a6eec4d609f2f7fa57a303176"}]}] Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a640ef1a6eec4d609f2f7fa57a303176 Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1329115035 Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ea96ae54eb049cb8fa307c7d83ae012 Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1329115035-project Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: {"status": "enable", "maintenance_mode": "enable"} Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 03 03:50:59.545813 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'n-d-854653-7', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:59.546528 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 03 03:50:59.547513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.554036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eebc195d-b099-4ea7-86d2-98b5dbc9880c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.556822 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eebc195d-b099-4ea7-86d2-98b5dbc9880c tempest-HostsAdminNegativeTestJSON-1329115035 tempest-HostsAdminNegativeTestJSON-1329115035-project] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854653-7" status: 403 len: 111 microversion: 2.1 time: 0.035997 Nov 03 03:50:59.568839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 50/114] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:50:59 2022] PUT /compute/v2.1/os-hosts/n-d-854653-7 => generated 111 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:50:59.582956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ff94a41-be05-4722-aaec-3160cb871516 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9dda4c0>, body: {"status": null, "maintenance_mode": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ff94a41-be05-4722-aaec-3160cb871516 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-hosts/n-d-854653-7 HTTP/1.1 Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 42 Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:59.591451 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: {"status": null, "maintenance_mode": null} Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 03 03:50:59.596091 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'n-d-854653-7', 'body': {'status': None, 'maintenance_mode': None}} Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'disable', Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'Enable', Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'Disable', Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance: Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi None Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.597086 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.599615 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.600952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:50:59.600952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:50:59.600952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 03 03:50:59.600952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.600952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ff94a41-be05-4722-aaec-3160cb871516 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.602321 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0ff94a41-be05-4722-aaec-3160cb871516 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/n-d-854653-7" status: 400 len: 127 microversion: 2.1 time: 0.026602 Nov 03 03:50:59.603408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 51/115] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:50:59 2022] PUT /compute/v2.1/os-hosts/n-d-854653-7 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:50:59.613246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b3396f6-001b-4eef-baa5-bbe736905388 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9f91b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:50:59.617201 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.hosts [None req-0b3396f6-001b-4eef-baa5-bbe736905388 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Enabling host nonexistent_hostname. Nov 03 03:50:59.627838 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-0b3396f6-001b-4eef-baa5-bbe736905388 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b3396f6-001b-4eef-baa5-bbe736905388 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Request method failure captured: Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 50 Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqhZXqoNQrRA3nixNJDOmk7Y0Z0CyzKsC1VhqJIOqCa0A-M8LlSGk_iZsU_-l-ib6mgXs7KC4h24hIaNO0N18Yg1Xu4WcZOMjzP4Yqo6ndQNQHaLAS3pwdb2RHJLXtwgdggmZ5xKXx6aEZBeLhMscgeGy_YtIMMPwIAMTpdGVLtb5o Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:50:59.629814 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8625a54525194cd3b3d46b5462410936", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8625a54525194cd3b3d46b5462410936"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8625a54525194cd3b3d46b5462410936"}]}] Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 8625a54525194cd3b3d46b5462410936 Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1608482582 Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7604bdcd44d84d3d97a6cd19b3cfbbd4 Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1608482582-project-admin Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: {"status": "enable", "maintenance_mode": "enable"} Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.631162 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 03 03:50:59.632009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:50:59.644003 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 03 03:50:59.645234 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:50:59.649034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b3396f6-001b-4eef-baa5-bbe736905388 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:50:59.655083 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b3396f6-001b-4eef-baa5-bbe736905388 tempest-HostsAdminNegativeTestJSON-1608482582 tempest-HostsAdminNegativeTestJSON-1608482582-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.040830 Nov 03 03:50:59.655785 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 52/116] 10.222.0.30 () {60 vars in 1211 bytes} [Thu Nov 3 03:50:59 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 03 03:50:59.658271 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1537b3ab-448b-4113-b689-3bd33f3270a2 tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.137704 Nov 03 03:50:59.669875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.670801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:50:59.677996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:59.678796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:59.682326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:59.682326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:50:59.682326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:50:59.682326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:50:59.692549 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 65/117] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:50:59 2022] POST /compute/v2.1/flavors => generated 413 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:50:59.720556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cfc374b7-8edc-460f-8451-123989f87c2b tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:50:59.834129 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cfc374b7-8edc-460f-8451-123989f87c2b tempest-FlavorsAdminTestJSON-1025742851 tempest-FlavorsAdminTestJSON-1025742851-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.140299 Nov 03 03:50:59.856652 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 66/118] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:50:59.880164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48858570-61a1-42bb-bfb4-2332ade558fd tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:00.005817 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48858570-61a1-42bb-bfb4-2332ade558fd tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1371716637" status: 202 len: 0 microversion: 2.1 time: 0.129155 Nov 03 03:51:00.006566 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 67/119] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:50:59 2022] DELETE /compute/v2.1/flavors/1371716637 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:51:00.016920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-032d22e8-48ee-4d83-8817-425f12a87b4f tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:00.023234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:00.041541 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40132952-c03b-45b4-bc87-ba54b6c1d868 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1224 microversion: 2.1 time: 0.377095 Nov 03 03:51:00.042190 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 53/120] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:50:59 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1224 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:00.122407 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-032d22e8-48ee-4d83-8817-425f12a87b4f tempest-FlavorsAdminTestJSON-621526858 tempest-FlavorsAdminTestJSON-621526858-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.107926 Nov 03 03:51:00.130667 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 68/121] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:00.339713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:00.340918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:00.371520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:00.372397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:00.373280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:00.374212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:00.380490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:00.402647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:01.073594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:01.076097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:01.099980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:01.102743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:01.103812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:01.105898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:01.106866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:01.111143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:01.139008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:01.148192 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bd18faa-b083-4bd4-8e6e-260b170cdbc8 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.819636 Nov 03 03:51:01.153299 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 54/122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:00 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:01.550267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:01.565720 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-67bff5cb-37f3-4f4d-a5dd-f28cfd71b359 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1272 microversion: 2.1 time: 0.497615 Nov 03 03:51:01.566574 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 69/123] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:01 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1272 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:02.185433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:02.186268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:02.198661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:02.200085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:02.200683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:02.203487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:02.210302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:02.211271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:02.624356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:02.624356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:02.645427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:02.645427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:02.645427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:02.645427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:02.645736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:02.645736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:02.918432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:02.935090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-67afe9a7-299e-40c6-8ad6-106f120469aa tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1278 microversion: 2.1 time: 0.343168 Nov 03 03:51:02.950910 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 70/124] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:02 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1278 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:03.189667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:03.213485 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b46fba1-fcb1-4f03-af51-ca644d8fce82 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 1.032963 Nov 03 03:51:03.214663 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 55/125] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:02 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:03.961280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:03.964117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:03.979825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:03.982871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:03.983825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:03.984970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:03.987161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:03.988513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:04.242356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:04.242969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:04.302330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:04.307758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:04.308373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:04.320895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:04.327895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:04.337365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:04.337830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:04.349043 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-925a3e85-89f9-465f-865c-4f1bd20e3a28 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1278 microversion: 2.1 time: 0.393137 Nov 03 03:51:04.361698 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 71/126] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:03 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1278 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:05.090625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:05.099236 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ead1c948-ed92-4a0e-bc29-c83b92747a8e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.862119 Nov 03 03:51:05.104204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 56/127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:04 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:05.374499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:05.379060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:05.394738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:05.404607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:05.405253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:05.409886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:05.410644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:05.412777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:05.777832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:05.793060 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9d756ce3-59dc-4303-aae3-2e8158e1bd4e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1278 microversion: 2.1 time: 0.422461 Nov 03 03:51:05.797742 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 72/128] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:05 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1278 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:06.010278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2cd886f1-aaf4-496a-b5a5-a545b2e3931b req-4615d109-b07f-43bb-8230-cd4eb14aae74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1c14ed-9f5b-4141-8cba-4cfeea85fc87", "tag": "9f6d8911-cbc9-4030-8fcb-7d2691870f30"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:06.050207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2cd886f1-aaf4-496a-b5a5-a545b2e3931b req-4615d109-b07f-43bb-8230-cd4eb14aae74 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.050792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2cd886f1-aaf4-496a-b5a5-a545b2e3931b req-4615d109-b07f-43bb-8230-cd4eb14aae74 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.051345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2cd886f1-aaf4-496a-b5a5-a545b2e3931b req-4615d109-b07f-43bb-8230-cd4eb14aae74 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.121918 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2cd886f1-aaf4-496a-b5a5-a545b2e3931b req-4615d109-b07f-43bb-8230-cd4eb14aae74 service nova] Creating event network-changed:9f6d8911-cbc9-4030-8fcb-7d2691870f30 for instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 on n-h2-854653-7 Nov 03 03:51:06.122983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2cd886f1-aaf4-496a-b5a5-a545b2e3931b req-4615d109-b07f-43bb-8230-cd4eb14aae74 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:51:06.124924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2cd886f1-aaf4-496a-b5a5-a545b2e3931b req-4615d109-b07f-43bb-8230-cd4eb14aae74 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:51:06.126033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:06.129693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:06.129817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.129817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.130657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.131671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.133535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.134896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.145340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.145865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.146311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.154592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.155403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.158463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.167376 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.rpcapi [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 03 03:51:06.168840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] Releasing lock "compute-rpcapi-router" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:51:06.206406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9622a72d-da93-40b4-a05d-a474b0f8de82 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.536192 Nov 03 03:51:06.210287 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 57/129] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:06.678982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7f9dc0430>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:06.687212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.688353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.691679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.742384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=79,nova_api:DELETE=13 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:06.754440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.755102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.757005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.784216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.787166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.787677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.805431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:06.810586 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab7ea736-4daf-42e5-8cea-2330619969bd tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.366595 Nov 03 03:51:06.814373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 58/130] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:06.821676 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6108d251-90fa-42a9-aa6e-3bff86461f6f tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.699461 Nov 03 03:51:06.822397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 73/131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:06 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:06.831501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7f9fbba60>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:06.834883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:06.836792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:06.837083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.837700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.838385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.866580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:06.868214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.869259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.869504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.870246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.871424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.876612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.880988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.884366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.884843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.887531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.888034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.889124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.902991 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7afb0338-2fbc-44a9-a693-f87f411db97b tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.078672 Nov 03 03:51:06.903968 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 74/132] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Nov 3 03:51:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:06.933367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7f9fbb310>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:06.938151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.939441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.940322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.975088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.975593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.976131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:06.992053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:06.992629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:06.994129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.002285 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be7f687f-f7d2-4550-b62a-9642cf5b336e tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085189 Nov 03 03:51:07.005796 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 75/133] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:07.013285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7fa01b4c0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:07.032484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.035585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.041697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.111629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.111629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.111629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.126414 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a432179-5127-4b67-9495-768a10e41753 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.116485 Nov 03 03:51:07.134355 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 76/134] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:07.154222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71367725-9603-4745-aec8-b292b106bd2c tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7f9fbbee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:07.156120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71367725-9603-4745-aec8-b292b106bd2c tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.156779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71367725-9603-4745-aec8-b292b106bd2c tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.157463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71367725-9603-4745-aec8-b292b106bd2c tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.197125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71367725-9603-4745-aec8-b292b106bd2c tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.053774 Nov 03 03:51:07.199283 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 77/135] 10.222.0.30 () {58 vars in 1179 bytes} [Thu Nov 3 03:51:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:07.215149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7f9fbb5e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:07.216970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.217721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.218366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.256524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.257139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.257654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.282392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.283006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.283585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.297883 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-099d861b-4461-42c8-b216-89f3afb2ccf6 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.087116 Nov 03 03:51:07.307913 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 78/136] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:07.312899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7f9fbbaf0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:07.314824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.315376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.315885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.341494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.342076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.342639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.350808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f52fa98a-a672-40fc-9d08-4291af7afdd4 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.041564 Nov 03 03:51:07.362236 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 79/137] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:07.367814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7fa01b700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:07.370508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.371243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.371769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.405334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.407696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.408247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.426366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0c4495fe-cac0-449b-ab64-927185f37a5a tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.062361 Nov 03 03:51:07.437628 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 80/138] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:07 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:07.450211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Calling method '.version_select at 0x7ff7f9f30f70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:07.452924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.455227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.455884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.499754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.502438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.502944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.546731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.547913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.548684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.571951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:51:07.577508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b06ff1d-3dc5-4d2f-a453-760c261314a0 tempest-HypervisorAdminTestJSON-503845749 tempest-HypervisorAdminTestJSON-503845749-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:51:07.581473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.582177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.584632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.587301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.590377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.593231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.638259 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.compute.rpcapi [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 03 03:51:07.641288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:51:07.714646 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-296b6efd-7c3c-408a-8af3-39d6da7d79d4 None None] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.269544 Nov 03 03:51:07.722197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 81/139] 10.222.0.30 () {58 vars in 1173 bytes} [Thu Nov 3 03:51:07 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:07.848485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:07.849858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:07.878248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.881113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.882144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.884767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:07.886569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:07.890433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:07.989407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:08.319571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:08.339566 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b7ef595-418f-4595-9158-8c1074e5c21b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 1.519104 Nov 03 03:51:08.357034 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 59/140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:06 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:08.595550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=12 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:08.686396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:08.703520 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a528aa6b-a67c-436b-889c-7089cdb1631e tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.853035 Nov 03 03:51:08.724032 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 82/141] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:07 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:09.370191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:09.370191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:09.395152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:09.395880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:09.398743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:09.404081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:09.405907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:09.409344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:10.039205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:10.054126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6c0f560-476d-4ff7-a6c4-85db98614a80 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.693602 Nov 03 03:51:10.055096 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 83/142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:09 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:10.062125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:10.062763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:10.086480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:10.089600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:10.090062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:10.090813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:10.091275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:10.091703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:10.319961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:10.334058 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5bc8e0a6-461c-45ed-900f-6853e926b574 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.277149 Nov 03 03:51:10.335099 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 84/143] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:10 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:10.362983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af15818f-22e6-4cda-909e-a26fe1692ea1 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:10.377281 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af15818f-22e6-4cda-909e-a26fe1692ea1 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 1.127851 Nov 03 03:51:10.380295 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 60/144] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:51:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:11.082803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:11.083682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:11.096469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d08b92d-6b11-40e9-992e-03f68688518f tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-518474603", "id": 896420650, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:11.098449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:11.099334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:11.099829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:11.100516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:11.103056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:11.104093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:11.112500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=12,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:11.194462 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d08b92d-6b11-40e9-992e-03f68688518f tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.804645 Nov 03 03:51:11.207155 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 85/145] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:51:10 2022] POST /compute/v2.1/flavors => generated 421 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:11.223867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d7ba88a7-aace-464d-bacb-296984dd2274 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:11.257595 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d7ba88a7-aace-464d-bacb-296984dd2274 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.043043 Nov 03 03:51:11.258410 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 86/146] 10.222.0.30 () {58 vars in 1182 bytes} [Thu Nov 3 03:51:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:51:11.268997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff88c158-cc7c-42bc-a0ca-3fa60a8e8c69 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1211778659", "id": 1116629624, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:11.393706 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff88c158-cc7c-42bc-a0ca-3fa60a8e8c69 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.128682 Nov 03 03:51:11.395320 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 87/147] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:51:11 2022] POST /compute/v2.1/flavors => generated 425 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:11.402779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:11.407645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:11.424100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:11.426212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:11.429149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:11.430156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:11.431599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:11.433176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:11.488209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:11.500659 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-656efe39-9666-4abc-92ce-bfc555584f56 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.424206 Nov 03 03:51:11.514498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 61/148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:11 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:11.525206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a98bae42-df26-48ce-938c-eb58fad96d57 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:11.533692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a98bae42-df26-48ce-938c-eb58fad96d57 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017782 Nov 03 03:51:11.544710 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 62/149] 10.222.0.30 () {58 vars in 1182 bytes} [Thu Nov 3 03:51:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:51:11.550087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02a2bd96-9505-4371-89a3-21a596e20b07 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Action: 'create', calling method: .version_select at 0x7ff7f9dda550>, body: {"keypair": {"name": "tempest-keypair-1985294686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIq1auSEabrRl03aj/ncdN74zFxQ/sapJJmvS1fbmnW/N2SdOcyYX+bplyyLi5qmZHWXa/yc/Dpw7UTGh3V8Ra/AshuqUSxJoO/pfHnLYHBk6J5jnZ2MnDyDMRIUYmXNA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:11.586588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-02a2bd96-9505-4371-89a3-21a596e20b07 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Getting quotas for project 35c9981944fe4698a48bf702c1e3ac11. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:11.600243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-02a2bd96-9505-4371-89a3-21a596e20b07 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Getting quotas for user d53f1a53065b47ddbea35b4008884c58 and project 35c9981944fe4698a48bf702c1e3ac11. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:11.699814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02a2bd96-9505-4371-89a3-21a596e20b07 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.153475 Nov 03 03:51:11.707938 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 63/150] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:51:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:12.362080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:12.396362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b3183fe-5d1a-4e20-ab56-eddf04a3daca tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.999552 Nov 03 03:51:12.396955 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 88/151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:11 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:12.532046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:12.533285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:12.544570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:12.545487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:12.546314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:12.547391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:12.548088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:12.549925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:12.572426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d8a467df-4679-41c9-952a-f3f23eae8fe9 req-271061dc-3246-4f41-a915-eafcdd9360f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1866da2-dbbd-466c-b1f8-16cafbecc86d", "tag": "1cca0579-a65e-45b3-b8ee-a3c0b38225d6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:12.596635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d8a467df-4679-41c9-952a-f3f23eae8fe9 req-271061dc-3246-4f41-a915-eafcdd9360f9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:12.598891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d8a467df-4679-41c9-952a-f3f23eae8fe9 req-271061dc-3246-4f41-a915-eafcdd9360f9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:12.600226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d8a467df-4679-41c9-952a-f3f23eae8fe9 req-271061dc-3246-4f41-a915-eafcdd9360f9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:12.632802 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d8a467df-4679-41c9-952a-f3f23eae8fe9 req-271061dc-3246-4f41-a915-eafcdd9360f9 service nova] Creating event network-changed:1cca0579-a65e-45b3-b8ee-a3c0b38225d6 for instance c1866da2-dbbd-466c-b1f8-16cafbecc86d on n-h1-854653-7 Nov 03 03:51:12.645333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d8a467df-4679-41c9-952a-f3f23eae8fe9 req-271061dc-3246-4f41-a915-eafcdd9360f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.701752 Nov 03 03:51:12.647771 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 64/152] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:13.084791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:13.096180 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-175e4fe8-3355-44d1-887a-dc075daac61b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.572737 Nov 03 03:51:13.104867 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 89/153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:12 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:13.426174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:13.426174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:13.446291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:13.446788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:13.454290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:13.461619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:13.462957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:13.463470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:14.124230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:14.124859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:14.136987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:14.143692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:14.144474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:14.144940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:14.145728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:14.146194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:14.150730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:14.180916 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28169978-e0a5-4fd1-912d-439dd3d37843 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.759085 Nov 03 03:51:14.187019 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 65/154] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:13 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:14.518055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:14.529164 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5cd50cb8-fe71-457f-b62e-c2eb39ff30ea tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.409125 Nov 03 03:51:14.546649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 90/155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:14 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:15.200780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9e6fb80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:15.206086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.209868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.214742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.215403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:15.221623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.221763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:15.221856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.221856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.232764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.233561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.234408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.235394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.235992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.238333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.269702 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f6bc490-b818-4813-bea4-1680afab1e87 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.517595 Nov 03 03:51:15.270423 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 66/156] 10.222.0.30 () {58 vars in 1128 bytes} [Thu Nov 3 03:51:14 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:15.285565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9dc0dc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:15.293661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.304278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.305085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.307016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.307977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.308592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.376326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d12070d-b6aa-44b4-a62c-ea0f2ef04e6b tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.096100 Nov 03 03:51:15.388183 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 67/157] 10.222.0.30 () {58 vars in 1139 bytes} [Thu Nov 3 03:51:15 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:15.398061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9e6fb80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:15.407027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.409257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.412507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.413577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.414486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.415992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.475660 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b32f33a5-52c2-4f2f-9710-ad9e6dc5883a tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.085715 Nov 03 03:51:15.476269 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 68/158] 10.222.0.30 () {58 vars in 1145 bytes} [Thu Nov 3 03:51:15 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:51:15.545491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:15.559194 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d844a05b-620f-4a49-851e-7b8162de0e9b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.348716 Nov 03 03:51:15.559406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:15.559837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:15.560342 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 91/159] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:15 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:15.569167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.569664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.570106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:15.570870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:15.571821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:15.572250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:16.049406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:16.060119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-615720952", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "1116629624", "adminPass": "***", "networks": [{"uuid": "6386c4cb-701d-4e59-9cf8-c0588876f4e7"}], "security_groups": [{"name": "tempest-securitygroup--795720748"}], "key_name": "tempest-keypair-1985294686", "user_data": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:16.068979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12c25f42-4660-4b62-b2db-5811ad71bbe4 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.514178 Nov 03 03:51:16.069793 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 69/160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:15 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:16.293331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] validate_networks() for [('6386c4cb-701d-4e59-9cf8-c0588876f4e7', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:51:16.947188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fda45c5f-1609-42bf-890b-cb9b53f700f7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Action: 'create', calling method: .version_select at 0x7ff7f9dc0700>, body: {"keypair": {"name": "tempest-keypair-1535589622", "type": "ssh", "user_id": "e416ee042e7e4e9088ac4f530b88bc00", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyOGHFinnlEmC8YNPPg32/uTh2sYVmplb7wOTXsXrF4RK+MRE/FSfb1MAUM2q7o6v1zWq6Y+MiVqGtL6SH8CAobb7mrZTc54aimt8p3RD45SLhmfs+W+uve2Mg4XuwHgA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:16.975527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-fda45c5f-1609-42bf-890b-cb9b53f700f7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Getting quotas for project 66df388880cc4068a9007ec19f54dfc6. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:16.981628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-fda45c5f-1609-42bf-890b-cb9b53f700f7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Getting quotas for user 4ebb4a3276f04caa9d03805e5fec545b and project 66df388880cc4068a9007ec19f54dfc6. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:17.111216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fda45c5f-1609-42bf-890b-cb9b53f700f7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.621759 Nov 03 03:51:17.111874 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 70/161] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 03:51:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 623 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 03:51:17.117142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:17.117809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:17.142033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:17.144736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:17.145225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:17.153814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:17.154756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:17.155342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:17.195177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=81 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:17.462161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:17.480324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-00ff032a-8443-4335-bc8b-cbb75ef6388b tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.367195 Nov 03 03:51:17.480949 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 71/162] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:17 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:17.619087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:17.673788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:51:17.673788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:51:17.673788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:51:17.673788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:51:17.673788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:51:17.674319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:17.674319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:17.674319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:17.674922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:17.675427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:17.675874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:17.702443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Getting quotas for project 35c9981944fe4698a48bf702c1e3ac11. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:17.711628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Getting quotas for user d53f1a53065b47ddbea35b4008884c58 and project 35c9981944fe4698a48bf702c1e3ac11. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:17.731943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:51:17.731943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:51:17.814306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-274a1929-4824-41cc-89bd-b72862e90954 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2007852276", "ram": 512, "vcpus": 1, "disk": 10, "id": 1494821289, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:18.806355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-274a1929-4824-41cc-89bd-b72862e90954 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.321955 Nov 03 03:51:18.811494 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 72/163] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:51:17 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:18.813826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:18.814450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:18.815551 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41b1d6cc-02cd-471e-875b-ea8bc1eb827a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.761095 Nov 03 03:51:18.820987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:18.821502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:18.821944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:18.822944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:18.823543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:18.823974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:18.824163 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 92/164] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:51:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:51:18.829767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14e59285-a332-454f-8b36-6f8e54abbf65 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Action: 'create', calling method: .version_select at 0x7ff7f9f301f0>, body: {"keypair": {"name": "tempest-keypair-1332156469", "type": "ssh", "user_id": "e416ee042e7e4e9088ac4f530b88bc00", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPdQrrTRxqb9hzKPs0xs0s2Rl6iXuU3LUDAqjisUFLjUzcPmt3zvdSXPxLC77fvk+9WRffXFyjP2upa0tGbzSmKZPIDzWffGiIe3x95EaLg4TZVZchwFP3H0x7TFvW2LQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:18.859723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-14e59285-a332-454f-8b36-6f8e54abbf65 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Getting quotas for project 66df388880cc4068a9007ec19f54dfc6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:18.864839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-14e59285-a332-454f-8b36-6f8e54abbf65 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Getting quotas for user 4ebb4a3276f04caa9d03805e5fec545b and project 66df388880cc4068a9007ec19f54dfc6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:18.949140 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14e59285-a332-454f-8b36-6f8e54abbf65 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.123385 Nov 03 03:51:18.950057 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 93/165] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 03:51:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 03:51:18.973809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:18.982594 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d78dac6b-0ab3-4531-a9e0-1056d2a4aff7 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.174624 Nov 03 03:51:18.983268 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 73/166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:18 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:18.990503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:18.991182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:18.997490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:18.998083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:18.998536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.007587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.008090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.008576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.096584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Calling method '.version_select at 0x7ff7f9fbbdc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.100629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.101214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.101717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.119743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.120219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.120663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.153824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.154317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.154760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.165851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.166341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.166786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.185738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.186359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.186673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.193482 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a92b0fa2-4d5a-49e1-a98d-40ed1f9091cd tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.242268 Nov 03 03:51:19.194299 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 94/167] 10.222.0.30 () {60 vars in 1243 bytes} [Thu Nov 3 03:51:18 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:51:19.215112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:19.223043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1485d29a-a7ff-4cb5-b315-d477e739a161 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.238905 Nov 03 03:51:19.225363 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 74/168] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:18 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:19.228616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cece16b3-5f1f-4411-acda-c643bb82ed4c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.229259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cece16b3-5f1f-4411-acda-c643bb82ed4c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:19.281252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cece16b3-5f1f-4411-acda-c643bb82ed4c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:19.288820 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cece16b3-5f1f-4411-acda-c643bb82ed4c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1264 microversion: 2.1 time: 0.063870 Nov 03 03:51:19.291582 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 75/169] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:19 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1264 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:19.299941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af35e34b-c9de-477e-a96a-f9f5adb19317 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Calling method '.version_select at 0x7ff7f9d770d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.312354 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af35e34b-c9de-477e-a96a-f9f5adb19317 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1535589622?user_id=e416ee042e7e4e9088ac4f530b88bc00" status: 200 len: 512 microversion: 2.10 time: 0.019616 Nov 03 03:51:19.312999 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 76/170] 10.222.0.30 () {60 vars in 1340 bytes} [Thu Nov 3 03:51:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1535589622?user_id=e416ee042e7e4e9088ac4f530b88bc00 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:19.314446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a851acac-820e-4b14-9591-862425f07e20 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.317816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Calling method '.version_select at 0x7ff7f9f1eaf0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.323195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.323469 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a851acac-820e-4b14-9591-862425f07e20 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] HTTP exception thrown: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.323678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.324173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a851acac-820e-4b14-9591-862425f07e20 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Request method failure captured: Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/flavors/1494821289/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqxcgXijY9szzX544lsk1e8PuZyx_X0iuDNH4IAkPhnTSnXzXGuqmz6HIwsBEOTnBOeP_YNSU6XdscUmZpyAypP93FqsUcf-AkzkTVYFu9O3hOSYXt_Vuc19BZ-eXK4vxsf7NPY4juZ1IADU69c_IWmeVfy8ITnzTZiKk8SGGOmn60 Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:51:19.325245 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2358654688b4f658f91fce013155815", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2358654688b4f658f91fce013155815"}]}] Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cee6ff43693c478087e78fdf6197b7a9 Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:19.326409 n-d-854653-7 devstack@n-api.service[127593]: exception: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'flavor_id': '1494821289', 'id': 'hw:cpu_thread_policy'} Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.327070 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a851acac-820e-4b14-9591-862425f07e20 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Returning 404 to user: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a851acac-820e-4b14-9591-862425f07e20 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] 10.222.0.30 "GET /compute/v2.1/flavors/1494821289/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.131391 Nov 03 03:51:19.328854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 95/171] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 03:51:19 2022] GET /compute/v2.1/flavors/1494821289/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:19.333470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-56a78071-095e-4def-80f1-3a1456ff36d7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Action: 'create', calling method: .version_select at 0x7ff7f9f0eee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1019628488", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+zmK+yYJN0l1jwdq9mF9qdMREFj6pFe0/+3J5/eRojBl41pCZaapv5wJ/95ncEsf35eu9s7d6KpfW6TiLfDmLH8u/STvJrvEnM1+u5RzGLMm6pX0c8tl4boi1IcmpE/Q=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:19.341265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.341749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.342180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.349119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-56a78071-095e-4def-80f1-3a1456ff36d7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Getting quotas for project 66df388880cc4068a9007ec19f54dfc6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:19.353416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-56a78071-095e-4def-80f1-3a1456ff36d7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Getting quotas for user 4ebb4a3276f04caa9d03805e5fec545b and project 66df388880cc4068a9007ec19f54dfc6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:19.374939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.375418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.375851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.385934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.386411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.386843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.405994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.405994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.406429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.412272 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1fd369ff-5ba2-4510-bedd-9b38da7d3629 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.098312 Nov 03 03:51:19.412835 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 77/172] 10.222.0.30 () {60 vars in 1222 bytes} [Thu Nov 3 03:51:19 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:19.417977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56beeba9-48a7-4210-80f2-6028dc221de9 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:19.421507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-56beeba9-48a7-4210-80f2-6028dc221de9 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'cee6ff43693c478087e78fdf6197b7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2358654688b4f658f91fce013155815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56beeba9-48a7-4210-80f2-6028dc221de9 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Request method failure captured: Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/flavors/1494821289/os-extra_specs HTTP/1.1 Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 66 Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqxcgXijY9szzX544lsk1e8PuZyx_X0iuDNH4IAkPhnTSnXzXGuqmz6HIwsBEOTnBOeP_YNSU6XdscUmZpyAypP93FqsUcf-AkzkTVYFu9O3hOSYXt_Vuc19BZ-eXK4vxsf7NPY4juZ1IADU69c_IWmeVfy8ITnzTZiKk8SGGOmn60 Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:19.423377 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2358654688b4f658f91fce013155815", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2358654688b4f658f91fce013155815"}]}] Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cee6ff43693c478087e78fdf6197b7a9 Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 03 03:51:19.424653 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'flavor_id': '1494821289', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:19.429397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 03 03:51:19.430696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.431950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56beeba9-48a7-4210-80f2-6028dc221de9 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:19.431950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-56beeba9-48a7-4210-80f2-6028dc221de9 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] 10.222.0.30 "POST /compute/v2.1/flavors/1494821289/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.010930 Nov 03 03:51:19.431950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 78/173] 10.222.0.30 () {60 vars in 1224 bytes} [Thu Nov 3 03:51:19 2022] POST /compute/v2.1/flavors/1494821289/os-extra_specs => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:19.431950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Calling method '.version_select at 0x7ff7f9ddadc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.433798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.436848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.436848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.437121 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-56a78071-095e-4def-80f1-3a1456ff36d7 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.107965 Nov 03 03:51:19.437121 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 96/174] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 03:51:19 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 03:51:19.441544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-046795d9-0ad5-40f6-a82b-16c76ef8b1c3 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:19.453427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:19.453902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:19.454341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:19.460223 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73ee859e-795e-4c9c-be17-ac82885ebb02 tempest-HypervisorAdminV253TestBase-1130540439 tempest-HypervisorAdminV253TestBase-1130540439-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/6e7934f1-7f6f-40fa-8cdf-da0f555f1256" status: 200 len: 792 microversion: 2.53 time: 0.033771 Nov 03 03:51:19.463519 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 79/175] 10.222.0.30 () {60 vars in 1298 bytes} [Thu Nov 3 03:51:19 2022] GET /compute/v2.1/os-hypervisors/6e7934f1-7f6f-40fa-8cdf-da0f555f1256 => generated 792 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:19.465811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15672200-06fb-4724-b73d-8fd9030468ec tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Calling method '.version_select at 0x7ff7f9d16550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.469388 n-d-854653-7 devstack@n-api.service[127594]: WARNING oslo_db.sqlalchemy.utils [None req-15672200-06fb-4724-b73d-8fd9030468ec tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 03 03:51:19.475807 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15672200-06fb-4724-b73d-8fd9030468ec tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "GET /compute/v2.1/os-keypairs?user_id=e416ee042e7e4e9088ac4f530b88bc00" status: 200 len: 726 microversion: 2.10 time: 0.013485 Nov 03 03:51:19.482509 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 80/176] 10.222.0.30 () {60 vars in 1259 bytes} [Thu Nov 3 03:51:19 2022] GET /compute/v2.1/os-keypairs?user_id=e416ee042e7e4e9088ac4f530b88bc00 => generated 726 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:19.489234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfa01f33-d6ed-4441-aca8-7d23f40f6f3b tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Calling method '.version_select at 0x7ff7f9ccb940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.540733 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-046795d9-0ad5-40f6-a82b-16c76ef8b1c3 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1494821289/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.102547 Nov 03 03:51:19.541372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 97/177] 10.222.0.30 () {60 vars in 1224 bytes} [Thu Nov 3 03:51:19 2022] POST /compute/v2.1/flavors/1494821289/os-extra_specs => generated 66 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:51:19.550943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d5573d1f-c5a1-45cd-acde-36a91d3e39be tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.552558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d5573d1f-c5a1-45cd-acde-36a91d3e39be tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'cee6ff43693c478087e78fdf6197b7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2358654688b4f658f91fce013155815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d5573d1f-c5a1-45cd-acde-36a91d3e39be tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Request method failure captured: Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqxcgXijY9szzX544lsk1e8PuZyx_X0iuDNH4IAkPhnTSnXzXGuqmz6HIwsBEOTnBOeP_YNSU6XdscUmZpyAypP93FqsUcf-AkzkTVYFu9O3hOSYXt_Vuc19BZ-eXK4vxsf7NPY4juZ1IADU69c_IWmeVfy8ITnzTZiKk8SGGOmn60 Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:51:19.554105 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2358654688b4f658f91fce013155815", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2358654688b4f658f91fce013155815"}]}] Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cee6ff43693c478087e78fdf6197b7a9 Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:19.555338 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'flavor_id': '1494821289', 'id': 'hw:numa_nodes'} Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:19.555901 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.556884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d5573d1f-c5a1-45cd-acde-36a91d3e39be tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:19.557796 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d5573d1f-c5a1-45cd-acde-36a91d3e39be tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] 10.222.0.30 "DELETE /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008141 Nov 03 03:51:19.557796 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 98/178] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 03:51:19 2022] DELETE /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes => generated 124 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:51:19.564519 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dfa01f33-d6ed-4441-aca8-7d23f40f6f3b tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1019628488" status: 204 len: 0 microversion: 2.10 time: 0.080607 Nov 03 03:51:19.565775 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 81/179] 10.222.0.30 () {60 vars in 1325 bytes} [Thu Nov 3 03:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1019628488 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 03:51:19.569216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70fe5df2-43bd-4a87-a18b-0f7dada0e3e7 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:19.576967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6600158f-119f-41b0-81aa-43c16b4dd779 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Calling method '.version_select at 0x7ff7f9ccb8b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.592517 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70fe5df2-43bd-4a87-a18b-0f7dada0e3e7 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1494821289/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031019 Nov 03 03:51:19.593145 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 99/180] 10.222.0.30 () {60 vars in 1224 bytes} [Thu Nov 3 03:51:19 2022] POST /compute/v2.1/flavors/1494821289/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:51:19.602818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-806379b0-44c9-4449-9510-82091a6b1b88 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:19.606405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-806379b0-44c9-4449-9510-82091a6b1b88 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'cee6ff43693c478087e78fdf6197b7a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2358654688b4f658f91fce013155815', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-806379b0-44c9-4449-9510-82091a6b1b88 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Request method failure captured: Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: request: PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 22 Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqxcgXijY9szzX544lsk1e8PuZyx_X0iuDNH4IAkPhnTSnXzXGuqmz6HIwsBEOTnBOeP_YNSU6XdscUmZpyAypP93FqsUcf-AkzkTVYFu9O3hOSYXt_Vuc19BZ-eXK4vxsf7NPY4juZ1IADU69c_IWmeVfy8ITnzTZiKk8SGGOmn60 Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:51:19.607960 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2358654688b4f658f91fce013155815", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2358654688b4f658f91fce013155815"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2358654688b4f658f91fce013155815"}]}] Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: c2358654688b4f658f91fce013155815 Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cee6ff43693c478087e78fdf6197b7a9 Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: {"hw:numa_nodes": "1"} Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:19.609602 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'flavor_id': '1494821289', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:19.610272 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 03 03:51:19.611223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.612188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-806379b0-44c9-4449-9510-82091a6b1b88 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:19.612188 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-806379b0-44c9-4449-9510-82091a6b1b88 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637 tempest-FlavorsExtraSpecsNegativeTestJSON-1194330637-project] 10.222.0.30 "PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010339 Nov 03 03:51:19.612188 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 100/181] 10.222.0.30 () {60 vars in 1265 bytes} [Thu Nov 3 03:51:19 2022] PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:51:19.618563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f3a7633-c64c-4255-b8a0-4d380da7dcd9 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.626132 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-8f3a7633-c64c-4255-b8a0-4d380da7dcd9 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] HTTP exception thrown: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f3a7633-c64c-4255-b8a0-4d380da7dcd9 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Request method failure captured: Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/flavors/1494821289/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzq04JZlW4Rf1xeb3CVPJJ4N6ZKl_x8Kfwwfp0JQdhhmYSAIfGrQZyQR2V2gy2FY7mFVGVBRKKajGuZYKNrJhNjNeaRQUr0EY6-LOBD2DDmoRPq6smVRlTGBxGqH1PCkamKk7J6UieOpe6fyiDIgpzSgKGPXyA_B1J8HjHwK_nSKDI4 Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e31fd741bc3046439849c4496021a8fe Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:19.627599 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e31fd741bc3046439849c4496021a8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e31fd741bc3046439849c4496021a8fe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e31fd741bc3046439849c4496021a8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e31fd741bc3046439849c4496021a8fe"}]}] Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e31fd741bc3046439849c4496021a8fe Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 64eb195fb55446e6b8612353841b8595 Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:19.628982 n-d-854653-7 devstack@n-api.service[127593]: exception: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'flavor_id': '1494821289', 'id': 'hw:cpu_thread_policy'} Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.629721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f3a7633-c64c-4255-b8a0-4d380da7dcd9 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Returning 404 to user: Flavor 1494821289 has no extra specs with key hw:cpu_thread_policy. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f3a7633-c64c-4255-b8a0-4d380da7dcd9 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1494821289/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.013721 Nov 03 03:51:19.630917 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 101/182] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 03:51:19 2022] DELETE /compute/v2.1/flavors/1494821289/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:51:19.638285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34bb8612-92ef-4002-af9b-7059d2fd7ef5 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-34bb8612-92ef-4002-af9b-7059d2fd7ef5 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34bb8612-92ef-4002-af9b-7059d2fd7ef5 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Request method failure captured: Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: request: PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 27 Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzq04JZlW4Rf1xeb3CVPJJ4N6ZKl_x8Kfwwfp0JQdhhmYSAIfGrQZyQR2V2gy2FY7mFVGVBRKKajGuZYKNrJhNjNeaRQUr0EY6-LOBD2DDmoRPq6smVRlTGBxGqH1PCkamKk7J6UieOpe6fyiDIgpzSgKGPXyA_B1J8HjHwK_nSKDI4 Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e31fd741bc3046439849c4496021a8fe Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:19.643687 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e31fd741bc3046439849c4496021a8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e31fd741bc3046439849c4496021a8fe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e31fd741bc3046439849c4496021a8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e31fd741bc3046439849c4496021a8fe"}]}] Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e31fd741bc3046439849c4496021a8fe Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 64eb195fb55446e6b8612353841b8595 Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: {"hw:cpu_policy": "shared"} Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:19.645252 n-d-854653-7 devstack@n-api.service[127593]: exception: Request body and URI mismatch Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'flavor_id': '1494821289', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.646292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.647673 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:19.647673 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:19.647673 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 03 03:51:19.647673 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.647673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34bb8612-92ef-4002-af9b-7059d2fd7ef5 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:19.647673 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-34bb8612-92ef-4002-af9b-7059d2fd7ef5 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.009438 Nov 03 03:51:19.647673 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 102/183] 10.222.0.30 () {60 vars in 1265 bytes} [Thu Nov 3 03:51:19 2022] PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes => generated 73 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:51:19.653209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0ed1646-0fd9-4b3f-9c34-75aa5460aaff tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0ed1646-0fd9-4b3f-9c34-75aa5460aaff tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Request method failure captured: Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: request: PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 49 Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzq04JZlW4Rf1xeb3CVPJJ4N6ZKl_x8Kfwwfp0JQdhhmYSAIfGrQZyQR2V2gy2FY7mFVGVBRKKajGuZYKNrJhNjNeaRQUr0EY6-LOBD2DDmoRPq6smVRlTGBxGqH1PCkamKk7J6UieOpe6fyiDIgpzSgKGPXyA_B1J8HjHwK_nSKDI4 Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e31fd741bc3046439849c4496021a8fe Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:19.665620 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e31fd741bc3046439849c4496021a8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e31fd741bc3046439849c4496021a8fe", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e31fd741bc3046439849c4496021a8fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e31fd741bc3046439849c4496021a8fe"}]}] Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e31fd741bc3046439849c4496021a8fe Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 64eb195fb55446e6b8612353841b8595 Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 03 03:51:19.667991 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'flavor_id': '1494821289', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance: Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 03 03:51:19.668808 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.670437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0ed1646-0fd9-4b3f-9c34-75aa5460aaff tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c0ed1646-0fd9-4b3f-9c34-75aa5460aaff tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.017078 Nov 03 03:51:19.671949 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 103/184] 10.222.0.30 () {60 vars in 1265 bytes} [Thu Nov 3 03:51:19 2022] PUT /compute/v2.1/flavors/1494821289/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 03 03:51:19.675320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae3679e0-9a21-4a9a-9416-07cceab6190d tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.709416 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6600158f-119f-41b0-81aa-43c16b4dd779 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332156469?user_id=e416ee042e7e4e9088ac4f530b88bc00" status: 204 len: 0 microversion: 2.10 time: 0.136433 Nov 03 03:51:19.710134 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 82/185] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 03:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332156469?user_id=e416ee042e7e4e9088ac4f530b88bc00 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 03 03:51:19.718483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac63a8ea-6d6e-47e0-8347-ceaea41a0ac5 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] Calling method '.version_select at 0x7ff7f9d77c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.788352 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae3679e0-9a21-4a9a-9416-07cceab6190d tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1494821289" status: 202 len: 0 microversion: 2.1 time: 0.116168 Nov 03 03:51:19.788950 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 104/186] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:51:19 2022] DELETE /compute/v2.1/flavors/1494821289 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:51:19.796441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe59b726-f11b-4c3f-8c86-1fc36bb4de64 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:19.801000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:19.818427 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac63a8ea-6d6e-47e0-8347-ceaea41a0ac5 tempest-KeyPairsV210TestJSON-1203014276 tempest-KeyPairsV210TestJSON-1203014276-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535589622?user_id=e416ee042e7e4e9088ac4f530b88bc00" status: 204 len: 0 microversion: 2.10 time: 0.103363 Nov 03 03:51:19.819064 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 83/187] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 03:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535589622?user_id=e416ee042e7e4e9088ac4f530b88bc00 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 03 03:51:19.820555 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe59b726-f11b-4c3f-8c86-1fc36bb4de64 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704 tempest-FlavorsExtraSpecsNegativeTestJSON-174975704-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.027516 Nov 03 03:51:19.821736 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 105/188] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:19 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:20.006271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:20.006886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:20.013946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:20.014481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:20.014923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:20.015619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:20.016079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:20.016510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:20.148053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:20.156060 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d6826e25-f14f-4f44-8b9b-a2874379ec2e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.153372 Nov 03 03:51:20.158816 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 84/189] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:20 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:20.250391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:20.251118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:20.257471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:20.258047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:20.258549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:20.259265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:20.259723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:20.260151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:20.316353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:20.316970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:20.325300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:20.326095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:20.326730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:20.327878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:20.328573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:20.329005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:20.402780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:20.410823 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2fec4ce-772d-43a8-9762-99aac6df34e8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1289 microversion: 2.1 time: 0.098559 Nov 03 03:51:20.412730 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 85/190] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:20 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:20.597169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:20.612412 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d271410e-bde1-466e-9f85-579b281cd8a3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.367712 Nov 03 03:51:20.614864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 106/191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:20 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:21.183276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:21.183999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:21.189978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:21.190462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:21.190900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:21.191595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:21.192055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:21.192483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:21.350238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:21.357959 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-523d4d94-7be8-4f67-b25d-15417178aab3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.178580 Nov 03 03:51:21.358528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 86/192] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:21 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:21.437272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:21.437963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:21.445601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:21.447866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:21.448320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:21.449067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:21.449532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:21.449962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:21.517205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:21.525239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4b76984-33be-4158-babc-d878b7ef8e99 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1337 microversion: 2.1 time: 0.092705 Nov 03 03:51:21.525816 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 107/193] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:21 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1337 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:21.641239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:21.641889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:21.643954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:21.648910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:21.649436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:21.649888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:21.650583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:21.651040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:21.651665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:21.962161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:21.972092 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0fa0aa0a-bf36-4b5c-aedd-8bca4cb0c4fc tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.334705 Nov 03 03:51:21.972671 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 87/194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:21 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:22.380329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:22.381241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:22.387447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:22.387930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:22.388369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:22.389115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:22.389577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:22.390002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:22.556576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:22.560343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:22.569472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:22.573471 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ba76ade-34b5-429b-8bba-dad467b1eb86 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.196131 Nov 03 03:51:22.574753 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 108/195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:22 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:22.595106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:22.595790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:22.596418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:22.597452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:22.598085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:22.607739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:22.737712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:22.749308 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2666bad-a50e-40aa-86df-beeab65a088f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1343 microversion: 2.1 time: 0.197079 Nov 03 03:51:22.750504 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 88/196] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:22 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:23.001844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:23.006095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:23.017901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:23.021312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:23.025652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:23.026180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:23.026937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:23.028243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:23.309332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:23.314347 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ab12d477-3383-4656-9c55-364af87e0ee2 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.320928 Nov 03 03:51:23.314931 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 109/197] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:22 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:23.531504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-18fd87cd-5191-4dcf-b4e3-294d3ed30a64 req-c8bbfc93-6fa7-4f55-b0de-e30011b95cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1866da2-dbbd-466c-b1f8-16cafbecc86d", "name": "network-vif-plugged", "status": "completed", "tag": "1cca0579-a65e-45b3-b8ee-a3c0b38225d6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:23.546263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-18fd87cd-5191-4dcf-b4e3-294d3ed30a64 req-c8bbfc93-6fa7-4f55-b0de-e30011b95cd9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:23.546897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-18fd87cd-5191-4dcf-b4e3-294d3ed30a64 req-c8bbfc93-6fa7-4f55-b0de-e30011b95cd9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:23.547450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-18fd87cd-5191-4dcf-b4e3-294d3ed30a64 req-c8bbfc93-6fa7-4f55-b0de-e30011b95cd9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:23.560574 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-18fd87cd-5191-4dcf-b4e3-294d3ed30a64 req-c8bbfc93-6fa7-4f55-b0de-e30011b95cd9 service nova] Creating event network-vif-plugged:1cca0579-a65e-45b3-b8ee-a3c0b38225d6 for instance c1866da2-dbbd-466c-b1f8-16cafbecc86d on n-h1-854653-7 Nov 03 03:51:23.566337 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-18fd87cd-5191-4dcf-b4e3-294d3ed30a64 req-c8bbfc93-6fa7-4f55-b0de-e30011b95cd9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272119 Nov 03 03:51:23.567064 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 89/198] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:23.598322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:23.598980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:23.606906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:23.607696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:23.608253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:23.608965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:23.614522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:23.614522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:23.775668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:23.776375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:23.788215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:23.788711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:23.789804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:23.793774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:23.794255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:23.794691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:24.026853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:24.035298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-db61ca3b-d35e-4fdc-bf00-1b6de7d696df tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.442035 Nov 03 03:51:24.052875 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 110/199] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:23 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:24.142829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:24.151502 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6066dac1-310c-4019-8f70-36c0fdb05132 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.380431 Nov 03 03:51:24.157314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 90/200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:23 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:24.308441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ec680942-20c1-4dac-b652-17b7ff6d1b5f req-fa6d79c1-7323-4401-ba35-40d947a076bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda48a2a-0f23-488b-8c52-4ba9ef3d808c", "tag": "43461328-2908-4d9b-8eef-f25845c12b25"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:24.322403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ec680942-20c1-4dac-b652-17b7ff6d1b5f req-fa6d79c1-7323-4401-ba35-40d947a076bd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:24.324780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ec680942-20c1-4dac-b652-17b7ff6d1b5f req-fa6d79c1-7323-4401-ba35-40d947a076bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:24.324780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ec680942-20c1-4dac-b652-17b7ff6d1b5f req-fa6d79c1-7323-4401-ba35-40d947a076bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:24.339050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:24.339768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:24.351097 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ec680942-20c1-4dac-b652-17b7ff6d1b5f req-fa6d79c1-7323-4401-ba35-40d947a076bd service nova] Creating event network-changed:43461328-2908-4d9b-8eef-f25845c12b25 for instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c on n-h2-854653-7 Nov 03 03:51:24.353791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:24.354378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:24.354893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:24.356468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:24.356468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:24.356843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:24.358679 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ec680942-20c1-4dac-b652-17b7ff6d1b5f req-fa6d79c1-7323-4401-ba35-40d947a076bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055842 Nov 03 03:51:24.360339 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 111/201] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:24.515417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:24.523576 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9011898-ee90-4bec-a578-d071ee369cd5 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.189221 Nov 03 03:51:24.524151 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 91/202] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:24 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:25.063690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:25.065151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:25.073783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:25.081748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:25.082673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:25.088171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:25.089099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:25.089763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:25.190454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:25.191650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:25.198573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:25.199323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:25.200268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:25.200923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:25.201560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:25.202144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:25.376691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:25.385264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14d2a439-6b5b-4ec5-a5c9-84eccbd393ee tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.326759 Nov 03 03:51:25.386156 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 112/203] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:25 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:25.433938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:25.469264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:25.479162 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8233822f-6693-425b-a321-34df381fc51c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.298520 Nov 03 03:51:25.483448 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 92/204] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:25 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:25.547150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:25.548045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:25.554471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:25.555116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:25.555637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:25.556549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:25.557188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:25.557871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:25.740376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:25.748083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:25.751544 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37781080-6258-4c1e-92ee-c5cf8d66effb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.208333 Nov 03 03:51:25.767626 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 113/205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:25 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:25.995013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-bc3511a1-0bee-4e2c-955f-5b1c26136e18 req-0ef44df7-358d-4377-844e-8eea4b5205fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1c14ed-9f5b-4141-8cba-4cfeea85fc87", "name": "network-vif-plugged", "status": "completed", "tag": "9f6d8911-cbc9-4030-8fcb-7d2691870f30"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:26.007907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bc3511a1-0bee-4e2c-955f-5b1c26136e18 req-0ef44df7-358d-4377-844e-8eea4b5205fe service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.009323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bc3511a1-0bee-4e2c-955f-5b1c26136e18 req-0ef44df7-358d-4377-844e-8eea4b5205fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.010464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bc3511a1-0bee-4e2c-955f-5b1c26136e18 req-0ef44df7-358d-4377-844e-8eea4b5205fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.026430 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-bc3511a1-0bee-4e2c-955f-5b1c26136e18 req-0ef44df7-358d-4377-844e-8eea4b5205fe service nova] Creating event network-vif-plugged:9f6d8911-cbc9-4030-8fcb-7d2691870f30 for instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 on n-h2-854653-7 Nov 03 03:51:26.033151 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-bc3511a1-0bee-4e2c-955f-5b1c26136e18 req-0ef44df7-358d-4377-844e-8eea4b5205fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042869 Nov 03 03:51:26.035268 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 114/206] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:26.113268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Calling method '.version_select at 0x7ff7f9cd2040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.115049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.115541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.116066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.132137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.133754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.134353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.150227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.150868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.151464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.158633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-423f73fb-1354-4529-b532-f781cb4e5537 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.204334 Nov 03 03:51:26.159191 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 93/207] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:25 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:26.286418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e1866d08-f261-4afc-ae47-66ddb89f3a02 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Calling method '.version_select at 0x7ff7f9e27040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.290185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e1866d08-f261-4afc-ae47-66ddb89f3a02 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'ac127e4480254ecea49a9228c022ffa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c63600d544097a3f54525edf3c789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e1866d08-f261-4afc-ae47-66ddb89f3a02 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Request method failure captured: Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hypervisors/n-h2-854653-7/search HTTP/1.1 Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzq8df_lh4OHXRw7xAYTuuPIM9sbAZBKEGga52K_6MNoBgdGatYj3R_l4KADEn2FVHuEQM0_Ic46DHyp6N1T0qt7Y0GX6_qYO0S9pvxnXy1LrSR4uli3w8y236h2XZctsvb05kzx9do9XWtdL1KSteXRRGZ6uT1s6Z-7lTtNMaJlwb8 Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: d36c63600d544097a3f54525edf3c789 Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1380457447 Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:51:26.292765 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d36c63600d544097a3f54525edf3c789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d36c63600d544097a3f54525edf3c789", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d36c63600d544097a3f54525edf3c789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d36c63600d544097a3f54525edf3c789"}]}] Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1380457447 Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: d36c63600d544097a3f54525edf3c789 Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1380457447 Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ac127e4480254ecea49a9228c022ffa0 Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 03 03:51:26.299293 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'n-h2-854653-7'} Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:26.300111 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 03 03:51:26.301364 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.302539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e1866d08-f261-4afc-ae47-66ddb89f3a02 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:26.302539 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e1866d08-f261-4afc-ae47-66ddb89f3a02 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h2-854653-7/search" status: 403 len: 117 microversion: 2.1 time: 0.126856 Nov 03 03:51:26.302539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 115/208] 10.222.0.30 () {58 vars in 1209 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/os-hypervisors/n-h2-854653-7/search => generated 117 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:26.304060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Calling method '.version_select at 0x7ff7f9cd2310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.306896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.307375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.307807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.320312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Request method failure captured: Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzq9EgqAVSHVyvM-2zl6SE8NEMb_Gd_ORi4-okfhkspB44u9AkLRvzh3eMPrgfwtL9PCCqQEQkdN0kfrHCd3SbhomLrtdBzXRH_vQdQXjzktzTrTqazQa8bluc4w-27GpXtWxZM-An6XGESbh4DaDX1XZHsHPSuCPnSBpcjyR9uvWHg Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0fb139b1b7b149b5bcb59c090ae57e1c Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-865414916 Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:51:26.322868 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fb139b1b7b149b5bcb59c090ae57e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0fb139b1b7b149b5bcb59c090ae57e1c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fb139b1b7b149b5bcb59c090ae57e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0fb139b1b7b149b5bcb59c090ae57e1c"}]}] Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-865414916 Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0fb139b1b7b149b5bcb59c090ae57e1c Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-865414916 Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 06e59b126b5d4b9c82a2a0c80f0b6d2f Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 03 03:51:26.324338 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.325155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45134f13-bbf4-4a6d-a740-7a7ad4b69213 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.023891 Nov 03 03:51:26.326210 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 94/209] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:26.335611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Calling method '.version_select at 0x7ff7f9e93550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.337805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.338664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.340070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.356202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.356694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.357291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.373714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.375209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.375817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.384855 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7b7e98f-4218-468e-a509-3035ef89c4c9 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053583 Nov 03 03:51:26.388417 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 116/210] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:26.396902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6177799-75ca-438c-8e14-b5f90cc71295 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Calling method '.version_select at 0x7ff7f9d16a60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.399461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6177799-75ca-438c-8e14-b5f90cc71295 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'ac127e4480254ecea49a9228c022ffa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36c63600d544097a3f54525edf3c789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6177799-75ca-438c-8e14-b5f90cc71295 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Request method failure captured: Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzq8df_lh4OHXRw7xAYTuuPIM9sbAZBKEGga52K_6MNoBgdGatYj3R_l4KADEn2FVHuEQM0_Ic46DHyp6N1T0qt7Y0GX6_qYO0S9pvxnXy1LrSR4uli3w8y236h2XZctsvb05kzx9do9XWtdL1KSteXRRGZ6uT1s6Z-7lTtNMaJlwb8 Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: d36c63600d544097a3f54525edf3c789 Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1380457447 Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:26.401517 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d36c63600d544097a3f54525edf3c789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d36c63600d544097a3f54525edf3c789", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d36c63600d544097a3f54525edf3c789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d36c63600d544097a3f54525edf3c789"}]}] Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1380457447 Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: d36c63600d544097a3f54525edf3c789 Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1380457447 Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac127e4480254ecea49a9228c022ffa0 Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 03 03:51:26.404358 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '1'} Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:26.405173 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 03 03:51:26.406372 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.410871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6177799-75ca-438c-8e14-b5f90cc71295 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:26.413371 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a6177799-75ca-438c-8e14-b5f90cc71295 tempest-HypervisorAdminNegativeUnderV252Test-1380457447 tempest-HypervisorAdminNegativeUnderV252Test-1380457447-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019623 Nov 03 03:51:26.413666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.415084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:26.416053 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 95/211] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:51:26.428577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Calling method '.version_select at 0x7ff7f9cd2670>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.432217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.432642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.432953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.433593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.433847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.434348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.435159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.435574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.436204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.443842 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] HTTP exception thrown: No hypervisor matching '149bba87-50b3-453f-9940-dea6a512e6e0' could be found. Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Request method failure captured: Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hypervisors/149bba87-50b3-453f-9940-dea6a512e6e0/servers HTTP/1.1 Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzq9EgqAVSHVyvM-2zl6SE8NEMb_Gd_ORi4-okfhkspB44u9AkLRvzh3eMPrgfwtL9PCCqQEQkdN0kfrHCd3SbhomLrtdBzXRH_vQdQXjzktzTrTqazQa8bluc4w-27GpXtWxZM-An6XGESbh4DaDX1XZHsHPSuCPnSBpcjyR9uvWHg Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0fb139b1b7b149b5bcb59c090ae57e1c Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-865414916 Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:51:26.445218 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fb139b1b7b149b5bcb59c090ae57e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0fb139b1b7b149b5bcb59c090ae57e1c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0fb139b1b7b149b5bcb59c090ae57e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0fb139b1b7b149b5bcb59c090ae57e1c"}]}] Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-865414916 Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0fb139b1b7b149b5bcb59c090ae57e1c Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-865414916 Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 06e59b126b5d4b9c82a2a0c80f0b6d2f Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: exception: No hypervisor matching '149bba87-50b3-453f-9940-dea6a512e6e0' could be found. Nov 03 03:51:26.446544 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '149bba87-50b3-453f-9940-dea6a512e6e0'} Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '149bba87-50b3-453f-9940-dea6a512e6e0' could be found. Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.447184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:26.448172 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:26.448172 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:26.448172 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:26.448172 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:26.448172 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '149bba87-50b3-453f-9940-dea6a512e6e0' could be found. Nov 03 03:51:26.448172 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:26.448172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] Returning 404 to user: No hypervisor matching '149bba87-50b3-453f-9940-dea6a512e6e0' could be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:26.448971 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3c30c7d-14a4-4062-8f27-ff5e712952a3 tempest-HypervisorAdminNegativeUnderV252Test-865414916 tempest-HypervisorAdminNegativeUnderV252Test-865414916-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/149bba87-50b3-453f-9940-dea6a512e6e0/servers" status: 404 len: 123 microversion: 2.1 time: 0.028428 Nov 03 03:51:26.450267 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 96/212] 10.222.0.30 () {58 vars in 1281 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/os-hypervisors/149bba87-50b3-453f-9940-dea6a512e6e0/servers => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:26.505985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.506995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:26.516728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.517372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.517817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.518729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.519196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.519625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.759319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:26.771575 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2682686-7b19-4e99-b201-2c1270aed591 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1320 microversion: 2.1 time: 0.362879 Nov 03 03:51:26.772813 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 117/213] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:26.788920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:26.793798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:26.801140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.801834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.802450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.803346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:26.803942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:26.804502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:26.889455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:26.891910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:26.898968 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-51e57f52-4af7-40ec-ae20-531a09655cc5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.398380 Nov 03 03:51:26.900160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 97/214] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:27.123831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:27.133743 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e06548e-1fb6-405d-9d84-8371fbb4bcbd tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.358164 Nov 03 03:51:27.145287 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 118/215] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:26 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:27.801173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:27.802466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:27.833796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:27.834551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:27.836111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:27.837143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:27.838248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:27.838904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:27.924209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:27.925897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:27.928551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:27.940094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:27.940596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:27.941058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:27.941774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:27.942222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:27.950410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:28.301273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:28.311036 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-899f43b8-e141-41e8-8126-ca9af7e23251 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1470 microversion: 2.1 time: 0.518333 Nov 03 03:51:28.311702 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 98/216] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:27 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1470 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:28.331422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:28.332039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:28.343582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:28.344302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:28.344944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:28.345875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:28.346475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:28.347432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:28.373414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:28.382219 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0490f899-4f17-403c-b25b-7b883d4033e7 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.462082 Nov 03 03:51:28.386685 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 119/217] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:27 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:28.739337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:28.744613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:28.752490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:28.752993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:28.753466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:28.754189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:28.754670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:28.757354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:28.804404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:28.815153 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7cb7f94-de2e-4c51-9acb-4d307c555dcb tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1337 microversion: 2.1 time: 0.492010 Nov 03 03:51:28.815986 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 99/218] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:28 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1337 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:28.859722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:51:29.343268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12ddb4eb-4397-4a53-a8e3-cff31bc22c5c tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 204 len: 0 microversion: 2.1 time: 0.954079 Nov 03 03:51:29.344595 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 120/219] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:51:28 2022] DELETE /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 0 bytes in 957 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:51:29.354908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:29.355544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:29.374921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:29.378747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:29.379268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:29.379721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:29.380461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:29.380925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:29.393932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:29.411523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:29.412151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:29.424840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:29.431762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:29.432712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:29.433667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:29.439721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:29.441395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:29.450514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:29.784077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:29.793302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc6982b9-f80e-4c13-be95-a3c6c4641d96 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.387373 Nov 03 03:51:29.793884 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 121/220] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:29 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:29.840061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:29.841159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:29.850782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:29.851288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:29.855977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:29.856978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:29.857640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:29.860971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:30.144620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:30.160355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e71dabf4-2c95-43b2-b903-adc3748f776d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1476 microversion: 2.1 time: 0.811460 Nov 03 03:51:30.163472 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 100/221] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:29 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1476 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:30.393507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:30.403330 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ba9ecd0-7e0b-4e0c-b4b4-75e406744517 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1487 microversion: 2.1 time: 0.567988 Nov 03 03:51:30.406660 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 122/222] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:29 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1487 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:30.431599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:30.432598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:30.446840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:30.453758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:30.453758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:30.453758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:30.453758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:30.454105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:30.815615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:30.816238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:30.829287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:30.829783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:30.830237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:30.830961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:30.831676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:30.831941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:31.387778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:31.404701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-855f1c56-cb1a-4898-9eb6-fbe4d696e95f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.590233 Nov 03 03:51:31.405414 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 123/223] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:30 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:31.420159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:31.426847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:31.464870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:31.474555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:31.479011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:31.481991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:31.484331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:31.488901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:31.606273 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-997b7189-d5c1-4dd3-8853-2d9983201fca tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1638 microversion: 2.1 time: 1.179452 Nov 03 03:51:31.609914 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 101/224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:30 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1638 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:31.631324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:31.632123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:31.642862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:31.642862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:31.642862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:31.642862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:31.643408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:31.643408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:31.672599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:51:31.869410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:31.881933 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b1d8e99-12d9-4c4f-abb5-f35e11d22876 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1476 microversion: 2.1 time: 0.472520 Nov 03 03:51:31.883452 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 124/225] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:31 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1476 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:32.429216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:32.430461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:32.440766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:32.441305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:32.441758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:32.443438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:32.443438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:32.443438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:32.670973 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1726566a-45b1-43f5-8717-02fd1b052231 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 204 len: 0 microversion: 2.1 time: 1.043829 Nov 03 03:51:32.677408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 102/226] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:51:31 2022] DELETE /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:51:32.686732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:32.687956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:32.707356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:32.707866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:32.712926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:32.712926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:32.712926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:32.712926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:33.119928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:33.129162 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fad89aa4-ade3-4d56-939c-b09d9552795c tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.704094 Nov 03 03:51:33.137632 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 125/227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:32 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:33.145716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:33.146812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:33.161764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:33.162527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:33.163013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:33.164268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:33.167755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:33.167755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:33.364294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:33.375877 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-88fe5bca-9d08-46fb-8df4-ffc8f2325399 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1434 microversion: 2.1 time: 0.236758 Nov 03 03:51:33.376653 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 126/228] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:33 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1434 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:33.596821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:33.634488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4a9d9a2-e069-4175-88cc-31007c2d62ec tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1493 microversion: 2.1 time: 0.952439 Nov 03 03:51:33.635113 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 103/229] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:32 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1493 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:33.663667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a44d68e-edb7-4046-a5c0-d7a79d67b984 tempest-InstanceUsageAuditLogTestJSON-1693189306 tempest-InstanceUsageAuditLogTestJSON-1693189306-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:33.670055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a9dfc5b4-97f9-4871-bf67-1ff2e48a80a3 req-8a92f65d-cd35-436d-8ab8-7bf328fcaf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1866da2-dbbd-466c-b1f8-16cafbecc86d", "name": "network-vif-deleted", "tag": "1cca0579-a65e-45b3-b8ee-a3c0b38225d6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:33.703397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a9dfc5b4-97f9-4871-bf67-1ff2e48a80a3 req-8a92f65d-cd35-436d-8ab8-7bf328fcaf54 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:33.709507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a9dfc5b4-97f9-4871-bf67-1ff2e48a80a3 req-8a92f65d-cd35-436d-8ab8-7bf328fcaf54 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:33.712028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a9dfc5b4-97f9-4871-bf67-1ff2e48a80a3 req-8a92f65d-cd35-436d-8ab8-7bf328fcaf54 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:33.745141 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a44d68e-edb7-4046-a5c0-d7a79d67b984 tempest-InstanceUsageAuditLogTestJSON-1693189306 tempest-InstanceUsageAuditLogTestJSON-1693189306-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-03 03:51:33" status: 200 len: 318 microversion: 2.1 time: 0.363187 Nov 03 03:51:33.747743 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 127/230] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 03:51:33 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-03%2003%3A51%3A33 => generated 318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:33.753555 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a9dfc5b4-97f9-4871-bf67-1ff2e48a80a3 req-8a92f65d-cd35-436d-8ab8-7bf328fcaf54 service nova] Creating event network-vif-deleted:1cca0579-a65e-45b3-b8ee-a3c0b38225d6 for instance c1866da2-dbbd-466c-b1f8-16cafbecc86d on n-h1-854653-7 Nov 03 03:51:33.762433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5de2be91-9d1c-455f-9f4c-98a849b2489d tempest-InstanceUsageAuditLogTestJSON-1693189306 tempest-InstanceUsageAuditLogTestJSON-1693189306-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:33.793706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a9dfc5b4-97f9-4871-bf67-1ff2e48a80a3 req-8a92f65d-cd35-436d-8ab8-7bf328fcaf54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148039 Nov 03 03:51:33.796558 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5de2be91-9d1c-455f-9f4c-98a849b2489d tempest-InstanceUsageAuditLogTestJSON-1693189306 tempest-InstanceUsageAuditLogTestJSON-1693189306-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.037775 Nov 03 03:51:33.797694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 104/231] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:33.803652 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 128/232] 10.222.0.30 () {58 vars in 1185 bytes} [Thu Nov 3 03:51:33 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:34.157111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:34.158261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:34.171524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:34.171953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:34.173154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:34.174157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:34.174834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:34.175415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:34.402539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:34.403550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:34.424558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:34.425157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:34.428452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:34.430954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:34.432561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:34.434850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:34.534354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:34.534879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:34.539758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:34.540459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lazy-loading 'fault' on Instance uuid c1866da2-dbbd-466c-b1f8-16cafbecc86d {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:51:35.056541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:35.064274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:35.074116 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27411ada-f4a7-4413-b2a5-fe638bc3c4e9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.922518 Nov 03 03:51:35.087888 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cb60a914-5d95-4fc8-a407-95124c8479f6 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 200 len: 1310 microversion: 2.1 time: 0.691734 Nov 03 03:51:35.092836 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 105/233] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:34 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:35.102472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ffffd906-eaa6-4b53-af61-a9fdc007d728 req-886d60c7-2293-42ce-8a69-edc12de9eed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda48a2a-0f23-488b-8c52-4ba9ef3d808c", "name": "network-vif-plugged", "status": "completed", "tag": "43461328-2908-4d9b-8eef-f25845c12b25"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:35.102976 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 129/234] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:34 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 1310 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:35.112057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:35.117720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:35.124204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ffffd906-eaa6-4b53-af61-a9fdc007d728 req-886d60c7-2293-42ce-8a69-edc12de9eed9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:35.124943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ffffd906-eaa6-4b53-af61-a9fdc007d728 req-886d60c7-2293-42ce-8a69-edc12de9eed9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:35.125366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ffffd906-eaa6-4b53-af61-a9fdc007d728 req-886d60c7-2293-42ce-8a69-edc12de9eed9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:35.139125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:35.147682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ffffd906-eaa6-4b53-af61-a9fdc007d728 req-886d60c7-2293-42ce-8a69-edc12de9eed9 service nova] Creating event network-vif-plugged:43461328-2908-4d9b-8eef-f25845c12b25 for instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c on n-h2-854653-7 Nov 03 03:51:35.147906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:35.148964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:35.150145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:35.155074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:35.155759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:35.165622 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ffffd906-eaa6-4b53-af61-a9fdc007d728 req-886d60c7-2293-42ce-8a69-edc12de9eed9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071202 Nov 03 03:51:35.166541 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 106/235] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:35.368718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:35.381195 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5c9a751-2023-427b-bbc1-fc6ec8d48ac3 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1451 microversion: 2.1 time: 0.275496 Nov 03 03:51:35.384498 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 130/236] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:35 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1451 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:35.425115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d25cab9c-9552-4119-b141-7a308e06c90b req-0b27ab84-8b84-4e63-83d0-b362df16bdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1c14ed-9f5b-4141-8cba-4cfeea85fc87", "name": "network-vif-deleted", "tag": "9f6d8911-cbc9-4030-8fcb-7d2691870f30"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:35.462788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d25cab9c-9552-4119-b141-7a308e06c90b req-0b27ab84-8b84-4e63-83d0-b362df16bdd8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:35.467662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d25cab9c-9552-4119-b141-7a308e06c90b req-0b27ab84-8b84-4e63-83d0-b362df16bdd8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:35.469422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d25cab9c-9552-4119-b141-7a308e06c90b req-0b27ab84-8b84-4e63-83d0-b362df16bdd8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:35.506446 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d25cab9c-9552-4119-b141-7a308e06c90b req-0b27ab84-8b84-4e63-83d0-b362df16bdd8 service nova] Creating event network-vif-deleted:9f6d8911-cbc9-4030-8fcb-7d2691870f30 for instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 on n-h2-854653-7 Nov 03 03:51:35.548350 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d25cab9c-9552-4119-b141-7a308e06c90b req-0b27ab84-8b84-4e63-83d0-b362df16bdd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108487 Nov 03 03:51:35.552653 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 107/237] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:36.102784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:36.103148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:36.121415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:36.122521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:36.132704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:36.132704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:36.133990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:36.135646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:36.139929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:36.140630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:36.143297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:36.143765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:36.144527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:36.144994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:36.145541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:36.153809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:36.192637 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] HTTP exception thrown: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Request method failure captured: Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d HTTP/1.1 Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqdyjTKA6_bdr_6wlcXQUOnxMwZPRW4-1YkgPYJpRf7sucrdRXmZyHwHvcR0FNy7dcFH1hMJS5Psv5lNNyiqmV3N41eFsy-vnEhIommpxn1bkMTvWNcrh1u8UleWJgTGm4SXphTzExMpa8b87qWXqqhtpMrJ2B-XLihuaa_FMEnZ3A Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:36.199230 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb5ff2c8e85d4bf3b7a2cc8afdab08f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}] Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f26c2f5a00a74611948ce866f62ee39d Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:51:36.200653 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'c1866da2-dbbd-466c-b1f8-16cafbecc86d'} Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:36.201339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:51:36.202479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:36.207076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Returning 404 to user: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:36.208734 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-537ba933-3a1e-4898-b082-3ce10f84f414 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 404 len: 111 microversion: 2.1 time: 0.092603 Nov 03 03:51:36.217212 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 108/238] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:36 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:36.409306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:36.410441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:36.423155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:36.424321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:36.424771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:36.429085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:36.429635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:36.432674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:36.448498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:36.457800 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc020267-8baf-422f-a0d7-3d3428c715cf tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1410 microversion: 2.1 time: 0.361285 Nov 03 03:51:36.462129 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 131/239] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:36 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1410 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:36.505566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:36.506516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:36.507215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:36.508019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lazy-loading 'fault' on Instance uuid 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:51:36.510700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-81417426", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:36.579894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b5717a94b93410b92e4229ccee24bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ede494be4a4f58a3df4212ef360327', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:36.606953 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2df53662-b8d5-4a2e-8e5e-aebfa0187bf7 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 200 len: 1327 microversion: 2.1 time: 0.197169 Nov 03 03:51:36.606953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 109/240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:36 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 1327 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:36.636736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:51:36.989142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:51:37.000526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:51:37.003251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:51:37.004606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:51:37.006152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:51:37.035125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.036804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.038165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.040356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.041397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.049207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.087622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:37.150034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Getting quotas for project fb5ff2c8e85d4bf3b7a2cc8afdab08f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:37.161493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Getting quotas for user f26c2f5a00a74611948ce866f62ee39d and project fb5ff2c8e85d4bf3b7a2cc8afdab08f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:37.196578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:51:37.203618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:51:37.378955 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8fb8ef0-8fb9-4142-89d2-493082d726c5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872269 Nov 03 03:51:37.383537 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 132/241] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:51:37.392997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01100899-bb15-4f76-aa4e-e7f58eb71916 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:37.393684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01100899-bb15-4f76-aa4e-e7f58eb71916 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:37.484067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01100899-bb15-4f76-aa4e-e7f58eb71916 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:37.492723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:37.493367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:37.504112 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01100899-bb15-4f76-aa4e-e7f58eb71916 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1218 microversion: 2.1 time: 0.114614 Nov 03 03:51:37.518234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.518234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.518234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.518234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.518661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.518661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.518832 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 110/242] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:37 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:37.628429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:37.628912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:37.638218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.638720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.639162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.639944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.640545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.641195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.662105 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] HTTP exception thrown: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Request method failure captured: Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 HTTP/1.1 Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqSF1bE4RxALQK8o1MhTwbjsnKlt-nOF2QUsnMzoKsLRO-Ot5Sy1DDu-d_x1chKmFcM0W9vWv7BG8emyHBvpwnrj7MfltVuLVMPd6Otwd0dTuz0buMhy4OMulUeznV8YbT2wTFdqTNXAfnTS377yYCF7MRRWpdpObtEGXdybnguPiM Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 75ede494be4a4f58a3df4212ef360327 Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:37.664644 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75ede494be4a4f58a3df4212ef360327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75ede494be4a4f58a3df4212ef360327", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75ede494be4a4f58a3df4212ef360327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75ede494be4a4f58a3df4212ef360327"}]}] Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 75ede494be4a4f58a3df4212ef360327 Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminTestJSON-1618552662-project Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 4b5717a94b93410b92e4229ccee24bb6 Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminTestJSON-1618552662-project Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:37.666078 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4c1c14ed-9f5b-4141-8cba-4cfeea85fc87'} Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:37.666925 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:37.668193 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:37.670074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Returning 404 to user: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:37.671212 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b2cdea6-38ac-40ad-b4be-f7292a9ad89c tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 404 len: 111 microversion: 2.1 time: 0.047432 Nov 03 03:51:37.672240 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 111/243] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:37 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:51:37.698165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-59887194-97cb-47c7-b1c3-b67d9ee161a2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:37.712693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59887194-97cb-47c7-b1c3-b67d9ee161a2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.713354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59887194-97cb-47c7-b1c3-b67d9ee161a2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.714250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59887194-97cb-47c7-b1c3-b67d9ee161a2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.865380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:37.875868 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a41cc383-d439-4ff8-8810-36eae0481fd5 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1608 microversion: 2.1 time: 0.388330 Nov 03 03:51:37.877616 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 133/244] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:37 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1608 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:37.911903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:37.913008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:37.923970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.928482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.929431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:37.930612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:37.931185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:37.931712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:38.544439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-59887194-97cb-47c7-b1c3-b67d9ee161a2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.866242 Nov 03 03:51:38.545583 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 112/245] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:37 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:38.551212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d75109e7-c5d8-4de5-b0c2-57a7414d86d1 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:38.562960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d75109e7-c5d8-4de5-b0c2-57a7414d86d1 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:38.623844 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ceb9b21-ee97-430b-9075-2ae08aabff22 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.715841 Nov 03 03:51:38.625661 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 134/246] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 03:51:37 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c/os-interface => generated 284 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:38.638973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32039d9e-d2ce-4364-915a-6686c87d3358 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:38.720121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d75109e7-c5d8-4de5-b0c2-57a7414d86d1 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:38.729117 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d75109e7-c5d8-4de5-b0c2-57a7414d86d1 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1218 microversion: 2.1 time: 0.181876 Nov 03 03:51:38.756189 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 113/247] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:38 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:38.771267 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-32039d9e-d2ce-4364-915a-6686c87d3358 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.142658 Nov 03 03:51:38.778230 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 135/248] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:38 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:38.791581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-927b0a6d-93fb-487e-b753-ca4d3c8a110a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1934098441"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:38.796925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-927b0a6d-93fb-487e-b753-ca4d3c8a110a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid 672cf254-28e4-423c-b17a-9432cbf82f14 for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:38.925553 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-927b0a6d-93fb-487e-b753-ca4d3c8a110a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.137641 Nov 03 03:51:38.927030 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 114/249] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:38.947624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e4003889-fec9-43f1-a918-6b0eb71b417e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:38.973997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4003889-fec9-43f1-a918-6b0eb71b417e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:38.974880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4003889-fec9-43f1-a918-6b0eb71b417e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:38.975616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4003889-fec9-43f1-a918-6b0eb71b417e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:39.431124 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e4003889-fec9-43f1-a918-6b0eb71b417e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.496163 Nov 03 03:51:39.433555 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 136/250] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:38 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:39.448812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e82dd41-db45-46f7-9091-3124219a95e7 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:39.458480 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e82dd41-db45-46f7-9091-3124219a95e7 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.017324 Nov 03 03:51:39.459194 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 115/251] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:51:39 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:39.472232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e579c812-33aa-449f-a500-5b096f7cb00b tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:39.511633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e579c812-33aa-449f-a500-5b096f7cb00b tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:39.512334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e579c812-33aa-449f-a500-5b096f7cb00b tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:39.514587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e579c812-33aa-449f-a500-5b096f7cb00b tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:39.754918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:39.756709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:39.770216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:39.771892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:39.774037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:39.774826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:39.775292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:39.778821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:39.920788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:39.934185 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e579c812-33aa-449f-a500-5b096f7cb00b tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.466435 Nov 03 03:51:39.946719 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 137/252] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:39 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:39.958629 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-93e801e7-50f6-4d3b-999c-3c464a0dc9fe tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1270 microversion: 2.1 time: 0.202932 Nov 03 03:51:39.962238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ab1f1ff-a396-4364-95f9-766527ebdecf tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:39.963165 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 116/253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:39 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:40.004216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:40.123223 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ab1f1ff-a396-4364-95f9-766527ebdecf tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.168714 Nov 03 03:51:40.124373 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 138/254] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:39 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:40.138029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3e37b7e8-d01f-4829-8916-3119b02ca75f tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1107452384"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:40.143046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-3e37b7e8-d01f-4829-8916-3119b02ca75f tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid d2813347-cfe8-4e07-bbaf-1aea65656ad5 for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:40.294832 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3e37b7e8-d01f-4829-8916-3119b02ca75f tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.161148 Nov 03 03:51:40.297291 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 117/255] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:40 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:40.311740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-386e91df-25f8-48e8-a2b2-a8656f136212 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:40.340595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-386e91df-25f8-48e8-a2b2-a8656f136212 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:40.343959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-386e91df-25f8-48e8-a2b2-a8656f136212 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:40.344866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-386e91df-25f8-48e8-a2b2-a8656f136212 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:40.725027 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-386e91df-25f8-48e8-a2b2-a8656f136212 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.418030 Nov 03 03:51:40.726862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 139/256] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:40 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:40.738108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96d6ed96-315b-4f12-973f-e2716773bfc4 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:40.751887 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96d6ed96-315b-4f12-973f-e2716773bfc4 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.017648 Nov 03 03:51:40.754202 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 118/257] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:51:40 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:40.769472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d863e08-82e5-4813-8325-3d9a1f399791 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:40.786123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d863e08-82e5-4813-8325-3d9a1f399791 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:40.786619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d863e08-82e5-4813-8325-3d9a1f399791 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:40.787061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d863e08-82e5-4813-8325-3d9a1f399791 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:40.994782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:41.000850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:41.019840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:41.020813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:41.022251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:41.030741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:41.031818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:41.034719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:41.209909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:41.222044 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af9b1446-bd50-4d22-ad00-2b85ab7a29e8 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1278 microversion: 2.1 time: 0.236467 Nov 03 03:51:41.222760 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 119/258] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:40 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:41.286108 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0d863e08-82e5-4813-8325-3d9a1f399791 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.520676 Nov 03 03:51:41.287548 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 140/259] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:40 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:41.303441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5d69eb6-de9c-4861-8c06-67ac11c36874 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:41.465664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5d69eb6-de9c-4861-8c06-67ac11c36874 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.170003 Nov 03 03:51:41.470335 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 120/260] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:41 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:41.480739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-29bcf002-a272-431e-bfc8-5dcbed5b337a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1184363387"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:41.490345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-29bcf002-a272-431e-bfc8-5dcbed5b337a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid 8db1323f-8e7e-4303-a8dc-90087b3686f7 for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:41.638087 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-29bcf002-a272-431e-bfc8-5dcbed5b337a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.160983 Nov 03 03:51:41.646404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 141/261] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:41.652806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45177758-bf17-4e51-a7c8-5aa6822f38c9 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:41.701366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45177758-bf17-4e51-a7c8-5aa6822f38c9 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:41.704372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45177758-bf17-4e51-a7c8-5aa6822f38c9 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:41.709240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45177758-bf17-4e51-a7c8-5aa6822f38c9 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:42.145403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:42.146244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:42.158689 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45177758-bf17-4e51-a7c8-5aa6822f38c9 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.511802 Nov 03 03:51:42.160172 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 121/262] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:41 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:42.164494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:42.164494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:42.165852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3484550f-890b-4d7c-9c17-cc3ab78d39b3 req-2f428229-da46-4944-b305-eae28fe9a52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda48a2a-0f23-488b-8c52-4ba9ef3d808c", "tag": "43461328-2908-4d9b-8eef-f25845c12b25"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:42.170560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:42.171449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:42.171947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:42.172394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:42.182982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:42.206881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3484550f-890b-4d7c-9c17-cc3ab78d39b3 req-2f428229-da46-4944-b305-eae28fe9a52f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:42.210972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3484550f-890b-4d7c-9c17-cc3ab78d39b3 req-2f428229-da46-4944-b305-eae28fe9a52f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:42.210972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3484550f-890b-4d7c-9c17-cc3ab78d39b3 req-2f428229-da46-4944-b305-eae28fe9a52f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:42.223193 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3484550f-890b-4d7c-9c17-cc3ab78d39b3 req-2f428229-da46-4944-b305-eae28fe9a52f service nova] Creating event network-changed:43461328-2908-4d9b-8eef-f25845c12b25 for instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c on n-h2-854653-7 Nov 03 03:51:42.253996 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3484550f-890b-4d7c-9c17-cc3ab78d39b3 req-2f428229-da46-4944-b305-eae28fe9a52f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087991 Nov 03 03:51:42.255791 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 122/263] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:42.289355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47e9aee9-be6c-40c5-8691-3ce451f2c924 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:42.342409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e9aee9-be6c-40c5-8691-3ce451f2c924 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:42.346685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e9aee9-be6c-40c5-8691-3ce451f2c924 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:42.348705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e9aee9-be6c-40c5-8691-3ce451f2c924 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:42.777378 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-47e9aee9-be6c-40c5-8691-3ce451f2c924 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.517911 Nov 03 03:51:42.778371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 123/264] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:42 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:42.783202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:42.787515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:42.808108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:42.808933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:42.810591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:42.814324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:42.814991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:42.816438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:42.871038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:42.955089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:42.972521 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-05bc4bb5-928d-46db-9bfc-ba71d3b7110e tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 200 len: 1587 microversion: 2.1 time: 0.825710 Nov 03 03:51:42.973745 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 142/265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:42 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 1587 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:42.979539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-962d5562-f5c2-4162-a88a-337d1741c84e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.076451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:43.088282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b37def16-db5b-4baf-8064-e91251d071ba tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1276 microversion: 2.1 time: 0.307692 Nov 03 03:51:43.090321 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 124/266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:42 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:43.129956 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-962d5562-f5c2-4162-a88a-337d1741c84e tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.154821 Nov 03 03:51:43.130554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 143/267] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:42 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:43.142745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e498be7a-029a-4bf8-83b3-a9352c8e63b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1849403976"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:43.158286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-e498be7a-029a-4bf8-83b3-a9352c8e63b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid 5c4a853c-5c48-4e92-8e68-96f4b609bde6 for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:43.293339 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e498be7a-029a-4bf8-83b3-a9352c8e63b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.156898 Nov 03 03:51:43.294888 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 144/268] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:43.305621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9cf6790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.319435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.325774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.325774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.325774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.326538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.326538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.371088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-36284702", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:43.432379 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bef8e9f4-65c3-4549-afab-494e974de379 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.136124 Nov 03 03:51:43.432997 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 145/269] 10.222.0.30 () {58 vars in 1128 bytes} [Thu Nov 3 03:51:43 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:43.461555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-92cef916-8f3b-4cbd-ad23-f5df59907140 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.494747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:51:43.592874 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-92cef916-8f3b-4cbd-ad23-f5df59907140 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.145423 Nov 03 03:51:43.593787 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 146/270] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:43 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:43.601442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9e8b0d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.605813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.606585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.608615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.609984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.611162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.611808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.643719 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f812f50b-b477-4746-bd55-3b90e83afaad tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.048098 Nov 03 03:51:43.653694 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 147/271] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:51:43 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:43.661799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d5f932a-cc2e-45e6-9357-bbeac79ca53a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.671135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7d5f932a-cc2e-45e6-9357-bbeac79ca53a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d5f932a-cc2e-45e6-9357-bbeac79ca53a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Request method failure captured: Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqVPN3j6OCZqop2YDDwHrta3cEodSkHeDAb-8E6PidFYOKwQRC-TR6i9M5AnYkMvU8t70b4mm64vzUc6LIRlHM0i7tUE_XqVNEqLrvsbw-uUkWqYX0dYat271Bpqm8ajjuXYfKdw6iawG62Y_CtaEQmRjEtr0ND5U2lIqtTRqnNexI Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:43.675046 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_132f0386f4584fb2a9d60f79378bbbd1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/132f0386f4584fb2a9d60f79378bbbd1"}]}] Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 4aa0a4914b8149fba0726f58166526a4 Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: exception: Aggregate 5 could not be found. Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5'} Nov 03 03:51:43.676271 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:43.676992 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Nov 03 03:51:43.678035 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.682666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d5f932a-cc2e-45e6-9357-bbeac79ca53a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:43.684056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d5f932a-cc2e-45e6-9357-bbeac79ca53a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.028786 Nov 03 03:51:43.685242 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 148/272] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:51:43 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:51:43.691914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9e938b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.698265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.699029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.699638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.701227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.702035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.702838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.736331 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-538e89eb-ad65-4aa5-9481-73842f9d3363 tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.049733 Nov 03 03:51:43.743506 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 149/273] 10.222.0.30 () {58 vars in 1128 bytes} [Thu Nov 3 03:51:43 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:43.748944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7be661e8-e646-461a-99be-a34691cc9741 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.761274 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7be661e8-e646-461a-99be-a34691cc9741 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7be661e8-e646-461a-99be-a34691cc9741 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Request method failure captured: Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqVPN3j6OCZqop2YDDwHrta3cEodSkHeDAb-8E6PidFYOKwQRC-TR6i9M5AnYkMvU8t70b4mm64vzUc6LIRlHM0i7tUE_XqVNEqLrvsbw-uUkWqYX0dYat271Bpqm8ajjuXYfKdw6iawG62Y_CtaEQmRjEtr0ND5U2lIqtTRqnNexI Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:43.764491 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_132f0386f4584fb2a9d60f79378bbbd1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/132f0386f4584fb2a9d60f79378bbbd1"}]}] Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 4aa0a4914b8149fba0726f58166526a4 Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: exception: Aggregate 5 could not be found. Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5'} Nov 03 03:51:43.765742 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:51:43.766423 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:43.767428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:43.768507 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:43.768507 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:43.768507 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:43.768507 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Nov 03 03:51:43.768507 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:43.776223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7be661e8-e646-461a-99be-a34691cc9741 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:43.778324 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7be661e8-e646-461a-99be-a34691cc9741 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.032704 Nov 03 03:51:43.779470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 150/274] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:43 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:51:43.789458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4ee8159-e3b9-4ea6-8305-c5323f1e09ce tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-516819607"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:43.798418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-d4ee8159-e3b9-4ea6-8305-c5323f1e09ce tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Generated uuid ddaa8429-887a-4bf0-a6a0-04c1fa1124ef for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:43.889765 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4ee8159-e3b9-4ea6-8305-c5323f1e09ce tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.108663 Nov 03 03:51:43.897298 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 151/275] 10.222.0.30 () {62 vars in 1205 bytes} [Thu Nov 3 03:51:43 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:43.906649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9e3f5e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:43.925757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.926326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.926773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.966270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:43.966822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:43.967252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:43.976670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:51:43.977563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:51:43.978496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:51:43.979087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:51:43.979680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:51:44.012097 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-237b011f-6e31-434b-a067-dacf1d8ad0cf tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-h2-854653-7" status: 200 len: 467 microversion: 2.1 time: 0.120394 Nov 03 03:51:44.012687 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 152/276] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Nov 3 03:51:43 2022] GET /compute/v2.1/os-hosts/n-h2-854653-7 => generated 467 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:44.017914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:44.021885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:44.036180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c212a35b-916b-47ff-91bc-014da2e1c3c6 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-606437856", "name": "tempest-test_aggregate-1132797083"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:44.039552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:44.040402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:44.040889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:44.041355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:44.044566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-c212a35b-916b-47ff-91bc-014da2e1c3c6 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid 3fc92bb4-7694-4a90-b0f2-b6f03ed79605 for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:44.111255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:44.118099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:44.152322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:51:44.157528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:51:44.172542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c212a35b-916b-47ff-91bc-014da2e1c3c6 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.155586 Nov 03 03:51:44.174554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 153/277] 10.222.0.30 () {60 vars in 1165 bytes} [Thu Nov 3 03:51:44 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:44.186720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f284e78-b94b-482e-acd4-d1e37ee146f6 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-76118059"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:44.431038 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-761ac342-d6cb-429d-be62-6ef8a494193f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.338102 Nov 03 03:51:44.433174 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 125/278] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:51:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:51:44.440352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Calling method '.version_select at 0x7ff7f9e1c0d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:44.460965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:44.464318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:44.465595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:44.509652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:44.510672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:44.514263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:44.565281 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-94e8562b-d31e-46ab-b37b-f9def273f24f tempest-HostsAdminTestJSON-1679145144 tempest-HostsAdminTestJSON-1679145144-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hosts/n-h1-854653-7" status: 200 len: 467 microversion: 2.1 time: 0.128623 Nov 03 03:51:44.567749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 126/279] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Nov 3 03:51:44 2022] GET /compute/v2.1/os-hosts/n-h1-854653-7 => generated 467 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:44.587384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:44.590302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:44.599073 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f284e78-b94b-482e-acd4-d1e37ee146f6 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 297 microversion: 2.41 time: 0.423141 Nov 03 03:51:44.608843 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 154/280] 10.222.0.30 () {62 vars in 1210 bytes} [Thu Nov 3 03:51:44 2022] PUT /compute/v2.1/os-aggregates/6 => generated 297 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:44.612547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:44.614828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:44.616174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:44.618956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec29ac00-eb7f-43ad-88c9-6bd876d87219 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:44.620999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:44.621603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:44.624277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:44.745112 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec29ac00-eb7f-43ad-88c9-6bd876d87219 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.134631 Nov 03 03:51:44.747928 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 155/281] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:44 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:44.761460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b16edbce-7121-4f56-ab83-6eee0ba2db56 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:44.762564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b16edbce-7121-4f56-ab83-6eee0ba2db56 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:45.189667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b16edbce-7121-4f56-ab83-6eee0ba2db56 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:45.201284 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b16edbce-7121-4f56-ab83-6eee0ba2db56 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1215 microversion: 2.1 time: 0.452233 Nov 03 03:51:45.204036 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 156/282] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:44 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1215 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:45.216042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23223908-b69f-47c9-8100-07b7ad449349 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:45.253245 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23223908-b69f-47c9-8100-07b7ad449349 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 297 microversion: 2.41 time: 0.047036 Nov 03 03:51:45.262145 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 157/283] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Nov 3 03:51:45 2022] GET /compute/v2.1/os-aggregates/6 => generated 297 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:45.279857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80362d50-e148-4162-9d7f-dd05dfce9c8d tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:45.295151 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-80362d50-e148-4162-9d7f-dd05dfce9c8d tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80362d50-e148-4162-9d7f-dd05dfce9c8d tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Request method failure captured: Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqVPN3j6OCZqop2YDDwHrta3cEodSkHeDAb-8E6PidFYOKwQRC-TR6i9M5AnYkMvU8t70b4mm64vzUc6LIRlHM0i7tUE_XqVNEqLrvsbw-uUkWqYX0dYat271Bpqm8ajjuXYfKdw6iawG62Y_CtaEQmRjEtr0ND5U2lIqtTRqnNexI Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:45.296741 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_132f0386f4584fb2a9d60f79378bbbd1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/132f0386f4584fb2a9d60f79378bbbd1"}]}] Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 4aa0a4914b8149fba0726f58166526a4 Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: exception: Aggregate 7 could not be found. Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7'} Nov 03 03:51:45.298173 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:45.298887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 03 03:51:45.299952 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.306849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80362d50-e148-4162-9d7f-dd05dfce9c8d tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:45.307997 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80362d50-e148-4162-9d7f-dd05dfce9c8d tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.044605 Nov 03 03:51:45.310481 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 158/284] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:51:45 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:51:45.325577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3e8c7eb8-01e3-4ed7-916e-411170c673af tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:45.347504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e8c7eb8-01e3-4ed7-916e-411170c673af tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:45.348258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e8c7eb8-01e3-4ed7-916e-411170c673af tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:45.348929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e8c7eb8-01e3-4ed7-916e-411170c673af tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:45.440982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:45.449366 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7f796b0f-44ce-453a-932f-20f8a88ac896 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.880281 Nov 03 03:51:45.453386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 127/285] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:44 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:45.464634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2087f700-587c-4966-8f62-1c9fe1f13a8a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:45.516890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2087f700-587c-4966-8f62-1c9fe1f13a8a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2087f700-587c-4966-8f62-1c9fe1f13a8a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Request method failure captured: Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqVPN3j6OCZqop2YDDwHrta3cEodSkHeDAb-8E6PidFYOKwQRC-TR6i9M5AnYkMvU8t70b4mm64vzUc6LIRlHM0i7tUE_XqVNEqLrvsbw-uUkWqYX0dYat271Bpqm8ajjuXYfKdw6iawG62Y_CtaEQmRjEtr0ND5U2lIqtTRqnNexI Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:51:45.532988 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_132f0386f4584fb2a9d60f79378bbbd1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/132f0386f4584fb2a9d60f79378bbbd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/132f0386f4584fb2a9d60f79378bbbd1"}]}] Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 132f0386f4584fb2a9d60f79378bbbd1 Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1127941415 Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 4aa0a4914b8149fba0726f58166526a4 Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminTestJSON-1127941415-project-admin Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: exception: Aggregate 7 could not be found. Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7'} Nov 03 03:51:45.534272 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:51:45.535135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:45.536133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:45.538322 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:45.538322 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:45.538322 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:45.538322 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 03 03:51:45.538322 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:45.538322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2087f700-587c-4966-8f62-1c9fe1f13a8a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:45.540913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2087f700-587c-4966-8f62-1c9fe1f13a8a tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.085505 Nov 03 03:51:45.541552 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 128/286] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:45 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:51:45.563683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9855b448-318b-45be-9eab-7561189b865c tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1125469126"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:45.586768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-9855b448-318b-45be-9eab-7561189b865c tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid 5900a3e8-b936-4b89-b677-52338e9b37db for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:45.747450 n-d-854653-7 devstack@n-api.service[127593]: WARNING nova.scheduler.client.report [None req-3e8c7eb8-01e3-4ed7-916e-411170c673af tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] [req-595e9b7d-45f1-4120-9718-e340f2fedcc5] Failed to update aggregates to [ddaa8429-887a-4bf0-a6a0-04c1fa1124ef] for resource provider with UUID 6e7934f1-7f6f-40fa-8cdf-da0f555f1256. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-595e9b7d-45f1-4120-9718-e340f2fedcc5"}]} Nov 03 03:51:45.760414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9855b448-318b-45be-9eab-7561189b865c tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.209893 Nov 03 03:51:45.761071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 129/287] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:45.793845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32277b6a-d4b8-4422-8c09-5b753f7e1d73 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:45.860595 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-32277b6a-d4b8-4422-8c09-5b753f7e1d73 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.084887 Nov 03 03:51:45.881806 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 130/288] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:51:45 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:45.898872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-619a52f6-cd82-4f7f-9190-d0d4ea2284cc tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:46.017072 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-619a52f6-cd82-4f7f-9190-d0d4ea2284cc tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.125116 Nov 03 03:51:46.026905 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 131/289] 10.222.0.30 () {60 vars in 1191 bytes} [Thu Nov 3 03:51:45 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:46.035320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b069fd5b-ced9-466d-aae6-4ffb0f99ec9f tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:46.049663 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b069fd5b-ced9-466d-aae6-4ffb0f99ec9f tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.020654 Nov 03 03:51:46.060171 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 132/290] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:51:46 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:46.066494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7914d317-c020-4a6b-840a-ad3e7f57b3d9 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:46.165559 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3e8c7eb8-01e3-4ed7-916e-411170c673af tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 312 microversion: 2.41 time: 0.853715 Nov 03 03:51:46.166998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 159/291] 10.222.0.30 () {62 vars in 1232 bytes} [Thu Nov 3 03:51:45 2022] POST /compute/v2.1/os-aggregates/6/action => generated 312 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:46.180254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fcdf1cd-ed93-4b0b-8602-0c070be339da tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:46.199084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=84,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:46.207559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fcdf1cd-ed93-4b0b-8602-0c070be339da tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:46.211266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fcdf1cd-ed93-4b0b-8602-0c070be339da tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:46.211978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fcdf1cd-ed93-4b0b-8602-0c070be339da tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:46.227454 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7914d317-c020-4a6b-840a-ad3e7f57b3d9 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.165737 Nov 03 03:51:46.228568 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 133/292] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:46 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:46.260225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d671d849-71de-4da9-812f-553b24d3d9ea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:46.260893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d671d849-71de-4da9-812f-553b24d3d9ea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:46.467123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d671d849-71de-4da9-812f-553b24d3d9ea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:46.477582 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d671d849-71de-4da9-812f-553b24d3d9ea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1215 microversion: 2.1 time: 0.240529 Nov 03 03:51:46.485180 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 134/293] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:46 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:46.491086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a501b2a8-4174-4525-8aae-c7a1da581cf2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-667189994", "availability_zone": "tempest-test_az-136030130"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:46.521630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-a501b2a8-4174-4525-8aae-c7a1da581cf2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid 31f5d737-01a9-46a7-bfd4-cf6bed1f270d for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:46.592475 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2fcdf1cd-ed93-4b0b-8602-0c070be339da tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 297 microversion: 2.41 time: 0.417157 Nov 03 03:51:46.593767 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 160/294] 10.222.0.30 () {62 vars in 1232 bytes} [Thu Nov 3 03:51:46 2022] POST /compute/v2.1/os-aggregates/6/action => generated 297 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:51:46.600583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:46.601584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:46.623492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:46.627120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:46.630492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:46.633687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:46.635255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:46.639401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:46.666786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a501b2a8-4174-4525-8aae-c7a1da581cf2 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.186566 Nov 03 03:51:46.682149 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 135/295] 10.222.0.30 () {60 vars in 1165 bytes} [Thu Nov 3 03:51:46 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:46.701080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7413168a-d0f9-43a0-ba5b-f16f1e0e3aa1 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:46.823100 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7413168a-d0f9-43a0-ba5b-f16f1e0e3aa1 tempest-AggregatesAdminTestV241-365544813 tempest-AggregatesAdminTestV241-365544813-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.138581 Nov 03 03:51:46.824079 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 136/296] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 03:51:46 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:46.848694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-414d4bc3-52ff-43b2-8a31-7d890c7011b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-667189994_new", "availability_zone": "tempest-test_az-136030130_new"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:46.998943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:47.006647 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00c1754f-f105-4471-bf19-e48023556b07 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.411204 Nov 03 03:51:47.009731 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 161/297] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:46 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:47.048354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-cc5026c0-ab40-418b-999d-1a1f6ecb545f req-05d99395-6d6b-4659-9c7f-fee92cac2f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa187bd2-73c4-4b20-b806-45b82425c98e", "tag": "f405e8ee-adc5-4b5a-973a-82f7af6ecd61"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:47.062173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc5026c0-ab40-418b-999d-1a1f6ecb545f req-05d99395-6d6b-4659-9c7f-fee92cac2f91 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:47.065035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc5026c0-ab40-418b-999d-1a1f6ecb545f req-05d99395-6d6b-4659-9c7f-fee92cac2f91 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:47.067354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc5026c0-ab40-418b-999d-1a1f6ecb545f req-05d99395-6d6b-4659-9c7f-fee92cac2f91 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:47.137845 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-cc5026c0-ab40-418b-999d-1a1f6ecb545f req-05d99395-6d6b-4659-9c7f-fee92cac2f91 service nova] Creating event network-changed:f405e8ee-adc5-4b5a-973a-82f7af6ecd61 for instance aa187bd2-73c4-4b20-b806-45b82425c98e on n-h1-854653-7 Nov 03 03:51:47.146793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-cc5026c0-ab40-418b-999d-1a1f6ecb545f req-05d99395-6d6b-4659-9c7f-fee92cac2f91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101068 Nov 03 03:51:47.149336 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 162/298] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:47.264204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414d4bc3-52ff-43b2-8a31-7d890c7011b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:47.265007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414d4bc3-52ff-43b2-8a31-7d890c7011b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:47.265694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414d4bc3-52ff-43b2-8a31-7d890c7011b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:47.423805 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-414d4bc3-52ff-43b2-8a31-7d890c7011b5 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.598460 Nov 03 03:51:47.432266 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 137/299] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 03:51:46 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:47.439156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bfeb2a97-d57c-41da-aa18-d56ad5fa40d8 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:47.454064 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bfeb2a97-d57c-41da-aa18-d56ad5fa40d8 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.021297 Nov 03 03:51:47.454965 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 163/300] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:51:47 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:47.466998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1edbbd03-2e7b-4fe9-9c01-39b9c1465b23 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:47.501155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:47.502431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:47.512147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:47.515587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:47.516075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:47.516826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:47.517331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:47.524768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:47.566769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1edbbd03-2e7b-4fe9-9c01-39b9c1465b23 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.104193 Nov 03 03:51:47.569634 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 138/301] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:47 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:47.581215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aad65b79-0cb5-48ab-9000-f6f983a05f11 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-845454025"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:47.604410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-aad65b79-0cb5-48ab-9000-f6f983a05f11 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Generated uuid 2a5b8f66-8d7a-4ce3-b3e2-a96da5f6293a for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:47.751478 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aad65b79-0cb5-48ab-9000-f6f983a05f11 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.175505 Nov 03 03:51:47.753775 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 139/302] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:47.773383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dad90988-b713-4d1c-9e56-1013bfae396c tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:47.781835 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dad90988-b713-4d1c-9e56-1013bfae396c tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.013332 Nov 03 03:51:47.784108 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 140/303] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:51:47 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:47.809622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-313c9ada-0edb-4635-9b8c-7fe45c1c6396 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:47.921749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:47.928350 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-313c9ada-0edb-4635-9b8c-7fe45c1c6396 tempest-AggregatesAdminTestJSON-1127941415 tempest-AggregatesAdminTestJSON-1127941415-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.122575 Nov 03 03:51:47.934556 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 141/304] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:51:47 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:51:47.952549 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6050e7a3-d66b-402b-bdeb-8dc8c0f62211 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1267 microversion: 2.1 time: 0.455211 Nov 03 03:51:47.952773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:47.954008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:47.959413 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 164/305] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:47 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1267 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:47.973397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:47.973397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:47.973397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:47.977126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:47.979285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:47.980453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:48.010129 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] HTTP exception thrown: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Request method failure captured: Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 HTTP/1.1 Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqSF1bE4RxALQK8o1MhTwbjsnKlt-nOF2QUsnMzoKsLRO-Ot5Sy1DDu-d_x1chKmFcM0W9vWv7BG8emyHBvpwnrj7MfltVuLVMPd6Otwd0dTuz0buMhy4OMulUeznV8YbT2wTFdqTNXAfnTS377yYCF7MRRWpdpObtEGXdybnguPiM Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 75ede494be4a4f58a3df4212ef360327 Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:48.029522 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75ede494be4a4f58a3df4212ef360327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75ede494be4a4f58a3df4212ef360327", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75ede494be4a4f58a3df4212ef360327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75ede494be4a4f58a3df4212ef360327"}]}] Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 75ede494be4a4f58a3df4212ef360327 Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminTestJSON-1618552662-project Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 4b5717a94b93410b92e4229ccee24bb6 Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminTestJSON-1618552662-project Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.032938 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4c1c14ed-9f5b-4141-8cba-4cfeea85fc87'} Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:48.033846 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.035183 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.036830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Returning 404 to user: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:48.040408 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a7391d10-9d5b-43e9-b337-5690b0294920 tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 404 len: 111 microversion: 2.1 time: 0.103881 Nov 03 03:51:48.046519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:48.047390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:48.047948 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 142/306] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:51:47 2022] DELETE /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:48.058942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:48.060415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] [instance: 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:48.066181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=9,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:48.068540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:48.070690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:48.071359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:48.079540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:48.083435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:48.083435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:48.083435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:48.083435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:48.083735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:48.089894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:48.092619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:48.094960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:48.107507 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] HTTP exception thrown: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Request method failure captured: Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 HTTP/1.1 Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqSF1bE4RxALQK8o1MhTwbjsnKlt-nOF2QUsnMzoKsLRO-Ot5Sy1DDu-d_x1chKmFcM0W9vWv7BG8emyHBvpwnrj7MfltVuLVMPd6Otwd0dTuz0buMhy4OMulUeznV8YbT2wTFdqTNXAfnTS377yYCF7MRRWpdpObtEGXdybnguPiM Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 75ede494be4a4f58a3df4212ef360327 Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:48.114940 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75ede494be4a4f58a3df4212ef360327"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75ede494be4a4f58a3df4212ef360327", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75ede494be4a4f58a3df4212ef360327"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75ede494be4a4f58a3df4212ef360327"}]}] Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 75ede494be4a4f58a3df4212ef360327 Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1618552662 Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminTestJSON-1618552662-project Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 4b5717a94b93410b92e4229ccee24bb6 Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminTestJSON-1618552662-project Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.116985 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4c1c14ed-9f5b-4141-8cba-4cfeea85fc87'} Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:48.117820 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. Nov 03 03:51:48.119216 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:48.120223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] Returning 404 to user: Instance 4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:48.120223 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2fc0a715-1ff4-4528-83ad-be5ec27cc5de tempest-AggregatesAdminTestJSON-1618552662 tempest-AggregatesAdminTestJSON-1618552662-project] 10.222.0.30 "GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87" status: 404 len: 111 microversion: 2.1 time: 0.061975 Nov 03 03:51:48.120223 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 143/307] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:48 2022] GET /compute/v2.1/servers/4c1c14ed-9f5b-4141-8cba-4cfeea85fc87 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:48.987250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:48.988714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:49.008021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:49.013401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:49.014380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:49.020510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:49.021391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:49.022104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:49.639069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:49.639069 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7305bdc8-af5f-403c-a253-a468000e220a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 1.196532 Nov 03 03:51:49.639069 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 165/308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:48 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:49.641387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:49.641387 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-63c970b2-d15d-4cf1-a1cf-43db27ff3067 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1285 microversion: 2.1 time: 0.288008 Nov 03 03:51:49.641387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 144/309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:48 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1285 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:50.401330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:50.402256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:50.402465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:50.403082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:50.416031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:50.418286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:50.418693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:50.420168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:50.421128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:50.424097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:50.433953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:50.433953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:50.434247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:50.434351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:50.434351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:50.434351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:50.686997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:50.698653 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-267e01fd-b9de-4298-bda3-11303b2763a8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1273 microversion: 2.1 time: 0.299976 Nov 03 03:51:50.699310 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 145/310] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:50 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1273 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:51.052241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:51.071722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43d85b12-c132-45a5-b2df-ebd3b237b34e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.670434 Nov 03 03:51:51.072618 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 166/311] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:50 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:51.723867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:51.724502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:51.734088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:51.738491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:51.742075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:51.743864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:51.743864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:51.743864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:52.097164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:52.097789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:52.104720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:52.124944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:52.124944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:52.124944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:52.124944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:52.125339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:52.389964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:52.405716 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9613232f-73bf-4f1d-b4e7-7ae640e2e997 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1315 microversion: 2.1 time: 0.686415 Nov 03 03:51:52.417039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 146/312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:51 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1315 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:52.604754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:52.615436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a6f5415-70ad-481d-98af-6a8b9e24a028 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.522070 Nov 03 03:51:52.615922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 167/313] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:52 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:53.170154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ef8576fd-a70d-4342-8d1a-fcc7fc768a77 req-7f00a7a4-d7e9-4d22-9351-9b537e38cd10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bb3703-e5fe-4369-a8d8-c04bd950e0ab", "tag": "965270ad-8778-4af5-9ceb-f4a595bdad96"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:53.193435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ef8576fd-a70d-4342-8d1a-fcc7fc768a77 req-7f00a7a4-d7e9-4d22-9351-9b537e38cd10 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:53.194416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ef8576fd-a70d-4342-8d1a-fcc7fc768a77 req-7f00a7a4-d7e9-4d22-9351-9b537e38cd10 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:53.196561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ef8576fd-a70d-4342-8d1a-fcc7fc768a77 req-7f00a7a4-d7e9-4d22-9351-9b537e38cd10 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:53.224259 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ef8576fd-a70d-4342-8d1a-fcc7fc768a77 req-7f00a7a4-d7e9-4d22-9351-9b537e38cd10 service nova] Creating event network-changed:965270ad-8778-4af5-9ceb-f4a595bdad96 for instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab on n-h2-854653-7 Nov 03 03:51:53.234492 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ef8576fd-a70d-4342-8d1a-fcc7fc768a77 req-7f00a7a4-d7e9-4d22-9351-9b537e38cd10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068926 Nov 03 03:51:53.235776 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 147/314] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:53.436069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:53.437816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:53.451000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:53.453719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:53.454355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:53.460248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:53.462431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:53.463718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:53.659323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:53.660954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:53.672977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:53.676012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:53.678067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:53.679572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:53.682444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:53.684022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:53.720951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:53.961531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:53.978846 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-efca41ef-fc8c-479a-8360-ca6d02ee9f72 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1315 microversion: 2.1 time: 0.550813 Nov 03 03:51:53.988464 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 168/315] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:53 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:54.086175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:54.144476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:54.164093 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-06e070fd-6a36-4895-bf94-f2e7d74bce16 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.526315 Nov 03 03:51:54.170355 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 148/316] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:53 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:54.905860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-401043587", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "f004922e-d064-49aa-9c71-6a282c3fe25b"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:55.008526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:55.009188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:55.011895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] validate_networks() for [('f004922e-d064-49aa-9c71-6a282c3fe25b', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:51:55.023085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:55.023582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:55.031064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:55.033251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:55.035391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:55.041134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:55.197136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:55.892223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:55.906898 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1adf0ec9-35e9-4a6a-bf3f-8a52f0a7ca53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1315 microversion: 2.1 time: 0.901092 Nov 03 03:51:55.909331 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 149/317] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:55 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:55.927545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:55.930677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:55.944021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:55.946781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:55.949469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:55.951310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:55.957768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:55.957768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:56.202848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:56.214903 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-026743b2-d0c1-482c-9f3e-1f4fb496e3be tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.304220 Nov 03 03:51:56.218308 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 150/318] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:55 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:56.397909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:51:56.398962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:51:56.399656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:51:56.400279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:51:56.400916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:51:56.429160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:56.430237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:56.431099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:56.437576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:56.438696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:56.439369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:56.490240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:51:56.501582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for user c4a4d4a61500400faf673aa67ff8be39 and project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:51:56.524150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:51:56.528381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:51:56.623058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:56.717828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15b5fb75-b10b-47b7-abb4-46de0f7be5ec tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.332755 Nov 03 03:51:56.729694 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 169/319] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:51:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:51:56.734970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82090e35-c5d5-4c7d-8f01-20dfc6e34064 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:56.735592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82090e35-c5d5-4c7d-8f01-20dfc6e34064 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:56.813055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82090e35-c5d5-4c7d-8f01-20dfc6e34064 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:56.825732 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82090e35-c5d5-4c7d-8f01-20dfc6e34064 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1210 microversion: 2.1 time: 0.091062 Nov 03 03:51:56.825732 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 170/320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:56 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:56.937639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:56.938552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:56.952936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:56.955395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:56.956565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:56.958839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:56.960548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:56.964815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.239396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75e8df59-78a1-48c3-8002-45775f916c04 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Calling method '.version_select at 0x7ff7faef4160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.241257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75e8df59-78a1-48c3-8002-45775f916c04 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'd32018b55fa74c62ac59910051d31807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ba948064f426db019a9e0d8fff30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75e8df59-78a1-48c3-8002-45775f916c04 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Request method failure captured: Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrZVdJM_eQdugQGnPVqrUiBIQc_tj0XWMXvNlba_wTYJmPd5hqq5ziGIySBZ7V4ng_0D825CWSiqdAftdNBOZK6UPHK22Z1VzvbYhzUnyIZ_gy532AmVjRWhgZXhJ3xWcLcL75Abzk0cwvoW3vADHkbczZ3-iBhnhXlfQVhqc1KpJ0 Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:57.243200 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da9ba948064f426db019a9e0d8fff30e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da9ba948064f426db019a9e0d8fff30e"}]}] Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d32018b55fa74c62ac59910051d31807 Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: action_args: {} Nov 03 03:51:57.244630 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:57.245420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 03 03:51:57.246513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.249068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75e8df59-78a1-48c3-8002-45775f916c04 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:57.250953 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75e8df59-78a1-48c3-8002-45775f916c04 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.632551 Nov 03 03:51:57.251715 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 151/321] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Nov 3 03:51:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 634 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:57.263499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.264364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:57.278892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.279666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.280319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.281252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.281898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.282534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.512286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:57.520080 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60eee6ec-dc28-4e61-bc31-3631b2b3af54 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1315 microversion: 2.1 time: 0.589005 Nov 03 03:51:57.521219 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 171/322] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:56 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:57.526466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e886a2cc-67df-43cc-9f4b-38761ddc3fe0 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Calling method '.version_select at 0x7ff7f9bcf430>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.528303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e886a2cc-67df-43cc-9f4b-38761ddc3fe0 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'd32018b55fa74c62ac59910051d31807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ba948064f426db019a9e0d8fff30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e886a2cc-67df-43cc-9f4b-38761ddc3fe0 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Request method failure captured: Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrZVdJM_eQdugQGnPVqrUiBIQc_tj0XWMXvNlba_wTYJmPd5hqq5ziGIySBZ7V4ng_0D825CWSiqdAftdNBOZK6UPHK22Z1VzvbYhzUnyIZ_gy532AmVjRWhgZXhJ3xWcLcL75Abzk0cwvoW3vADHkbczZ3-iBhnhXlfQVhqc1KpJ0 Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:51:57.530056 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da9ba948064f426db019a9e0d8fff30e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da9ba948064f426db019a9e0d8fff30e"}]}] Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d32018b55fa74c62ac59910051d31807 Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: action_args: {} Nov 03 03:51:57.531246 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:57.531982 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 03 03:51:57.533031 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.535601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e886a2cc-67df-43cc-9f4b-38761ddc3fe0 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:57.536637 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e886a2cc-67df-43cc-9f4b-38761ddc3fe0 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014026 Nov 03 03:51:57.541826 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 172/323] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:57 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:57.640717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:57.650132 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ff54823-56a7-4eed-ab4e-9e2e5663ff5e tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.396898 Nov 03 03:51:57.651046 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 152/324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:57 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:57.656048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f227891-4bac-4344-a418-88c8a2ba17f9 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Calling method '.version_select at 0x7ff7f9ad54c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.657977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f227891-4bac-4344-a418-88c8a2ba17f9 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'd32018b55fa74c62ac59910051d31807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ba948064f426db019a9e0d8fff30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f227891-4bac-4344-a418-88c8a2ba17f9 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Request method failure captured: Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrZVdJM_eQdugQGnPVqrUiBIQc_tj0XWMXvNlba_wTYJmPd5hqq5ziGIySBZ7V4ng_0D825CWSiqdAftdNBOZK6UPHK22Z1VzvbYhzUnyIZ_gy532AmVjRWhgZXhJ3xWcLcL75Abzk0cwvoW3vADHkbczZ3-iBhnhXlfQVhqc1KpJ0 Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:57.659808 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da9ba948064f426db019a9e0d8fff30e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da9ba948064f426db019a9e0d8fff30e"}]}] Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d32018b55fa74c62ac59910051d31807 Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: action_args: {} Nov 03 03:51:57.661290 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:57.662024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 03 03:51:57.663803 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:57.665155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f227891-4bac-4344-a418-88c8a2ba17f9 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:57.666144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f227891-4bac-4344-a418-88c8a2ba17f9 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.013795 Nov 03 03:51:57.671032 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 153/325] 10.222.0.30 () {58 vars in 1179 bytes} [Thu Nov 3 03:51:57 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:57.784441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.789332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.790078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.790688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.791593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.792356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.793131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.817145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:51:57.827118 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47bbfaae-1e57-46be-a622-9271eee741a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.283814 Nov 03 03:51:57.840877 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 173/326] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:51:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:57.873564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Calling method '.version_select at 0x7ff7f9a7cee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.877549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.877549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.877549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.911689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.913640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.914128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.914558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.915285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.915739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.917172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.933728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.935066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.936159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.958109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2cea7c4-71c5-47d7-a15c-4f057c8b1606 tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.114246 Nov 03 03:51:57.959840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:57.960612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:57.961402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:57.966345 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 174/327] 10.222.0.30 () {58 vars in 1164 bytes} [Thu Nov 3 03:51:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:51:57.971272 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-964d1c7d-b1b3-4492-9fc6-6a417fc1bff2 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.298868 Nov 03 03:51:57.971963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f54ccd96-df6c-4a82-970c-042c6a21bf19 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1046508031"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:57.972338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 154/328] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:57.979868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-f54ccd96-df6c-4a82-970c-042c6a21bf19 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid f4888dbb-7e57-43e4-bfd6-178f80c90f4d for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:57.980070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-962e17e1-39a2-472f-a816-ffda14cb793b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:57.980070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-962e17e1-39a2-472f-a816-ffda14cb793b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:58.050234 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f54ccd96-df6c-4a82-970c-042c6a21bf19 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082555 Nov 03 03:51:58.051184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 175/329] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:58.056937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.059798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.060407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.060955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.062576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.063514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.064189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.090451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-962e17e1-39a2-472f-a816-ffda14cb793b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:58.105645 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-962e17e1-39a2-472f-a816-ffda14cb793b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1210 microversion: 2.1 time: 0.131858 Nov 03 03:51:58.106483 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 155/330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:57 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:58.130487 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1482dec2-c049-4b5e-ae51-120c70698b1d tempest-AZAdminV2TestJSON-141886689 tempest-AZAdminV2TestJSON-141886689-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.077790 Nov 03 03:51:58.135489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97dc609b-d44f-4faa-9b14-d5dbc426c410 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Calling method '.version_select at 0x7ff7f9ad5af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.137375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97dc609b-d44f-4faa-9b14-d5dbc426c410 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'd32018b55fa74c62ac59910051d31807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ba948064f426db019a9e0d8fff30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97dc609b-d44f-4faa-9b14-d5dbc426c410 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Request method failure captured: Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrZVdJM_eQdugQGnPVqrUiBIQc_tj0XWMXvNlba_wTYJmPd5hqq5ziGIySBZ7V4ng_0D825CWSiqdAftdNBOZK6UPHK22Z1VzvbYhzUnyIZ_gy532AmVjRWhgZXhJ3xWcLcL75Abzk0cwvoW3vADHkbczZ3-iBhnhXlfQVhqc1KpJ0 Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:51:58.140801 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da9ba948064f426db019a9e0d8fff30e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da9ba948064f426db019a9e0d8fff30e"}]}] Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d32018b55fa74c62ac59910051d31807 Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '1'} Nov 03 03:51:58.142079 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:58.142789 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 03 03:51:58.143814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.144726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97dc609b-d44f-4faa-9b14-d5dbc426c410 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:58.144726 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97dc609b-d44f-4faa-9b14-d5dbc426c410 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.032655 Nov 03 03:51:58.148910 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 156/331] 10.222.0.30 () {58 vars in 1173 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:58.153834 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 176/332] 10.222.0.30 () {58 vars in 1185 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:58.154278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a87542ce-6003-47c2-a759-56b76e7068d9 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:58.171195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87542ce-6003-47c2-a759-56b76e7068d9 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.172040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87542ce-6003-47c2-a759-56b76e7068d9 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.172642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87542ce-6003-47c2-a759-56b76e7068d9 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.172953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4718066-950d-4741-9d5a-aa07cc758926 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Calling method '.version_select at 0x7ff7f9f0ef70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.176214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a4718066-950d-4741-9d5a-aa07cc758926 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] HTTP exception thrown: Hypervisor with ID 'bda124ff-cf39-4c5e-b3c5-a98d05d0421a' could not be found. Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4718066-950d-4741-9d5a-aa07cc758926 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Request method failure captured: Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hypervisors/bda124ff-cf39-4c5e-b3c5-a98d05d0421a/uptime HTTP/1.1 Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrcGh1vXC0AjS3kseHLNx5qIg714pxb24eitSiLO3QgW7RNuitQXPlgQthKCECQTwBChrRpeuOyld6aJ3MYVJIyZ6pfYcD_iLnR7nohfzOSUuCWPaDysC5tmY8FafXKiq5zKnl53ma2TH5hS3DbGBYFRIEhqDL9MxwgVtz2Ttyod20 Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: c65a8034fed245198e26d364ef970685 Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-89549346 Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:58.195641 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c65a8034fed245198e26d364ef970685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c65a8034fed245198e26d364ef970685", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c65a8034fed245198e26d364ef970685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c65a8034fed245198e26d364ef970685"}]}] Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-89549346 Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: c65a8034fed245198e26d364ef970685 Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-89549346 Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 8ffde2d6e82f4b46ba88be7be40a0a26 Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: exception: Hypervisor with ID 'bda124ff-cf39-4c5e-b3c5-a98d05d0421a' could not be found. Nov 03 03:51:58.211698 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'bda124ff-cf39-4c5e-b3c5-a98d05d0421a'} Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'bda124ff-cf39-4c5e-b3c5-a98d05d0421a' Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 03 03:51:58.212401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'bda124ff-cf39-4c5e-b3c5-a98d05d0421a' could not be found. Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.213813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'bda124ff-cf39-4c5e-b3c5-a98d05d0421a' could not be found. Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4718066-950d-4741-9d5a-aa07cc758926 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Returning 404 to user: Hypervisor with ID 'bda124ff-cf39-4c5e-b3c5-a98d05d0421a' could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a4718066-950d-4741-9d5a-aa07cc758926 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/bda124ff-cf39-4c5e-b3c5-a98d05d0421a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.041016 Nov 03 03:51:58.215485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 177/333] 10.222.0.30 () {58 vars in 1278 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/os-hypervisors/bda124ff-cf39-4c5e-b3c5-a98d05d0421a/uptime => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:58.216171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Calling method '.version_select at 0x7ff7f9c2c0d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.216171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.216171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.216171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.246045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.246708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.247217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.259776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.260274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.261783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.276351 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e1d7f030-447a-4263-855e-cf3b3f43a4b5 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.070386 Nov 03 03:51:58.277339 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 178/334] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:58.310559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb26ab4b-7cfd-454d-86a7-406fb1ca7881 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Calling method '.version_select at 0x7ff7fa1a9700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.312439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eb26ab4b-7cfd-454d-86a7-406fb1ca7881 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'd32018b55fa74c62ac59910051d31807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ba948064f426db019a9e0d8fff30e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb26ab4b-7cfd-454d-86a7-406fb1ca7881 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Request method failure captured: Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrZVdJM_eQdugQGnPVqrUiBIQc_tj0XWMXvNlba_wTYJmPd5hqq5ziGIySBZ7V4ng_0D825CWSiqdAftdNBOZK6UPHK22Z1VzvbYhzUnyIZ_gy532AmVjRWhgZXhJ3xWcLcL75Abzk0cwvoW3vADHkbczZ3-iBhnhXlfQVhqc1KpJ0 Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:51:58.314775 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_da9ba948064f426db019a9e0d8fff30e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/da9ba948064f426db019a9e0d8fff30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/da9ba948064f426db019a9e0d8fff30e"}]}] Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: da9ba948064f426db019a9e0d8fff30e Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304 Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d32018b55fa74c62ac59910051d31807 Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1915145304-project Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1'} Nov 03 03:51:58.316147 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:58.316865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 03 03:51:58.318260 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.320533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb26ab4b-7cfd-454d-86a7-406fb1ca7881 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:58.321599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb26ab4b-7cfd-454d-86a7-406fb1ca7881 tempest-HypervisorAdminNegativeTestJSON-1915145304 tempest-HypervisorAdminNegativeTestJSON-1915145304-project] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.029800 Nov 03 03:51:58.332873 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 179/335] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:58.351595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d729caa-9f94-486d-b7eb-a18e5b6e53a8 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Calling method '.version_select at 0x7ff7f9bde700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.354102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7d729caa-9f94-486d-b7eb-a18e5b6e53a8 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] HTTP exception thrown: Hypervisor with ID '428a4915-3fe9-4468-8571-307507a80471' could not be found. Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d729caa-9f94-486d-b7eb-a18e5b6e53a8 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Request method failure captured: Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-hypervisors/428a4915-3fe9-4468-8571-307507a80471 HTTP/1.1 Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrcGh1vXC0AjS3kseHLNx5qIg714pxb24eitSiLO3QgW7RNuitQXPlgQthKCECQTwBChrRpeuOyld6aJ3MYVJIyZ6pfYcD_iLnR7nohfzOSUuCWPaDysC5tmY8FafXKiq5zKnl53ma2TH5hS3DbGBYFRIEhqDL9MxwgVtz2Ttyod20 Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: c65a8034fed245198e26d364ef970685 Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-89549346 Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:51:58.356631 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c65a8034fed245198e26d364ef970685"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c65a8034fed245198e26d364ef970685", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c65a8034fed245198e26d364ef970685"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c65a8034fed245198e26d364ef970685"}]}] Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-89549346 Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: c65a8034fed245198e26d364ef970685 Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-89549346 Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 8ffde2d6e82f4b46ba88be7be40a0a26 Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: exception: Hypervisor with ID '428a4915-3fe9-4468-8571-307507a80471' could not be found. Nov 03 03:51:58.358014 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '428a4915-3fe9-4468-8571-307507a80471'} Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '428a4915-3fe9-4468-8571-307507a80471' Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 03 03:51:58.358830 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:51:58.360510 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '428a4915-3fe9-4468-8571-307507a80471' could not be found. Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '428a4915-3fe9-4468-8571-307507a80471' could not be found. Nov 03 03:51:58.361750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.363138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d729caa-9f94-486d-b7eb-a18e5b6e53a8 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] Returning 404 to user: Hypervisor with ID '428a4915-3fe9-4468-8571-307507a80471' could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:58.364142 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d729caa-9f94-486d-b7eb-a18e5b6e53a8 tempest-HypervisorAdminNegativeTestJSON-89549346 tempest-HypervisorAdminNegativeTestJSON-89549346-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/428a4915-3fe9-4468-8571-307507a80471" status: 404 len: 123 microversion: 2.1 time: 0.024089 Nov 03 03:51:58.364828 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 180/336] 10.222.0.30 () {58 vars in 1257 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/os-hypervisors/428a4915-3fe9-4468-8571-307507a80471 => generated 123 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:58.544870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.545536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:58.555434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.556127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.556832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.557740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.561123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.561123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.598717 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a87542ce-6003-47c2-a759-56b76e7068d9 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.442873 Nov 03 03:51:58.605429 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 157/337] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:51:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:58.613050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:58.627340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.628422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.629080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.722765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-854653-7. Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 39 Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:51:58.726296 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: {"add_host": {"host": "n-h2-854653-7"}} Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:51:58.727707 n-d-854653-7 devstack@n-api.service[127594]: exception: Aggregate 11 already has host n-h2-854653-7. Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-854653-7'}}} Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result.read() Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 03 03:51:58.728449 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854653-7-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi session.flush() Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 03 03:51:58.729535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 03 03:51:58.730566 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 03 03:51:58.731541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result.read() Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854653-7-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 3, 3, 51, 58, 662828), 'updated_at': None, 'host': 'n-h2-854653-7', 'aggregate_id': 11}] Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.732504 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-854653-7. Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.735634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-854653-7. Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:51:58.741670 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:51:58.744910 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-854653-7. Nov 03 03:51:58.744910 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:51:58.744910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-854653-7. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:58.744910 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14c20a1e-fcc4-423f-9169-216761950dcb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.120079 Nov 03 03:51:58.744910 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 158/338] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:51:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 03 03:51:58.745949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:58.746454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:58.765933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.765933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.766090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.766687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.767143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.767656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:58.841596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:58.851911 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b3454807-ed65-4557-9104-0a92d063d906 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1315 microversion: 2.1 time: 0.309878 Nov 03 03:51:58.852751 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 181/339] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:58.858199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-100ecd2a-2afb-4534-b824-8a7415607946 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:58.902610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-100ecd2a-2afb-4534-b824-8a7415607946 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:58.905515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-100ecd2a-2afb-4534-b824-8a7415607946 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:58.905988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-100ecd2a-2afb-4534-b824-8a7415607946 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:59.076646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:59.092875 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87238756-eacd-455d-b564-e16dc6eff856 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.360056 Nov 03 03:51:59.099424 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 159/340] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:58 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:51:59.132548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:59.132966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:59.142412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:59.143196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:59.148879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:59.148879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:59.148879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:59.148879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:59.282957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:59.291774 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8609895-dbfa-4e4a-bb4c-2f622708cf39 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1206 microversion: 2.1 time: 0.163471 Nov 03 03:51:59.292924 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 160/341] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:59 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1206 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:51:59.396063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-100ecd2a-2afb-4534-b824-8a7415607946 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.541553 Nov 03 03:51:59.398190 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 182/342] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:51:58 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:59.410667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-38ee7da3-d875-4015-b4b5-7794e8f26a55 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:59.442143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-52e62145-4635-4d9f-8e7f-cc48cd7e0dc9 req-07c7e86c-e4df-469c-bd5f-550123bf4376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa187bd2-73c4-4b20-b806-45b82425c98e", "name": "network-vif-plugged", "status": "completed", "tag": "f405e8ee-adc5-4b5a-973a-82f7af6ecd61"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:59.493999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52e62145-4635-4d9f-8e7f-cc48cd7e0dc9 req-07c7e86c-e4df-469c-bd5f-550123bf4376 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:59.496818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52e62145-4635-4d9f-8e7f-cc48cd7e0dc9 req-07c7e86c-e4df-469c-bd5f-550123bf4376 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:59.498722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52e62145-4635-4d9f-8e7f-cc48cd7e0dc9 req-07c7e86c-e4df-469c-bd5f-550123bf4376 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:59.521341 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-38ee7da3-d875-4015-b4b5-7794e8f26a55 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.114483 Nov 03 03:51:59.523088 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 161/343] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:51:59 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 03 03:51:59.536508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0467335e-25db-4b60-a84f-31984766f042 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-30156436"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:59.551572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-0467335e-25db-4b60-a84f-31984766f042 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid ba6b0602-8ed2-401c-a09c-085cb564b5f4 for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:51:59.558905 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-52e62145-4635-4d9f-8e7f-cc48cd7e0dc9 req-07c7e86c-e4df-469c-bd5f-550123bf4376 service nova] Creating event network-vif-plugged:f405e8ee-adc5-4b5a-973a-82f7af6ecd61 for instance aa187bd2-73c4-4b20-b806-45b82425c98e on n-h1-854653-7 Nov 03 03:51:59.565346 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-52e62145-4635-4d9f-8e7f-cc48cd7e0dc9 req-07c7e86c-e4df-469c-bd5f-550123bf4376 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127617 Nov 03 03:51:59.566499 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 183/344] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:51:59.688922 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0467335e-25db-4b60-a84f-31984766f042 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.157839 Nov 03 03:51:59.693290 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 162/345] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:51:59 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:51:59.876907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:51:59.877803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:51:59.900206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:59.900706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:59.909111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:59.910162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:51:59.911565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:51:59.913922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:51:59.947257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e195646-a1dc-4087-a8e0-0a20f20ed787 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:51:59.950409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1e195646-a1dc-4087-a8e0-0a20f20ed787 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '2e8224e669d247d0aef64c7e5014354b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b3273d198dd445c85b0237a34a8f1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e195646-a1dc-4087-a8e0-0a20f20ed787 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Request method failure captured: Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 39 Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrb4Oq1SZiyQ2-zIXBuPqGy1bcK4dqw3unRDGpQJoYwFnOFnQ2WN_DG45ZY7veguIwE63eZMrsxY5IPgiitjeexwwNLxNtEL_r9UDxRX8PcZQqJ-FNfLnsQi-Vua0R00a379WhaS9X9hnRWBSh6zQI0a5JxlbYfqSDbwYYjLYdcb_w Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:51:59.957510 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b3273d198dd445c85b0237a34a8f1fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b3273d198dd445c85b0237a34a8f1fb"}]}] Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 2e8224e669d247d0aef64c7e5014354b Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: {"add_host": {"host": "n-h2-854653-7"}} Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:51:59.958815 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-854653-7'}}} Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:51:59.963329 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 03 03:51:59.964391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:51:59.965422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e195646-a1dc-4087-a8e0-0a20f20ed787 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:51:59.965422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1e195646-a1dc-4087-a8e0-0a20f20ed787 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.258801 Nov 03 03:51:59.965422 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 184/346] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:51:59 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:51:59.973229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26e39533-f97d-43f5-94b1-265f6e0c9cd9 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:00.079741 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26e39533-f97d-43f5-94b1-265f6e0c9cd9 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.115523 Nov 03 03:52:00.080341 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 185/347] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:51:59 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:52:00.089414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-528c4297-5579-49e5-9e9b-6dea9fceb993 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1140134118"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:00.092943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-528c4297-5579-49e5-9e9b-6dea9fceb993 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid 7b109407-1e23-4447-9109-ff3923639b81 for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:52:00.177998 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-528c4297-5579-49e5-9e9b-6dea9fceb993 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.092510 Nov 03 03:52:00.187470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 186/348] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:52:00.194629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:00.195522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:00.217256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:00.218646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:00.219386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:00.220743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:00.221545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:00.222168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:00.352611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:00.365502 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7e63f31-6769-41a2-ac2a-0524e206c5e2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1315 microversion: 2.1 time: 0.492770 Nov 03 03:52:00.366806 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 163/349] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:51:59 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:00.385062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1915050524"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:00.396222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:00.396969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:00.398040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:00.406091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:00.406645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:00.407324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:00.415747 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1915050524 could not be found. Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 58 Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:52:00.418007 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: {"add_host": {"host": "tempest-nonexist_host-1915050524"}} Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:00.419338 n-d-854653-7 devstack@n-api.service[127594]: exception: Compute host tempest-nonexist_host-1915050524 could not be found. Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1915050524'}}} Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1915050524' is not mapped to any cell Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.420041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 03 03:52:00.421281 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1915050524 could not be found. Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1915050524 could not be found. Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.422739 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1915050524 could not be found. Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1915050524 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87735946-3887-4796-a988-0fa1fb167b4e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.051445 Nov 03 03:52:00.426350 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 164/350] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:52:00 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:00.429867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:00.432627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:00.436606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:00.437365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:00.437988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:00.439141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:00.439786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:00.440395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:00.445098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:00.585038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:00.603012 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-516eb5ae-98ce-43bd-8d2d-3dcca69e372c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1270 microversion: 2.1 time: 0.174994 Nov 03 03:52:00.614271 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 165/351] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:00 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1270 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:00.629714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-602aeb2d-a160-4a6c-abfa-ee2ef9148de2 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:00.677317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:00.687625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4044f393-9e4e-4eb3-a736-cba9b9e195fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1318 microversion: 2.1 time: 0.498996 Nov 03 03:52:00.688219 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 187/352] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:00 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:00.748313 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-602aeb2d-a160-4a6c-abfa-ee2ef9148de2 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.131710 Nov 03 03:52:00.754328 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 166/353] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:00 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:52:00.760814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4700648f-d984-4834-bce5-4aa31c7f3ba5 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4700648f-d984-4834-bce5-4aa31c7f3ba5 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 283 Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:52:00.765206 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.766463 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:52:00.767053 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:00.767722 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.768688 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.769725 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:52:00.769725 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:52:00.769725 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:52:00.769725 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.769725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4700648f-d984-4834-bce5-4aa31c7f3ba5 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:00.770385 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4700648f-d984-4834-bce5-4aa31c7f3ba5 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.015029 Nov 03 03:52:00.770971 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 188/354] 10.222.0.30 () {60 vars in 1165 bytes} [Thu Nov 3 03:52:00 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 03 03:52:00.792224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-37df19c0-e3ca-404c-a824-0fef35ab52cb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-37df19c0-e3ca-404c-a824-0fef35ab52cb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 27 Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:52:00.792623 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: {"aggregate": {"name": ""}} Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:00.794145 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi '' Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:00.794996 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 03 03:52:00.796457 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.797840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-37df19c0-e3ca-404c-a824-0fef35ab52cb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:00.797840 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-37df19c0-e3ca-404c-a824-0fef35ab52cb tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.013784 Nov 03 03:52:00.801324 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 167/355] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:00 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:52:00.807365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9464d51-73f8-488c-b2ee-6abc26444234 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1693885080"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:00.814477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9464d51-73f8-488c-b2ee-6abc26444234 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '2e8224e669d247d0aef64c7e5014354b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b3273d198dd445c85b0237a34a8f1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9464d51-73f8-488c-b2ee-6abc26444234 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Request method failure captured: Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 60 Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrb4Oq1SZiyQ2-zIXBuPqGy1bcK4dqw3unRDGpQJoYwFnOFnQ2WN_DG45ZY7veguIwE63eZMrsxY5IPgiitjeexwwNLxNtEL_r9UDxRX8PcZQqJ-FNfLnsQi-Vua0R00a379WhaS9X9hnRWBSh6zQI0a5JxlbYfqSDbwYYjLYdcb_w Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:52:00.816663 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b3273d198dd445c85b0237a34a8f1fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b3273d198dd445c85b0237a34a8f1fb"}]}] Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 2e8224e669d247d0aef64c7e5014354b Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: {"aggregate": {"name": "tempest-test_aggregate-1693885080"}} Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:00.822190 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1693885080'}}} Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:52:00.822936 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:52:00.823945 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 03 03:52:00.825069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.825069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9464d51-73f8-488c-b2ee-6abc26444234 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:00.825069 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9464d51-73f8-488c-b2ee-6abc26444234 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.016567 Nov 03 03:52:00.825069 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 189/356] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:00 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:52:00.831040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65132139-70f1-4bf3-bbfc-83abc4e23665 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1936720927"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:00.834848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-65132139-70f1-4bf3-bbfc-83abc4e23665 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid 01d556b8-6c40-4282-bcf6-f81b7da5df37 for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:52:00.921570 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65132139-70f1-4bf3-bbfc-83abc4e23665 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.095218 Nov 03 03:52:00.922788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 168/357] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:00.937391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac519053-eb18-4547-abb0-bdc49e37202e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1936720927"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:00.940758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-ac519053-eb18-4547-abb0-bdc49e37202e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid 908fe08d-b6c2-42f5-85a0-4e2aeffd787e for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:52:00.959291 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ac519053-eb18-4547-abb0-bdc49e37202e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1936720927 already exists. Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac519053-eb18-4547-abb0-bdc49e37202e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 60 Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:52:00.964065 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: {"aggregate": {"name": "tempest-test_aggregate-1936720927"}} Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:00.965612 n-d-854653-7 devstack@n-api.service[127593]: exception: Aggregate tempest-test_aggregate-1936720927 already exists. Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1936720927'}}} Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 03 03:52:00.966502 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1936720927 already exists. Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:00.968223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1936720927 already exists. Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1936720927 already exists. Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac519053-eb18-4547-abb0-bdc49e37202e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1936720927 already exists. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:00.969888 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac519053-eb18-4547-abb0-bdc49e37202e tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.034061 Nov 03 03:52:00.977125 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 190/358] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:00 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:52:00.982368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1fe1650-bcf1-47bb-8038-de08b5b1791c tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.089099 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1fe1650-bcf1-47bb-8038-de08b5b1791c tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.115119 Nov 03 03:52:01.094848 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 169/359] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:00 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:52:01.099709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ce1952d-5f24-4bdf-8770-b44ccf3f9773 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1745184044"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:01.107888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-1ce1952d-5f24-4bdf-8770-b44ccf3f9773 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid e16b486a-c6f4-4766-8b1d-aba8744fab4d for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:52:01.219868 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ce1952d-5f24-4bdf-8770-b44ccf3f9773 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.123698 Nov 03 03:52:01.220479 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 191/360] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:52:01.233836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b36c596e-d40a-427b-9d75-57781697775b tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.235603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b36c596e-d40a-427b-9d75-57781697775b tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '2e8224e669d247d0aef64c7e5014354b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b3273d198dd445c85b0237a34a8f1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b36c596e-d40a-427b-9d75-57781697775b tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Request method failure captured: Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrb4Oq1SZiyQ2-zIXBuPqGy1bcK4dqw3unRDGpQJoYwFnOFnQ2WN_DG45ZY7veguIwE63eZMrsxY5IPgiitjeexwwNLxNtEL_r9UDxRX8PcZQqJ-FNfLnsQi-Vua0R00a379WhaS9X9hnRWBSh6zQI0a5JxlbYfqSDbwYYjLYdcb_w Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:52:01.237768 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b3273d198dd445c85b0237a34a8f1fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b3273d198dd445c85b0237a34a8f1fb"}]}] Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 2e8224e669d247d0aef64c7e5014354b Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 03 03:52:01.239187 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '15'} Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:01.239886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 03 03:52:01.241189 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.243384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b36c596e-d40a-427b-9d75-57781697775b tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:01.245316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b36c596e-d40a-427b-9d75-57781697775b tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.014749 Nov 03 03:52:01.255224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-963f8616-c8da-4d2d-8f04-d5dd2b3cba0f tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.255722 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 170/361] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:01.372444 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-963f8616-c8da-4d2d-8f04-d5dd2b3cba0f tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.121068 Nov 03 03:52:01.373033 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 192/362] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:01 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 03 03:52:01.385644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-678c7ad5-e61e-41cd-bf73-70d4183433d0 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.398082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.403157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:01.406135 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-678c7ad5-e61e-41cd-bf73-70d4183433d0 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-678c7ad5-e61e-41cd-bf73-70d4183433d0 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:52:01.407928 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: exception: Aggregate -1 could not be found. Nov 03 03:52:01.409480 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '-1'} Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 03 03:52:01.410276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.411736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:01.413722 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:01.413722 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:01.413722 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:01.413722 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:01.413722 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 03 03:52:01.413722 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.414141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:01.414232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-678c7ad5-e61e-41cd-bf73-70d4183433d0 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:01.414232 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-678c7ad5-e61e-41cd-bf73-70d4183433d0 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035331 Nov 03 03:52:01.417387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 171/363] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:01 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:52:01.423622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:01.423622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:01.423622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:01.423622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:01.424084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:01.424084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:01.431499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d3180f76-1a74-4440-bade-134300272d6c tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-218810922"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:01.435765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-d3180f76-1a74-4440-bade-134300272d6c tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid 9bfd7916-438b-47ab-8591-50f163e13623 for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:52:01.589755 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d3180f76-1a74-4440-bade-134300272d6c tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.164010 Nov 03 03:52:01.590501 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 172/364] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:52:01.615908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cfa25ca-08e8-4b30-812d-ec1d3f9a487d tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.617715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9cfa25ca-08e8-4b30-812d-ec1d3f9a487d tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '2e8224e669d247d0aef64c7e5014354b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b3273d198dd445c85b0237a34a8f1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cfa25ca-08e8-4b30-812d-ec1d3f9a487d tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Request method failure captured: Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrb4Oq1SZiyQ2-zIXBuPqGy1bcK4dqw3unRDGpQJoYwFnOFnQ2WN_DG45ZY7veguIwE63eZMrsxY5IPgiitjeexwwNLxNtEL_r9UDxRX8PcZQqJ-FNfLnsQi-Vua0R00a379WhaS9X9hnRWBSh6zQI0a5JxlbYfqSDbwYYjLYdcb_w Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:52:01.619365 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b3273d198dd445c85b0237a34a8f1fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b3273d198dd445c85b0237a34a8f1fb"}]}] Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 2e8224e669d247d0aef64c7e5014354b Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 03 03:52:01.620778 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '16'} Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:01.621931 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:01.626305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cfa25ca-08e8-4b30-812d-ec1d3f9a487d tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:01.627819 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9cfa25ca-08e8-4b30-812d-ec1d3f9a487d tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.022591 Nov 03 03:52:01.627819 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 173/365] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:52:01 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:52:01.628594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2ec591b8-a816-4af1-a152-716bb4854f4e req-8e479c61-efe3-47f8-8757-d093fe11741f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bb3703-e5fe-4369-a8d8-c04bd950e0ab", "name": "network-vif-plugged", "status": "completed", "tag": "965270ad-8778-4af5-9ceb-f4a595bdad96"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:01.638720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2ec591b8-a816-4af1-a152-716bb4854f4e req-8e479c61-efe3-47f8-8757-d093fe11741f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:01.639421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2ec591b8-a816-4af1-a152-716bb4854f4e req-8e479c61-efe3-47f8-8757-d093fe11741f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:01.640033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2ec591b8-a816-4af1-a152-716bb4854f4e req-8e479c61-efe3-47f8-8757-d093fe11741f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:01.652466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2ec591b8-a816-4af1-a152-716bb4854f4e req-8e479c61-efe3-47f8-8757-d093fe11741f service nova] Creating event network-vif-plugged:965270ad-8778-4af5-9ceb-f4a595bdad96 for instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab on n-h2-854653-7 Nov 03 03:52:01.658207 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2ec591b8-a816-4af1-a152-716bb4854f4e req-8e479c61-efe3-47f8-8757-d093fe11741f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033292 Nov 03 03:52:01.658809 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 174/366] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:01.663913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.664795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:01.671791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:01.672525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:01.677571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:01.677571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:01.677571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:01.677571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:01.798090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:01.812866 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1dcf58f0-ce01-4b57-bab6-d1b0d94f284c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1268 microversion: 2.1 time: 0.152797 Nov 03 03:52:01.832622 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 175/367] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:01 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:01.844350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84d43a03-d20d-4143-bad1-4b05ca09e799 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.863624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:01.889901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ae06952-9005-41d7-8713-14538af2f0be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1315 microversion: 2.1 time: 0.490051 Nov 03 03:52:01.889901 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 193/368] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:01 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:01.892176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.892793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:01.909292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:01.909907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:01.910457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:01.911330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:01.913643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:01.916323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:01.957396 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84d43a03-d20d-4143-bad1-4b05ca09e799 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.120123 Nov 03 03:52:01.962636 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 176/369] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:01 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:52:01.976469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2966f18-cec3-45ab-8e39-c43b7cd97f13 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:01.994064 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d2966f18-cec3-45ab-8e39-c43b7cd97f13 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2966f18-cec3-45ab-8e39-c43b7cd97f13 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:52:01.999650 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: exception: Aggregate -1 could not be found. Nov 03 03:52:02.000893 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '-1'} Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:02.001616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 03 03:52:02.002750 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.007100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2966f18-cec3-45ab-8e39-c43b7cd97f13 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:02.008344 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2966f18-cec3-45ab-8e39-c43b7cd97f13 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040786 Nov 03 03:52:02.010892 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 177/370] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 03:52:01 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 03 03:52:02.035100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60893f5c-b665-48b9-af8a-f8190f5b67e2 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:02.038929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-60893f5c-b665-48b9-af8a-f8190f5b67e2 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '2e8224e669d247d0aef64c7e5014354b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b3273d198dd445c85b0237a34a8f1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60893f5c-b665-48b9-af8a-f8190f5b67e2 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Request method failure captured: Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrb4Oq1SZiyQ2-zIXBuPqGy1bcK4dqw3unRDGpQJoYwFnOFnQ2WN_DG45ZY7veguIwE63eZMrsxY5IPgiitjeexwwNLxNtEL_r9UDxRX8PcZQqJ-FNfLnsQi-Vua0R00a379WhaS9X9hnRWBSh6zQI0a5JxlbYfqSDbwYYjLYdcb_w Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:52:02.040871 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b3273d198dd445c85b0237a34a8f1fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b3273d198dd445c85b0237a34a8f1fb"}]}] Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 2e8224e669d247d0aef64c7e5014354b Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 03 03:52:02.049409 n-d-854653-7 devstack@n-api.service[127594]: action_args: {} Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:02.050134 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.051271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60893f5c-b665-48b9-af8a-f8190f5b67e2 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:02.052457 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60893f5c-b665-48b9-af8a-f8190f5b67e2 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.012502 Nov 03 03:52:02.052457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 178/371] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:52:02 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:02.067146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-066a5c66-e5a3-4048-8da5-fcfb25925887 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-42717540"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:02.077092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-066a5c66-e5a3-4048-8da5-fcfb25925887 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid e848d465-f071-417a-9c05-10b2c335f414 for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:52:02.167704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:02.176222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec80be6d-811b-4184-a392-240f8e28c728 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1468 microversion: 2.1 time: 0.290890 Nov 03 03:52:02.181079 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 194/372] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:01 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:02.200487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:02.203174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:02.212831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:02.213443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:02.213967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:02.214689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:02.215160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:02.215596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:02.253993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-066a5c66-e5a3-4048-8da5-fcfb25925887 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.197132 Nov 03 03:52:02.261610 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 179/373] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:02 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:02.270237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b67b910a-7b7b-410d-b7d8-81cc439f5e72 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:02.290458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b67b910a-7b7b-410d-b7d8-81cc439f5e72 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:02.291129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b67b910a-7b7b-410d-b7d8-81cc439f5e72 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:02.291930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b67b910a-7b7b-410d-b7d8-81cc439f5e72 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:02.305606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:DELETE=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:02.604869 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06d40d6d-0d13-4507-b0b0-5c86fcb6566e tempest-DeleteServersAdminTestJSON-1383375584 tempest-DeleteServersAdminTestJSON-1383375584-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e/action" status: 202 len: 0 microversion: 2.1 time: 0.409248 Nov 03 03:52:02.608855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 195/374] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:52:02 2022] POST /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:52:02.613800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b67b910a-7b7b-410d-b7d8-81cc439f5e72 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 241 microversion: 2.1 time: 0.351087 Nov 03 03:52:02.614708 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 180/375] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:52:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 241 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:52:02.624872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:02.625886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:02.626945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48f9dcc5-3fcc-4dfe-b360-42a268eb7672 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:02.634843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48f9dcc5-3fcc-4dfe-b360-42a268eb7672 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '2e8224e669d247d0aef64c7e5014354b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b3273d198dd445c85b0237a34a8f1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:02.635325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:02.636004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48f9dcc5-3fcc-4dfe-b360-42a268eb7672 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Request method failure captured: Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 42 Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrb4Oq1SZiyQ2-zIXBuPqGy1bcK4dqw3unRDGpQJoYwFnOFnQ2WN_DG45ZY7veguIwE63eZMrsxY5IPgiitjeexwwNLxNtEL_r9UDxRX8PcZQqJ-FNfLnsQi-Vua0R00a379WhaS9X9hnRWBSh6zQI0a5JxlbYfqSDbwYYjLYdcb_w Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:52:02.636485 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b3273d198dd445c85b0237a34a8f1fb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b3273d198dd445c85b0237a34a8f1fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b3273d198dd445c85b0237a34a8f1fb"}]}] Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4b3273d198dd445c85b0237a34a8f1fb Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506 Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 2e8224e669d247d0aef64c7e5014354b Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1058727506-project Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: {"remove_host": {"host": "n-h2-854653-7"}} Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:02.637686 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-854653-7'}}} Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:02.638464 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 03 03:52:02.639501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:02.641525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:02.646077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:02.646077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:02.646077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:02.649559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48f9dcc5-3fcc-4dfe-b360-42a268eb7672 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:02.650509 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48f9dcc5-3fcc-4dfe-b360-42a268eb7672 tempest-AggregatesAdminNegativeTestJSON-1058727506 tempest-AggregatesAdminNegativeTestJSON-1058727506-project] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.027756 Nov 03 03:52:02.651091 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 181/376] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:52:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:52:02.660068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6450f1c8-2d0e-4004-ae62-967ce13c913f tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:02.672764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6450f1c8-2d0e-4004-ae62-967ce13c913f tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:02.677315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6450f1c8-2d0e-4004-ae62-967ce13c913f tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:02.677980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6450f1c8-2d0e-4004-ae62-967ce13c913f tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:02.690117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:02.690801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:02.691390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:02.692057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lazy-loading 'fault' on Instance uuid aa187bd2-73c4-4b20-b806-45b82425c98e {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:52:03.020435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6450f1c8-2d0e-4004-ae62-967ce13c913f tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 226 microversion: 2.1 time: 0.364809 Nov 03 03:52:03.023480 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 182/377] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:52:02 2022] POST /compute/v2.1/os-aggregates/17/action => generated 226 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:03.032807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:03.033817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:03.049396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:03.050400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:03.051001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:03.054609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:03.058026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:03.058647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:03.432832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:03.441750 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-264edaab-28c4-4cf7-b76e-d39a96f21c5d tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1451 microversion: 2.1 time: 0.828650 Nov 03 03:52:03.460085 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 196/378] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:02 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1451 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:03.478460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:03.479137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:03.493873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:03.495532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:03.495978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:03.498972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:03.499451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:03.501631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:03.682241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:03.691517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-debc6027-577f-46d0-b5fb-eb2dec62b337 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.666631 Nov 03 03:52:03.693085 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 183/379] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:03 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:03.706193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-166a7e87-1061-4eab-b200-8d047a5f52a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:03.800272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:03.810795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0eb42ef-fc0a-477c-ace5-c9c78eedd229 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1464 microversion: 2.1 time: 0.349493 Nov 03 03:52:03.815574 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 197/380] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:03 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:03.826832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:03.827576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:03.837405 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-166a7e87-1061-4eab-b200-8d047a5f52a4 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.143968 Nov 03 03:52:03.838861 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 184/381] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:03 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:52:03.854300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:03.854881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:03.855330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:03.856442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:03.857095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:03.857685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:03.981524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:52:04.233971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:04.235504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:04.258343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.273438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.277640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.281182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.281813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.282434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.407391 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d22ebbbc-2b78-4b69-ad8b-654010c3f6cd tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 204 len: 0 microversion: 2.1 time: 0.588722 Nov 03 03:52:04.411306 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 198/382] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:52:03 2022] DELETE /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:52:04.424528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-afcdbb9d-8e6e-4c00-b4ed-4c930775bba7 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1243311789"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:04.430023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.aggregate [None req-afcdbb9d-8e6e-4c00-b4ed-4c930775bba7 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Generated uuid 60aa9b9e-9474-42bd-9746-6df75c6c2ae5 for aggregate {{(pid=127593) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 03:52:04.542261 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-afcdbb9d-8e6e-4c00-b4ed-4c930775bba7 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.124825 Nov 03 03:52:04.544147 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 199/383] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 03:52:04 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:04.551752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:04.554584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:04.570766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.575803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.575803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.575803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.575803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.576533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.615468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.616259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.616947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.617689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lazy-loading 'fault' on Instance uuid aa187bd2-73c4-4b20-b806-45b82425c98e {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:52:04.804391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:04.816881 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6f19b74-116e-4dc8-a187-0e23468c8827 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1457 microversion: 2.1 time: 0.271414 Nov 03 03:52:04.817635 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 200/384] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:04 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1457 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:04.824444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:04.841703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.842284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.842926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.863173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.863173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.863173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.868187 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.compute.aggregates [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 03 03:52:04.868998 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Request method failure captured: Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 42 Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrdsuxhnf8Bdk0WiQiX7O291eDOWf3WJb2wujqPA292fx2pymUDSZ7qz8-Lda95P61CHXPmjzJkaxXuGUrcVN8-COHgD_aea8YrJgOThLDWJmlVH4NsnUaTgxqZFEwKmIeZcm0pzPsHhqQcfbZc0voUdsx2_EtDAuvoIaWU1dNbWPU Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:52:04.870877 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4b84115a420346bc809b2493a86b5e62", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4b84115a420346bc809b2493a86b5e62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4b84115a420346bc809b2493a86b5e62"}]}] Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4b84115a420346bc809b2493a86b5e62 Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-124666453 Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3092b65b2c194d43bc53d3f681f26f20 Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: {"remove_host": {"host": "nonexist_host"}} Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:04.872276 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot remove host nonexist_host in aggregate 18 Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 03 03:52:04.872984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 03 03:52:04.874567 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.875702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4b964d7b-2f8f-4b41-a68f-3c1dd1900b62 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.053780 Nov 03 03:52:04.878229 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 201/385] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 03:52:04 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:52:04.879501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:04.879736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:04.885874 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a31d2c4-2c49-470f-ab3e-457a03639783 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1615 microversion: 2.1 time: 1.045760 Nov 03 03:52:04.886762 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 185/386] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:03 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1615 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:04.893179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.893179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.893179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.893179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.897791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.897791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.901098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f903ab74-7ec5-4214-9b0c-feb4b102e4b0 req-626bce3c-6742-4c76-acf0-69d93c067a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e", "tag": "d1831cce-663d-4321-9dbf-b189e71623a7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:04.938550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f903ab74-7ec5-4214-9b0c-feb4b102e4b0 req-626bce3c-6742-4c76-acf0-69d93c067a93 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:04.942854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f903ab74-7ec5-4214-9b0c-feb4b102e4b0 req-626bce3c-6742-4c76-acf0-69d93c067a93 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:04.943319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f903ab74-7ec5-4214-9b0c-feb4b102e4b0 req-626bce3c-6742-4c76-acf0-69d93c067a93 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:04.971375 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f903ab74-7ec5-4214-9b0c-feb4b102e4b0 req-626bce3c-6742-4c76-acf0-69d93c067a93 service nova] Creating event network-changed:d1831cce-663d-4321-9dbf-b189e71623a7 for instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e on n-h1-854653-7 Nov 03 03:52:05.000282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f903ab74-7ec5-4214-9b0c-feb4b102e4b0 req-626bce3c-6742-4c76-acf0-69d93c067a93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105272 Nov 03 03:52:05.001311 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 186/387] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:05.016175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b80b3e15-793f-4e98-b5d6-2f2ca92f6839 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:05.125596 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b80b3e15-793f-4e98-b5d6-2f2ca92f6839 tempest-AggregatesAdminNegativeTestJSON-124666453 tempest-AggregatesAdminNegativeTestJSON-124666453-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.122246 Nov 03 03:52:05.126581 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 187/388] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 03:52:05 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:52:05.134797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c93c4ba-cd90-4e74-9586-cb65f1b9473f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: .version_select at 0x7ff7f9b33040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-434561685", "policies": ["affinity"]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:05.137170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:05.137705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:05.145111 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90d63a00-78a5-4f3d-9e22-176cdeaa95f1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.270540 Nov 03 03:52:05.145687 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 202/389] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:04 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:05.170020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7c93c4ba-cd90-4e74-9586-cb65f1b9473f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:05.175111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7c93c4ba-cd90-4e74-9586-cb65f1b9473f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:05.332119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7c93c4ba-cd90-4e74-9586-cb65f1b9473f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:05.336013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7c93c4ba-cd90-4e74-9586-cb65f1b9473f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:05.347341 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c93c4ba-cd90-4e74-9586-cb65f1b9473f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.219692 Nov 03 03:52:05.347943 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 188/390] 10.222.0.30 () {60 vars in 1174 bytes} [Thu Nov 3 03:52:05 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:05.420700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-475be30c-dcc3-4427-a783-3f0bf7d034ed tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] Calling method '.version_select at 0x7ff7f9b935e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:05.464941 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-475be30c-dcc3-4427-a783-3f0bf7d034ed tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.270344 Nov 03 03:52:05.480350 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 203/391] 10.222.0.30 () {58 vars in 1185 bytes} [Thu Nov 3 03:52:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:05.480983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db677198-b6bc-43d8-a2a6-208675cf9424 tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9c9bf70>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:05.578261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-475be30c-dcc3-4427-a783-3f0bf7d034ed tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:05.579858 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-475be30c-dcc3-4427-a783-3f0bf7d034ed tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001907 Nov 03 03:52:05.580461 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 204/392] 10.222.0.30 () {56 vars in 886 bytes} [Thu Nov 3 03:52:05 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 03 03:52:05.705831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1496152814", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fa87d659-57c4-49f8-9f9a-3812226b8b89"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:05.789861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:52:06.545516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:52:06.546311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:52:06.547271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:52:06.548069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:52:06.548820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:52:06.584190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:06.585719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:06.590952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:06.590952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:06.590952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:06.590952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:06.623678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:06.630479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:06.647408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Going to run 2 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:52:06.670515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=12,nova_api:DELETE=5,nova_api:UPDATE=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:06.677934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:06.876064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127593) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 03 03:52:06.936207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:06.948572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:07.037484 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db677198-b6bc-43d8-a2a6-208675cf9424 tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.561939 Nov 03 03:52:07.038631 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 189/393] 10.222.0.30 () {60 vars in 1206 bytes} [Thu Nov 3 03:52:05 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:07.043772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:07.044879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:07.051909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.052501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.053209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.054437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.056931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.064802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.077581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:07.086927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:07.109984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=8ac54f27-7411-4e64-a59a-25eb34ef7eb4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:07.116246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.116732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.117203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.117697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lazy-loading 'fault' on Instance uuid aa187bd2-73c4-4b20-b806-45b82425c98e {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:52:07.247303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:07.252577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:07.289627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:07.297682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-913d379a-9769-437c-99c2-d7d6432cfbaf tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1308 microversion: 2.1 time: 0.257718 Nov 03 03:52:07.298578 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 190/394] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:07 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:07.303255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:07.304027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:07.309746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.310428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.311204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.312081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.312535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.312976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.381151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:07.387090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:07.391742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:07.429213 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abe2a068-2384-4907-9967-879f0db55bb5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.735797 Nov 03 03:52:07.429822 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 205/395] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:52:05 2022] POST /compute/v2.1/servers => generated 32 bytes in 1737 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Nov 03 03:52:07.435634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a8c35bac-cf05-4175-b22c-e1e36f43647b req-59f92a48-8c8b-49a8-833c-be970f607dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa187bd2-73c4-4b20-b806-45b82425c98e", "name": "network-vif-deleted", "tag": "f405e8ee-adc5-4b5a-973a-82f7af6ecd61"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:07.447338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a8c35bac-cf05-4175-b22c-e1e36f43647b req-59f92a48-8c8b-49a8-833c-be970f607dbc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.454099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a8c35bac-cf05-4175-b22c-e1e36f43647b req-59f92a48-8c8b-49a8-833c-be970f607dbc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.454099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a8c35bac-cf05-4175-b22c-e1e36f43647b req-59f92a48-8c8b-49a8-833c-be970f607dbc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.476830 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a8c35bac-cf05-4175-b22c-e1e36f43647b req-59f92a48-8c8b-49a8-833c-be970f607dbc service nova] Creating event network-vif-deleted:f405e8ee-adc5-4b5a-973a-82f7af6ecd61 for instance aa187bd2-73c4-4b20-b806-45b82425c98e on n-h1-854653-7 Nov 03 03:52:07.479673 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a8c35bac-cf05-4175-b22c-e1e36f43647b req-59f92a48-8c8b-49a8-833c-be970f607dbc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047270 Nov 03 03:52:07.480788 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 206/396] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:07.507628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a85b90cd-75cf-4195-adbb-e312fc29cbcf tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] Calling method '.version_select at 0x7ff7f9c1a790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:07.525006 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a85b90cd-75cf-4195-adbb-e312fc29cbcf tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.035885 Nov 03 03:52:07.525756 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 207/397] 10.222.0.30 () {58 vars in 1185 bytes} [Thu Nov 3 03:52:07 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:07.530403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:07.535449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:07.536466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Searching by: {'deleted': False, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 03:52:07.555869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.556393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.556841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.558053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:07.558521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:07.558956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:07.666305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 03:52:07.727720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:07.732083 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8204f31-d775-444a-9372-fe95ce755875 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.432435 Nov 03 03:52:07.737497 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 191/398] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:07 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:07.746707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13238718-4e5f-4f76-84df-307fe1ff58e7 tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9d77040>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:07.783875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94d683b4-4293-4a3f-a511-0fc33bac42ac tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.256974 Nov 03 03:52:07.785554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 208/399] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 03:52:07 2022] GET /compute/v2.1/servers => generated 1002 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:07.798189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a1fe5e9-3996-44ce-9c33-05be1bf798ba tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:07.807830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a1fe5e9-3996-44ce-9c33-05be1bf798ba tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:07.897383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a1fe5e9-3996-44ce-9c33-05be1bf798ba tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:07.910802 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a1fe5e9-3996-44ce-9c33-05be1bf798ba tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1219 microversion: 2.1 time: 0.115491 Nov 03 03:52:07.929365 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 209/400] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:07 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:08.326269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:08.326938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:08.334315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:08.335370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:08.336029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:08.336923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:08.337607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:08.338039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:08.373518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:08.374157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:08.374467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:08.375062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lazy-loading 'fault' on Instance uuid aa187bd2-73c4-4b20-b806-45b82425c98e {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:52:08.433852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:08.441904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6adb355-d9e5-4abd-8444-aaa3080386e3 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1308 microversion: 2.1 time: 0.124926 Nov 03 03:52:08.458430 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 210/401] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:08 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:08.759948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:08.760686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:08.767440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:08.767927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:08.768368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:08.769257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:08.769879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:08.770308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:08.928222 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13238718-4e5f-4f76-84df-307fe1ff58e7 tempest-QuotaClassesAdminTestJSON-1576230416 tempest-QuotaClassesAdminTestJSON-1576230416-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.189397 Nov 03 03:52:08.928885 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 192/402] 10.222.0.30 () {60 vars in 1206 bytes} [Thu Nov 3 03:52:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:08.937842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6dc5ffdb-ffe4-4356-9da0-790d544e148e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:08.938823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6dc5ffdb-ffe4-4356-9da0-790d544e148e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:08.975532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:08.987514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-95468a9e-fe27-469e-8506-f22176aff816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.231650 Nov 03 03:52:08.988534 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 211/403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:08 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:09.008565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6dc5ffdb-ffe4-4356-9da0-790d544e148e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:09.017127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6dc5ffdb-ffe4-4356-9da0-790d544e148e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1219 microversion: 2.1 time: 0.086583 Nov 03 03:52:09.017706 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 193/404] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:08 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:09.468219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:09.468815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:09.480670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:09.481412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:09.481851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:09.482559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:09.483015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:09.483438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:09.525496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:09.526178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:09.526597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:09.527066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lazy-loading 'fault' on Instance uuid aa187bd2-73c4-4b20-b806-45b82425c98e {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:52:09.573808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26c2f5a00a74611948ce866f62ee39d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb5ff2c8e85d4bf3b7a2cc8afdab08f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:09.583445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c10597a5-5a28-41aa-bf9e-9bcca410b936 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 200 len: 1308 microversion: 2.1 time: 0.121099 Nov 03 03:52:09.584648 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 212/405] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:09 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:10.013116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:10.013858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:10.020837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.021387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.022621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.023521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.024266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.024848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.040242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:10.040864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:10.048379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.049488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.050130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.050849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.051472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.051911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.133398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:10.142234 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e87a4f1d-31fd-402e-8c05-373ceac3397c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1215 microversion: 2.1 time: 0.105689 Nov 03 03:52:10.142818 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 213/406] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:10 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:10.211520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:10.245678 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8c61827-9382-4d32-8dd9-d3284075e9bf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.234182 Nov 03 03:52:10.246918 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 194/407] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:10 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:10.608442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:10.609288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:10.622908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.623433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.623868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.624566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.625034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.632363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.651951 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] HTTP exception thrown: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Request method failure captured: Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e HTTP/1.1 Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqdyjTKA6_bdr_6wlcXQUOnxMwZPRW4-1YkgPYJpRf7sucrdRXmZyHwHvcR0FNy7dcFH1hMJS5Psv5lNNyiqmV3N41eFsy-vnEhIommpxn1bkMTvWNcrh1u8UleWJgTGm4SXphTzExMpa8b87qWXqqhtpMrJ2B-XLihuaa_FMEnZ3A Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:52:10.653229 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb5ff2c8e85d4bf3b7a2cc8afdab08f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}] Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f26c2f5a00a74611948ce866f62ee39d Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.654411 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'aa187bd2-73c4-4b20-b806-45b82425c98e'} Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:10.655077 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.662042 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.665275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Returning 404 to user: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:10.665275 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4646205-9ed0-4b77-aaaf-95e2b24c3a4b tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 404 len: 111 microversion: 2.1 time: 0.051383 Nov 03 03:52:10.665275 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 214/408] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:10 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:10.666192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:10.666620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:10.667118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:10.673321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.673812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.674251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.674961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.675417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.675845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.690342 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] HTTP exception thrown: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Request method failure captured: Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e HTTP/1.1 Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqdyjTKA6_bdr_6wlcXQUOnxMwZPRW4-1YkgPYJpRf7sucrdRXmZyHwHvcR0FNy7dcFH1hMJS5Psv5lNNyiqmV3N41eFsy-vnEhIommpxn1bkMTvWNcrh1u8UleWJgTGm4SXphTzExMpa8b87qWXqqhtpMrJ2B-XLihuaa_FMEnZ3A Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:52:10.692019 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb5ff2c8e85d4bf3b7a2cc8afdab08f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}] Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f26c2f5a00a74611948ce866f62ee39d Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.693397 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'aa187bd2-73c4-4b20-b806-45b82425c98e'} Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:10.694133 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.695581 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.696652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Returning 404 to user: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:10.696652 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5857ca2-1cdb-47bc-8a7a-004dd81d18e5 tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 404 len: 111 microversion: 2.1 time: 0.032467 Nov 03 03:52:10.696652 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 195/409] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:52:10 2022] DELETE /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:10.702126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:10.702748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: aa187bd2-73c4-4b20-b806-45b82425c98e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:10.708760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.709543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.710152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.710891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.711358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.711815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.728698 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] HTTP exception thrown: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Request method failure captured: Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e HTTP/1.1 Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqdyjTKA6_bdr_6wlcXQUOnxMwZPRW4-1YkgPYJpRf7sucrdRXmZyHwHvcR0FNy7dcFH1hMJS5Psv5lNNyiqmV3N41eFsy-vnEhIommpxn1bkMTvWNcrh1u8UleWJgTGm4SXphTzExMpa8b87qWXqqhtpMrJ2B-XLihuaa_FMEnZ3A Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:52:10.730604 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb5ff2c8e85d4bf3b7a2cc8afdab08f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}] Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f26c2f5a00a74611948ce866f62ee39d Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.731779 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'aa187bd2-73c4-4b20-b806-45b82425c98e'} Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:10.732429 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. Nov 03 03:52:10.738486 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.739495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Returning 404 to user: Instance aa187bd2-73c4-4b20-b806-45b82425c98e could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:10.739495 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bf3662cb-fa3f-4687-8339-9f94e4be062a tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e" status: 404 len: 111 microversion: 2.1 time: 0.033864 Nov 03 03:52:10.739495 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 215/410] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:10 2022] GET /compute/v2.1/servers/aa187bd2-73c4-4b20-b806-45b82425c98e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:10.749350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:10.749874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:10.763803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.766834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.766834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.766834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.766834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.767356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.786589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] HTTP exception thrown: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Request method failure captured: Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d HTTP/1.1 Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqdyjTKA6_bdr_6wlcXQUOnxMwZPRW4-1YkgPYJpRf7sucrdRXmZyHwHvcR0FNy7dcFH1hMJS5Psv5lNNyiqmV3N41eFsy-vnEhIommpxn1bkMTvWNcrh1u8UleWJgTGm4SXphTzExMpa8b87qWXqqhtpMrJ2B-XLihuaa_FMEnZ3A Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:52:10.789167 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb5ff2c8e85d4bf3b7a2cc8afdab08f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}] Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f26c2f5a00a74611948ce866f62ee39d Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.790489 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'c1866da2-dbbd-466c-b1f8-16cafbecc86d'} Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:10.791153 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.792198 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.796151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Returning 404 to user: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:10.797893 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-129ea4c8-3e22-4abd-926c-5c1db84f07da tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 404 len: 111 microversion: 2.1 time: 0.054406 Nov 03 03:52:10.798956 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 196/411] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:52:10 2022] DELETE /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:10.807612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:10.808634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] [instance: c1866da2-dbbd-466c-b1f8-16cafbecc86d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:10.815762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.816431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.817075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.818045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:10.819078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:10.819714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:10.834862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] HTTP exception thrown: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Request method failure captured: Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d HTTP/1.1 Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzqdyjTKA6_bdr_6wlcXQUOnxMwZPRW4-1YkgPYJpRf7sucrdRXmZyHwHvcR0FNy7dcFH1hMJS5Psv5lNNyiqmV3N41eFsy-vnEhIommpxn1bkMTvWNcrh1u8UleWJgTGm4SXphTzExMpa8b87qWXqqhtpMrJ2B-XLihuaa_FMEnZ3A Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:52:10.836400 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fb5ff2c8e85d4bf3b7a2cc8afdab08f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fb5ff2c8e85d4bf3b7a2cc8afdab08f8"}]}] Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: fb5ff2c8e85d4bf3b7a2cc8afdab08f8 Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-608081903 Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f26c2f5a00a74611948ce866f62ee39d Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersAdminTestJSON-608081903-project Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.837698 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'c1866da2-dbbd-466c-b1f8-16cafbecc86d'} Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:10.838351 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. Nov 03 03:52:10.839397 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:10.840402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] Returning 404 to user: Instance c1866da2-dbbd-466c-b1f8-16cafbecc86d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:10.840402 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5e2060f3-1c92-4d67-ab4b-f024faeb31fb tempest-DeleteServersAdminTestJSON-608081903 tempest-DeleteServersAdminTestJSON-608081903-project] 10.222.0.30 "GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d" status: 404 len: 111 microversion: 2.1 time: 0.034696 Nov 03 03:52:10.841712 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 216/412] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:10 2022] GET /compute/v2.1/servers/c1866da2-dbbd-466c-b1f8-16cafbecc86d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:11.168255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:11.169389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:11.176612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:11.177290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:11.177724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:11.179365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:11.179898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:11.180487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:11.245342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:11.253142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7dd19166-72e4-445f-97c1-bdda5bd0b6f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1271 microversion: 2.1 time: 0.090772 Nov 03 03:52:11.253688 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 197/413] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:11 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:11.273318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:11.273932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:11.280343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:11.281250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:11.281881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:11.282769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:11.283405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:11.283986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:11.556591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:11.564463 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3938d588-4c97-4e72-8ad1-d29ef4113971 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.299357 Nov 03 03:52:11.565151 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 217/414] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:11 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:12.280104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:12.281120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:12.297895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:12.298738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:12.300335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:12.302587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:12.304737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:12.306144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:12.449398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:12.468800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d62839e-6b2f-4d00-9d23-0f991076eef9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1277 microversion: 2.1 time: 0.194634 Nov 03 03:52:12.469373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 198/415] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:12 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:12.589185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:12.589892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:12.600270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:12.601146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:12.601851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:12.602651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:12.603186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:12.603686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:12.988648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:12.998696 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a8f651a-6afe-4664-af70-12a11f267e6a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.413878 Nov 03 03:52:12.998696 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 218/416] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:12 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:13.305756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-75a92a4b-1bce-438a-8110-1942377fb4ff req-89f95070-a85a-43c7-b77f-1cfb1569bfe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e", "name": "network-vif-plugged", "status": "completed", "tag": "d1831cce-663d-4321-9dbf-b189e71623a7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:13.337279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-75a92a4b-1bce-438a-8110-1942377fb4ff req-89f95070-a85a-43c7-b77f-1cfb1569bfe4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:13.339669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-75a92a4b-1bce-438a-8110-1942377fb4ff req-89f95070-a85a-43c7-b77f-1cfb1569bfe4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:13.340136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-75a92a4b-1bce-438a-8110-1942377fb4ff req-89f95070-a85a-43c7-b77f-1cfb1569bfe4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:13.371370 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-75a92a4b-1bce-438a-8110-1942377fb4ff req-89f95070-a85a-43c7-b77f-1cfb1569bfe4 service nova] Creating event network-vif-plugged:d1831cce-663d-4321-9dbf-b189e71623a7 for instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e on n-h1-854653-7 Nov 03 03:52:13.378138 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-75a92a4b-1bce-438a-8110-1942377fb4ff req-89f95070-a85a-43c7-b77f-1cfb1569bfe4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078335 Nov 03 03:52:13.379311 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 199/417] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:13.505415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:13.506245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:13.519596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:13.521231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:13.522890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:13.527012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:13.527859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:13.528467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:13.899282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:13.914222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-011b4839-6053-48cc-a02e-6a0529c2761d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.413448 Nov 03 03:52:13.934306 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 219/418] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:13 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:14.021291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:14.022043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:14.033213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:14.035912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:14.035912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:14.035912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:14.035912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:14.036206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:14.310600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:14.320867 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-de73efd1-9724-4c7f-9af5-6e9ee04ae562 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.303863 Nov 03 03:52:14.329149 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 200/419] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:14 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:14.573344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d8829189-2154-4ea8-9ccb-fa81fc4b6df5 req-af0405b9-6b50-4fd6-b7aa-228cbbdf88e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac54f27-7411-4e64-a59a-25eb34ef7eb4", "tag": "234ef2f1-6a7d-409d-8151-536e381d8502"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:14.590003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8829189-2154-4ea8-9ccb-fa81fc4b6df5 req-af0405b9-6b50-4fd6-b7aa-228cbbdf88e1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:14.590501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8829189-2154-4ea8-9ccb-fa81fc4b6df5 req-af0405b9-6b50-4fd6-b7aa-228cbbdf88e1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:14.590942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8829189-2154-4ea8-9ccb-fa81fc4b6df5 req-af0405b9-6b50-4fd6-b7aa-228cbbdf88e1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:14.620762 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d8829189-2154-4ea8-9ccb-fa81fc4b6df5 req-af0405b9-6b50-4fd6-b7aa-228cbbdf88e1 service nova] Creating event network-changed:234ef2f1-6a7d-409d-8151-536e381d8502 for instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 on n-h1-854653-7 Nov 03 03:52:14.629856 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d8829189-2154-4ea8-9ccb-fa81fc4b6df5 req-af0405b9-6b50-4fd6-b7aa-228cbbdf88e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061351 Nov 03 03:52:14.632312 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 220/420] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:14.940938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:14.941723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:14.954638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:14.955145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:14.958855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:14.958855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:14.958855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:14.958855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:15.160733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27ef4e30-3842-42d1-84df-57a23c63ce84 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:15.163685 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-27ef4e30-3842-42d1-84df-57a23c63ce84 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27ef4e30-3842-42d1-84df-57a23c63ce84 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354-project-admin] Request method failure captured: Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrueYi5jrHRdyHH6UAc1vjGh9HOGPRr3rKbw5AA9oIIKHo5n6chRmEx7l4NlvYzubkPPvE0Kh1pqCU1KU3Ea9SypyLWMCVBkKm8P8qVMTIQ31kFq88iQFXt87F1rM8VrIIIZ0wpIowN_u4Ar2KXrr4s08a7V-2_sAvovkhlC4GVa0A Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 5c39a2fbbcc04eb3913cda0c76db08fd Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:52:15.172102 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c39a2fbbcc04eb3913cda0c76db08fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5c39a2fbbcc04eb3913cda0c76db08fd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5c39a2fbbcc04eb3913cda0c76db08fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5c39a2fbbcc04eb3913cda0c76db08fd"}]}] Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 5c39a2fbbcc04eb3913cda0c76db08fd Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354-project-admin Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b327a37e86bf4e3291186d779f8f69ed Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354-project-admin Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:15.173612 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid timestamp for date invalid_time Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'invalid_time'} Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:15.174301 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 03 03:52:15.175590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.179522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27ef4e30-3842-42d1-84df-57a23c63ce84 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:15.180655 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27ef4e30-3842-42d1-84df-57a23c63ce84 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354 tempest-InstanceUsageAuditLogNegativeTestJSON-1062969354-project-admin] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.546497 Nov 03 03:52:15.182557 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 201/421] 10.222.0.30 () {58 vars in 1224 bytes} [Thu Nov 3 03:52:14 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 549 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:52:15.201926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:15.220003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0ee6881-b6dd-40b6-8708-3f410fa72c48 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.278554 Nov 03 03:52:15.224706 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 221/422] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:14 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:15.343932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:15.344755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:15.355063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:15.355662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:15.357249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:15.358736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:15.359667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:15.361260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:15.641923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:15.653049 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2128b292-ace4-4e46-9598-513721fce1ef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1310 microversion: 2.1 time: 0.312942 Nov 03 03:52:15.653863 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 222/423] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:15 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1310 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:15.663660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c68d6469-1ade-4f7b-9b4c-1520f3de3ff0 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:15.665476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c68d6469-1ade-4f7b-9b4c-1520f3de3ff0 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'd258c30d15ca4942ab57e48ad8997df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d3a10938b34b708740fbc436645665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c68d6469-1ade-4f7b-9b4c-1520f3de3ff0 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Request method failure captured: Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrsu_2i2ny__mgtC1q33jDnBgnZXLE_AfZdrv_xu_rKNURVEyxZEhs4yZi1rAck_My1ffKO9k2pWJ1SxGgyt3gOvve-U-g4HZmZ6__MSsCxpeTXf9yzLS-NZLV96pC8ql3_2TcYg1l2AB3QScXKimG1m7uyfA2UG0i6KwCHetdacKk Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 52d3a10938b34b708740fbc436645665 Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:52:15.667026 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52d3a10938b34b708740fbc436645665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52d3a10938b34b708740fbc436645665", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52d3a10938b34b708740fbc436645665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52d3a10938b34b708740fbc436645665"}]}] Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 52d3a10938b34b708740fbc436645665 Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d258c30d15ca4942ab57e48ad8997df2 Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project Nov 03 03:52:15.668471 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: action_args: {} Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:15.672854 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 03 03:52:15.674056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.675104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c68d6469-1ade-4f7b-9b4c-1520f3de3ff0 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:15.675104 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c68d6469-1ade-4f7b-9b4c-1520f3de3ff0 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.480609 Nov 03 03:52:15.675104 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 202/424] 10.222.0.30 () {58 vars in 1185 bytes} [Thu Nov 3 03:52:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 482 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:15.682392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42161fa1-c3ff-426b-b56b-18438ba414cc tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:15.695840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42161fa1-c3ff-426b-b56b-18438ba414cc tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'd258c30d15ca4942ab57e48ad8997df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52d3a10938b34b708740fbc436645665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:15.702311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b9edce1f-85e2-484c-be89-aae4f4847b65 req-1e21653a-7251-480f-ac5f-62f0ba3a2d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0559920c-7ef3-41c1-a19b-908e2f345a0b", "tag": "0733053d-83ad-4f44-ad78-c2f1c3894f57"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42161fa1-c3ff-426b-b56b-18438ba414cc tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Request method failure captured: Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-03%2003:52:15 HTTP/1.1 Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrsu_2i2ny__mgtC1q33jDnBgnZXLE_AfZdrv_xu_rKNURVEyxZEhs4yZi1rAck_My1ffKO9k2pWJ1SxGgyt3gOvve-U-g4HZmZ6__MSsCxpeTXf9yzLS-NZLV96pC8ql3_2TcYg1l2AB3QScXKimG1m7uyfA2UG0i6KwCHetdacKk Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 52d3a10938b34b708740fbc436645665 Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:52:15.709045 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52d3a10938b34b708740fbc436645665"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_52d3a10938b34b708740fbc436645665", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/52d3a10938b34b708740fbc436645665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/52d3a10938b34b708740fbc436645665"}]}] Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 52d3a10938b34b708740fbc436645665 Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d258c30d15ca4942ab57e48ad8997df2 Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project Nov 03 03:52:15.710371 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '2022-11-03 03:52:15'} Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:52:15.710955 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 03 03:52:15.713152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:15.717855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42161fa1-c3ff-426b-b56b-18438ba414cc tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:15.721203 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42161fa1-c3ff-426b-b56b-18438ba414cc tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376 tempest-InstanceUsageAuditLogNegativeTestJSON-1911485376-project] 10.222.0.30 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-03 03:52:15" status: 403 len: 128 microversion: 2.1 time: 0.047404 Nov 03 03:52:15.727635 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 223/425] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 03:52:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-03%2003%3A52%3A15 => generated 128 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:15.746773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b9edce1f-85e2-484c-be89-aae4f4847b65 req-1e21653a-7251-480f-ac5f-62f0ba3a2d94 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:15.748755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b9edce1f-85e2-484c-be89-aae4f4847b65 req-1e21653a-7251-480f-ac5f-62f0ba3a2d94 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:15.749593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b9edce1f-85e2-484c-be89-aae4f4847b65 req-1e21653a-7251-480f-ac5f-62f0ba3a2d94 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:15.763148 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b9edce1f-85e2-484c-be89-aae4f4847b65 req-1e21653a-7251-480f-ac5f-62f0ba3a2d94 service nova] Creating event network-changed:0733053d-83ad-4f44-ad78-c2f1c3894f57 for instance 0559920c-7ef3-41c1-a19b-908e2f345a0b on n-h1-854653-7 Nov 03 03:52:15.769920 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b9edce1f-85e2-484c-be89-aae4f4847b65 req-1e21653a-7251-480f-ac5f-62f0ba3a2d94 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088726 Nov 03 03:52:15.770825 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 203/426] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:16.248004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:16.248777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:16.256382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:16.257062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:16.257565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:16.258501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:16.259021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:16.259600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:16.529053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:16.541293 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f684c0bc-c4f9-4ade-9cfd-698039ab91d4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.297201 Nov 03 03:52:16.559346 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 224/427] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:16 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:16.681351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:16.682101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:16.693867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:16.695660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:16.700284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:16.700284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:16.700284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:16.700284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:16.797898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f99fbc10>, body: {"quota_set": {"ram": "5120"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:16.920029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:16.933078 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04fda58f-a857-4e30-8caa-edcb0adda53c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1492 microversion: 2.1 time: 0.252953 Nov 03 03:52:16.933078 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 225/428] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:16 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1492 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:17.315944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:17.317227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:17.324654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.329682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.331677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.333310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.335095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.335689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.368891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.369788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.370458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.371481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.372572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.374013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.512920 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9245b4d-0b48-471a-969a-eb6f805cde81 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109" status: 200 len: 148 microversion: 2.57 time: 1.045812 Nov 03 03:52:17.514436 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 204/429] 10.222.0.30 () {62 vars in 1303 bytes} [Thu Nov 3 03:52:16 2022] PUT /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109 => generated 148 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:52:17.534675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Calling method '.version_select at 0x7ff7f9a17a60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:17.615954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:17.624894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.626295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.627378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.629056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.629694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.631140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.665360 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4bcd48c3-dbe3-4bf9-8d71-6d6cb779d9f0 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109/detail" status: 200 len: 463 microversion: 2.57 time: 0.141202 Nov 03 03:52:17.666584 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 205/430] 10.222.0.30 () {60 vars in 1304 bytes} [Thu Nov 3 03:52:17 2022] GET /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109/detail => generated 463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 03:52:17.676741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:17.678400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:17.689626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.690572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.691413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.692299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.693047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.693937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.823000 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ee1c612-5493-4181-a420-d738345dcb25 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1643 microversion: 2.1 time: 0.870640 Nov 03 03:52:17.824608 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 226/431] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:16 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1643 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:17.854514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:17.855154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:17.866068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.866797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.868402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.869324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:17.869805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:17.871742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:17.895882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:17.914726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=36 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:18.206873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:18.221276 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16d0ce24-ab20-4271-b82a-66bcb1f16071 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.553185 Nov 03 03:52:18.221862 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 206/432] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:17 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:18.229712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:18.233914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:18.251372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.252135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.252745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:18.253857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.254478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.255069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:18.295654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:52:18.331023 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-352d1db1-314f-4820-a895-391f3bc04138 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1643 microversion: 2.1 time: 0.482818 Nov 03 03:52:18.332252 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 227/433] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:17 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1643 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:18.364661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9a1b9d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:18.374372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:18.719746 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10c3753e-6912-4dbf-8b59-f01ee6438594 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 204 len: 0 microversion: 2.1 time: 0.493561 Nov 03 03:52:18.720674 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 207/434] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:52:18 2022] DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:52:18.727318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:18.736112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.737008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.737635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:18.738221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.741569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.742101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:18.784363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:UPDATE=16,nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:18.816621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-56c6bc79-96a6-4bc4-a5e5-0238e3475019 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094927 Nov 03 03:52:18.824645 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 208/435] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:52:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:18.830773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854653-7", "block_migration": true, "disk_over_commit": false}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:18.835559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:18.852841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.857866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.858639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:18.859862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.860569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.861434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:18.867521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.868613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.870130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:18.872695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:18.873859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:18.876563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:19.020056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:19.022401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:19.024325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:19.026666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:19.027692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:19.030142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:19.230695 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e5648c53-2f92-40fa-b0c0-0d4f04c6614a tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109?user_id=26afd9e912cc4c82986208fa31c074b3" status: 200 len: 148 microversion: 2.57 time: 0.880500 Nov 03 03:52:19.239368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 228/436] 10.222.0.30 () {62 vars in 1384 bytes} [Thu Nov 3 03:52:18 2022] PUT /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109?user_id=26afd9e912cc4c82986208fa31c074b3 => generated 148 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:52:19.253915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1856161818", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "896420650", "adminPass": "***", "networks": [{"uuid": "6386c4cb-701d-4e59-9cf8-c0588876f4e7"}], "security_groups": [{"name": "tempest-securitygroup--795720748"}], "key_name": "tempest-keypair-1985294686", "user_data": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:19.376686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lazy-loading 'flavor' on Instance uuid fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:52:19.488448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Going to try to live migrate instance to n-h2-854653-7 {{(pid=127594) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:52:19.507387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] validate_networks() for [('6386c4cb-701d-4e59-9cf8-c0588876f4e7', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:52:20.418461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:52:20.419711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:52:20.420419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:52:20.421075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:52:20.421672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:52:20.445495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:20.448257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:20.449644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:20.451331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:20.455134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:20.455134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:20.503832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Getting quotas for project 35c9981944fe4698a48bf702c1e3ac11. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:20.533645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Getting quotas for user d53f1a53065b47ddbea35b4008884c58 and project 35c9981944fe4698a48bf702c1e3ac11. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:20.582915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:52:20.589471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:21.096036 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ecd7e3a7-82f9-4e85-96ce-cc409eb231db tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.854526 Nov 03 03:52:21.097484 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 229/437] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:52:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:52:21.106149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b7416ad-cc10-4c3e-a005-a465aa75b789 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] Calling method '.version_select at 0x7ff7f9b230d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:21.836317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:21.839733 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b7416ad-cc10-4c3e-a005-a465aa75b789 tempest-QuotasAdminTestV257-2089134222 tempest-QuotasAdminTestV257-2089134222-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109?user_id=26afd9e912cc4c82986208fa31c074b3" status: 200 len: 190 microversion: 2.57 time: 0.741180 Nov 03 03:52:21.845933 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 230/438] 10.222.0.30 () {60 vars in 1364 bytes} [Thu Nov 3 03:52:21 2022] GET /compute/v2.1/os-quota-sets/7b952a0dd58f4a9489b562d3f6cc1109?user_id=26afd9e912cc4c82986208fa31c074b3 => generated 190 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:52:21.851597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:21.852226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:21.867294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:21.868124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:21.869030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:21.869963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:21.871004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:21.872528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:22.242701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:22.252665 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7fe11c34-8695-4ea1-9d96-64ddae5e9ab7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.405370 Nov 03 03:52:22.257226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 231/439] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:21 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:22.808063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3309fded-3073-4b97-8bb0-000e650011e8 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1260830813", "ram": 512, "vcpus": 1, "disk": 10, "id": 1829823698, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:22.956036 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3309fded-3073-4b97-8bb0-000e650011e8 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.692815 Nov 03 03:52:22.961289 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 232/440] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:52:22 2022] POST /compute/v2.1/flavors => generated 416 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:22.969845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:22.969845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:22.995838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:22.996337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:22.996783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:23.020063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:23.021074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:23.021722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:23.147629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:23.172978 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f23e3186-0762-409f-b33f-ee45566bc926 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1267 microversion: 2.1 time: 0.196312 Nov 03 03:52:23.176002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 233/441] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:22 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:23.182006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d70c9c3d-ee8c-477d-99ab-b13cc2f819fe tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:23.353552 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d70c9c3d-ee8c-477d-99ab-b13cc2f819fe tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1829823698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.175994 Nov 03 03:52:23.357387 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 234/442] 10.222.0.30 () {60 vars in 1224 bytes} [Thu Nov 3 03:52:23 2022] POST /compute/v2.1/flavors/1829823698/os-extra_specs => generated 66 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:23.362874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:23.366676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:23.381349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:23.381848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:23.384139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:23.389170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:23.391086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:23.391757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:23.651891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:23.663272 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37c89932-6bae-4ae5-9a6e-2c17d92d7858 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.302955 Nov 03 03:52:23.664249 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 235/443] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:23 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:24.723639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7a34c548-b187-4b87-9c96-a9913428e16a tempest-FlavorsExtraSpecsTestJSON-529806271 tempest-FlavorsExtraSpecsTestJSON-529806271-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:24.746280 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7a34c548-b187-4b87-9c96-a9913428e16a tempest-FlavorsExtraSpecsTestJSON-529806271 tempest-FlavorsExtraSpecsTestJSON-529806271-project] 10.222.0.30 "GET /compute/v2.1/flavors/1829823698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 1.079994 Nov 03 03:52:24.749385 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 236/444] 10.222.0.30 () {58 vars in 1203 bytes} [Thu Nov 3 03:52:23 2022] GET /compute/v2.1/flavors/1829823698/os-extra_specs => generated 66 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:24.767455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5689adab-5f23-43d4-a7c6-1f52889b739e req-5e53fa7c-fc5b-4628-b991-2eda50a1698e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda48a2a-0f23-488b-8c52-4ba9ef3d808c", "name": "network-vif-deleted", "tag": "43461328-2908-4d9b-8eef-f25845c12b25"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:24.803897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5689adab-5f23-43d4-a7c6-1f52889b739e req-5e53fa7c-fc5b-4628-b991-2eda50a1698e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:24.809124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5689adab-5f23-43d4-a7c6-1f52889b739e req-5e53fa7c-fc5b-4628-b991-2eda50a1698e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:24.814053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5689adab-5f23-43d4-a7c6-1f52889b739e req-5e53fa7c-fc5b-4628-b991-2eda50a1698e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:24.836238 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5689adab-5f23-43d4-a7c6-1f52889b739e req-5e53fa7c-fc5b-4628-b991-2eda50a1698e service nova] Creating event network-vif-deleted:43461328-2908-4d9b-8eef-f25845c12b25 for instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c on n-h2-854653-7 Nov 03 03:52:24.846523 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5689adab-5f23-43d4-a7c6-1f52889b739e req-5e53fa7c-fc5b-4628-b991-2eda50a1698e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095762 Nov 03 03:52:24.852827 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 237/445] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:24.858254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:24.863497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:24.876134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:24.880261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:24.881065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:24.882071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:24.884212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:24.887202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:25.097090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:25.107061 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1050b76-1514-4a96-84ff-e0dcbb8b8d78 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1323 microversion: 2.1 time: 0.256715 Nov 03 03:52:25.111495 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 238/446] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:24 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1323 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:25.122560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:25.124850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:25.148565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:25.149482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:25.153504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:25.153504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:25.153504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:25.153504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:25.356491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:25.366593 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de282f3f-993e-4c51-8004-dffbbec7021a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.253446 Nov 03 03:52:25.367864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 239/447] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:25 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:25.373576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da26c084-355d-4757-98fd-c981d5c73918 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:25.401693 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da26c084-355d-4757-98fd-c981d5c73918 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1829823698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032536 Nov 03 03:52:25.402825 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 240/448] 10.222.0.30 () {60 vars in 1224 bytes} [Thu Nov 3 03:52:25 2022] POST /compute/v2.1/flavors/1829823698/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:25.418852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ebb5e7ea-3f7c-49cd-9c7e-5a6fd0398c73 tempest-FlavorsExtraSpecsTestJSON-529806271 tempest-FlavorsExtraSpecsTestJSON-529806271-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:25.439466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ebb5e7ea-3f7c-49cd-9c7e-5a6fd0398c73 tempest-FlavorsExtraSpecsTestJSON-529806271 tempest-FlavorsExtraSpecsTestJSON-529806271-project] 10.222.0.30 "GET /compute/v2.1/flavors/1829823698/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.031125 Nov 03 03:52:25.445740 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 241/449] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 03:52:25 2022] GET /compute/v2.1/flavors/1829823698/os-extra_specs/hw:numa_nodes => generated 22 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:25.457294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1634752-f1be-4778-8f55-5ea629daa060 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:25.513526 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1634752-f1be-4778-8f55-5ea629daa060 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/1829823698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.062357 Nov 03 03:52:25.521928 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 242/450] 10.222.0.30 () {60 vars in 1224 bytes} [Thu Nov 3 03:52:25 2022] POST /compute/v2.1/flavors/1829823698/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:25.533671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93b40379-0f8d-474a-9346-c70eb7043426 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:25.554822 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93b40379-0f8d-474a-9346-c70eb7043426 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1829823698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030896 Nov 03 03:52:25.566764 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 243/451] 10.222.0.30 () {58 vars in 1203 bytes} [Thu Nov 3 03:52:25 2022] GET /compute/v2.1/flavors/1829823698/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:25.573623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c7139f2-a84f-49b4-bf74-99632906f34e tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:25.731636 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3c7139f2-a84f-49b4-bf74-99632906f34e tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/1829823698/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.162033 Nov 03 03:52:25.736975 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 244/452] 10.222.0.30 () {60 vars in 1265 bytes} [Thu Nov 3 03:52:25 2022] PUT /compute/v2.1/flavors/1829823698/os-extra_specs/hw:numa_nodes => generated 22 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:25.757169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c2b7f94-5134-4e24-94c1-874e9f8d6055 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:25.776766 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c2b7f94-5134-4e24-94c1-874e9f8d6055 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1829823698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035343 Nov 03 03:52:25.778460 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 245/453] 10.222.0.30 () {58 vars in 1203 bytes} [Thu Nov 3 03:52:25 2022] GET /compute/v2.1/flavors/1829823698/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:25.792853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f394b86-464c-488e-ab36-f8011b429897 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:25.958392 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f394b86-464c-488e-ab36-f8011b429897 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1829823698/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.174292 Nov 03 03:52:25.959015 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 246/454] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 03:52:25 2022] DELETE /compute/v2.1/flavors/1829823698/os-extra_specs/hw:numa_nodes => generated 0 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 03 03:52:25.967487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08a99205-d387-4a66-a154-f2e9ed4375d2 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:26.113985 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-08a99205-d387-4a66-a154-f2e9ed4375d2 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1829823698/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.146453 Nov 03 03:52:26.113985 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 247/455] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 03:52:25 2022] DELETE /compute/v2.1/flavors/1829823698/os-extra_specs/hw:cpu_policy => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 03 03:52:26.450999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1828833716", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:26.537792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:52:26.916909 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-130e0057-de7b-405a-a6f6-a869212efd14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e/action" status: 202 len: 0 microversion: 2.1 time: 8.090152 Nov 03 03:52:26.917440 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 209/456] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:52:18 2022] POST /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e/action => generated 0 bytes in 8092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:52:26.922187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c481f3ee-d75b-4f65-8028-ab2ed3216551 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:26.944075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c481f3ee-d75b-4f65-8028-ab2ed3216551 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/1829823698/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025265 Nov 03 03:52:26.945539 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 210/457] 10.222.0.30 () {58 vars in 1203 bytes} [Thu Nov 3 03:52:26 2022] GET /compute/v2.1/flavors/1829823698/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:26.960275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:26.966550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:52:26.967075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:52:26.967517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:52:26.967944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:52:26.968365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:52:26.976012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:26.997218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.000030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.000796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.002798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.007415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.008604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.010252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.012981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.014808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.015768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.019435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.024726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.078569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:27.096543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for user 74ac442756f54baa8b70bb302b35b95c and project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:27.151545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:52:27.157097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:27.220524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:27.255211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:27.265898 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92e23251-e6aa-4c85-bbd5-8fef9bc453f9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1321 microversion: 2.1 time: 0.312737 Nov 03 03:52:27.267833 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 211/458] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:26 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:27.300349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:27.301260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:27.315768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.316788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.317507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.318458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.319144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.319783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.344228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19beac1d-30fb-4188-a02b-1adc0454a038 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232127 Nov 03 03:52:27.351535 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 248/459] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:52:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:52:27.351535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:27.351825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:27.358816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.359658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.360287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.361085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.361616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.362112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:27.624929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:27.735861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:27.747033 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb8ec281-b573-4351-8686-0f66d01f8aac tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.400375 Nov 03 03:52:27.752719 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 249/460] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:27 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:27.767052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74b4ff7b-59d4-42cd-b3b6-098691ff6820 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:27.828857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:27.855631 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83055fd9-caf5-40b3-9f21-6a05a3395c70 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.567631 Nov 03 03:52:27.865911 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 212/461] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:27 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:27.873452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4417edae-faac-4e72-a7a1-7f9b62b679a2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:27.874096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4417edae-faac-4e72-a7a1-7f9b62b679a2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:27.933774 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74b4ff7b-59d4-42cd-b3b6-098691ff6820 tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1829823698" status: 202 len: 0 microversion: 2.1 time: 0.179739 Nov 03 03:52:27.935553 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 250/462] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:52:27 2022] DELETE /compute/v2.1/flavors/1829823698 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:52:27.940879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-cb26b12d-51a4-4849-90a8-683edb013284 req-1171c2fa-a729-4f2e-9aad-1c9ad859e3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac54f27-7411-4e64-a59a-25eb34ef7eb4", "name": "network-vif-plugged", "status": "completed", "tag": "234ef2f1-6a7d-409d-8151-536e381d8502"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:27.969704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cb26b12d-51a4-4849-90a8-683edb013284 req-1171c2fa-a729-4f2e-9aad-1c9ad859e3e9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:27.970865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cb26b12d-51a4-4849-90a8-683edb013284 req-1171c2fa-a729-4f2e-9aad-1c9ad859e3e9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:27.971469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cb26b12d-51a4-4849-90a8-683edb013284 req-1171c2fa-a729-4f2e-9aad-1c9ad859e3e9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:28.003593 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-cb26b12d-51a4-4849-90a8-683edb013284 req-1171c2fa-a729-4f2e-9aad-1c9ad859e3e9 service nova] Creating event network-vif-plugged:234ef2f1-6a7d-409d-8151-536e381d8502 for instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 on n-h1-854653-7 Nov 03 03:52:28.009386 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-cb26b12d-51a4-4849-90a8-683edb013284 req-1171c2fa-a729-4f2e-9aad-1c9ad859e3e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072211 Nov 03 03:52:28.010278 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 251/463] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:28.015759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9dc8cc72-caf3-4492-a3f0-003ae5df195a tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:28.059799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4417edae-faac-4e72-a7a1-7f9b62b679a2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:28.068950 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9dc8cc72-caf3-4492-a3f0-003ae5df195a tempest-FlavorsExtraSpecsTestJSON-972697970 tempest-FlavorsExtraSpecsTestJSON-972697970-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.057145 Nov 03 03:52:28.071222 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4417edae-faac-4e72-a7a1-7f9b62b679a2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1213 microversion: 2.1 time: 0.204124 Nov 03 03:52:28.085053 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 252/464] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:52:28 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:28.086498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 213/465] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:27 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1213 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:28.295446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:28.296186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:28.302723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:28.303472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:28.304299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:28.305121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:28.305824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:28.306491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:28.671998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:28.681505 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-521a844b-c008-4b60-991b-4796bafdbefe tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.389715 Nov 03 03:52:28.689736 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 253/466] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:28 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:28.774149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:28.779859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:28.780482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:28.795823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:28.802668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:28.802668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:28.804822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:28.805352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:28.805973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:28.872083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:28.872881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:28.887362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:28.887362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:28.888174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:28.888975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:28.903452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:28.903924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:29.408170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:29.420919 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6be7bb31-b472-4874-9676-ab4cfb37d54f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.552698 Nov 03 03:52:29.437763 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 254/467] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:28 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:29.438333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:29.443506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:29.444479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:29.451317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:29.451992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:29.469168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:29.469168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:29.469168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:29.469168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:29.469495 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80821f98-37b8-443b-b8ea-61f07eb8d33d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.683520 Nov 03 03:52:29.469495 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 214/468] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:28 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:29.577241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:29.595492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c984b4e-5429-48b1-8650-65afc6b567f4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1217 microversion: 2.1 time: 0.154916 Nov 03 03:52:29.596821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 255/469] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:29 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:29.714048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:29.715169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:29.723174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:29.724602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:29.725504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:29.727036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:29.727616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:29.728042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:30.386352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:30.410221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b2068d18-94bd-4493-8b51-36560c4751d4 req-4864d522-243e-4031-ab6d-9d911b843ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559920c-7ef3-41c1-a19b-908e2f345a0b", "name": "network-vif-plugged", "status": "completed", "tag": "0733053d-83ad-4f44-ad78-c2f1c3894f57"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:30.425439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8a39007a-1fa2-4da4-a5bf-ccc757756c35 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.717211 Nov 03 03:52:30.427856 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 215/470] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:29 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:30.447919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2068d18-94bd-4493-8b51-36560c4751d4 req-4864d522-243e-4031-ab6d-9d911b843ee1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:30.451614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2068d18-94bd-4493-8b51-36560c4751d4 req-4864d522-243e-4031-ab6d-9d911b843ee1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:30.452219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2068d18-94bd-4493-8b51-36560c4751d4 req-4864d522-243e-4031-ab6d-9d911b843ee1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:30.455382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:30.456124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:30.484041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:30.485630 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b2068d18-94bd-4493-8b51-36560c4751d4 req-4864d522-243e-4031-ab6d-9d911b843ee1 service nova] Creating event network-vif-plugged:0733053d-83ad-4f44-ad78-c2f1c3894f57 for instance 0559920c-7ef3-41c1-a19b-908e2f345a0b on n-h1-854653-7 Nov 03 03:52:30.487291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:30.488437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:30.489883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:30.491851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:30.494796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:30.497561 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b2068d18-94bd-4493-8b51-36560c4751d4 req-4864d522-243e-4031-ab6d-9d911b843ee1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100362 Nov 03 03:52:30.498487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 256/471] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:30.511546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:30.513424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:30.528485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:30.531493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:30.533598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:30.538480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:30.539118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:30.542731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:31.319259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:31.327382 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-364cf097-d53c-4ca3-b8df-e2ebdf9ad824 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.881106 Nov 03 03:52:31.337386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 216/472] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:30 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:31.342528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-80aaa501-6e35-4ab5-b37e-b6fed21d7046 req-e964f1f1-0c2b-408a-baef-459146148250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e", "name": "network-vif-unplugged", "status": "completed", "tag": "d1831cce-663d-4321-9dbf-b189e71623a7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:31.369286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-80aaa501-6e35-4ab5-b37e-b6fed21d7046 req-e964f1f1-0c2b-408a-baef-459146148250 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:31.370052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-80aaa501-6e35-4ab5-b37e-b6fed21d7046 req-e964f1f1-0c2b-408a-baef-459146148250 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:31.370701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-80aaa501-6e35-4ab5-b37e-b6fed21d7046 req-e964f1f1-0c2b-408a-baef-459146148250 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:31.395282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-80aaa501-6e35-4ab5-b37e-b6fed21d7046 req-e964f1f1-0c2b-408a-baef-459146148250 service nova] Creating event network-vif-unplugged:d1831cce-663d-4321-9dbf-b189e71623a7 for instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e on n-h1-854653-7 Nov 03 03:52:31.400058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:31.406744 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-80aaa501-6e35-4ab5-b37e-b6fed21d7046 req-e964f1f1-0c2b-408a-baef-459146148250 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067685 Nov 03 03:52:31.411880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af0567d2-a23f-4f99-a891-e9931a087d14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.910870 Nov 03 03:52:31.412747 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 217/473] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:31.414325 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 257/474] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:30 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:31.418884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:31.423602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:31.437730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:31.440633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:31.440633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:31.440633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:31.440633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:31.441518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:31.455097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:31.455728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:31.466135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:31.469880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:31.470314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:31.471064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:31.476724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:31.477253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:31.730921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:31.743845 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90293363-896e-4dcd-a9bd-ed3e3a3d9476 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1283 microversion: 2.1 time: 0.329118 Nov 03 03:52:31.745249 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 218/475] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:31 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1283 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:31.963156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:31.973606 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e1899222-cbf7-4fb4-8e45-92961241084d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.524598 Nov 03 03:52:31.974806 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 258/476] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:31 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:32.352066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:32.355009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:32.372572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:32.373125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:32.373571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:32.374500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:32.374972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:32.375484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:32.438535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:32.440007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:32.463912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:32.464729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:32.465821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:32.467488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:32.468174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:32.470389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:32.923544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:32.938641 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab317301-512b-4139-bcfa-68bceae5fe3a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1319 microversion: 2.1 time: 0.590642 Nov 03 03:52:32.943918 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 219/477] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:32 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:32.968864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:32.969128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:32.979637 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8190b2f6-adf2-42e2-ae03-3ce056339a4e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.547163 Nov 03 03:52:32.982517 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 259/478] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:32 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:32.986623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:33.008550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:33.009211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:33.015386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:33.015945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:33.016407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:33.019862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:33.024758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:33.025091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:33.025953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:33.026567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:33.032036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:33.034104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:33.035035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:33.035642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:33.320075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:33.329104 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2568a8bc-e096-4d76-ada8-ab465e7e2d37 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1271 microversion: 2.1 time: 0.382587 Nov 03 03:52:33.344161 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 220/479] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:32 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1271 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:33.685426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:33.703674 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7de1ddd1-fdfe-4ff4-99ad-8851d13fec88 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.704430 Nov 03 03:52:33.710328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 260/480] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:32 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:33.726015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e8594448-d072-460e-bcc7-ba93e8468105 req-121f7d70-775c-4dc2-a711-832f0f31031f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9a0477-ea48-4f40-9445-76db8506018d", "tag": "6337b891-a979-4469-b430-a1977ed3002a"}, {"name": "network-changed", "server_uuid": "fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e", "tag": "d1831cce-663d-4321-9dbf-b189e71623a7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:33.743352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e8594448-d072-460e-bcc7-ba93e8468105 req-121f7d70-775c-4dc2-a711-832f0f31031f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:33.744093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e8594448-d072-460e-bcc7-ba93e8468105 req-121f7d70-775c-4dc2-a711-832f0f31031f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:33.745195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e8594448-d072-460e-bcc7-ba93e8468105 req-121f7d70-775c-4dc2-a711-832f0f31031f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:33.768030 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e8594448-d072-460e-bcc7-ba93e8468105 req-121f7d70-775c-4dc2-a711-832f0f31031f service nova] Creating event network-changed:6337b891-a979-4469-b430-a1977ed3002a for instance 0c9a0477-ea48-4f40-9445-76db8506018d on n-h2-854653-7 Nov 03 03:52:33.769205 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e8594448-d072-460e-bcc7-ba93e8468105 req-121f7d70-775c-4dc2-a711-832f0f31031f service nova] Creating event network-changed:d1831cce-663d-4321-9dbf-b189e71623a7 for instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e on n-h1-854653-7 Nov 03 03:52:33.786596 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e8594448-d072-460e-bcc7-ba93e8468105 req-121f7d70-775c-4dc2-a711-832f0f31031f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074201 Nov 03 03:52:33.791066 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 261/481] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:33.956540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db64239a-dcb6-4484-8d4c-966c3279a112 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Calling method '.version_select at 0x7ff7f98ea4c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:33.972188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:33.973530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:33.994198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:33.994689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:33.995129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:33.995843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:33.996300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:33.996722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:34.016655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:34.092969 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db64239a-dcb6-4484-8d4c-966c3279a112 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.741791 Nov 03 03:52:34.104980 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 221/482] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:52:33 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:52:34.112899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:34.114093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:34.122587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:34.123309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:34.123935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:34.126060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:34.126684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:34.127268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:34.331686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:34.349516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26f7af65-faeb-4998-8e7b-e9f16fd173ab tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1467 microversion: 2.1 time: 0.380733 Nov 03 03:52:34.350326 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 262/483] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:33 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1467 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:34.376621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22e8f407-6347-4cac-9e94-8ebdf6010058 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Action: 'create', calling method: .version_select at 0x7ff7f98ff820>, body: {"pool": "non_exist_pool"} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:34.567643 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-22e8f407-6347-4cac-9e94-8ebdf6010058 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] HTTP exception thrown: Floating IP pool not found. Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22e8f407-6347-4cac-9e94-8ebdf6010058 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Request method failure captured: Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 26 Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsAtx7mx4dnp4z326XZ7IuhRcNDYfh0_EWPLOAhm7D3uqx3sVTJ2knw3fnFhLe-Yk8dFprL8rvFmj4n9tzPhlNftxKFjnzAhYrPebf_yO5Ne376QdObthcA2QsCXS3qXZ_oNs0ZzTvRHE9e_lGQVoqY-BRsDqGKaM7w8e7jD8aucPI Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: b996d361060f4effbbfd2150b8f4f7d2 Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-771745546 Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:52:34.570870 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b996d361060f4effbbfd2150b8f4f7d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b996d361060f4effbbfd2150b8f4f7d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b996d361060f4effbbfd2150b8f4f7d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b996d361060f4effbbfd2150b8f4f7d2"}]}] Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-771745546 Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: b996d361060f4effbbfd2150b8f4f7d2 Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-771745546 Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsNegativeTestJSON-771745546-project Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 9cd2af53c7014ffcad21951b1198aad8 Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-771745546-project Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: {"pool": "non_exist_pool"} Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: exception: Floating IP pool not found. Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 03 03:52:34.572243 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:34.573352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 03 03:52:34.574799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:34.576595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22e8f407-6347-4cac-9e94-8ebdf6010058 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Returning 404 to user: Floating IP pool not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:34.577718 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-22e8f407-6347-4cac-9e94-8ebdf6010058 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.223179 Nov 03 03:52:34.578500 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 263/484] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 03:52:34 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:52:34.591282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:34.604223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:34.645436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:34.646879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:34.647739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:34.651271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:34.651937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:34.652578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:34.871219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:34.881995 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-79c8e108-faa8-4197-98f8-c8c2a54cdb65 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.775453 Nov 03 03:52:34.893573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:34.898392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 222/485] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:34 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:34.906703 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4caff144-a305-42a4-8fdd-53c801f8a0c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1271 microversion: 2.1 time: 0.326847 Nov 03 03:52:34.909977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:34.911404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 264/486] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:34 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1271 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:34.933890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:34.934068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6c5c308-c35b-406f-98db-e29c98ee97d5 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Calling method '.version_select at 0x7ff7f98ff940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:34.950317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:34.950800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:34.953458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:34.954206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:34.954671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:34.955106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:35.185073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-a6c5c308-c35b-406f-98db-e29c98ee97d5 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 980bdbab-7cdf-4145-b59f-719672341685 could not be found", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 03:52:35.185778 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a6c5c308-c35b-406f-98db-e29c98ee97d5 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] HTTP exception thrown: Floating IP not found for ID 980bdbab-7cdf-4145-b59f-719672341685 Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6c5c308-c35b-406f-98db-e29c98ee97d5 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Request method failure captured: Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-floating-ips/980bdbab-7cdf-4145-b59f-719672341685 HTTP/1.1 Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsAtx7mx4dnp4z326XZ7IuhRcNDYfh0_EWPLOAhm7D3uqx3sVTJ2knw3fnFhLe-Yk8dFprL8rvFmj4n9tzPhlNftxKFjnzAhYrPebf_yO5Ne376QdObthcA2QsCXS3qXZ_oNs0ZzTvRHE9e_lGQVoqY-BRsDqGKaM7w8e7jD8aucPI Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: b996d361060f4effbbfd2150b8f4f7d2 Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-771745546 Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:52:35.201555 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b996d361060f4effbbfd2150b8f4f7d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b996d361060f4effbbfd2150b8f4f7d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b996d361060f4effbbfd2150b8f4f7d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b996d361060f4effbbfd2150b8f4f7d2"}]}] Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-771745546 Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: b996d361060f4effbbfd2150b8f4f7d2 Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-771745546 Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsNegativeTestJSON-771745546-project Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 9cd2af53c7014ffcad21951b1198aad8 Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-771745546-project Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: exception: Floating IP not found for ID 980bdbab-7cdf-4145-b59f-719672341685 Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '980bdbab-7cdf-4145-b59f-719672341685'} Nov 03 03:52:35.202864 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 03:52:35.203893 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 980bdbab-7cdf-4145-b59f-719672341685 could not be found Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-829100c0-ac3f-4d9e-8c90-355e707905ba'] Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 980bdbab-7cdf-4145-b59f-719672341685. Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:35.205154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 980bdbab-7cdf-4145-b59f-719672341685 Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:52:35.206344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:52:35.207542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 980bdbab-7cdf-4145-b59f-719672341685 Nov 03 03:52:35.207542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:52:35.207542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6c5c308-c35b-406f-98db-e29c98ee97d5 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] Returning 404 to user: Floating IP not found for ID 980bdbab-7cdf-4145-b59f-719672341685 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:52:35.207542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6c5c308-c35b-406f-98db-e29c98ee97d5 tempest-FloatingIPsNegativeTestJSON-771745546 tempest-FloatingIPsNegativeTestJSON-771745546-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/980bdbab-7cdf-4145-b59f-719672341685" status: 404 len: 111 microversion: 2.1 time: 0.290658 Nov 03 03:52:35.207542 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 265/487] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:52:34 2022] DELETE /compute/v2.1/os-floating-ips/980bdbab-7cdf-4145-b59f-719672341685 => generated 111 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:52:35.224565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:35.224565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:35.235511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:35.236213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:35.236683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:35.238630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:35.240380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:35.240840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:35.999521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:36.013205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eb0729dd-832c-4347-9f75-4dc029ed03d9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 200 len: 1469 microversion: 2.1 time: 1.104937 Nov 03 03:52:36.028840 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 223/488] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:34 2022] GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 1469 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:36.036916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:36.038353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:36.047702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:36.048522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:36.050305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:36.051379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:36.052262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:36.052915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:36.142934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:36.158587 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55672362-0d28-4de7-8415-0c1d957e00f6 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.952854 Nov 03 03:52:36.173122 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 266/489] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:35 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:36.173122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:36.173122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:36.188040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:36.191139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:36.191642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:36.194798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:36.195289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:36.195953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:36.948479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:36.962458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d9e1bcf-28aa-4ef4-a267-1d8528734c23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.929001 Nov 03 03:52:36.963395 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 224/490] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:36 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:36.974494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:37.002200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:37.004573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Searching by: {'reservation_id': 'r-s36l4px9', 'deleted': False, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 03:52:37.020436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:37.021511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:37.021951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:37.026020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:37.028260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:37.028741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:37.029360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:37.045973 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c032a65-f87c-41ec-8e3d-ecab371cdf3b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 0.884933 Nov 03 03:52:37.046983 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 267/491] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:36 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:37.048537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:37.129363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=28 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:37.241099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a1791cc-8439-4d68-8012-6276510d0490 tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-746185524", "id": 60032020, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:37.256740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 03:52:37.331426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:37.351483 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a1791cc-8439-4d68-8012-6276510d0490 tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 461 microversion: 2.61 time: 0.302129 Nov 03 03:52:37.356563 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 268/492] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 03:52:37 2022] POST /compute/v2.1/flavors => generated 461 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:52:37.364830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:37.369926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:37.388242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:37.391521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:37.392446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:37.393819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:37.396948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:37.397678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:37.554355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:37.567490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:37.576102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:37.576731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:37.664548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:37.675999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-91cab2a4-7fe8-401c-95ca-59db93f829ff tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.318186 Nov 03 03:52:37.693416 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 269/493] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:37 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:37.795728 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9136bd6f-6635-468d-8cca-70e078702503 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-s36l4px9" status: 200 len: 2929 microversion: 2.1 time: 0.830997 Nov 03 03:52:37.801281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 225/494] 10.222.0.30 () {58 vars in 1197 bytes} [Thu Nov 3 03:52:36 2022] GET /compute/v2.1/servers/detail?reservation_id=r-s36l4px9 => generated 2929 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:37.823213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7affa90-7fd9-4382-9dba-46692695f19a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:37.891318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.compute.server_groups [None req-f7affa90-7fd9-4382-9dba-46692695f19a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Querying cell 464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) for 2 instances {{(pid=127594) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 03 03:52:37.894616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7affa90-7fd9-4382-9dba-46692695f19a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:37.895571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7affa90-7fd9-4382-9dba-46692695f19a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:37.913763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7affa90-7fd9-4382-9dba-46692695f19a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:37.979441 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7affa90-7fd9-4382-9dba-46692695f19a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/fa87d659-57c4-49f8-9f9a-3812226b8b89" status: 200 len: 265 microversion: 2.1 time: 0.159995 Nov 03 03:52:37.980026 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 226/495] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:52:37 2022] GET /compute/v2.1/os-server-groups/fa87d659-57c4-49f8-9f9a-3812226b8b89 => generated 265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:52:37.991643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:38.001290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:38.012927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.014198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.014799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.016380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.022704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.023379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.119165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-701e717c-6107-4a85-897e-87c8b3ae8671 tempest-FlavorsV261TestJSON-339643513 tempest-FlavorsV261TestJSON-339643513-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:38.136111 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-701e717c-6107-4a85-897e-87c8b3ae8671 tempest-FlavorsV261TestJSON-339643513 tempest-FlavorsV261TestJSON-339643513-project] 10.222.0.30 "GET /compute/v2.1/flavors/60032020" status: 200 len: 461 microversion: 2.61 time: 0.441464 Nov 03 03:52:38.141238 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 270/496] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 03:52:37 2022] GET /compute/v2.1/flavors/60032020 => generated 461 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:52:38.151426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:38.152266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:38.165428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.167926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.172813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.174644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.175274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.175896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.392059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:38.400195 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b2f22c6-95a9-48f1-b442-1ce786757a0d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.413234 Nov 03 03:52:38.418004 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 227/497] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:37 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:38.431668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:38.432600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:38.450983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.451698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.452360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.453299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.453947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.454549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.724704 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-625f63a2-d485-478f-b438-133d6dcf8218 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 200 len: 1618 microversion: 2.1 time: 0.581454 Nov 03 03:52:38.726879 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 271/498] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:38 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 1618 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:38.735330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:38.735920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c19a5570-330a-47ea-9f8f-8791a07e00cd tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] Action: 'update', calling method: .version_select at 0x7ff7fb0e15e0>, body: {"flavor": {"description": "new"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:38.745255 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7eb41fa2-32fc-4468-b4cb-e9da5e2e418d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 0.325818 Nov 03 03:52:38.759137 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 228/499] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:38 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:38.777812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:38.778467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:38.795639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.796035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.796482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.797241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.797709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.798139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.872708 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c19a5570-330a-47ea-9f8f-8791a07e00cd tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] 10.222.0.30 "PUT /compute/v2.1/flavors/60032020" status: 200 len: 462 microversion: 2.61 time: 0.144386 Nov 03 03:52:38.882115 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 272/500] 10.222.0.30 () {62 vars in 1213 bytes} [Thu Nov 3 03:52:38 2022] PUT /compute/v2.1/flavors/60032020 => generated 462 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:52:38.888521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:38.889877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:38.917430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.919734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.921949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:38.923565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:38.924320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:38.925093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:39.299971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:39.311249 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91242cc2-a3b8-48cc-b8a1-734496570038 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.550811 Nov 03 03:52:39.314002 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 229/501] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:38 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:39.325327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fad1bd3d-58a6-4573-b1e7-f511c0741763 tempest-FlavorsV261TestJSON-339643513 tempest-FlavorsV261TestJSON-339643513-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:39.336249 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41b7e70e-5216-40c5-ae8a-3514655610c1 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 200 len: 1620 microversion: 2.1 time: 0.452336 Nov 03 03:52:39.337539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 273/502] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:38 2022] GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 1620 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:39.373508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c984688-d4c3-4bfa-9e08-46b8cc210753 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: .version_select at 0x7ff7f989a310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1827007236", "policies": ["anti-affinity"]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:39.403081 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fad1bd3d-58a6-4573-b1e7-f511c0741763 tempest-FlavorsV261TestJSON-339643513 tempest-FlavorsV261TestJSON-339643513-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 7149 microversion: 2.61 time: 0.085740 Nov 03 03:52:39.404298 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 230/503] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:52:39 2022] GET /compute/v2.1/flavors/detail => generated 7149 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:52:39.431406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0465956a-35c1-45cc-be43-3801f5bd452e tempest-FlavorsV261TestJSON-339643513 tempest-FlavorsV261TestJSON-339643513-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:39.432393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5c984688-d4c3-4bfa-9e08-46b8cc210753 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:39.453293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5c984688-d4c3-4bfa-9e08-46b8cc210753 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:39.488238 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0465956a-35c1-45cc-be43-3801f5bd452e tempest-FlavorsV261TestJSON-339643513 tempest-FlavorsV261TestJSON-339643513-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 3676 microversion: 2.61 time: 0.061840 Nov 03 03:52:39.503313 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 231/504] 10.222.0.30 () {60 vars in 1166 bytes} [Thu Nov 3 03:52:39 2022] GET /compute/v2.1/flavors => generated 3676 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:52:39.517597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:39.518504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:39.537520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:39.538014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:39.538448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:39.553751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:39.554329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:39.554974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:39.581627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5c984688-d4c3-4bfa-9e08-46b8cc210753 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:39.587974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5c984688-d4c3-4bfa-9e08-46b8cc210753 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:39.603501 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c984688-d4c3-4bfa-9e08-46b8cc210753 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.234080 Nov 03 03:52:39.605281 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 274/505] 10.222.0.30 () {60 vars in 1174 bytes} [Thu Nov 3 03:52:39 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:52:39.610490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2d45572-4da6-4f15-b3ce-62f958e68387 tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:39.755917 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2d45572-4da6-4f15-b3ce-62f958e68387 tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/60032020" status: 202 len: 0 microversion: 2.61 time: 0.149287 Nov 03 03:52:39.756783 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 275/506] 10.222.0.30 () {60 vars in 1196 bytes} [Thu Nov 3 03:52:39 2022] DELETE /compute/v2.1/flavors/60032020 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:52:39.764911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ff553a8-950b-4e81-9c86-3cfa0da92cbe tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:39.845866 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ff553a8-950b-4e81-9c86-3cfa0da92cbe tempest-FlavorsV261TestJSON-2057032219 tempest-FlavorsV261TestJSON-2057032219-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.083858 Nov 03 03:52:39.850580 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 276/507] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:52:39 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:52:39.861103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:39.862729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:39.888469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:39.888984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:39.889468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:39.902401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:39.902914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:39.903366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:39.949802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:39.964027 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c75f6df-79b5-4491-8275-c645a79a0c40 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.456402 Nov 03 03:52:39.984366 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 232/508] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:39 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:39.998580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1942730083", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7f3feee2-6ae4-48b8-b755-6e98ff81572d"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:40.116998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:52:40.577060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:40.604251 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-761fca88-651d-4027-b7ce-5f36b106dbf0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 0.749867 Nov 03 03:52:40.613146 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 277/509] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:39 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:40.617357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9179ddf2-3c95-48a7-a780-00dad5961838 req-2a41a234-1bc9-4f7b-9bfe-3025da593a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb3fa88-5c7b-4b15-ac0b-347c3353070f", "tag": "6e412a17-821b-446c-a74e-78bc6a61268d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:40.642997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9179ddf2-3c95-48a7-a780-00dad5961838 req-2a41a234-1bc9-4f7b-9bfe-3025da593a4f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:40.645271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9179ddf2-3c95-48a7-a780-00dad5961838 req-2a41a234-1bc9-4f7b-9bfe-3025da593a4f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:40.646307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9179ddf2-3c95-48a7-a780-00dad5961838 req-2a41a234-1bc9-4f7b-9bfe-3025da593a4f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:40.681981 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9179ddf2-3c95-48a7-a780-00dad5961838 req-2a41a234-1bc9-4f7b-9bfe-3025da593a4f service nova] Creating event network-changed:6e412a17-821b-446c-a74e-78bc6a61268d for instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f on n-h2-854653-7 Nov 03 03:52:40.696048 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9179ddf2-3c95-48a7-a780-00dad5961838 req-2a41a234-1bc9-4f7b-9bfe-3025da593a4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087936 Nov 03 03:52:40.697355 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 278/510] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:40.703192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:40.711849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:40.722371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:40.735967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:40.736466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:40.736910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:40.738309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:40.739391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:40.741925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:41.509511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:52:41.510468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:52:41.511121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:52:41.511844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:52:41.512488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:52:41.554827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:41.558278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:41.558745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:41.559564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:41.560035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:41.560476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:41.615805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:41.624934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:41.641446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:41.646818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Going to run 2 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:52:41.649909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:41.651381 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19d283ff-0e7a-4c00-be02-02e6bb6d3271 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.952385 Nov 03 03:52:41.673226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 279/511] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:40 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:41.680414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:41.688062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:41.709185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:41.713646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:41.713646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:41.714700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:41.715205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:41.715665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:41.840877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127594) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 03 03:52:41.880587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:41.896219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:42.033712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:42.090711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:42.102712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:42.103429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90e1b6f1-fcdd-4a55-b0cd-7845707bea17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.428965 Nov 03 03:52:42.111277 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 280/512] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:41 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:42.131860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-49963918-9153-4ef9-93a1-711fc3844235 req-c16fed2d-8235-4ec0-b005-4b8d8e486af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9a0477-ea48-4f40-9445-76db8506018d", "name": "network-vif-plugged", "status": "completed", "tag": "6337b891-a979-4469-b430-a1977ed3002a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:42.146644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49963918-9153-4ef9-93a1-711fc3844235 req-c16fed2d-8235-4ec0-b005-4b8d8e486af4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:42.147358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49963918-9153-4ef9-93a1-711fc3844235 req-c16fed2d-8235-4ec0-b005-4b8d8e486af4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:42.147969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49963918-9153-4ef9-93a1-711fc3844235 req-c16fed2d-8235-4ec0-b005-4b8d8e486af4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:42.178857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:42.184410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=eb682fda-192b-4143-937c-92dd4e7c5a23,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:42.195652 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-49963918-9153-4ef9-93a1-711fc3844235 req-c16fed2d-8235-4ec0-b005-4b8d8e486af4 service nova] Creating event network-vif-plugged:6337b891-a979-4469-b430-a1977ed3002a for instance 0c9a0477-ea48-4f40-9445-76db8506018d on n-h2-854653-7 Nov 03 03:52:42.212545 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-49963918-9153-4ef9-93a1-711fc3844235 req-c16fed2d-8235-4ec0-b005-4b8d8e486af4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099912 Nov 03 03:52:42.219841 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 281/513] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:42.245850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:42.250886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:42.271760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:42.273623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:42.274231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:42.277482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:42.278153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:42.281640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:42.385415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:42.396102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:42.551027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:42.570355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'server_group_members'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:42.656340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa7d53ec-9efc-44ab-80e2-a8810dacced2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.670213 Nov 03 03:52:42.657576 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 233/514] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:52:39 2022] POST /compute/v2.1/servers => generated 32 bytes in 2672 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 03 03:52:42.667452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:42.678543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:42.679588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Searching by: {'deleted': False, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 03:52:42.713349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:42.715115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:42.715583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:42.717866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:42.718333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:42.720874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:42.958949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 03:52:43.046123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:43.057914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e670a942-6f50-470d-aa86-4b0ece301962 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 0.836341 Nov 03 03:52:43.062141 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 282/515] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:42 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:43.078537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:43.079277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:43.094406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:43.094917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:43.095371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:43.096101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:43.096566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:43.096993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:43.137495 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a49d5422-f17b-4353-8f32-00c6c630f36f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.474898 Nov 03 03:52:43.143923 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 234/516] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 03:52:42 2022] GET /compute/v2.1/servers => generated 1664 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:43.157593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:43.162379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:43.165563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:43.166224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:43.166812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:43.167670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:43.168275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:43.169111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:43.639969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:43.654547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7531ed68-6b0f-48cd-954d-a4b1bd79d04a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.589963 Nov 03 03:52:43.656012 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 283/517] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:43 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:43.666267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9c0c419-7d4d-40b0-bb88-6bbd5cb67a5a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:43.666940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c9c0c419-7d4d-40b0-bb88-6bbd5cb67a5a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:43.714730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:43.724936 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fda38172-6b1b-4ca9-bb46-6e9e815e234f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.571656 Nov 03 03:52:43.725545 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 235/518] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:43 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:43.788066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c9c0c419-7d4d-40b0-bb88-6bbd5cb67a5a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:43.805557 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c9c0c419-7d4d-40b0-bb88-6bbd5cb67a5a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1219 microversion: 2.1 time: 0.147614 Nov 03 03:52:43.806935 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 284/519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:43 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:44.092109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:44.092700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:44.106678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:44.107179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:44.107624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:44.108343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:44.113465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:44.114607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:44.348789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:44.359245 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d1187c9-c81e-4970-860d-d55dc25cf4bf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 0.273494 Nov 03 03:52:44.374497 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 236/520] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:44 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:44.678434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:44.679060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:44.691447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:44.692179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:44.692826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:44.693777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:44.694732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:44.695327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:44.750705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:44.751415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:44.768377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:44.774493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:44.775235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:44.777890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:44.778537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:44.781366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:45.263690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:45.278336 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-532be96d-0425-4e59-ae6e-d47eb3c16f13 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.530456 Nov 03 03:52:45.282617 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 237/521] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:44 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:45.325516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f0dd627-e98e-4f74-a9ea-e263e247e702 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:45.331670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f0dd627-e98e-4f74-a9ea-e263e247e702 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:45.440338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:45.497246 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83bf1299-82f0-4c1d-946f-236683ad6807 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1388 microversion: 2.1 time: 0.809500 Nov 03 03:52:45.499077 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 285/522] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:44 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1388 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:45.519313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:45.520555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:45.528358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:45.529681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:45.530375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:45.531544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:45.532234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:45.533762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:45.603987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f0dd627-e98e-4f74-a9ea-e263e247e702 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:45.612852 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f0dd627-e98e-4f74-a9ea-e263e247e702 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1219 microversion: 2.1 time: 0.328965 Nov 03 03:52:45.619111 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 238/523] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:45 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1219 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:45.891331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:45.923569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e97afb3e-553c-415b-8540-6a5ea8b40de0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 0.413759 Nov 03 03:52:45.933060 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 286/524] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:45 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:46.146060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1201db59-a6ca-452c-a913-d4989a1eedc3 tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] Action: 'create', calling method: .version_select at 0x7ff7f962d310>, body: {"security_group": {"name": "tempest-securitygroup-20137971", "description": "tempest-description-513824141"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:46.327659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:46.328847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:46.364466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:46.365971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:46.366977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:46.370027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:46.373227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:46.374245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:46.899647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:46.912901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9450dd13-6a74-4770-bc6a-e92cac1bb87a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1502 microversion: 2.1 time: 0.598665 Nov 03 03:52:46.918876 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 287/525] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:46 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1502 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:46.943542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:46.948084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:46.975192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:46.976779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:46.977270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:46.978012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:46.978482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:46.982323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:47.758346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:47.792006 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-567941cc-f17c-44ab-a987-f2ce735bb2b2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1586 microversion: 2.1 time: 0.858084 Nov 03 03:52:47.798471 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 288/526] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:46 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1586 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:47.808799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:47.819630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:47.837960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:47.856575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:47.857159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:47.864622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:47.865489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:47.866122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:47.871107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:48.168865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:48.184129 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ef250df1-01b1-4644-aaf3-ae7b7a4a9a2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1279 microversion: 2.1 time: 0.384182 Nov 03 03:52:48.204744 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 289/527] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:47 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1279 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:48.231934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:48.234153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:48.257264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:48.259210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:48.261354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:48.262888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:48.264731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:48.266053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:48.307616 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1201db59-a6ca-452c-a913-d4989a1eedc3 tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 2.687011 Nov 03 03:52:48.308942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 239/528] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:52:45 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 2689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:48.314507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:48.315971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:48.363613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:48.364571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:48.365037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:48.381950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:48.384680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:48.384680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:48.970125 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0cee3a9d-d5dd-4ea8-ac67-2a1298c6dfe2 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.659719 Nov 03 03:52:48.971191 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 240/529] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 03:52:48 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d/os-interface => generated 284 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:48.987270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:48.988356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:49.004835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:49.005625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:49.006277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:49.007182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:49.007921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:49.008523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:49.196029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:49.208790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1b17d892-c3c8-40f9-963e-0de560ad0cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 0.988951 Nov 03 03:52:49.209230 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 290/530] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:48 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:49.223018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ea46a879-ab25-43fc-9123-f1d9d72b0f9b tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] Action: 'create', calling method: .version_select at 0x7ff7f98a74c0>, body: {"security_group": {"name": "tempest-securitygroup-427429448", "description": "tempest-description-1899614918"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:49.721732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:49.730164 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b4d1c69-e18b-4e6d-a601-31371ed904f6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1492 microversion: 2.1 time: 0.757748 Nov 03 03:52:49.749059 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 241/531] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:48 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1492 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:49.749059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:49.749059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:49.767892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:49.773766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:49.776012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:49.776893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:49.786412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:49.787243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:50.257102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:50.275138 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7e3bf30-8050-4d44-b54f-aa7a1cb712b5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1277 microversion: 2.1 time: 0.535162 Nov 03 03:52:50.317438 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 242/532] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:49 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1277 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:50.332773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b24bb2dd-9e1a-4120-a30e-ee2f4fecb97c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '.version_select at 0x7ff7f962d9d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:50.354281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b24bb2dd-9e1a-4120-a30e-ee2f4fecb97c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:50.355396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b24bb2dd-9e1a-4120-a30e-ee2f4fecb97c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:50.356247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b24bb2dd-9e1a-4120-a30e-ee2f4fecb97c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:50.413240 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b24bb2dd-9e1a-4120-a30e-ee2f4fecb97c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.094085 Nov 03 03:52:50.424567 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 243/533] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:52:50 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:50.438589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:50.449954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:50.467753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:50.468271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:50.468716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:50.469471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:50.469924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:50.470356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:50.934667 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ea46a879-ab25-43fc-9123-f1d9d72b0f9b tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.716100 Nov 03 03:52:50.938113 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 291/534] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:52:49 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:50.944950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:50.946697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:50.969761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:50.970555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:50.971508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:50.972475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:50.973219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:50.973870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:51.632544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:51.640937 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73a10201-e599-4136-bc6e-b73df6cc8dfa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1313 microversion: 2.1 time: 1.214870 Nov 03 03:52:51.642082 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 244/535] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:50 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1313 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:51.714486 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36662af5-363e-4d35-93c7-116f82e9fafd tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1643 microversion: 2.1 time: 0.776986 Nov 03 03:52:51.716409 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 292/536] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:50 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1643 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:51.726045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2cae61e4-c95b-4f2f-8fd4-338cee03a7f0 req-4dce77d0-439c-477b-a189-50f27dee2527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb3fa88-5c7b-4b15-ac0b-347c3353070f", "name": "network-vif-plugged", "status": "completed", "tag": "6e412a17-821b-446c-a74e-78bc6a61268d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:51.746160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2cae61e4-c95b-4f2f-8fd4-338cee03a7f0 req-4dce77d0-439c-477b-a189-50f27dee2527 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:51.747202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2cae61e4-c95b-4f2f-8fd4-338cee03a7f0 req-4dce77d0-439c-477b-a189-50f27dee2527 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:51.747866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2cae61e4-c95b-4f2f-8fd4-338cee03a7f0 req-4dce77d0-439c-477b-a189-50f27dee2527 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:51.767959 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2cae61e4-c95b-4f2f-8fd4-338cee03a7f0 req-4dce77d0-439c-477b-a189-50f27dee2527 service nova] Creating event network-vif-plugged:6e412a17-821b-446c-a74e-78bc6a61268d for instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f on n-h2-854653-7 Nov 03 03:52:51.774777 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2cae61e4-c95b-4f2f-8fd4-338cee03a7f0 req-4dce77d0-439c-477b-a189-50f27dee2527 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056737 Nov 03 03:52:51.777863 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 293/537] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:51.931108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c1454399-c612-4d16-95f4-2e8765fde4ea tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] Action: 'create', calling method: .version_select at 0x7ff7f96def70>, body: {"security_group": {"name": "tempest-securitygroup-1199224134", "description": "tempest-description-1933019954"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:52.208640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-291958347", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:52.294608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:52:52.822023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:53.521459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:52:53.522072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:52:53.522343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:52:53.522968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:52:53.523655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:52:53.543740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:53.556841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:53.558902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:53.560243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:53.563846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:53.564592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:53.628293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Getting quotas for project a5523210923a49b89034225825178521. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:53.641247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Getting quotas for user d9d3efcb99604673aac5857ce3f98e51 and project a5523210923a49b89034225825178521. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:53.688646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:52:53.691730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:53.731964 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c1454399-c612-4d16-95f4-2e8765fde4ea tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.088557 Nov 03 03:52:53.734156 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 245/538] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:52:51 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:53.740014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:53.741422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:53.768290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:53.774612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:53.778783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:53.781862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:53.782558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:53.784962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:53.898415 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b20f9187-abe7-4a51-a8a6-f08edfce1889 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.119095 Nov 03 03:52:53.904298 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 294/539] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:52:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:52:53.922237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1609366408", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "f004922e-d064-49aa-9c71-6a282c3fe25b"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:54.039289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] validate_networks() for [('f004922e-d064-49aa-9c71-6a282c3fe25b', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:52:54.362467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:54.383035 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da0210fb-0d83-47a5-901f-d76ac4ce96f9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1319 microversion: 2.1 time: 0.642285 Nov 03 03:52:54.386287 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 246/540] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:53 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1319 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:54.400904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:54.406465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:54.431270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:54.433646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:54.438198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:54.440062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:54.442972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:54.443605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:54.756975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:54.777953 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bbe5adc3-b861-4f93-abfd-9437cf0cbf1f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1586 microversion: 2.1 time: 0.389433 Nov 03 03:52:54.779328 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 247/541] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:54 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1586 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:54.791277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a8c0b2f2-9f73-4a23-b990-79fb18e30d87 req-3a5a0ca3-c246-4ac5-bdba-8ec72af22a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9a0477-ea48-4f40-9445-76db8506018d", "tag": "6337b891-a979-4469-b430-a1977ed3002a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:54.802307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8c0b2f2-9f73-4a23-b990-79fb18e30d87 req-3a5a0ca3-c246-4ac5-bdba-8ec72af22a04 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:54.802848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8c0b2f2-9f73-4a23-b990-79fb18e30d87 req-3a5a0ca3-c246-4ac5-bdba-8ec72af22a04 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:54.804031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8c0b2f2-9f73-4a23-b990-79fb18e30d87 req-3a5a0ca3-c246-4ac5-bdba-8ec72af22a04 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:54.822111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a8c0b2f2-9f73-4a23-b990-79fb18e30d87 req-3a5a0ca3-c246-4ac5-bdba-8ec72af22a04 service nova] Creating event network-changed:6337b891-a979-4469-b430-a1977ed3002a for instance 0c9a0477-ea48-4f40-9445-76db8506018d on n-h2-854653-7 Nov 03 03:52:54.830546 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a8c0b2f2-9f73-4a23-b990-79fb18e30d87 req-3a5a0ca3-c246-4ac5-bdba-8ec72af22a04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049140 Nov 03 03:52:54.831782 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 248/542] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:54.839870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:54.840906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:54.849631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:54.850369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:54.851065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:54.852032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:54.852873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:54.853644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:54.883031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:52:55.095585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:52:55.096134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:52:55.096477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:52:55.096907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:52:55.097352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:52:55.119092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:55.120113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:55.121624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:55.123045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:55.123708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:55.124498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:55.145446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:52:55.152107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for user c4a4d4a61500400faf673aa67ff8be39 and project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:52:55.177575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:52:55.181532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:52:55.293890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:55.311949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10d4cbf8-b1d5-4af8-a40b-971f516379e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1463 microversion: 2.1 time: 0.478437 Nov 03 03:52:55.324811 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 249/543] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:54 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1463 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:55.341725 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5bb2eccc-5c38-4812-aca3-4d69556a3599 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.435792 Nov 03 03:52:55.343117 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 295/544] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:52:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:52:55.349416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a49efda5-cbf6-4ee6-b7bc-e418f2370585 tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] Action: 'create', calling method: .version_select at 0x7ff7f99b41f0>, body: {"security_group": {"name": "tempest-securitygroup-1881799640", "description": "tempest-description-1608766102"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:55.361409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c6d897aa-af5a-4b1e-b4ee-d90e277c9293 req-1317e3b2-0e87-4517-96dc-01d7f2a2a4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5", "tag": "41b4ae7a-5902-4ee5-b545-38667d17f6d4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:55.379465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c6d897aa-af5a-4b1e-b4ee-d90e277c9293 req-1317e3b2-0e87-4517-96dc-01d7f2a2a4d4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:55.381162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c6d897aa-af5a-4b1e-b4ee-d90e277c9293 req-1317e3b2-0e87-4517-96dc-01d7f2a2a4d4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:55.383023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c6d897aa-af5a-4b1e-b4ee-d90e277c9293 req-1317e3b2-0e87-4517-96dc-01d7f2a2a4d4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:55.397738 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c6d897aa-af5a-4b1e-b4ee-d90e277c9293 req-1317e3b2-0e87-4517-96dc-01d7f2a2a4d4 service nova] Creating event network-changed:41b4ae7a-5902-4ee5-b545-38667d17f6d4 for instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 on n-h2-854653-7 Nov 03 03:52:55.402816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c6d897aa-af5a-4b1e-b4ee-d90e277c9293 req-1317e3b2-0e87-4517-96dc-01d7f2a2a4d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076559 Nov 03 03:52:55.403532 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 250/545] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:55.412097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85909065-6805-4415-adc2-18ddc9cc2734 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:55.413223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85909065-6805-4415-adc2-18ddc9cc2734 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:55.568907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85909065-6805-4415-adc2-18ddc9cc2734 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:55.579869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85909065-6805-4415-adc2-18ddc9cc2734 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1218 microversion: 2.1 time: 0.174763 Nov 03 03:52:55.589442 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 251/546] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:55 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:56.042661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:56.043540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:56.060095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:56.060592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:56.061130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:56.061799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:56.062222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:56.062847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:56.200187 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a49efda5-cbf6-4ee6-b7bc-e418f2370585 tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.855504 Nov 03 03:52:56.201782 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 296/547] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:52:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:56.215488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b03fce42-b7b9-404f-9a35-28d02e22dbfb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:56.216140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b03fce42-b7b9-404f-9a35-28d02e22dbfb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:56.374733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b03fce42-b7b9-404f-9a35-28d02e22dbfb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:56.404914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b03fce42-b7b9-404f-9a35-28d02e22dbfb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1211 microversion: 2.1 time: 0.200512 Nov 03 03:52:56.409864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 297/548] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:56 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1211 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:56.431245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:56.432865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:56.473834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:56.474587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:56.475054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:56.480504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:56.484503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:56.487120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:56.563815 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-daf0b26f-2615-4cc6-8b97-7d6c583fc6fe tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1614 microversion: 2.1 time: 0.981863 Nov 03 03:52:56.568270 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 252/549] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:55 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1614 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:56.593799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc4fe7f3-4c78-4901-9e31-88a5118ebf99 tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] Calling method '.version_select at 0x7ff7f9619790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:56.976289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:57.000390 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d30772a-f4d0-4e16-b18c-6b7847755e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1319 microversion: 2.1 time: 0.586834 Nov 03 03:52:57.018694 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 298/550] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:56 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:57.028873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:57.030119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:57.037140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:57.037934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:57.038591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:57.039687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:57.040354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:57.040979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:57.175499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eacef8d3c2ae47519bba70f6424056fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f22db116f324a53b32b3e8aa8433ed0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:57.182839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] flavor_id is None. Assuming migration. {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 03 03:52:57.182839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 03:52:57.589743 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-880ae4fb-798c-4df4-9449-81e8ca03e024 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f/action" status: 202 len: 0 microversion: 2.1 time: 0.569527 Nov 03 03:52:57.599802 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 299/551] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:52:57 2022] POST /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:52:57.616969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:57.620084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:57.632269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:57.632269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:57.632269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:57.639540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:57.642951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:57.643626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:57.750822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:57.761346 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ab6072c-186b-49de-ab86-3ab9f888db68 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1278 microversion: 2.1 time: 0.160206 Nov 03 03:52:57.765570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 300/552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:57 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:57.779763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ca4d1391-f16c-430a-81aa-6821e290e586 req-8a35d676-7f8c-429f-9cac-78886e7a5d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb682fda-192b-4143-937c-92dd4e7c5a23", "tag": "44a5439b-effe-4ab4-8b8d-2b01e36f09f5"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:52:57.803292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ca4d1391-f16c-430a-81aa-6821e290e586 req-8a35d676-7f8c-429f-9cac-78886e7a5d29 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:57.806953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ca4d1391-f16c-430a-81aa-6821e290e586 req-8a35d676-7f8c-429f-9cac-78886e7a5d29 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:57.808041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ca4d1391-f16c-430a-81aa-6821e290e586 req-8a35d676-7f8c-429f-9cac-78886e7a5d29 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:57.847337 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ca4d1391-f16c-430a-81aa-6821e290e586 req-8a35d676-7f8c-429f-9cac-78886e7a5d29 service nova] Creating event network-changed:44a5439b-effe-4ab4-8b8d-2b01e36f09f5 for instance eb682fda-192b-4143-937c-92dd4e7c5a23 on n-h1-854653-7 Nov 03 03:52:57.854108 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ca4d1391-f16c-430a-81aa-6821e290e586 req-8a35d676-7f8c-429f-9cac-78886e7a5d29 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085538 Nov 03 03:52:57.857997 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 301/553] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:52:57.860608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:57.864267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:57.881432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:57.882076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:57.882641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:57.883568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:57.884133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:57.884727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:58.006103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:58.042101 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-452c0a59-9918-49f9-824c-df66e74b5f0e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1207 microversion: 2.1 time: 0.184153 Nov 03 03:52:58.051523 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 302/554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:57 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1207 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:58.066029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:58.067862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:58.074939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:58.075456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:58.075906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:58.076626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:58.077402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:58.077529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:58.337169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:58.349551 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-455c4e18-abf5-424d-955c-157cc9c3d7f7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1472 microversion: 2.1 time: 0.294712 Nov 03 03:52:58.351785 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 303/555] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:58 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1472 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:58.360777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:58.364617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:58.392901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:58.398611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:58.399080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:58.399835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:58.400308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:58.400737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:58.754228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:58.763554 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccc0c969-c3ff-43e7-828e-d7ce3c41e97d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1319 microversion: 2.1 time: 0.409652 Nov 03 03:52:58.773988 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 304/556] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:58 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:58.796340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:58.797052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:58.809052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:58.810462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:58.810462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:58.813199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:58.813962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:58.816608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:58.916186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:58.930529 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37711ea1-7e1e-44a3-b6b2-431bad280956 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1278 microversion: 2.1 time: 0.137622 Nov 03 03:52:58.949339 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 305/557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:58 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:59.073377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:59.073998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:59.089163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:59.089672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:59.090896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:59.094789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:59.095974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:59.097569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:59.292468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:59.302676 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f036cbe-5d29-49aa-b04f-4a2659e8db58 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1207 microversion: 2.1 time: 0.235610 Nov 03 03:52:59.303244 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 306/558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:59 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1207 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:52:59.383898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:59.384968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:59.399768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:59.401245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:59.402122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:59.403696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:59.404594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:59.405314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:59.788239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:52:59.806904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15ceb164-254f-41d1-ac2a-839661945b22 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1472 microversion: 2.1 time: 0.428818 Nov 03 03:52:59.808315 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 307/559] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:59 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:52:59.812661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:52:59.813553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:52:59.826806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:59.827605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:59.833833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:52:59.837087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:52:59.837087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:52:59.837087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:00.493346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:00.503367 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-76244a8d-367f-42a0-9505-dff0c332bffa tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1319 microversion: 2.1 time: 0.694354 Nov 03 03:53:00.504205 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 308/560] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:52:59 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:00.510149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:00.511851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:00.530579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:00.531348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:00.534031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:00.534957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:00.536177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:00.536780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:00.682758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:00.685003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:00.689986 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-049b642a-88ef-4d5c-97d4-14e399e36ffe tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1276 microversion: 2.1 time: 0.184529 Nov 03 03:53:00.698463 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 309/561] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:00 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:00.706083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:00.725994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:00.738976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:00.739740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:00.740922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:00.741306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:00.741774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:00.742371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:00.876181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:00.890862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f896b9a-1dbc-4bee-9881-5b9cedbb0cbe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1263 microversion: 2.1 time: 0.188468 Nov 03 03:53:00.891634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 310/562] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:00 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:00.897859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-407a02c8-d03a-4307-8d42-0bb73bfa435d req-441d8072-0b90-4065-bedd-6bb409bd4076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5", "name": "network-vif-plugged", "status": "completed", "tag": "41b4ae7a-5902-4ee5-b545-38667d17f6d4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:00.928176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-407a02c8-d03a-4307-8d42-0bb73bfa435d req-441d8072-0b90-4065-bedd-6bb409bd4076 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:00.929067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-407a02c8-d03a-4307-8d42-0bb73bfa435d req-441d8072-0b90-4065-bedd-6bb409bd4076 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:00.929733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-407a02c8-d03a-4307-8d42-0bb73bfa435d req-441d8072-0b90-4065-bedd-6bb409bd4076 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:00.948583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-407a02c8-d03a-4307-8d42-0bb73bfa435d req-441d8072-0b90-4065-bedd-6bb409bd4076 service nova] Creating event network-vif-plugged:41b4ae7a-5902-4ee5-b545-38667d17f6d4 for instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 on n-h2-854653-7 Nov 03 03:53:00.958828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-407a02c8-d03a-4307-8d42-0bb73bfa435d req-441d8072-0b90-4065-bedd-6bb409bd4076 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062439 Nov 03 03:53:00.959842 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 311/563] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:00.968418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:00.969680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:00.978907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:00.979733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:00.980425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:00.981527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:00.982997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:00.983687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:01.638747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:01.655581 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe9057a6-3e58-489e-adeb-e3ff3ca4a70a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1472 microversion: 2.1 time: 0.693278 Nov 03 03:53:01.656173 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 312/564] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:00 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1472 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:01.682945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:01.683583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:01.710582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:01.717951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:01.718544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:01.719316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:01.719793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:01.720217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:02.059804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:02.083123 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-143ce2c3-e425-4ad6-a6b3-a22c53a9f689 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1319 microversion: 2.1 time: 0.412472 Nov 03 03:53:02.087508 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 313/565] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:01 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:02.098733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:02.102769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:02.131713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:02.134558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:02.135825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:02.137632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:02.144708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:02.144708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:02.144708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:02.277367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:02.300675 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-808353f4-e652-4564-847d-5a8991101869 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1276 microversion: 2.1 time: 0.211267 Nov 03 03:53:02.307291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 314/566] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:02 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:02.320636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:02.321951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:02.336107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:02.355893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:02.360071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:02.360071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:02.360071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:02.360071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:02.707398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:02.718257 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c6d9d15-9d24-461e-94b8-266fcffa4916 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1269 microversion: 2.1 time: 0.408160 Nov 03 03:53:02.742874 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 315/567] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:02 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1269 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:02.762276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:02.766165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:02.786325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:02.789325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:02.790037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:02.791484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:02.792323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:02.793722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:03.526426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:03.536835 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ff28b71-a6d3-41f8-8367-0a3f3f0be3fa tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1472 microversion: 2.1 time: 0.792434 Nov 03 03:53:03.543387 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 316/568] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:02 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1472 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:03.554057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:03.554681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:03.565436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:03.572133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:03.572133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:03.572133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:03.572133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:03.573645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:04.031410 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc4fe7f3-4c78-4901-9e31-88a5118ebf99 tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12426 microversion: 2.1 time: 7.456354 Nov 03 03:53:04.032201 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 253/569] 10.222.0.30 () {58 vars in 1191 bytes} [Thu Nov 3 03:52:56 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12426 bytes in 7458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:53:04.050244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:04.051156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:04.058626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:04.067298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:04.067982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:04.069459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:04.070096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:04.071169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:04.558378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:04.567812 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bde97a82-e000-4a65-a07b-c98567126253 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1469 microversion: 2.1 time: 1.026860 Nov 03 03:53:04.574068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 317/570] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:03 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1469 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:04.578844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:04.591524 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4384fa71-7aec-4190-bf96-2c66dba985e8 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.558052 Nov 03 03:53:04.595034 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 254/571] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:04 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:04.600526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30709778-4a2c-4938-8567-24bc371d8f9b tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] Calling method '.version_select at 0x7ff7f95ee9d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:04.601646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:04.605171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:04.620069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:04.625476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:04.626195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:04.627107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:04.635685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:04.636437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:05.132686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:05.579255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=30 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:05.733260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:05.759123 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15484f0d-730b-487a-b598-92421ef04722 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 1.183429 Nov 03 03:53:05.763568 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 318/572] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:04 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:05.776985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:05.780138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:05.796508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:05.801776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:05.802420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:05.804525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:05.806224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:05.807387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:06.012431 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30709778-4a2c-4938-8567-24bc371d8f9b tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 1.415550 Nov 03 03:53:06.014067 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 255/573] 10.222.0.30 () {58 vars in 1191 bytes} [Thu Nov 3 03:53:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:06.025124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:06.025969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:06.039053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:06.039912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:06.045349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:06.045349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:06.045894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:06.046530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:06.399968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=24 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:06.671553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:06.680836 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4681df04-67c3-470f-93e0-d5d67cf260d2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.916007 Nov 03 03:53:06.681453 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 319/574] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:05 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:06.687815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:06.688640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:06.716709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:06.718224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:06.719219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:06.720246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:06.720834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:06.721533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:06.751473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:06.760733 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-726f9691-bca1-4b03-bf80-a6be6df821fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1319 microversion: 2.1 time: 0.745470 Nov 03 03:53:06.761398 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 256/575] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:06 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1319 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:06.767256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6cc464d4-6957-41f7-8895-3fbd219d714a tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] Calling method '.version_select at 0x7ff7f95db940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:07.140087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:07.148369 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80c0965e-887a-42fb-8dbf-628eca985499 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.465577 Nov 03 03:53:07.148955 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 320/576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:06 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:07.153356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-570c7bfe-5b43-443d-ae3d-242a3dd18c81 req-eaaa1acf-3d2a-45c8-8ad3-3a6a639adc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb682fda-192b-4143-937c-92dd4e7c5a23", "name": "network-vif-plugged", "status": "completed", "tag": "44a5439b-effe-4ab4-8b8d-2b01e36f09f5"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:07.163237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-570c7bfe-5b43-443d-ae3d-242a3dd18c81 req-eaaa1acf-3d2a-45c8-8ad3-3a6a639adc87 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:07.163723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-570c7bfe-5b43-443d-ae3d-242a3dd18c81 req-eaaa1acf-3d2a-45c8-8ad3-3a6a639adc87 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:07.164235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-570c7bfe-5b43-443d-ae3d-242a3dd18c81 req-eaaa1acf-3d2a-45c8-8ad3-3a6a639adc87 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:07.175689 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-570c7bfe-5b43-443d-ae3d-242a3dd18c81 req-eaaa1acf-3d2a-45c8-8ad3-3a6a639adc87 service nova] Creating event network-vif-plugged:44a5439b-effe-4ab4-8b8d-2b01e36f09f5 for instance eb682fda-192b-4143-937c-92dd4e7c5a23 on n-h1-854653-7 Nov 03 03:53:07.181903 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-570c7bfe-5b43-443d-ae3d-242a3dd18c81 req-eaaa1acf-3d2a-45c8-8ad3-3a6a639adc87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031702 Nov 03 03:53:07.182585 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 321/577] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:07.187341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-04e8a411-4552-4527-9076-10b1bb0eacb0 req-63111e36-3d6c-404a-ad7b-7af14bded40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b75530a-26ef-44c1-99d3-5ff30f3ae5cf", "tag": "92280416-ffea-4aae-a135-b4d7c67670b1"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:07.197150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-04e8a411-4552-4527-9076-10b1bb0eacb0 req-63111e36-3d6c-404a-ad7b-7af14bded40b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:07.197543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-04e8a411-4552-4527-9076-10b1bb0eacb0 req-63111e36-3d6c-404a-ad7b-7af14bded40b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:07.197977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-04e8a411-4552-4527-9076-10b1bb0eacb0 req-63111e36-3d6c-404a-ad7b-7af14bded40b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:07.210331 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-04e8a411-4552-4527-9076-10b1bb0eacb0 req-63111e36-3d6c-404a-ad7b-7af14bded40b service nova] Creating event network-changed:92280416-ffea-4aae-a135-b4d7c67670b1 for instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf on n-h1-854653-7 Nov 03 03:53:07.215542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-04e8a411-4552-4527-9076-10b1bb0eacb0 req-63111e36-3d6c-404a-ad7b-7af14bded40b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Nov 03 03:53:07.216624 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 322/578] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:07.222146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:07.223407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:07.229615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:07.230484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:07.231080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:07.231952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:07.232555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:07.233177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:07.615635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:07.624495 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a11d26e5-8468-4eb5-ab07-8219a641b7f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.406319 Nov 03 03:53:07.641730 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 323/579] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:07 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:07.643095 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6cc464d4-6957-41f7-8895-3fbd219d714a tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c7f30783-7a64-40d9-bdae-a35f56cc30b9" status: 202 len: 0 microversion: 2.1 time: 0.880466 Nov 03 03:53:07.643882 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 257/580] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:06 2022] DELETE /compute/v2.1/os-security-groups/c7f30783-7a64-40d9-bdae-a35f56cc30b9 => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:07.662465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7502103-f94c-43af-98ea-38eea311e3bb tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] Calling method '.version_select at 0x7ff7f95d3280>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:07.770868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b8398b6-29de-43a6-b6d7-0ac9546ed1ca tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f98a7310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1832570666", "description": "tempest-description-825074171"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:08.110675 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7502103-f94c-43af-98ea-38eea311e3bb tempest-SecurityGroupsTestAdminJSON-513681813 tempest-SecurityGroupsTestAdminJSON-513681813-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/fe1c5d1e-1279-4529-a9e7-9796715290cb" status: 202 len: 0 microversion: 2.1 time: 0.452570 Nov 03 03:53:08.112106 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 258/581] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:07 2022] DELETE /compute/v2.1/os-security-groups/fe1c5d1e-1279-4529-a9e7-9796715290cb => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:08.119430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:08.120448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:08.138760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.139268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.139714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.140436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.140899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.144418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.192082 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b8398b6-29de-43a6-b6d7-0ac9546ed1ca tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.565107 Nov 03 03:53:08.200803 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 324/582] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:53:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:08.200803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:08.200803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:08.209940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.216504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.218083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.224064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.224064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.224064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.343604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:08.354428 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78513bd5-6d3e-4f19-b8bc-d16ea50ef9ff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.240865 Nov 03 03:53:08.355322 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 259/583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:08 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:08.360379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61446891-01d2-4e09-bb52-329eec3181f7 tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] Calling method '.version_select at 0x7ff7f95db160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:08.473405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:08.485057 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3bd1a1fb-3449-4406-a3fc-120038337ac9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1319 microversion: 2.1 time: 0.290147 Nov 03 03:53:08.486569 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 325/584] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:08 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:08.502748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:08.503710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:08.512218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.515552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.515552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.515552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.515552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.515865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.713708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:08.723145 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d788c32c-663f-49a7-911a-b8ddd5c2da72 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.228346 Nov 03 03:53:08.723716 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 326/585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:08 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:08.730791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4db17b5-654b-4a21-9d21-cdeb6394e71a tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f989a4c0>, body: {"security_group_rule": {"parent_group_id": "ab1361e9-be1a-434f-80ae-faff7f10e33f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:08.743686 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61446891-01d2-4e09-bb52-329eec3181f7 tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/236a6fc4-740a-4491-a7af-82d3133f63db" status: 202 len: 0 microversion: 2.1 time: 0.386914 Nov 03 03:53:08.749824 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 260/586] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:08 2022] DELETE /compute/v2.1/os-security-groups/236a6fc4-740a-4491-a7af-82d3133f63db => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:08.749824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:08.750110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:08.756822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.757701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.758343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.759276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:08.759930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:08.760577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:08.967075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:08.976841 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d17e8c2-4dbf-4276-b857-1eacd7bf17ae tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.230446 Nov 03 03:53:08.978243 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 261/587] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:08 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:08.985397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-57050d42-0f28-4749-9a88-c23e187b0964 tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] Calling method '.version_select at 0x7ff7f95f08b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:09.370356 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-57050d42-0f28-4749-9a88-c23e187b0964 tempest-SecurityGroupsTestAdminJSON-1401091042 tempest-SecurityGroupsTestAdminJSON-1401091042-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/241d8931-0f07-4005-a25c-54ef30e619c8" status: 202 len: 0 microversion: 2.1 time: 0.385810 Nov 03 03:53:09.370356 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 262/588] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:08 2022] DELETE /compute/v2.1/os-security-groups/241d8931-0f07-4005-a25c-54ef30e619c8 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:09.374091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-67b4f7ed-a78b-4e15-ae06-e546bf57f242 req-a70d0b51-16a1-4870-a739-6b2109962e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d37b662-d2df-4e08-9286-7985bf484951", "tag": "fa9e47ab-fb53-402b-a4c9-c2597d798541"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:09.403996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-67b4f7ed-a78b-4e15-ae06-e546bf57f242 req-a70d0b51-16a1-4870-a739-6b2109962e63 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:09.405844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-67b4f7ed-a78b-4e15-ae06-e546bf57f242 req-a70d0b51-16a1-4870-a739-6b2109962e63 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:09.405991 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4db17b5-654b-4a21-9d21-cdeb6394e71a tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.680893 Nov 03 03:53:09.406525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-67b4f7ed-a78b-4e15-ae06-e546bf57f242 req-a70d0b51-16a1-4870-a739-6b2109962e63 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:09.406854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 327/589] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 03:53:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:09.414679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:09.415103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:09.427766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:09.428187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:09.428623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:09.429431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:09.429895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:09.430319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:09.448207 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-67b4f7ed-a78b-4e15-ae06-e546bf57f242 req-a70d0b51-16a1-4870-a739-6b2109962e63 service nova] Creating event network-changed:fa9e47ab-fb53-402b-a4c9-c2597d798541 for instance 9d37b662-d2df-4e08-9286-7985bf484951 on n-h1-854653-7 Nov 03 03:53:09.461982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-67b4f7ed-a78b-4e15-ae06-e546bf57f242 req-a70d0b51-16a1-4870-a739-6b2109962e63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093104 Nov 03 03:53:09.466627 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 263/590] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:09.480114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-204eba95-3cea-48f4-a2ba-fde8a372be46 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f95eedc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1527301785", "description": "tempest-description-743229169"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:09.628027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:09.640003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3a980c6-4bdf-4db8-bb94-a62c720da943 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.231958 Nov 03 03:53:09.641201 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 328/591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:09 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:09.646742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:09.647564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:09.654271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:09.655002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:09.655655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:09.656544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:09.657328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:09.657909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:09.934390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:09.949161 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d8f28368-35d4-4832-9d71-7c8f0b69076b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1319 microversion: 2.1 time: 0.306558 Nov 03 03:53:09.950108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 329/592] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:09 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:09.957496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:09.958344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:09.973515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:09.975701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:09.976363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:09.980609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:09.982646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:09.983268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:10.020073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:10.126400 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-204eba95-3cea-48f4-a2ba-fde8a372be46 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.658067 Nov 03 03:53:10.139876 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 264/593] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:53:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:10.147130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:10.148215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:10.154657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:10.155155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:10.155655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:10.156509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:10.156976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:10.157490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:10.193537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:10.205710 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae618558-7e05-4d00-96db-56e89791a173 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.253463 Nov 03 03:53:10.205710 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 330/594] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:09 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:10.227147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c7a64bf-979e-4b4d-8a56-5f0aeb8ff858 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f983baf0>, body: {"security_group_rule": {"parent_group_id": "d9c9b8bb-3b36-4220-a674-4c62ea35f0ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:10.480825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:10.495519 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-880b3cdb-846c-448f-bb93-2af7bd9c4574 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.350550 Nov 03 03:53:10.496420 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 265/595] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:10 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:10.664689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:10.666226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:10.675811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:10.676621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:10.677260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:10.679631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:10.680327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:10.681159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.034099 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c7a64bf-979e-4b4d-8a56-5f0aeb8ff858 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.827581 Nov 03 03:53:11.035992 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 331/596] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 03:53:10 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:11.049583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:11.051555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:11.068421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.069364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.071383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.075311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.076056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.078412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.101779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:11.114649 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f780aab-7403-41db-ad03-efb753c7128e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.453951 Nov 03 03:53:11.127130 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 266/597] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:10 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:11.129999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b791ca5c-63c7-445a-bb67-7b2b3e7c977e tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f98f7670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-974506079", "description": "tempest-description-747256532"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:11.348453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:11.358435 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5bb710ee-ba7e-4b83-a3ba-e5e16a8ab98b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1469 microversion: 2.1 time: 0.320163 Nov 03 03:53:11.369925 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 332/598] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:11 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:11.379853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:11.379853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:11.387606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.391613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.398415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.399619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.400236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.401208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.651901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:11.673139 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc026aec-cabe-4098-90f0-a9ae68300251 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.311478 Nov 03 03:53:11.689205 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 333/599] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:11 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:11.689205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:11.693980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b791ca5c-63c7-445a-bb67-7b2b3e7c977e tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.568970 Nov 03 03:53:11.702116 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 267/600] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:53:11 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:11.702116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:11.702116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:11.704533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:11.709819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Searching by: {'reservation_id': 'r-bhk4v4ho', 'deleted': False, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 03:53:11.712859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.713385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.716956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.717757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.718231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.718663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.721475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.721987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.722976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.727289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.728346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:11.728346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:11.901547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 03:53:11.983811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:11.993391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:11.999356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:11.999860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.000310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.004849 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-19b75cf3-05ef-4f08-96b8-99bc376abaef tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.309214 Nov 03 03:53:12.006410 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 268/601] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:11 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:12.025584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-084978fe-83fc-45e0-861d-36d2615c4a0d tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f96de940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1870277477", "description": "tempest-description-1989238867"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:12.178100 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b39ef87c-f81c-4e3f-a499-5608008cff91 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?reservation_id=r-bhk4v4ho" status: 200 len: 2931 microversion: 2.1 time: 0.502642 Nov 03 03:53:12.179290 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 334/602] 10.222.0.30 () {58 vars in 1197 bytes} [Thu Nov 3 03:53:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-bhk4v4ho => generated 2931 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:12.184152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:12.185257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:12.192340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.193207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.194068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.194999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.195673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.196404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.374964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:12.383141 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2490b470-82b1-4254-91d7-9ef951a909db tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.202742 Nov 03 03:53:12.383702 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 335/603] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:12 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:12.388064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6ab3983-9b34-4779-b2ac-36c95ce32aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:12.401328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_groups [None req-e6ab3983-9b34-4779-b2ac-36c95ce32aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Querying cell 464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) for 2 instances {{(pid=127593) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 03 03:53:12.402027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ab3983-9b34-4779-b2ac-36c95ce32aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.402498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ab3983-9b34-4779-b2ac-36c95ce32aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.402928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ab3983-9b34-4779-b2ac-36c95ce32aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.432172 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6ab3983-9b34-4779-b2ac-36c95ce32aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/7f3feee2-6ae4-48b8-b755-6e98ff81572d" status: 200 len: 271 microversion: 2.1 time: 0.047390 Nov 03 03:53:12.432754 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 336/604] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:53:12 2022] GET /compute/v2.1/os-server-groups/7f3feee2-6ae4-48b8-b755-6e98ff81572d => generated 271 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:12.443127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:12.443734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:12.449364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.449843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.450274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.450964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.451413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.451854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.577350 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c6e37d9-2f65-474c-adf7-07737ad54b8b tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 200 len: 1620 microversion: 2.1 time: 0.137619 Nov 03 03:53:12.577988 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 337/605] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:12 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 1620 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:12.599543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:12.600146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:12.605899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.606319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.606753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.607438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.607885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.608304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.802657 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-084978fe-83fc-45e0-861d-36d2615c4a0d tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.794985 Nov 03 03:53:12.803243 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 269/606] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:53:12 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:12.808168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:12.809908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:12.818733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.819223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.819658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:12.820357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:12.820810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:12.821274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:13.031400 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3f11173-1c0b-49e3-8baa-028134ec52bb tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1620 microversion: 2.1 time: 0.435778 Nov 03 03:53:13.032246 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 338/607] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:12 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1620 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:13.033029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:13.038927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6de823fb-6d23-4261-bee4-88423c8f0fbf tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f9748c10>, body: {"security_group_rule": {"parent_group_id": "1f6c130d-7515-463d-bc4f-745837a8dd2f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9deffefe-9fd9-403e-9fb6-eecc71ee3362"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:13.042916 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c8da1de-b032-4dcb-b053-cd71620b80a1 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.238322 Nov 03 03:53:13.045346 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 270/608] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:12 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:13.070358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:13.071267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:13.083609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:13.087876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:13.087876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:13.087876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:13.087876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:13.088213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:13.310875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:13.321767 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a60682b-76f5-4b5e-8956-bbea45bbb032 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.274890 Nov 03 03:53:13.345449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 271/609] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:13 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:13.350858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1810071156", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "54bb3703-e5fe-4369-a8d8-c04bd950e0ab"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:13.406499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:53:14.268439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:53:14.270982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:53:14.278671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:53:14.280986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:53:14.283787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:53:14.294907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:14.306882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.311649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.312534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.316427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.316427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.316427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.329919 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6de823fb-6d23-4261-bee4-88423c8f0fbf tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.295888 Nov 03 03:53:14.331093 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 339/610] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 03:53:13 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:14.336960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:14.339384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:14.343689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:14.353325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:14.355179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.359176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.361303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.363500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.366684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.373174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:53:14.374035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.376409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:53:14.544998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:14.553652 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-890dcc7d-b005-4ffc-b35b-9ceec0682375 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.220664 Nov 03 03:53:14.554215 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 340/611] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:14 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:14.569589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:14.570259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:14.578245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.578958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.579570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.580430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.581061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.581682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.615104 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-93baf256-927c-4201-85ee-b92762131d05 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.268630 Nov 03 03:53:14.615889 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 272/612] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:53:14.620842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:14.622232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:14.646102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.647765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.651915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.652952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:14.667010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:14.669511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:14.752089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:14.766956 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-125f360e-7a1c-452c-b27a-33711fe84ab5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.211339 Nov 03 03:53:14.776747 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 341/613] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:14 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:14.786309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5435854-d976-4d43-bda1-56cace4abf7d tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f98ffe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-482103036", "description": "tempest-description-895389559"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:14.936928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:14.957317 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-205ded7b-6255-4841-a62f-71b800c3f377 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.340043 Nov 03 03:53:14.961161 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 273/614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:14 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:14.965469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-068267f0-dad9-44c1-8eb3-7ee4e9ad5907 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:14.966432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-068267f0-dad9-44c1-8eb3-7ee4e9ad5907 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:15.056057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-068267f0-dad9-44c1-8eb3-7ee4e9ad5907 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:15.063456 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-068267f0-dad9-44c1-8eb3-7ee4e9ad5907 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1217 microversion: 2.1 time: 0.104094 Nov 03 03:53:15.066083 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 274/615] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:14 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:15.282880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5435854-d976-4d43-bda1-56cace4abf7d tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.504949 Nov 03 03:53:15.289503 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 342/616] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:53:14 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:15.300889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e81c891-a140-4205-859c-20716489de45 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f971d1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1518616736", "description": "tempest-description-1387328809"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:15.549977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-790194766", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:15.605688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:53:15.790512 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e81c891-a140-4205-859c-20716489de45 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.497262 Nov 03 03:53:15.800235 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 275/617] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:53:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:15.800235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:15.800235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:15.804382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:15.804875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:15.805338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:15.806041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:15.806535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:15.806967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:15.878948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:53:15.879382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:53:15.879914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:53:15.880334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:53:15.888084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:53:15.900808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:15.900808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:15.903136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:15.904073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:15.904560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:15.904999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:15.939776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Getting quotas for project 823aa65f33fb44f2b70a9c6c5342cd76. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:15.947363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Getting quotas for user dcb2b44cf2e44553ae1e83b97cabc1b2 and project 823aa65f33fb44f2b70a9c6c5342cd76. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:15.966936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:53:15.969673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:53:16.031590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:16.042966 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cbae6112-18c6-40e9-ad47-5c3c087c703a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.250412 Nov 03 03:53:16.044641 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 276/618] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:15 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:16.049614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:16.051045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:16.058515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:16.071201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:16.071995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:16.073468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:16.074141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:16.074835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:16.152864 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-baa00182-3ab7-44d1-94d0-9866c8693df9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744562 Nov 03 03:53:16.154286 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 343/619] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:53:16.161652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5192f502-ea8e-4eca-aad1-9c4e5912a602 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f98a39d0>, body: {"security_group_rule": {"parent_group_id": "e0673182-a06a-4b2a-aa3a-c272e66866e7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "925e0ee7-3af3-4401-b4f1-da5836df0274"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:16.340857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:16.356748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10505828-e16a-41d8-b61b-fe7a8537ce44 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.310804 Nov 03 03:53:16.361246 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 277/620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:16 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:16.371321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:16.372280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:16.382515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:16.383304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:16.385689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:16.385689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:16.385689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:16.386132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:16.653732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:16.663131 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e97d0b2b-2466-4cd6-997a-9a56feb6bb99 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.300324 Nov 03 03:53:16.677040 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 278/621] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:16 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:16.677040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:16.677040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:16.677040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:16.682652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:16.682652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:16.682652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:16.682652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:16.683041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:16.820700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:16.836332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:16.842508 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f18b5133-33b3-4880-b6d7-922ff88890a9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1269 microversion: 2.1 time: 0.177234 Nov 03 03:53:16.857043 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 279/622] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:16 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1269 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:16.864974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee5ca3d6-a59d-4572-ac4d-b3e9d3945d3b tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:16.864974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee5ca3d6-a59d-4572-ac4d-b3e9d3945d3b tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:16.945306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ee5ca3d6-a59d-4572-ac4d-b3e9d3945d3b tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:16.953560 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee5ca3d6-a59d-4572-ac4d-b3e9d3945d3b tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1221 microversion: 2.1 time: 0.105941 Nov 03 03:53:16.954364 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 280/623] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:16 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:16.959769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dde32317-c878-439d-82a7-dc491ff6f8e2 req-776b80ca-373e-4ec7-b704-00a14b708a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b75530a-26ef-44c1-99d3-5ff30f3ae5cf", "name": "network-vif-plugged", "status": "completed", "tag": "92280416-ffea-4aae-a135-b4d7c67670b1"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:16.971166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dde32317-c878-439d-82a7-dc491ff6f8e2 req-776b80ca-373e-4ec7-b704-00a14b708a75 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:16.971475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dde32317-c878-439d-82a7-dc491ff6f8e2 req-776b80ca-373e-4ec7-b704-00a14b708a75 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:16.973221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dde32317-c878-439d-82a7-dc491ff6f8e2 req-776b80ca-373e-4ec7-b704-00a14b708a75 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:16.990388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dde32317-c878-439d-82a7-dc491ff6f8e2 req-776b80ca-373e-4ec7-b704-00a14b708a75 service nova] Creating event network-vif-plugged:92280416-ffea-4aae-a135-b4d7c67670b1 for instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf on n-h1-854653-7 Nov 03 03:53:16.998792 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dde32317-c878-439d-82a7-dc491ff6f8e2 req-776b80ca-373e-4ec7-b704-00a14b708a75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043016 Nov 03 03:53:16.999649 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 281/624] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:17.074387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:17.075331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:17.084868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.085391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.085825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.086651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.088586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.093357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.118458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5192f502-ea8e-4eca-aad1-9c4e5912a602 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.962392 Nov 03 03:53:17.126754 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 344/625] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 03:53:16 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:17.132466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ec6ac67-289b-4257-b2ff-9d7f509668c9 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f9748ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:17.357952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:17.383929 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae5743fe-f331-40a2-89ec-195417d9464c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.314026 Nov 03 03:53:17.405236 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 282/626] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:17 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:17.414693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:17.421718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:17.430946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.432685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.433463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.434256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.434783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.435390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.688344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:17.697086 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80dadeab-f8d7-4ced-8ac5-552d93f04f1f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.290620 Nov 03 03:53:17.697713 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 283/627] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:17 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:17.703498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:17.704106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:17.710090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.710595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.711034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.711728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.712186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.712612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.853868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:17.861777 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af40b016-5de7-495e-83d6-3da938883d5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.162649 Nov 03 03:53:17.862319 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 284/628] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:17 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:17.871318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:17.871942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:17.877704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.878861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.879298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.879982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:17.880431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:17.880851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:17.940686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:17.948184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d7d03358-7806-4e32-aca5-0d9864c74c4f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1269 microversion: 2.1 time: 0.080580 Nov 03 03:53:17.948738 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 285/629] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:17 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:17.979446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4f78b3f-a970-4bb2-9504-03ea5093dd30 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:17.980833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4f78b3f-a970-4bb2-9504-03ea5093dd30 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:18.033484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4f78b3f-a970-4bb2-9504-03ea5093dd30 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:18.040409 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ec6ac67-289b-4257-b2ff-9d7f509668c9 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/925e0ee7-3af3-4401-b4f1-da5836df0274" status: 202 len: 0 microversion: 2.1 time: 0.912168 Nov 03 03:53:18.042816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4f78b3f-a970-4bb2-9504-03ea5093dd30 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1221 microversion: 2.1 time: 0.065731 Nov 03 03:53:18.042940 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 345/630] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:17 2022] DELETE /compute/v2.1/os-security-groups/925e0ee7-3af3-4401-b4f1-da5836df0274 => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:18.043050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 286/631] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:17 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1221 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:18.049575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-942bca4d-f3d0-4524-95db-c475edb679f3 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f99b41f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:18.107465 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-942bca4d-f3d0-4524-95db-c475edb679f3 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/e0673182-a06a-4b2a-aa3a-c272e66866e7" status: 200 len: 246 microversion: 2.1 time: 0.061782 Nov 03 03:53:18.108048 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 346/632] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 03:53:18 2022] GET /compute/v2.1/os-security-groups/e0673182-a06a-4b2a-aa3a-c272e66866e7 => generated 246 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:18.124218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23450f2c-ecef-4ef1-86fd-763bef5c8dbd tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f95f01f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-874912136", "description": "tempest-description-1696842245"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:18.414373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:18.415664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:18.422466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:18.427935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:18.428389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:18.429357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:18.429853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:18.431330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:18.532338 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23450f2c-ecef-4ef1-86fd-763bef5c8dbd tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.412766 Nov 03 03:53:18.533005 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 287/633] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 03:53:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:18.557317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67f3fc00-c26d-4a18-8194-b77ec6b9ef98 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f95dbca0>, body: {"security_group_rule": {"parent_group_id": "2e820be0-846a-4a9b-b4ab-4f9cf63e1538", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:18.740055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:18.748431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c33bcde-dbfb-477d-b022-f1a134fd544a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.339913 Nov 03 03:53:18.749338 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 347/634] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:18 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:18.754550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:18.755406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:18.761799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:18.762527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:18.763145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:18.769443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:18.769443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:18.769443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:18.990543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:18.998834 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f622d468-72a2-47dc-b49f-8512a1f8c7a6 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.248278 Nov 03 03:53:18.999416 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 348/635] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:18 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:19.004674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:19.005553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:19.011320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.011813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.012259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.012967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.013560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.013875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.247242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-67f3fc00-c26d-4a18-8194-b77ec6b9ef98 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.703202 Nov 03 03:53:19.248014 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 288/636] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 03:53:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:19.252700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:19.253905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:19.261801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.262304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.263028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.264075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.264446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.264899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.284415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:19.295242 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6f533c6-4a90-4f1e-9eff-de64fa85a483 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1311 microversion: 2.1 time: 0.294567 Nov 03 03:53:19.296494 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 349/637] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:18 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1311 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:19.306101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-97e20681-a20b-49e2-8d1e-2518c5f64ee4 req-bd16e331-fda6-40a9-bee7-a0ad5e7db7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d37b662-d2df-4e08-9286-7985bf484951", "name": "network-vif-plugged", "status": "completed", "tag": "fa9e47ab-fb53-402b-a4c9-c2597d798541"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:19.329439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97e20681-a20b-49e2-8d1e-2518c5f64ee4 req-bd16e331-fda6-40a9-bee7-a0ad5e7db7cf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.330013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97e20681-a20b-49e2-8d1e-2518c5f64ee4 req-bd16e331-fda6-40a9-bee7-a0ad5e7db7cf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.330870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97e20681-a20b-49e2-8d1e-2518c5f64ee4 req-bd16e331-fda6-40a9-bee7-a0ad5e7db7cf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.343297 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-97e20681-a20b-49e2-8d1e-2518c5f64ee4 req-bd16e331-fda6-40a9-bee7-a0ad5e7db7cf service nova] Creating event network-vif-plugged:fa9e47ab-fb53-402b-a4c9-c2597d798541 for instance 9d37b662-d2df-4e08-9286-7985bf484951 on n-h1-854653-7 Nov 03 03:53:19.348595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:19.349577 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-97e20681-a20b-49e2-8d1e-2518c5f64ee4 req-bd16e331-fda6-40a9-bee7-a0ad5e7db7cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051160 Nov 03 03:53:19.353638 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 350/638] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:19.360584 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33666829-c911-4ebc-b795-df9281261ce9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1275 microversion: 2.1 time: 0.111683 Nov 03 03:53:19.361788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:19.361916 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 289/639] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:19 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:19.363218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:19.370404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.371054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.371566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.372341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.373032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.373475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.479089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:19.491605 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bd9c61c2-230d-4db3-9c41-ce98075b3f3a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1273 microversion: 2.1 time: 0.136543 Nov 03 03:53:19.492984 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 351/640] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:19 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:19.498499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f838adb-7d16-4b33-b497-aeae3fbc1479 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Action: 'create', calling method: .version_select at 0x7ff7f98a3e50>, body: {"security_group_rule": {"parent_group_id": "2e820be0-846a-4a9b-b4ab-4f9cf63e1538", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:19.531982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a3cacc1-bea1-49e4-ba7e-53e1189ee53f tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Action: 'create', calling method: .version_select at 0x7ff7f95db9d0>, body: {"keypair": {"name": "tempest-keypair-1518352839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxyFfWdyQCOub97RXuCNMddfpsbDRR0+9qBS54haApJf25a6lwJM5XKbD7Mt5dyReET+KNIQVbOpn3HlA+btmPYh5LCDQr2UbgIDSZSOb9ufTHf85upO3rKux/CR8RByA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:19.547360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8a3cacc1-bea1-49e4-ba7e-53e1189ee53f tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Getting quotas for project 11ae4739f59d4d14bad947b274c240ee. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:19.553081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8a3cacc1-bea1-49e4-ba7e-53e1189ee53f tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Getting quotas for user 0fd22f5b843d4d82851147c1f2a89342 and project 11ae4739f59d4d14bad947b274c240ee. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:19.633827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8a3cacc1-bea1-49e4-ba7e-53e1189ee53f tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.270974 Nov 03 03:53:19.634551 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 290/641] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:53:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:19.772566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:19.773655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:19.782178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.785339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.786079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:19.787515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:19.788217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:19.788880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.127355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:20.135468 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-56a47a61-dbe8-4e01-af71-b4915a3783d4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.367514 Nov 03 03:53:20.136275 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 291/642] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:19 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:20.140825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:20.152928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:20.156219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.156709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.157187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.157896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.158512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.158775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.243240 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f838adb-7d16-4b33-b497-aeae3fbc1479 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.748876 Nov 03 03:53:20.251324 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 352/643] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 03:53:19 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:20.256944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-09d26153-b53b-48da-a038-5c3be92c345e tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f99ea280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:20.356402 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-09d26153-b53b-48da-a038-5c3be92c345e tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/2e820be0-846a-4a9b-b4ab-4f9cf63e1538" status: 200 len: 664 microversion: 2.1 time: 0.103596 Nov 03 03:53:20.357334 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 353/644] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 03:53:20 2022] GET /compute/v2.1/os-security-groups/2e820be0-846a-4a9b-b4ab-4f9cf63e1538 => generated 664 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:20.368884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:20.371898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:20.372763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:20.377187 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45bd9330-43e6-4e33-a1d0-5505f4baf7d9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1318 microversion: 2.1 time: 0.240005 Nov 03 03:53:20.378643 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 292/645] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:20 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:20.380020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.380682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.381302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.382186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.382870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.383463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.396821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-257774bb-f677-4c40-953c-f954a95d9eb2 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f971d310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:20.621337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:20.629737 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80d570ad-0e3a-4e3e-9715-7e871a475604 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1494 microversion: 2.1 time: 0.261871 Nov 03 03:53:20.641260 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 354/646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:20 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1494 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:20.641260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:20.641260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:20.641260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.641860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.642200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.642924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.643377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.643993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.877293 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-257774bb-f677-4c40-953c-f954a95d9eb2 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/e2c2ab0c-6b2b-4f05-90b0-07b56a5f8825" status: 202 len: 0 microversion: 2.1 time: 0.486305 Nov 03 03:53:20.878983 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 293/647] 10.222.0.30 () {58 vars in 1287 bytes} [Thu Nov 3 03:53:20 2022] DELETE /compute/v2.1/os-security-group-rules/e2c2ab0c-6b2b-4f05-90b0-07b56a5f8825 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:20.886127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:20.886991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:20.893531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.894246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.894759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.895542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.901508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.902094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.929090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:20.938939 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0db73d0d-d79e-45e0-b218-5614947a14e4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.307592 Nov 03 03:53:20.939779 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 355/648] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:20 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:20.946045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:20.946635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:20.953604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.954707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.955355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.956063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:20.956695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:20.957382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:20.961693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:21.012657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:21.023495 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0fa2cea-b208-4cb8-9fbb-e17e335b9b50 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1279 microversion: 2.1 time: 0.142631 Nov 03 03:53:21.023937 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 294/649] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:20 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:21.028976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfd6d385-a2b0-47b5-911c-1bd033294318 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f95db5e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:21.240135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2161733c-6c13-418b-bc94-34e496cbe855 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1645 microversion: 2.1 time: 0.298463 Nov 03 03:53:21.240962 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 356/650] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:20 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1645 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:21.247107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:21.247107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:21.252135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:21.252637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:21.253111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:21.253819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:21.254472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:21.254904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:21.722582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:21.730711 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-733008ff-0159-4324-8860-e7423763ffa0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.488934 Nov 03 03:53:21.731286 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 357/651] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:21 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:21.737060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:21.737910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:21.750713 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dfd6d385-a2b0-47b5-911c-1bd033294318 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2e820be0-846a-4a9b-b4ab-4f9cf63e1538" status: 202 len: 0 microversion: 2.1 time: 0.725287 Nov 03 03:53:21.751899 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 295/652] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:21 2022] DELETE /compute/v2.1/os-security-groups/2e820be0-846a-4a9b-b4ab-4f9cf63e1538 => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:21.753603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:21.754280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:21.754745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:21.755675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:21.756139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:21.757634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:21.760411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:21.762087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:21.770509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:21.771004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:21.771446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:21.772158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:21.772707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:21.773170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.027330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:22.036188 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4ff79cb-df48-4fc7-91c7-31691a5488eb tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1467 microversion: 2.1 time: 0.282896 Nov 03 03:53:22.037516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dbfaf658-e67f-449e-84f8-3b61d026d90a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1645 microversion: 2.1 time: 0.304251 Nov 03 03:53:22.038410 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 358/653] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:21 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1645 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:22.050409 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 296/654] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:21 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1467 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:22.061884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43df1690-fcc5-44b0-a5a4-6f6fba42caaa tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f97661f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:22.063114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:22.063752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:22.070968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.071469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.071911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.072624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.073124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.073556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.111258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-43df1690-fcc5-44b0-a5a4-6f6fba42caaa tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 03:53:22.111876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.security_group_api [None req-43df1690-fcc5-44b0-a5a4-6f6fba42caaa tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Neutron security group 925e0ee7-3af3-4401-b4f1-da5836df0274 not found {{(pid=127593) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 03:53:22.114365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-43df1690-fcc5-44b0-a5a4-6f6fba42caaa tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] HTTP exception thrown: Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist Nov 03 03:53:22.114365 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-8c4f1862-57e0-46db-8989-cf7656e05918'] Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43df1690-fcc5-44b0-a5a4-6f6fba42caaa tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Request method failure captured: Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-security-groups/925e0ee7-3af3-4401-b4f1-da5836df0274 HTTP/1.1 Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsikCUpSlSAXeUBQt3o1-Qp9j3TEEwmWwxCOt-ULz3TD0gRzrEK5LUwelAHoqbBeWfrthevDdYTY2_nDHz2o9l6mZL1qiqFW2XjXhaLkyN7O4uGRMNn0bzuH0Hg0n3Wy5PXCLe7D9OtUeK6vz3vmj6anxVRQiP2SMuRrFusqLNtctk Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 7cf0739c99664b1ba8186a2df3278eff Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1316850598 Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:53:22.127838 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cf0739c99664b1ba8186a2df3278eff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cf0739c99664b1ba8186a2df3278eff", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cf0739c99664b1ba8186a2df3278eff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cf0739c99664b1ba8186a2df3278eff"}]}] Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1316850598 Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 7cf0739c99664b1ba8186a2df3278eff Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1316850598 Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesTestJSON-1316850598-project Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 4db15482dec24f13b269deb62f0892b4 Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1316850598-project Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-8c4f1862-57e0-46db-8989-cf7656e05918'] Nov 03 03:53:22.130089 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '925e0ee7-3af3-4401-b4f1-da5836df0274'} Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:53:22.131050 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4f1862-57e0-46db-8989-cf7656e05918'] Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 03:53:22.132472 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4f1862-57e0-46db-8989-cf7656e05918'] Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4f1862-57e0-46db-8989-cf7656e05918'] Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.133776 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c4f1862-57e0-46db-8989-cf7656e05918'] Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43df1690-fcc5-44b0-a5a4-6f6fba42caaa tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Returning 404 to user: Security group 925e0ee7-3af3-4401-b4f1-da5836df0274 does not exist Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-8c4f1862-57e0-46db-8989-cf7656e05918'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:22.135631 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43df1690-fcc5-44b0-a5a4-6f6fba42caaa tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/925e0ee7-3af3-4401-b4f1-da5836df0274" status: 404 len: 194 microversion: 2.1 time: 0.091017 Nov 03 03:53:22.136891 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 359/655] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:22 2022] DELETE /compute/v2.1/os-security-groups/925e0ee7-3af3-4401-b4f1-da5836df0274 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:22.144717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:22.145444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:22.153431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.154783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.155420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.156325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.157279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.157911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.326121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:22.337557 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f0d53ee-de4e-427c-8154-9f20b1e53969 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.285801 Nov 03 03:53:22.338171 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 297/656] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:22 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:22.414081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:22.434599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c986a80-33c0-41e9-99ec-367abbe4b39a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1321 microversion: 2.1 time: 0.293805 Nov 03 03:53:22.435573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 360/657] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:22 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:22.440132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:22.443898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.444631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.445260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.446155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.446795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.447370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.474875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ca3b1cd-8fc1-4bfd-87d0-a6218a6f3e2f tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038147 Nov 03 03:53:22.482794 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 361/658] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:53:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:22.488888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3738c387-b77b-4421-af4a-6b8a69b0230e tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f98f93a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:22.509732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1824866629", "block_migration": true, "disk_over_commit": false}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:22.512305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:22.518966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.519725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.520337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.521298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.521935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.522511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.554541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lazy-loading 'flavor' on Instance uuid 9d37b662-d2df-4e08-9286-7985bf484951 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:53:22.567717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Going to try to live migrate instance to tempest-host-1824866629 {{(pid=127594) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:53:22.575248 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] HTTP exception thrown: Compute host tempest-host-1824866629 could not be found. Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Request method failure captured: Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951/action HTTP/1.1 Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 107 Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzsSkRdPfi8W1e9BwEiqBh2dN_nZWUdmZ1VjBy6Ps6yiBaxk1_wdjuvJGxRtJT0bpg86PWPn1xLhjC1SH2ul0yahT2vDP4YQCB1KNGpM4aiAoMr9TZ53X9zzXZCFNfP2gygUMfHPzPScHkKlBYiNsqq7wbsAu_og9qoJASY96VzSAXA Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 18d0005cea504bb0980fd7d26ecb683e Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveMigrationNegativeTest-1675715281 Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:53:22.598701 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/18d0005cea504bb0980fd7d26ecb683e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_18d0005cea504bb0980fd7d26ecb683e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/18d0005cea504bb0980fd7d26ecb683e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/18d0005cea504bb0980fd7d26ecb683e"}]}] Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveMigrationNegativeTest-1675715281 Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 18d0005cea504bb0980fd7d26ecb683e Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1675715281 Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveMigrationNegativeTest-1675715281-project-admin Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: af17b260aaf24c0599b633aae48669d2 Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveMigrationNegativeTest-1675715281-project-admin Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: {"os-migrateLive": {"host": "tempest-host-1824866629", "block_migration": true, "disk_over_commit": false}} Nov 03 03:53:22.600352 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: exception: Compute host tempest-host-1824866629 could not be found. Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '9d37b662-d2df-4e08-9286-7985bf484951', 'body': {'os-migrateLive': {'host': 'tempest-host-1824866629', 'block_migration': True, 'disk_over_commit': False}}} Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 03:53:22.601310 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1824866629 could not be found. Nov 03 03:53:22.602677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1824866629 could not be found. Nov 03 03:53:22.603987 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1824866629 could not be found. Nov 03 03:53:22.605548 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:22.607855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Returning 400 to user: Compute host tempest-host-1824866629 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:22.610184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-88e23a5a-b64b-4ede-b69b-16cbbb582613 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951/action" status: 400 len: 100 microversion: 2.1 time: 0.270769 Nov 03 03:53:22.614971 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 298/659] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Nov 3 03:53:22 2022] POST /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951/action => generated 100 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:53:22.618594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-940596de-dbb7-44c1-94be-b9e928708da6 req-37324e20-2f0e-4f49-8b2d-122ea10f953e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ed1e03-ada4-4c50-83f4-90801903c28b", "tag": "09035df0-e0e5-447c-88fa-26d50d1c7fbb"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:22.629277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-940596de-dbb7-44c1-94be-b9e928708da6 req-37324e20-2f0e-4f49-8b2d-122ea10f953e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.629755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-940596de-dbb7-44c1-94be-b9e928708da6 req-37324e20-2f0e-4f49-8b2d-122ea10f953e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.630252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-940596de-dbb7-44c1-94be-b9e928708da6 req-37324e20-2f0e-4f49-8b2d-122ea10f953e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.644893 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-940596de-dbb7-44c1-94be-b9e928708da6 req-37324e20-2f0e-4f49-8b2d-122ea10f953e service nova] Creating event network-changed:09035df0-e0e5-447c-88fa-26d50d1c7fbb for instance 07ed1e03-ada4-4c50-83f4-90801903c28b on n-h1-854653-7 Nov 03 03:53:22.647546 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-940596de-dbb7-44c1-94be-b9e928708da6 req-37324e20-2f0e-4f49-8b2d-122ea10f953e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035205 Nov 03 03:53:22.648779 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 299/660] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:22.654216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:22.654834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:22.663423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.664151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.664677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.665667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.666207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.666640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.870194 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec0a7ebb-c324-42ad-bea1-c10ec9fdf64a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf/action" status: 202 len: 0 microversion: 2.1 time: 0.219944 Nov 03 03:53:22.871333 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 300/661] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:53:22 2022] POST /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:22.876704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:22.877538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:22.885752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.886263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.886774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.887584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:22.888150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:22.888544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:22.996432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3738c387-b77b-4421-af4a-6b8a69b0230e tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e0673182-a06a-4b2a-aa3a-c272e66866e7" status: 202 len: 0 microversion: 2.1 time: 0.504967 Nov 03 03:53:22.998292 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 362/662] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:22 2022] DELETE /compute/v2.1/os-security-groups/e0673182-a06a-4b2a-aa3a-c272e66866e7 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:23.003572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:23.005226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:23.020910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:23.021589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:23.022285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:23.023115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:23.023683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:23.033731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:23.185474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:23.195219 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc940036-bb59-45bb-8eda-cc3421b671d5 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1467 microversion: 2.1 time: 0.322726 Nov 03 03:53:23.195796 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 301/663] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:22 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1467 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:23.200169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:23.200786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:23.207327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:23.207831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:23.208262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:23.208970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:23.209464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:23.209894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:23.241703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:23.250208 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64666c67-fa80-4ae5-b95e-299f5024bce2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.250607 Nov 03 03:53:23.250773 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 363/664] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:22 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:23.257163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5a8a4dba-72c3-4c3a-9a3c-f757b43d2f6d tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f9999a60>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:23.441795 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dfb8169e-cf76-4849-a89e-12aba9eb5cc7 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1650 microversion: 2.1 time: 0.244898 Nov 03 03:53:23.447927 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 302/665] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:23 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1650 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:23.463092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-783618565", "imageRef": "46e42410-d827-48ca-a457-59b9977a80d5", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b6c2cbd2-4723-4430-97fa-9869874e5b48"}], "security_groups": [{"name": "tempest-securitygroup--1013450554"}], "key_name": "tempest-keypair-1518352839", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:23.574463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] validate_networks() for [('b6c2cbd2-4723-4430-97fa-9869874e5b48', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:53:23.661171 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5a8a4dba-72c3-4c3a-9a3c-f757b43d2f6d tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/9deffefe-9fd9-403e-9fb6-eecc71ee3362" status: 202 len: 0 microversion: 2.1 time: 0.408381 Nov 03 03:53:23.664272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 364/666] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:23 2022] DELETE /compute/v2.1/os-security-groups/9deffefe-9fd9-403e-9fb6-eecc71ee3362 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:23.669850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1343090924", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:23.747377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:53:24.101463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:53:24.102064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:53:24.102339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:53:24.102743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:53:24.103148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:53:24.113224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.114050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.114490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.115406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.115868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.116299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.120033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:53:24.120830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:53:24.121750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:53:24.122455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:53:24.123119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:53:24.129149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:24.133720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.134200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.134815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.135416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Getting quotas for project a5523210923a49b89034225825178521. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:24.135809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.136452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.136997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.141902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Getting quotas for user d9d3efcb99604673aac5857ce3f98e51 and project a5523210923a49b89034225825178521. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:24.155505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Getting quotas for project 11ae4739f59d4d14bad947b274c240ee. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:24.155905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:53:24.158445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:53:24.161086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Getting quotas for user 0fd22f5b843d4d82851147c1f2a89342 and project 11ae4739f59d4d14bad947b274c240ee. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:24.173859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:53:24.176358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='46e42410-d827-48ca-a457-59b9977a80d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:53:24.270841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccce8078-8f11-41f5-97d2-ade73b395981 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605101 Nov 03 03:53:24.271568 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0df8dea7-5913-44b7-a5b8-f6528a930182 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818390 Nov 03 03:53:24.272051 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 365/667] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:53:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:53:24.272998 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 303/668] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:53:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:53:24.277350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:24.278272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:24.286066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.286618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.287059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.287828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.288289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.288811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.289472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:24.290275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:24.299401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.301046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.302178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.303608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.304559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.305212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.309454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:24.503596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:24.514323 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6c04807-da62-4aec-b03b-dc79e6c2c6bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.240834 Nov 03 03:53:24.515117 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 366/669] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:24 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:24.520761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17a75db8-89f8-4b37-a723-e59cc8a735cc tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f98ff0d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:24.530142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:24.538664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fbdd1868-cd1d-4513-882d-9aa66bc7e242 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1321 microversion: 2.1 time: 0.264423 Nov 03 03:53:24.539936 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 304/670] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:24 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:24.556208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9ed2e6ae-f964-4459-a5be-e36c9ebab6cf req-1aaae663-07f8-4d02-8ba1-e90772606e8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f9a4af-f9ed-4f4b-9bca-dd78047a73b6", "tag": "a1012c07-a912-4c33-84aa-608dd2cc4371"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:24.561254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:24.567031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9ed2e6ae-f964-4459-a5be-e36c9ebab6cf req-1aaae663-07f8-4d02-8ba1-e90772606e8f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.567515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9ed2e6ae-f964-4459-a5be-e36c9ebab6cf req-1aaae663-07f8-4d02-8ba1-e90772606e8f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.567949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9ed2e6ae-f964-4459-a5be-e36c9ebab6cf req-1aaae663-07f8-4d02-8ba1-e90772606e8f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.578979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9ed2e6ae-f964-4459-a5be-e36c9ebab6cf req-1aaae663-07f8-4d02-8ba1-e90772606e8f service nova] Creating event network-changed:a1012c07-a912-4c33-84aa-608dd2cc4371 for instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 on n-h2-854653-7 Nov 03 03:53:24.584324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9ed2e6ae-f964-4459-a5be-e36c9ebab6cf req-1aaae663-07f8-4d02-8ba1-e90772606e8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042980 Nov 03 03:53:24.584937 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 305/671] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:24.590336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:24.591052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:24.597625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.598119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.598566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.602062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.602062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.602062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.781884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:24.790206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75333750-cd6a-48ed-b6a1-3072ae69069f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.204101 Nov 03 03:53:24.791014 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 306/672] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:24 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:24.796957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc19e1cc-6534-4b82-97b9-c18e07b65a8b tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:24.797877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc19e1cc-6534-4b82-97b9-c18e07b65a8b tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:24.850260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc19e1cc-6534-4b82-97b9-c18e07b65a8b tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:24.857206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc19e1cc-6534-4b82-97b9-c18e07b65a8b tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1245 microversion: 2.1 time: 0.065020 Nov 03 03:53:24.857796 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 307/673] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:24 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:24.862938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea651388-08cb-4778-bd0d-c0796e5ae27d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:24.863722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ea651388-08cb-4778-bd0d-c0796e5ae27d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:24.871111 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-17a75db8-89f8-4b37-a723-e59cc8a735cc tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/1f6c130d-7515-463d-bc4f-745837a8dd2f" status: 202 len: 0 microversion: 2.1 time: 0.354447 Nov 03 03:53:24.871862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 367/674] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:24 2022] DELETE /compute/v2.1/os-security-groups/1f6c130d-7515-463d-bc4f-745837a8dd2f => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:24.876649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:24.877298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:24.884983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.885733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.886231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.888221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:24.889569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:24.890285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:24.954986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ea651388-08cb-4778-bd0d-c0796e5ae27d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:24.963873 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ea651388-08cb-4778-bd0d-c0796e5ae27d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1219 microversion: 2.1 time: 0.105066 Nov 03 03:53:24.964609 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 308/675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:24 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:24.969460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f5a1c98c-be32-4d83-89a4-8cf1e1183219 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f96de820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:25.091461 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccd5a186-2fca-417a-b061-7de47f88677d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1630 microversion: 2.1 time: 0.218394 Nov 03 03:53:25.092034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 368/676] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:24 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1630 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:25.115801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854653-7", "block_migration": true, "disk_over_commit": false}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:25.119445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:25.126478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:25.126963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:25.127405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:25.128541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:25.129003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:25.129457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:25.198379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lazy-loading 'flavor' on Instance uuid 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:53:25.249667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Going to try to live migrate instance to n-h2-854653-7 {{(pid=127593) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:53:25.291811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f5a1c98c-be32-4d83-89a4-8cf1e1183219 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/d9c9b8bb-3b36-4220-a674-4c62ea35f0ac" status: 202 len: 0 microversion: 2.1 time: 0.325907 Nov 03 03:53:25.292394 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 309/677] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:24 2022] DELETE /compute/v2.1/os-security-groups/d9c9b8bb-3b36-4220-a674-4c62ea35f0ac => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:25.300494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-57276bcc-0b79-45ba-8fdb-48275914cf41 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] Calling method '.version_select at 0x7ff7f94cb700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:25.568286 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-57276bcc-0b79-45ba-8fdb-48275914cf41 tempest-SecurityGroupRulesTestJSON-1316850598 tempest-SecurityGroupRulesTestJSON-1316850598-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/ab1361e9-be1a-434f-80ae-faff7f10e33f" status: 202 len: 0 microversion: 2.1 time: 0.271773 Nov 03 03:53:25.568865 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 310/678] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:53:25 2022] DELETE /compute/v2.1/os-security-groups/ab1361e9-be1a-434f-80ae-faff7f10e33f => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:53:25.576629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:25.577970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:25.586838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:25.591696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:25.591696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:25.591696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:25.591696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:25.592115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:25.735563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:25.742584 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78a42a27-4b23-44c2-a756-13743d8b9119 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.172451 Nov 03 03:53:25.758031 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 311/679] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:25 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:25.764223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:25.767351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:25.775955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:25.776592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:25.777200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:25.778046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:25.778599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:25.779203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.043690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:26.052497 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-613842cc-9bfc-4627-81e6-7585fc9fff31 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1321 microversion: 2.1 time: 0.293005 Nov 03 03:53:26.053622 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 312/680] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:25 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:26.058848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:26.059510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:26.065216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.066258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.066814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.072995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.074983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.076510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.537354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:26.552388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-646ceff3-dc4d-49eb-b015-b4b84bdac2fb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.496171 Nov 03 03:53:26.553623 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 313/681] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:26 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:26.559983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:26.560778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:26.567626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.568906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.570313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.571907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.572693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.573465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.661327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:26.669557 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-43058b05-b9a9-401b-9f88-75e7124ca3da tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1249 microversion: 2.1 time: 0.114028 Nov 03 03:53:26.682236 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 314/682] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:26 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1249 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:26.693865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:26.695029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:26.703921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.704479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.705044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.721266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.721266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.721266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.796611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:26.804424 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-919c796b-fe1f-4248-9745-7c66d22bed3a tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1215 microversion: 2.1 time: 0.120826 Nov 03 03:53:26.817149 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 315/683] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:26 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:26.817149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:26.817149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:26.817149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.817540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.818207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.818385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:26.818804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:26.819234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:26.976587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:26.985091 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4eb27cc4-3e1c-4ed0-9df3-c3143529a3db tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.178393 Nov 03 03:53:26.986279 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 316/684] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:26 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:27.077512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:27.078402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:27.087574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.087934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.088376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:27.089114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.089568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.091006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:27.264320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:27.275851 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e372e8f7-52ce-491f-ad1e-5247ae3c8731 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1321 microversion: 2.1 time: 0.203216 Nov 03 03:53:27.276851 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 317/685] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:27 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:27.576222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:27.576953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:27.587819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.588613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.590349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:27.591576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.593580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.594257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:27.827393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:27.836519 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c6fdf3a9-fc6c-4e52-abd2-88d2874e2be7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1477 microversion: 2.1 time: 0.264202 Nov 03 03:53:27.840633 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 318/686] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:27 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1477 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:27.852311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:27.853109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:27.860835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.861735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.862892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:27.863847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.864314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.864884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:27.948934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:27.960123 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b5f5993-82e4-4635-9516-bdaa6075797e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1241 microversion: 2.1 time: 0.116481 Nov 03 03:53:27.961142 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 319/687] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:27 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:27.967389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:27.967901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:27.975162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.975656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.976132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:27.976808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:27.977354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:27.977999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:28.012634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:53:28.412244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e97f102e-3a9c-45e8-ad58-f4ca9d4fc822 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 204 len: 0 microversion: 2.1 time: 0.448509 Nov 03 03:53:28.413362 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 320/688] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:53:27 2022] DELETE /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:53:28.421143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:28.422182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:28.436885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:28.440101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:28.440101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:28.441911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:28.442538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:28.445336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:28.591028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:28.598534 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41b26eda-0691-4fda-941b-aad8b42d8d0d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1279 microversion: 2.1 time: 0.183619 Nov 03 03:53:28.599110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 321/689] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:28 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1279 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:28.613963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:28.614849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:28.630895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:28.631395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:28.631837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:28.632553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:28.633044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:28.633463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:28.969955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:28.979406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73887534-9b33-45f7-8e35-36bb761078fd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.377257 Nov 03 03:53:28.986834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 322/690] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:28 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:28.994568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:28.995429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:29.003504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:29.004427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:29.005504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:29.006650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:29.008121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:29.008570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:29.281192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:29.284560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:29.291342 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-130d6646-cba9-49ef-a9ee-830876f5c244 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1321 microversion: 2.1 time: 0.302760 Nov 03 03:53:29.306693 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 323/691] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:28 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:29.318948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:29.318948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:29.327479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:29.329557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:29.329557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:29.329557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:29.330330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:29.330689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:29.632330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:29.641518 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e54b574a-49ec-4517-98ec-242968b8c7a8 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1710 microversion: 2.1 time: 0.333390 Nov 03 03:53:29.642118 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 324/692] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:29 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1710 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:29.647780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:29.648404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:29.654319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:29.654808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:29.655295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:29.662417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:29.666555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:29.666555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:29.942880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5cc68173-0831-4f3f-84a7-0b922c4d29bb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf/action" status: 202 len: 0 microversion: 2.1 time: 4.831560 Nov 03 03:53:29.943587 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 369/693] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:53:25 2022] POST /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf/action => generated 0 bytes in 4833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:53:29.953082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-49561939-5c1c-44df-bcfd-ba5daa801605 req-3bb75de7-66cc-43df-950c-9d6f9997bdb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f9a4af-f9ed-4f4b-9bca-dd78047a73b6", "name": "network-vif-plugged", "status": "completed", "tag": "a1012c07-a912-4c33-84aa-608dd2cc4371"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:29.981771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49561939-5c1c-44df-bcfd-ba5daa801605 req-3bb75de7-66cc-43df-950c-9d6f9997bdb3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:29.982599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49561939-5c1c-44df-bcfd-ba5daa801605 req-3bb75de7-66cc-43df-950c-9d6f9997bdb3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:29.983240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49561939-5c1c-44df-bcfd-ba5daa801605 req-3bb75de7-66cc-43df-950c-9d6f9997bdb3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.020240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:30.032786 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-49561939-5c1c-44df-bcfd-ba5daa801605 req-3bb75de7-66cc-43df-950c-9d6f9997bdb3 service nova] Creating event network-vif-plugged:a1012c07-a912-4c33-84aa-608dd2cc4371 for instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 on n-h2-854653-7 Nov 03 03:53:30.033195 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7da27e6b-8947-49be-9546-4bfb18447c2c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1476 microversion: 2.1 time: 0.388873 Nov 03 03:53:30.033788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 325/694] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:29 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1476 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:30.044430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:30.052319 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-49561939-5c1c-44df-bcfd-ba5daa801605 req-3bb75de7-66cc-43df-950c-9d6f9997bdb3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103472 Nov 03 03:53:30.052537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:30.057342 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 370/695] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:30.076573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3bb2446d-d920-4dd3-958d-edef9c80dbfd req-8f639093-0665-4e08-8ecd-9e40085e534f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb3fa88-5c7b-4b15-ac0b-347c3353070f", "name": "network-vif-unplugged", "status": "completed", "tag": "6e412a17-821b-446c-a74e-78bc6a61268d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:30.080657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.088123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.090295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.093059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.093543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.097102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.112702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3bb2446d-d920-4dd3-958d-edef9c80dbfd req-8f639093-0665-4e08-8ecd-9e40085e534f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.121909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3bb2446d-d920-4dd3-958d-edef9c80dbfd req-8f639093-0665-4e08-8ecd-9e40085e534f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.122328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3bb2446d-d920-4dd3-958d-edef9c80dbfd req-8f639093-0665-4e08-8ecd-9e40085e534f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.156691 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3bb2446d-d920-4dd3-958d-edef9c80dbfd req-8f639093-0665-4e08-8ecd-9e40085e534f service nova] Creating event network-vif-unplugged:6e412a17-821b-446c-a74e-78bc6a61268d for instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f on n-h1-854653-7 Nov 03 03:53:30.179499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-3bb2446d-d920-4dd3-958d-edef9c80dbfd req-8f639093-0665-4e08-8ecd-9e40085e534f service nova] Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:53:30.206778 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3bb2446d-d920-4dd3-958d-edef9c80dbfd req-8f639093-0665-4e08-8ecd-9e40085e534f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148194 Nov 03 03:53:30.207400 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 371/696] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:30.220715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:30.222420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:30.238535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.239501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.240109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.241841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.244510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.247351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.499263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:30.507383 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e649f358-7323-4757-ab74-9ff16078bf40 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1297 microversion: 2.1 time: 0.471693 Nov 03 03:53:30.524731 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 326/697] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:30 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1297 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:30.531187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:30.532194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:30.541165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.541873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.542508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.543475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.544183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.544800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.582082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:30.593226 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b15e0a6b-0430-4763-8db7-0ae1df841b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1289 microversion: 2.1 time: 0.384401 Nov 03 03:53:30.597366 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 372/698] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:30 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1289 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:30.605681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:30.607390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:30.618737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.619740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.620587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.622307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:30.623764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:30.625081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:30.968984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:30.977241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1fc1fe58-4f67-4cec-8fd5-317c4f9b78e3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.451073 Nov 03 03:53:31.000213 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 327/699] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:30 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:31.000213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:31.000213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:31.006230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.007065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.007715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:31.008792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.009536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.010189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:31.035259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:31.049051 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf066bbb-c5bd-4bd0-a00d-936c00ca1aa8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.449563 Nov 03 03:53:31.050503 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 373/700] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:30 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:31.056327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:31.057297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:31.069246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.069996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.070444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:31.071231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.071728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.073611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:31.555376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:31.569579 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4fbdaaca-fd79-43a3-9bf1-22f4e1c091a6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1321 microversion: 2.1 time: 0.574512 Nov 03 03:53:31.570946 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 328/701] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:30 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1321 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:31.583295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:31.584869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:31.596946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.601049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.601049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:31.601049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.601329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.601810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:31.944053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:31.957906 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41631a41-433a-4a97-8a63-de17a1f1026a tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1710 microversion: 2.1 time: 0.905948 Nov 03 03:53:31.958806 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 374/702] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:31 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1710 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:31.968860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:31.969592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:31.981729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.982503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.983164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:31.984159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:31.985124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:31.985772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:32.279247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:32.301510 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-397722a8-7663-4784-8cb5-8b12b4bca1d5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1315 microversion: 2.1 time: 0.341374 Nov 03 03:53:32.306958 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 375/703] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:31 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:32.333100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:32.334311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:32.341468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:32.342347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:32.343319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:32.344275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:32.344978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:32.345649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:32.409927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:32.418523 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c43c328e-a4cf-48a3-889b-8da86096303e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1476 microversion: 2.1 time: 0.846278 Nov 03 03:53:32.419107 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 329/704] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:31 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1476 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:32.436405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:32.436405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:32.454909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:32.455420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:32.456435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:32.457386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:32.458176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:32.458765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.005346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:33.022336 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10dd04c7-7950-4b89-a2a3-29bc2721127b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 0.709149 Nov 03 03:53:33.022336 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 376/705] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:32 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:33.037561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-731cae50-b65c-41bc-ae5d-c02df18167ae req-97f409e4-06da-47d0-a46c-fc5facf1e134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9a0477-ea48-4f40-9445-76db8506018d", "name": "network-vif-deleted", "tag": "6337b891-a979-4469-b430-a1977ed3002a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:33.075713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-731cae50-b65c-41bc-ae5d-c02df18167ae req-97f409e4-06da-47d0-a46c-fc5facf1e134 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.079834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-731cae50-b65c-41bc-ae5d-c02df18167ae req-97f409e4-06da-47d0-a46c-fc5facf1e134 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.081875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-731cae50-b65c-41bc-ae5d-c02df18167ae req-97f409e4-06da-47d0-a46c-fc5facf1e134 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.104052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:33.128125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:33.134489 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-31b5962b-f30b-45b9-9c11-db8e3f976667 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.712748 Nov 03 03:53:33.140901 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 330/706] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:32 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:33.153403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:33.160295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:33.162005 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-731cae50-b65c-41bc-ae5d-c02df18167ae req-97f409e4-06da-47d0-a46c-fc5facf1e134 service nova] Creating event network-vif-deleted:6337b891-a979-4469-b430-a1977ed3002a for instance 0c9a0477-ea48-4f40-9445-76db8506018d on n-h2-854653-7 Nov 03 03:53:33.177562 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-731cae50-b65c-41bc-ae5d-c02df18167ae req-97f409e4-06da-47d0-a46c-fc5facf1e134 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153163 Nov 03 03:53:33.180727 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 377/707] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:33.193267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.193960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.194418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.195305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.195762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.196191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.199228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-39b29fac-4f94-4dda-ade9-5dc96624bee0 req-4f6d3f42-2e10-48ac-8377-cdaa741932e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed1e03-ada4-4c50-83f4-90801903c28b", "name": "network-vif-plugged", "status": "completed", "tag": "09035df0-e0e5-447c-88fa-26d50d1c7fbb"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:33.226632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-39b29fac-4f94-4dda-ade9-5dc96624bee0 req-4f6d3f42-2e10-48ac-8377-cdaa741932e1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.232706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-39b29fac-4f94-4dda-ade9-5dc96624bee0 req-4f6d3f42-2e10-48ac-8377-cdaa741932e1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.232706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-39b29fac-4f94-4dda-ade9-5dc96624bee0 req-4f6d3f42-2e10-48ac-8377-cdaa741932e1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.290303 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-39b29fac-4f94-4dda-ade9-5dc96624bee0 req-4f6d3f42-2e10-48ac-8377-cdaa741932e1 service nova] Creating event network-vif-plugged:09035df0-e0e5-447c-88fa-26d50d1c7fbb for instance 07ed1e03-ada4-4c50-83f4-90801903c28b on n-h1-854653-7 Nov 03 03:53:33.302702 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-39b29fac-4f94-4dda-ade9-5dc96624bee0 req-4f6d3f42-2e10-48ac-8377-cdaa741932e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120228 Nov 03 03:53:33.311784 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 378/708] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:33.320138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b1dbedcf-e522-4a96-bd96-8844bcde415c req-67e11c70-c901-418e-ad48-e3c662f656bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb3fa88-5c7b-4b15-ac0b-347c3353070f", "tag": "6e412a17-821b-446c-a74e-78bc6a61268d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:33.352310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b1dbedcf-e522-4a96-bd96-8844bcde415c req-67e11c70-c901-418e-ad48-e3c662f656bf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.353006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b1dbedcf-e522-4a96-bd96-8844bcde415c req-67e11c70-c901-418e-ad48-e3c662f656bf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.353636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b1dbedcf-e522-4a96-bd96-8844bcde415c req-67e11c70-c901-418e-ad48-e3c662f656bf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.382445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b1dbedcf-e522-4a96-bd96-8844bcde415c req-67e11c70-c901-418e-ad48-e3c662f656bf service nova] Creating event network-changed:6e412a17-821b-446c-a74e-78bc6a61268d for instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f on n-h1-854653-7 Nov 03 03:53:33.391430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-b1dbedcf-e522-4a96-bd96-8844bcde415c req-67e11c70-c901-418e-ad48-e3c662f656bf service nova] Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:53:33.412786 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b1dbedcf-e522-4a96-bd96-8844bcde415c req-67e11c70-c901-418e-ad48-e3c662f656bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103252 Nov 03 03:53:33.414426 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 379/709] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:33.421678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:33.422759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:33.431314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.432448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.433183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.435904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.436588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.438774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.756093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:33.771887 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e672a609-95d5-4278-a379-efba8aa563d8 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.629335 Nov 03 03:53:33.772480 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 331/710] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:33 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:33.777007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:33.777992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:33.795258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.796170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.796787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.797714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.798394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.799041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.855785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:33.856969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:33.856969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:33.857238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lazy-loading 'fault' on Instance uuid 0c9a0477-ea48-4f40-9445-76db8506018d {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:53:34.064697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53f1a53065b47ddbea35b4008884c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c9981944fe4698a48bf702c1e3ac11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:34.094991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:34.101712 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ed10400-6b67-4166-8172-126b7d8ef6a0 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 200 len: 1353 microversion: 2.1 time: 0.328098 Nov 03 03:53:34.107306 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43b69b11-fa6a-41a1-aee3-f8c322cf3f39 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1470 microversion: 2.1 time: 0.691099 Nov 03 03:53:34.109697 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 332/711] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:33 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 1353 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:34.120240 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 380/712] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:33 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1470 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:34.136303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:34.138457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:34.141032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:34.141920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:34.149882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:34.151653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.152341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.152948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.156421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.157160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.157759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.158027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:34.160251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:34.160677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.169330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.169905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.170668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.171146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.171567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.367318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:34.382175 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f912f99-6a4f-48b0-882a-d9e152b1e870 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1303 microversion: 2.1 time: 0.267433 Nov 03 03:53:34.384597 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 333/713] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:34 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1303 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:34.398015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:34.400220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:34.417001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.418453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.420216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.422266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.423040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.426090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.722649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:34.732366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-25beffb0-b0ae-41ce-88ed-42c5ac498b52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1474 microversion: 2.1 time: 0.610415 Nov 03 03:53:34.738299 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 381/714] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:34 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1474 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:34.789038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:34.798482 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80925f99-5904-4a37-abd2-1db62c4b5380 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 0.412565 Nov 03 03:53:34.804828 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 334/715] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:34 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:34.826322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:34.827164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:34.841464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.852663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.853290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.855017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:34.856477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:34.857058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:34.960565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=26 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:35.256937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e11954d3-66b1-4829-8aec-d90cd776a3d3 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:35.257562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e11954d3-66b1-4829-8aec-d90cd776a3d3 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] [instance: 73eca501-7a75-4df5-9cd9-c644e880c1fc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-e11954d3-66b1-4829-8aec-d90cd776a3d3 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] HTTP exception thrown: Instance 73eca501-7a75-4df5-9cd9-c644e880c1fc could not be found. Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e11954d3-66b1-4829-8aec-d90cd776a3d3 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Request method failure captured: Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/73eca501-7a75-4df5-9cd9-c644e880c1fc/action HTTP/1.1 Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 15 Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsrPpTpvtT0ouscU3nyC-_hwQ21QRXVpcdOXxXUnFNMUHlPegQ82c13lpsGeifIsXAtcWAdOMJZINjDQ8H5AvFpEe-HEwbHKW_QiCLLrRGoDUuDhcBuDocstl6suQZPR9IT5P7kyTSjFOzsX8YszIeJy_T4fgLFk5fhl9N6k656EJU Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:53:35.273988 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_177180df8d38453190155d17c8b1c216", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/177180df8d38453190155d17c8b1c216"}]}] Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0581529e855d4362967f5ae3fdcb9001 Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: {"migrate": {}} Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:53:35.275697 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 73eca501-7a75-4df5-9cd9-c644e880c1fc could not be found. Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '73eca501-7a75-4df5-9cd9-c644e880c1fc', 'body': {'migrate': {}}} Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73eca501-7a75-4df5-9cd9-c644e880c1fc could not be found. Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:35.276697 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73eca501-7a75-4df5-9cd9-c644e880c1fc could not be found. Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73eca501-7a75-4df5-9cd9-c644e880c1fc could not be found. Nov 03 03:53:35.278715 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.280791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e11954d3-66b1-4829-8aec-d90cd776a3d3 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Returning 404 to user: Instance 73eca501-7a75-4df5-9cd9-c644e880c1fc could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:35.288626 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e11954d3-66b1-4829-8aec-d90cd776a3d3 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/73eca501-7a75-4df5-9cd9-c644e880c1fc/action" status: 404 len: 111 microversion: 2.1 time: 0.548867 Nov 03 03:53:35.292847 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 382/716] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:53:34 2022] POST /compute/v2.1/servers/73eca501-7a75-4df5-9cd9-c644e880c1fc/action => generated 111 bytes in 554 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:35.305981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:35.306842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:35.332287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:35.333470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:35.334146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:35.336180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:35.336894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:35.343167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:35.503994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:35.520324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a6131619-e441-4c64-ae45-fca744ec9362 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.707961 Nov 03 03:53:35.541528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 335/717] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:34 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:35.554388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:35.555336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:35.573903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:35.584388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:35.585264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:35.586257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:35.586959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:35.590775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:35.623614 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] HTTP exception thrown: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Request method failure captured: Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d HTTP/1.1 Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqbJihYdqPKh1RHiMOPSgvG7v-CPGfI93VSWSsLp5sEKYdidxhw5HWRDfBF06SBu3gaiPZnfYqEI4lWVF02Wqrgg2VSbnjOagqv2h6y-0yqibKK2aJFWxqYWRic2JPCpUa1Ks5FZd9njTDxMXiJJv_lDo8bUaVzj9lgPEMPAobItTs Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:53:35.637978 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35c9981944fe4698a48bf702c1e3ac11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35c9981944fe4698a48bf702c1e3ac11"}]}] Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d53f1a53065b47ddbea35b4008884c58 Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:35.639363 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0c9a0477-ea48-4f40-9445-76db8506018d'} Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:35.640115 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:35.641296 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:35.646676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Returning 404 to user: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:35.651796 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fdab43ea-f14a-4f41-81ec-48ba02990a9d tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 404 len: 111 microversion: 2.1 time: 0.112318 Nov 03 03:53:35.654358 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 336/718] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:35 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:35.667621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-330d3d61-ab63-4356-a885-c20c62c10ae2 req-59813b4d-fe73-460b-b71a-154afbdca9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c54136-4fb8-491b-990e-282f64369489", "tag": "6c663de4-1de1-41ef-a17e-743a818165b0"}, {"server_uuid": "3b75530a-26ef-44c1-99d3-5ff30f3ae5cf", "name": "network-vif-unplugged", "status": "completed", "tag": "92280416-ffea-4aae-a135-b4d7c67670b1"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:35.691153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-330d3d61-ab63-4356-a885-c20c62c10ae2 req-59813b4d-fe73-460b-b71a-154afbdca9ad service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:35.692754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-330d3d61-ab63-4356-a885-c20c62c10ae2 req-59813b4d-fe73-460b-b71a-154afbdca9ad service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:35.693352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-330d3d61-ab63-4356-a885-c20c62c10ae2 req-59813b4d-fe73-460b-b71a-154afbdca9ad service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:35.736195 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-330d3d61-ab63-4356-a885-c20c62c10ae2 req-59813b4d-fe73-460b-b71a-154afbdca9ad service nova] Creating event network-changed:6c663de4-1de1-41ef-a17e-743a818165b0 for instance f0c54136-4fb8-491b-990e-282f64369489 on n-h2-854653-7 Nov 03 03:53:35.738701 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-330d3d61-ab63-4356-a885-c20c62c10ae2 req-59813b4d-fe73-460b-b71a-154afbdca9ad service nova] Creating event network-vif-unplugged:92280416-ffea-4aae-a135-b4d7c67670b1 for instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf on n-h1-854653-7 Nov 03 03:53:35.753834 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-330d3d61-ab63-4356-a885-c20c62c10ae2 req-59813b4d-fe73-460b-b71a-154afbdca9ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.099167 Nov 03 03:53:35.764615 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 337/719] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:35.786930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:35.788401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:35.809847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:35.811087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:35.811771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:35.814649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:35.817063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:35.817773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:35.881614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:35.899189 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fbb0e5d7-28f0-47d3-9248-0b6a3d3943c0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.603269 Nov 03 03:53:35.901326 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 383/720] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:35 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:35.941883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-5657105", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:36.082512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:53:36.510349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:36.525848 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17763c47-1d4e-4697-a1b7-51cc15054234 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.757609 Nov 03 03:53:36.526430 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 338/721] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:35 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:36.530900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:36.531397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:36.562122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:36.562691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:36.566310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:36.567060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:36.569607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:36.570720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:36.602103 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] HTTP exception thrown: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Request method failure captured: Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c HTTP/1.1 Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqbJihYdqPKh1RHiMOPSgvG7v-CPGfI93VSWSsLp5sEKYdidxhw5HWRDfBF06SBu3gaiPZnfYqEI4lWVF02Wqrgg2VSbnjOagqv2h6y-0yqibKK2aJFWxqYWRic2JPCpUa1Ks5FZd9njTDxMXiJJv_lDo8bUaVzj9lgPEMPAobItTs Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:53:36.604025 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35c9981944fe4698a48bf702c1e3ac11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35c9981944fe4698a48bf702c1e3ac11"}]}] Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d53f1a53065b47ddbea35b4008884c58 Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:36.605694 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'dda48a2a-0f23-488b-8c52-4ba9ef3d808c'} Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:36.606583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:36.607782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:36.610342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Returning 404 to user: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:36.611514 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7cb57468-b891-4327-a8c0-078482a11bda tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 404 len: 111 microversion: 2.1 time: 0.084166 Nov 03 03:53:36.613344 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 339/722] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:53:36 2022] DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:36.619865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:36.621528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:36.628669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:36.629694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:36.630502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:36.631598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:36.633210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:36.633882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:36.892296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:53:36.894303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:53:36.895007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:53:36.895425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:53:36.896014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:53:36.907918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:36.908373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:36.908865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:36.909652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:36.910344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:36.910827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:36.928925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Getting quotas for project 823aa65f33fb44f2b70a9c6c5342cd76. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:36.934810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Getting quotas for user dcb2b44cf2e44553ae1e83b97cabc1b2 and project 823aa65f33fb44f2b70a9c6c5342cd76. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:36.947870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:53:36.950307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:53:37.032041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:37.050004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf9c6ecf-9797-4d5a-a3e9-4a12a0a23c5a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1474 microversion: 2.1 time: 0.433733 Nov 03 03:53:37.057892 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 340/723] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:36 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1474 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:37.067872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:37.068518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:37.075465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.076021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.076527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.077332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.078644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.079229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.139727 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0b5e5d4f-d0a9-4f41-8514-79314783915a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236514 Nov 03 03:53:37.143917 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 384/724] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:53:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:53:37.149152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:37.153884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:37.178592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.179477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.180229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.181466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.182201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.182851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.640935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:37.650561 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d98c503-f31f-4e08-aedc-176bbb08fd9d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 0.590366 Nov 03 03:53:37.652799 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 341/725] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:37 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:37.667961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:37.671717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:37.697404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.698981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.703196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.705081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.707699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.709840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.719022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:37.730945 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74aa7174-93a8-4b26-ad3f-67eb4efa1c01 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.585660 Nov 03 03:53:37.733306 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 385/726] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:37 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:37.753525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:37.754150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:37.769667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.770178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.770293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:37.770767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.771488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.771612 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] HTTP exception thrown: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:37.772542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.772982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Request method failure captured: Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c HTTP/1.1 Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqbJihYdqPKh1RHiMOPSgvG7v-CPGfI93VSWSsLp5sEKYdidxhw5HWRDfBF06SBu3gaiPZnfYqEI4lWVF02Wqrgg2VSbnjOagqv2h6y-0yqibKK2aJFWxqYWRic2JPCpUa1Ks5FZd9njTDxMXiJJv_lDo8bUaVzj9lgPEMPAobItTs Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:53:37.773150 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35c9981944fe4698a48bf702c1e3ac11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35c9981944fe4698a48bf702c1e3ac11"}]}] Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d53f1a53065b47ddbea35b4008884c58 Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:37.774398 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'dda48a2a-0f23-488b-8c52-4ba9ef3d808c'} Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:37.775108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:37.777719 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:37.780932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Returning 404 to user: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:37.780932 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bccd8db4-e88e-4482-a565-4f03cf0cb9ba tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 404 len: 111 microversion: 2.1 time: 0.120216 Nov 03 03:53:37.785889 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 342/727] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:37 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:37.795750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad3738c9-c5c0-44ab-bfa3-c63a61d65b97 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:37.796710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad3738c9-c5c0-44ab-bfa3-c63a61d65b97 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:37.921956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad3738c9-c5c0-44ab-bfa3-c63a61d65b97 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:37.930905 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad3738c9-c5c0-44ab-bfa3-c63a61d65b97 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1219 microversion: 2.1 time: 0.142533 Nov 03 03:53:37.934757 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 343/728] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:37 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:37.946831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:37.948611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:37.970539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.987533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.994018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:37.995119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:37.996048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:37.996648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:38.593398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:38.605537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec860d83-fdf2-412b-9073-c70f9dfef241 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1317 microversion: 2.1 time: 0.869802 Nov 03 03:53:38.606364 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 386/729] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:37 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1317 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:38.624962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccd5c9ed-d664-4f89-b47e-0ee0df50f2d9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '.version_select at 0x7ff7f9c9d160>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:38.730380 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccd5c9ed-d664-4f89-b47e-0ee0df50f2d9 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985294686" status: 202 len: 0 microversion: 2.1 time: 0.122810 Nov 03 03:53:38.730972 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 387/730] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 03:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985294686 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:38.738404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b37c8bae-cb2d-4ebf-b57b-b849e2f7e107 req-7983159e-8663-468e-9d6b-d5687fdbaa99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b75530a-26ef-44c1-99d3-5ff30f3ae5cf", "tag": "92280416-ffea-4aae-a135-b4d7c67670b1"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:38.762125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b37c8bae-cb2d-4ebf-b57b-b849e2f7e107 req-7983159e-8663-468e-9d6b-d5687fdbaa99 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:38.762902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b37c8bae-cb2d-4ebf-b57b-b849e2f7e107 req-7983159e-8663-468e-9d6b-d5687fdbaa99 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:38.763557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b37c8bae-cb2d-4ebf-b57b-b849e2f7e107 req-7983159e-8663-468e-9d6b-d5687fdbaa99 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:38.783910 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b37c8bae-cb2d-4ebf-b57b-b849e2f7e107 req-7983159e-8663-468e-9d6b-d5687fdbaa99 service nova] Creating event network-changed:92280416-ffea-4aae-a135-b4d7c67670b1 for instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf on n-h1-854653-7 Nov 03 03:53:38.794864 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b37c8bae-cb2d-4ebf-b57b-b849e2f7e107 req-7983159e-8663-468e-9d6b-d5687fdbaa99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062643 Nov 03 03:53:38.796068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 388/731] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:38.802040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:38.810328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:38.838239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:38.839095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:38.839794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:38.840758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:38.841460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:38.842101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:38.930434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:38.952597 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08d2f6ac-4b6b-487b-af26-ea8b41001a5c tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 1.014553 Nov 03 03:53:38.957148 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 344/732] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:37 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:38.980670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:38.983467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:39.013125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:39.018134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:39.018926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:39.022051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:39.022728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:39.026523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:39.561505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:39.570508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9dbc5a02-0961-427d-a8c9-81743e0d1f83 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1471 microversion: 2.1 time: 0.772976 Nov 03 03:53:39.571100 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 389/733] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:38 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1471 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:39.600574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:39.600574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:39.614216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:39.614792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:39.615322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:39.616235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:39.616723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:39.617257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:39.940694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:39.953937 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fe25eb83-f25b-4dfb-97a0-8998b98c28fc tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 0.995296 Nov 03 03:53:39.957293 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 345/734] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:38 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:39.971669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:39.974046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:39.990230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:39.990914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:39.991652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:39.992987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:39.994241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:39.995121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.138250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:40.147206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ccd4a4fd-077a-429e-bd1a-1464d648d0e6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1271 microversion: 2.1 time: 0.188221 Nov 03 03:53:40.151646 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 346/735] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:39 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1271 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:40.166006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0bf2b684-dead-4006-9541-640c2cb761bb req-101c1b23-92dd-445b-b771-64a9ef6f78fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088f74bc-3359-48f9-951b-a8ffed40674d", "tag": "c20dba85-cf5f-4b11-b841-d340e90a025a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:40.196612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0bf2b684-dead-4006-9541-640c2cb761bb req-101c1b23-92dd-445b-b771-64a9ef6f78fd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.197319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0bf2b684-dead-4006-9541-640c2cb761bb req-101c1b23-92dd-445b-b771-64a9ef6f78fd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.197948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0bf2b684-dead-4006-9541-640c2cb761bb req-101c1b23-92dd-445b-b771-64a9ef6f78fd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.218444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0bf2b684-dead-4006-9541-640c2cb761bb req-101c1b23-92dd-445b-b771-64a9ef6f78fd service nova] Creating event network-changed:c20dba85-cf5f-4b11-b841-d340e90a025a for instance 088f74bc-3359-48f9-951b-a8ffed40674d on n-h2-854653-7 Nov 03 03:53:40.226185 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0bf2b684-dead-4006-9541-640c2cb761bb req-101c1b23-92dd-445b-b771-64a9ef6f78fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072310 Nov 03 03:53:40.227371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 347/736] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:40.244098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f7a87170-e7c4-40d4-825b-e1c0e5bd1e52 req-f549ac4d-2ccb-40be-b991-f11a52b80ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb3fa88-5c7b-4b15-ac0b-347c3353070f", "name": "network-vif-plugged", "status": "completed", "tag": "6e412a17-821b-446c-a74e-78bc6a61268d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:40.281490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f7a87170-e7c4-40d4-825b-e1c0e5bd1e52 req-f549ac4d-2ccb-40be-b991-f11a52b80ab0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.281988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f7a87170-e7c4-40d4-825b-e1c0e5bd1e52 req-f549ac4d-2ccb-40be-b991-f11a52b80ab0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.282429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f7a87170-e7c4-40d4-825b-e1c0e5bd1e52 req-f549ac4d-2ccb-40be-b991-f11a52b80ab0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.310870 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f7a87170-e7c4-40d4-825b-e1c0e5bd1e52 req-f549ac4d-2ccb-40be-b991-f11a52b80ab0 service nova] Creating event network-vif-plugged:6e412a17-821b-446c-a74e-78bc6a61268d for instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f on n-h1-854653-7 Nov 03 03:53:40.329582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-f7a87170-e7c4-40d4-825b-e1c0e5bd1e52 req-f549ac4d-2ccb-40be-b991-f11a52b80ab0 service nova] Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:53:40.348295 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f7a87170-e7c4-40d4-825b-e1c0e5bd1e52 req-f549ac4d-2ccb-40be-b991-f11a52b80ab0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111669 Nov 03 03:53:40.349178 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 348/737] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:40.359332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:40.359332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:40.370482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.371259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.371935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.372960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.373935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.374699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.700504 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02cc1cdb-cf09-42d4-9a50-a435c1b51eeb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f/action" status: 204 len: 0 microversion: 2.1 time: 0.346235 Nov 03 03:53:40.703029 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 349/738] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:53:40 2022] POST /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f/action => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:53:40.730765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:40.736034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:40.749700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:40.754485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.756773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.757495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.759109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.761403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.763970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.774343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:40.805211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-18999eeb-c57b-4837-b6b8-304a73e94812 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 1.228766 Nov 03 03:53:40.805906 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 390/739] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:39 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:40.818235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:40.842444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:40.849975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.852282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.852282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:40.852803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:40.858718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:40.860712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:41.939537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:41.954439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da394003-ca76-4114-8783-02a25c891cea tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1467 microversion: 2.1 time: 1.249295 Nov 03 03:53:41.955340 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 350/740] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:40 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1467 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:41.961818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:41.963038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:41.972218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:41.973897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:41.974652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:41.975582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:41.976281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:41.976878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:42.167289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:42.176973 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2f023ac-7d7c-41ab-932b-3a062951ad09 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 1.370027 Nov 03 03:53:42.177633 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 391/741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:40 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:42.182295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:42.182912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:42.207518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:42.209695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:42.210676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:42.211448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:42.211932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:42.215786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:43.208659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:43.219715 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9145137a-c0c6-4683-87ae-49c0e8a90418 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1471 microversion: 2.1 time: 1.263034 Nov 03 03:53:43.241409 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 351/742] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:41 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1471 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:43.254525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:43.255420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:43.268733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:43.269261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:43.271649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:43.271649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:43.277518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:43.278616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:43.415397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:43.427934 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b173a7f-8d12-43d6-bf1a-49405b3626f6 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1277 microversion: 2.1 time: 0.183259 Nov 03 03:53:43.433412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 352/743] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:43 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:43.443128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:43.443927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:43.475935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:43.480235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:43.480876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:43.481823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:43.482385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:43.482890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:43.508795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:43.620595 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-507a5423-495f-4290-b281-620e87f900b0 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 1.365804 Nov 03 03:53:43.620595 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 392/744] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:42 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:43.620595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:43.620595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:43.620595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:43.622177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:43.622177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:43.622177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:43.622177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:43.622642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.276477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:44.285529 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d922a4c8-cd14-4565-8126-dfdf7dbca426 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.851146 Nov 03 03:53:44.294854 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 353/745] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:43 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:44.300451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1716b1e4-6c23-4f56-b529-6819f619c18f req-b7c4bc6f-abd5-42bb-851c-c132020fbe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c54136-4fb8-491b-990e-282f64369489", "name": "network-vif-plugged", "status": "completed", "tag": "6c663de4-1de1-41ef-a17e-743a818165b0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:44.321556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1716b1e4-6c23-4f56-b529-6819f619c18f req-b7c4bc6f-abd5-42bb-851c-c132020fbe0c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:44.321556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1716b1e4-6c23-4f56-b529-6819f619c18f req-b7c4bc6f-abd5-42bb-851c-c132020fbe0c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:44.322012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1716b1e4-6c23-4f56-b529-6819f619c18f req-b7c4bc6f-abd5-42bb-851c-c132020fbe0c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.344175 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1716b1e4-6c23-4f56-b529-6819f619c18f req-b7c4bc6f-abd5-42bb-851c-c132020fbe0c service nova] Creating event network-vif-plugged:6c663de4-1de1-41ef-a17e-743a818165b0 for instance f0c54136-4fb8-491b-990e-282f64369489 on n-h2-854653-7 Nov 03 03:53:44.353962 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1716b1e4-6c23-4f56-b529-6819f619c18f req-b7c4bc6f-abd5-42bb-851c-c132020fbe0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056931 Nov 03 03:53:44.354575 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 354/746] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:44.363964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:44.364699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:44.372078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:44.372567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:44.373008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.374426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:44.374853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:44.375280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.384794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8aeea53-068b-487e-8763-56bb7364fcf5 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1618 microversion: 2.1 time: 0.837430 Nov 03 03:53:44.386603 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 393/747] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:43 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1618 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:44.396556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:44.401786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:44.412399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:44.417631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:44.418297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.419195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:44.421392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:44.422024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.860742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:44.870045 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01c27010-e010-4cb8-bd05-08b96196b6f8 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.514134 Nov 03 03:53:44.872845 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 355/748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:44 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:44.891446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:44.892419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:44.913243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:44.916384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:44.916384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.916384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:44.916384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:44.916811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:44.977058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:45.006133 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68e72308-9340-4633-921e-c2f36b7d362f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1471 microversion: 2.1 time: 0.613557 Nov 03 03:53:45.007866 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 394/749] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:44 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1471 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:45.017252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:45.025419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:45.028341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:45.034114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f3a45a3-ce7c-4291-bb59-4d34125f4301 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1277 microversion: 2.1 time: 0.159911 Nov 03 03:53:45.034825 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 356/750] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:44 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:45.040875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1712188665", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["54bb3703-e5fe-4369-a8d8-c04bd950e0ab"]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:45.041169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:45.044264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:45.045483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:45.046396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:45.047690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:45.049305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:45.109554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:53:45.993318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:46.003135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4bc5f2c6-dd93-4229-8ec8-650f87b87749 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 0.994010 Nov 03 03:53:46.004224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 395/751] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:45 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:46.009099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85e8d7ca-c26a-49ea-8929-67e109b7f7e5 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:46.109432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85e8d7ca-c26a-49ea-8929-67e109b7f7e5 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1116629624" status: 202 len: 0 microversion: 2.1 time: 0.103870 Nov 03 03:53:46.113253 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 396/752] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 03:53:46 2022] DELETE /compute/v2.1/flavors/1116629624 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:46.116324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:46.116942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:46.122897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.123387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.123904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.124606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.125118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.125552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.167807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:53:46.168321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:53:46.168689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:53:46.169607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:53:46.169753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:53:46.179563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.180156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.182060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.182060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.182060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.182416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.200193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:46.205403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:46.219804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:53:46.222185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:53:46.356022 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0ddb2b4-5f55-483a-9a67-49164721061b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.319886 Nov 03 03:53:46.356837 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 357/753] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:53:46.362250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:46.362860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:46.370051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.373344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.373344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.373344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.373344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.373693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.497441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:46.512090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a3344a1-6a5e-4471-8e8b-11c57a6d6c7a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.400310 Nov 03 03:53:46.530102 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 397/754] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:46 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:46.530102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:46.530102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:46.530102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.530636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.531306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.532385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.533908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.534624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.873249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:46.881451 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18e2ba3d-ac18-426d-b5f1-8877199a68c6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.523277 Nov 03 03:53:46.897044 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 358/755] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:46 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:46.897260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:46.897381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:46.897381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:46.897534 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-887e4ba6-9189-4d5a-9d12-6b44a7215526 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1471 microversion: 2.1 time: 0.376606 Nov 03 03:53:46.908986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.909890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.910025 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 398/756] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:46 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:46.911769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.912540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:46.913006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:46.915598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:46.915740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa763e46-afb0-49b9-a8a1-f59eba7cff6f tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:46.920669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:46.940508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa763e46-afb0-49b9-a8a1-f59eba7cff6f tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.029298 Nov 03 03:53:46.953620 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 399/757] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:53:46 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:46.960928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37c22272-20da-49d1-96b8-a600672b7c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:46.961623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37c22272-20da-49d1-96b8-a600672b7c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:46.964739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:46.965422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:47.070429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37c22272-20da-49d1-96b8-a600672b7c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:47.077387 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37c22272-20da-49d1-96b8-a600672b7c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1217 microversion: 2.1 time: 0.122658 Nov 03 03:53:47.081840 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 400/758] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:46 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:47.082821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94cfcec3-ad5f-4f9b-800e-7d9630e35e76 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.143965 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94cfcec3-ad5f-4f9b-800e-7d9630e35e76 tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/896420650" status: 202 len: 0 microversion: 2.1 time: 0.064907 Nov 03 03:53:47.149325 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 401/759] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 03:53:47 2022] DELETE /compute/v2.1/flavors/896420650 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:47.149812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.150436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:47.156228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.156718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.157193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.157906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.159023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.159458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.203545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:47.213242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1d90442-7ce7-41cf-bd6b-01be14cb6061 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.329781 Nov 03 03:53:47.214060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 359/760] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:46 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:47.218533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-339774f4-27a4-4fb5-80b7-c4cdecc8868c tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.239860 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-339774f4-27a4-4fb5-80b7-c4cdecc8868c tempest-ServersWithSpecificFlavorTestJSON-242739644 tempest-ServersWithSpecificFlavorTestJSON-242739644-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024568 Nov 03 03:53:47.240544 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 360/761] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:53:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:47.271399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.272127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:47.280933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.281842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.283212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.284575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.285270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.287348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.302707 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] HTTP exception thrown: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Request method failure captured: Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d HTTP/1.1 Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqbJihYdqPKh1RHiMOPSgvG7v-CPGfI93VSWSsLp5sEKYdidxhw5HWRDfBF06SBu3gaiPZnfYqEI4lWVF02Wqrgg2VSbnjOagqv2h6y-0yqibKK2aJFWxqYWRic2JPCpUa1Ks5FZd9njTDxMXiJJv_lDo8bUaVzj9lgPEMPAobItTs Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:53:47.305218 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35c9981944fe4698a48bf702c1e3ac11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35c9981944fe4698a48bf702c1e3ac11"}]}] Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d53f1a53065b47ddbea35b4008884c58 Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.306830 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0c9a0477-ea48-4f40-9445-76db8506018d'} Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:47.307738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.313316 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.315361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Returning 404 to user: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:47.315361 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bfe09380-9f76-499b-b0ab-fdb792e3ec64 tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 404 len: 111 microversion: 2.1 time: 0.044744 Nov 03 03:53:47.315361 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 361/762] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:53:47 2022] DELETE /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:47.333422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.334066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: 0c9a0477-ea48-4f40-9445-76db8506018d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:47.345716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.346484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.347250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.347979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.348442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.348876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.366194 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] HTTP exception thrown: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Request method failure captured: Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d HTTP/1.1 Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqbJihYdqPKh1RHiMOPSgvG7v-CPGfI93VSWSsLp5sEKYdidxhw5HWRDfBF06SBu3gaiPZnfYqEI4lWVF02Wqrgg2VSbnjOagqv2h6y-0yqibKK2aJFWxqYWRic2JPCpUa1Ks5FZd9njTDxMXiJJv_lDo8bUaVzj9lgPEMPAobItTs Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:53:47.368261 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35c9981944fe4698a48bf702c1e3ac11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35c9981944fe4698a48bf702c1e3ac11"}]}] Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d53f1a53065b47ddbea35b4008884c58 Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.373342 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0c9a0477-ea48-4f40-9445-76db8506018d'} Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:47.374139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. Nov 03 03:53:47.376142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.379266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Returning 404 to user: Instance 0c9a0477-ea48-4f40-9445-76db8506018d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:47.379266 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a43f159b-f733-406b-a72b-7a043d59bd8f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d" status: 404 len: 111 microversion: 2.1 time: 0.041579 Nov 03 03:53:47.379266 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 362/763] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:47 2022] GET /compute/v2.1/servers/0c9a0477-ea48-4f40-9445-76db8506018d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:47.405464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.406009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:47.416701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.417387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.417835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.418718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.419971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.420456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.441306 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] HTTP exception thrown: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Request method failure captured: Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c HTTP/1.1 Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqbJihYdqPKh1RHiMOPSgvG7v-CPGfI93VSWSsLp5sEKYdidxhw5HWRDfBF06SBu3gaiPZnfYqEI4lWVF02Wqrgg2VSbnjOagqv2h6y-0yqibKK2aJFWxqYWRic2JPCpUa1Ks5FZd9njTDxMXiJJv_lDo8bUaVzj9lgPEMPAobItTs Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:53:47.443644 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35c9981944fe4698a48bf702c1e3ac11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35c9981944fe4698a48bf702c1e3ac11"}]}] Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d53f1a53065b47ddbea35b4008884c58 Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.444922 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'dda48a2a-0f23-488b-8c52-4ba9ef3d808c'} Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:47.445890 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.447023 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.448710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Returning 404 to user: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:47.448710 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f7aebe5-d582-47a2-90db-59fea957763f tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 404 len: 111 microversion: 2.1 time: 0.053527 Nov 03 03:53:47.448877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:47.448989 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 363/764] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:53:47 2022] DELETE /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:47.453564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:47.456520 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94f5a007-27c3-4dc5-8cfa-38f5f33e3147 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 0.310731 Nov 03 03:53:47.461590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.462695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] [instance: dda48a2a-0f23-488b-8c52-4ba9ef3d808c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:47.464151 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 402/765] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:47 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:47.469036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.469658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.470205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.471068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.471647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.472174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.490348 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] HTTP exception thrown: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Request method failure captured: Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c HTTP/1.1 Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzqbJihYdqPKh1RHiMOPSgvG7v-CPGfI93VSWSsLp5sEKYdidxhw5HWRDfBF06SBu3gaiPZnfYqEI4lWVF02Wqrgg2VSbnjOagqv2h6y-0yqibKK2aJFWxqYWRic2JPCpUa1Ks5FZd9njTDxMXiJJv_lDo8bUaVzj9lgPEMPAobItTs Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:53:47.492084 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35c9981944fe4698a48bf702c1e3ac11", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35c9981944fe4698a48bf702c1e3ac11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35c9981944fe4698a48bf702c1e3ac11"}]}] Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 35c9981944fe4698a48bf702c1e3ac11 Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324 Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d53f1a53065b47ddbea35b4008884c58 Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-700214324-project Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.493689 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'dda48a2a-0f23-488b-8c52-4ba9ef3d808c'} Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:47.494537 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. Nov 03 03:53:47.496280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:53:47.498490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] Returning 404 to user: Instance dda48a2a-0f23-488b-8c52-4ba9ef3d808c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:47.498490 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f284d71-1620-4916-ad33-94ccf75fa5be tempest-ServersWithSpecificFlavorTestJSON-700214324 tempest-ServersWithSpecificFlavorTestJSON-700214324-project] 10.222.0.30 "GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c" status: 404 len: 111 microversion: 2.1 time: 0.043917 Nov 03 03:53:47.499593 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 364/766] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:47 2022] GET /compute/v2.1/servers/dda48a2a-0f23-488b-8c52-4ba9ef3d808c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:53:47.537187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.537939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:47.547800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.548286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.551200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.552165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.552643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.555158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.920331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:47.925395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:47.940375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.941355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.949770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.954469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:47.955429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:47.957724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:47.975222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:48.219622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:48.241122 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8855da40-e40d-4b83-87d6-46214e7a99e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.708811 Nov 03 03:53:48.243516 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 403/767] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:47 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:48.254032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:48.254658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:48.267287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.268460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.269275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.270006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.270707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.271567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.526272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:48.540642 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ea617a3-eb77-4554-8691-737cfbcb10d4 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.636274 Nov 03 03:53:48.542498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 365/768] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:47 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:48.557867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:48.559184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:48.567221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.568074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.568715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.570196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.570854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.571826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.678882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:48.688211 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7554b557-9456-4eb6-8c78-f637e7352056 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1269 microversion: 2.1 time: 0.144506 Nov 03 03:53:48.689001 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 366/769] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:48 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:48.693816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:48.704071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:48.704071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:48.704071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.704071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.704752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.706238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.706698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.707124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.709104 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24c40c10-97a2-457a-afcb-d75c9cd8af24 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1471 microversion: 2.1 time: 0.461293 Nov 03 03:53:48.709739 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 404/770] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:48 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1471 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:48.731812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-38221439-eab4-413e-aee2-50c1dfb85e36 req-5746a0a7-ad38-4b3c-935b-bed92871ee42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8", "tag": "65bafe43-c6c3-4f47-b466-9725fb6e19e4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:48.743268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-38221439-eab4-413e-aee2-50c1dfb85e36 req-5746a0a7-ad38-4b3c-935b-bed92871ee42 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.744401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-38221439-eab4-413e-aee2-50c1dfb85e36 req-5746a0a7-ad38-4b3c-935b-bed92871ee42 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.745081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-38221439-eab4-413e-aee2-50c1dfb85e36 req-5746a0a7-ad38-4b3c-935b-bed92871ee42 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.759650 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-38221439-eab4-413e-aee2-50c1dfb85e36 req-5746a0a7-ad38-4b3c-935b-bed92871ee42 service nova] Creating event network-changed:65bafe43-c6c3-4f47-b466-9725fb6e19e4 for instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 on n-h1-854653-7 Nov 03 03:53:48.769094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-38221439-eab4-413e-aee2-50c1dfb85e36 req-5746a0a7-ad38-4b3c-935b-bed92871ee42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045291 Nov 03 03:53:48.770092 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 405/771] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:48.778464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:48.779429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:48.788556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.789377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.790008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:48.790910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:48.791549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:48.792204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:49.392121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:49.407652 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-541b8c9c-0880-4b29-9097-29c7eb13fbc9 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.716707 Nov 03 03:53:49.409702 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 367/772] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:48 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:49.415020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:49.415908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:49.439765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:49.440457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:49.441006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:49.442020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:49.442585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:49.443128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:49.579112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:49.586108 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7c48b04-26c2-46ae-a4de-26ff21ecbb3d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1319 microversion: 2.1 time: 0.814150 Nov 03 03:53:49.587232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 406/773] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:48 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1319 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:49.593113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:49.593879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:49.601562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:49.602217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:49.602804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:49.603775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:49.604796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:49.605549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.019190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:50.039415 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eadd95d8-65c1-48f4-84c4-928b8741cadd tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.450806 Nov 03 03:53:50.050481 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 407/774] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:49 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:50.061176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:50.065408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:50.069333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.070073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.070684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.071594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.072199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.072786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.084406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:50.098427 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf446856-4898-41a6-85ba-891e9b41ed61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.687111 Nov 03 03:53:50.099338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 368/775] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:49 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:50.107234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:50.111982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:50.121928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.122432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.122877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.123592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.124225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.124664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.159416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:50.170646 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-709ec62d-634d-4223-8ac1-2a6648164c9f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1275 microversion: 2.1 time: 0.116380 Nov 03 03:53:50.185050 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 408/776] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:50 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:50.405881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:50.414471 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41890138-8eb4-41b5-92d3-de4502179f4c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1471 microversion: 2.1 time: 0.313868 Nov 03 03:53:50.422453 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 369/777] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:50 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:50.441842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:50.442963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:50.454184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.457966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.457966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.458700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.459418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.460053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.610206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:50.610746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:50.612809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:50.621541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.622460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.624003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.625361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.627840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.628684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.657232 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c0a6583e-8a6e-4b98-9482-dcf0f138a754 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.222420 Nov 03 03:53:50.677595 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 409/778] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:50 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:50.914763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:50.923432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e8fdbed0-c209-466c-abfe-146a2b2719d7 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1469 microversion: 2.1 time: 0.317241 Nov 03 03:53:50.924553 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 370/779] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:50 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1469 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:50.950527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:50.951625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:50.960809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.969796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.970272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:50.971600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:50.972082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:50.972530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:51.010797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lazy-loading 'flavor' on Instance uuid f0c54136-4fb8-491b-990e-282f64369489 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:53:51.070066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:51.071012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:51.087473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:51.092077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:51.092846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:51.093826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:51.094468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:51.097251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:51.519048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:51.530210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9eaadaa2-83cf-40e1-b9ec-4fe01abba932 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.469929 Nov 03 03:53:51.536802 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 371/780] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:51 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:51.551867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:51.552422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:51.560097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:51.560606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:51.561149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:51.562937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:51.563413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:51.563851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:51.801359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:51.813523 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e4331c14-f0aa-431e-b74e-09653ad3bf1b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1504 microversion: 2.1 time: 0.272773 Nov 03 03:53:51.827001 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 372/781] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:51 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1504 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:51.837209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:51.838178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:51.844627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:51.845600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:51.846385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:51.847403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:51.848029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:51.848724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.045603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:52.054352 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4cc2c3df-b74c-45ed-ad46-306ae79d4afd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.226124 Nov 03 03:53:52.054940 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 373/782] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:51 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:52.059651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:52.066269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:52.072793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.074872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.082355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.082355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.082355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.082681 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55ff149a-e7c8-4c48-810a-b012b0bf1dea tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489/action" status: 202 len: 0 microversion: 2.1 time: 1.131062 Nov 03 03:53:52.082681 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 410/783] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:53:50 2022] POST /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489/action => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:53:52.084396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.087114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:52.087920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:52.095049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.095934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.096591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.097675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.098361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.099282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.355964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:52.366523 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5442e5b1-5e47-450f-a956-528b824f7cc6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1471 microversion: 2.1 time: 0.310303 Nov 03 03:53:52.370392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:52.378721 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 374/784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:52 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:52.389492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0230533f-60a5-46b5-a1a8-c5f2bddda3de tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.310118 Nov 03 03:53:52.390405 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 411/785] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:52 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:52.390953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:52.392922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:52.411671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.412169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.412606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.413355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.413814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.415077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.559237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:52.560478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:52.568600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.569573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.570259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.571683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.572643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.573421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.729857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:52.744979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d199e16-80d8-495e-a67a-951647a767c4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1477 microversion: 2.1 time: 0.354984 Nov 03 03:53:52.758896 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 375/786] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:52 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1477 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:52.841097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:52.842277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:52.857407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.858573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.859204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.861307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:52.863136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:52.864060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:52.871058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:52.883768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-488362c7-072f-4f4d-bdbe-6a5d8975f815 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.326081 Nov 03 03:53:52.884609 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 412/787] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:52 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:53.037273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:53.046651 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b60d0529-1b3b-457a-b999-fbffacc206b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1479 microversion: 2.1 time: 0.210181 Nov 03 03:53:53.047511 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 376/788] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:52 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1479 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:53.072120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-739032f7-b949-41e5-bc88-7ea05c51d7df tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '.version_select at 0x7ff7f98ff1f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:53.077546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-739032f7-b949-41e5-bc88-7ea05c51d7df tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.078039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-739032f7-b949-41e5-bc88-7ea05c51d7df tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.078479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-739032f7-b949-41e5-bc88-7ea05c51d7df tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.080705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:53.081361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:53.088623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.091417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.092708 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-739032f7-b949-41e5-bc88-7ea05c51d7df tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.024496 Nov 03 03:53:53.093958 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 413/789] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:53:53 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:53.094600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.095927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.096427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.096867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.107660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:53.108643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:53.116254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.117137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.117752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.134063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.134805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.135531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.561756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:53.581520 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-452e32f0-876b-4e5f-832e-8e337bc5f388 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.505198 Nov 03 03:53:53.582120 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 377/790] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:53 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:53.593661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:53.595124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:53.617961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.624005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.624603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.625941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.626426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.627986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.655130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9a0b493-8649-4b15-bc21-cf2f5f799813 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1630 microversion: 2.1 time: 0.545481 Nov 03 03:53:53.664060 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 414/791] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:53 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1630 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:53.679438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:53.680270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:53.695112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.695902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.696528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:53.700262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:53.700928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:53.701557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.074333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:54.086471 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8246ef0-b87d-4582-ac3e-017621971c14 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.420972 Nov 03 03:53:54.102405 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 415/792] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:53 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:54.156000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:54.191223 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d75f31f4-adff-4bf2-90d0-c5a1a29cf5c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1463 microversion: 2.1 time: 0.604788 Nov 03 03:53:54.192026 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 378/793] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:53 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1463 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:54.210068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f619296-f993-4dc3-9867-1e1bb31a2dc4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Action: 'create', calling method: .version_select at 0x7ff7f971dee0>, body: {"keypair": {"name": "tempest-keypair-644447059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoqJATdIdQ25qhq+W9yQNdF8OVAAlP7hHBcCKn6M6DYfqbCAFn13zLwTuZsnCWnU3yP28QwALLE/oDRUEWAcbNcKkmmwI98pjBRnxQraBH6XwE2da8aPQ0UO43ZgfRGbg=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:54.283722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-9f619296-f993-4dc3-9867-1e1bb31a2dc4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for project 71461e876c80455aa1875086a2ec4f49. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:54.309487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-9f619296-f993-4dc3-9867-1e1bb31a2dc4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for user c4a4d4a61500400faf673aa67ff8be39 and project 71461e876c80455aa1875086a2ec4f49. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:54.368404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-16f75432-30af-48b3-9d40-5ebb1c70b279 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Action: 'create', calling method: .version_select at 0x7ff7f9bdee50>, body: {"keypair": {"name": "tempest-keypair-1301571029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ4YGRfuEFr+GwMeeahkKCXOEbrtcVs47pubjoXKhcAYmKieRi4StqaB9+EDf7nZoIHOBDDutgMGdk2AihX/+eyK7vQr40qQ19K8OXwFwHry6+KQxJvhm5t8SXY4HMTOQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:54.405726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-16f75432-30af-48b3-9d40-5ebb1c70b279 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Getting quotas for project 988963f3904b448591fadbaf28367442. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:54.421290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-16f75432-30af-48b3-9d40-5ebb1c70b279 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Getting quotas for user ce31ba9aca1943b0975f0cd17dad4633 and project 988963f3904b448591fadbaf28367442. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:54.474171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f619296-f993-4dc3-9867-1e1bb31a2dc4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.279482 Nov 03 03:53:54.489233 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 379/794] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:53:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:54.489233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:54.492626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:54.504197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.505099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.505767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.506676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.507323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.507946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.547653 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-16f75432-30af-48b3-9d40-5ebb1c70b279 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.448263 Nov 03 03:53:54.548317 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 416/795] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:53:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:54.558669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:54.560341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:54.568929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.570287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.570926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.572135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.572817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.573878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.860806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:54.872471 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-952f6d4b-3957-455c-bc54-13d2c0dc9d99 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.323030 Nov 03 03:53:54.878506 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 417/796] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:54 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:54.892072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:54.900742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:54.906139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:54.925496 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-56bdf14b-5008-40b2-aff6-32e7ebad3a89 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1460 microversion: 2.1 time: 0.436463 Nov 03 03:53:54.929162 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 380/797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:54 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1460 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:54.934579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.944510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.945842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.946926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.947590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.948196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.951116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:54.951750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:54.973481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.984472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.985400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:54.986883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:54.987433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:54.991171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:55.410504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:55.431497 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6061a11-e9fd-4c0d-9e27-95a5a3a8a626 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.500424 Nov 03 03:53:55.443189 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 381/798] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:54 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:55.456437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:55.457729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:55.475949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:55.476934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:55.477299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:55.481474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:55.481994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:55.482446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:55.630711 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-414ce876-912d-40be-a73a-c7e480a68196 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1614 microversion: 2.1 time: 0.750743 Nov 03 03:53:55.631629 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 418/799] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:54 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1614 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:55.648584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:55.649256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:55.655619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:55.656056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:55.656506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:55.657255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:55.657752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:55.658198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.083486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:56.102198 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7d2484e-de5a-415f-8b05-d0208c5a3108 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.469069 Nov 03 03:53:56.102387 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 419/800] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:55 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:56.107240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-876eff6f-b825-4a2c-aaba-4391430372b7 req-331495c0-883e-4c02-b115-11932f62fdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "438573f8-4fa5-4eec-980b-a22eda8dbe5b", "tag": "eb61c650-8f77-482d-8944-6b25b624e884"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:56.126087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-876eff6f-b825-4a2c-aaba-4391430372b7 req-331495c0-883e-4c02-b115-11932f62fdf1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:56.129836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-876eff6f-b825-4a2c-aaba-4391430372b7 req-331495c0-883e-4c02-b115-11932f62fdf1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:56.130503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-876eff6f-b825-4a2c-aaba-4391430372b7 req-331495c0-883e-4c02-b115-11932f62fdf1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.135911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:56.146920 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-876eff6f-b825-4a2c-aaba-4391430372b7 req-331495c0-883e-4c02-b115-11932f62fdf1 service nova] Creating event network-changed:eb61c650-8f77-482d-8944-6b25b624e884 for instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b on n-h1-854653-7 Nov 03 03:53:56.157654 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-876eff6f-b825-4a2c-aaba-4391430372b7 req-331495c0-883e-4c02-b115-11932f62fdf1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050607 Nov 03 03:53:56.161097 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 420/801] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:56.166364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0ade7e0-1d06-4ab8-8513-2a52e51463e5 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '.version_select at 0x7ff7f9c2ce50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:56.170025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ade7e0-1d06-4ab8-8513-2a52e51463e5 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:56.177639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ade7e0-1d06-4ab8-8513-2a52e51463e5 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:56.178412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0ade7e0-1d06-4ab8-8513-2a52e51463e5 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.187713 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0ade7e0-1d06-4ab8-8513-2a52e51463e5 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.025308 Nov 03 03:53:56.188978 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 421/802] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:53:56 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:56.189884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:56.194634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:56.195647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:56.203119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:56.204119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:56.204983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.213171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:56.213171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:56.213171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.470707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:56.485366 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e83be4f-938d-4e61-99c0-43275710c057 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1611 microversion: 2.1 time: 1.040030 Nov 03 03:53:56.487176 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 382/803] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:55 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1611 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:56.496527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-66f69482-15d6-4c4a-bbea-131afb40900a req-fb0a1a05-0a22-40e2-ba4b-f0624a86acf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088f74bc-3359-48f9-951b-a8ffed40674d", "name": "network-vif-plugged", "status": "completed", "tag": "c20dba85-cf5f-4b11-b841-d340e90a025a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:56.507425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-66f69482-15d6-4c4a-bbea-131afb40900a req-fb0a1a05-0a22-40e2-ba4b-f0624a86acf7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:56.508157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-66f69482-15d6-4c4a-bbea-131afb40900a req-fb0a1a05-0a22-40e2-ba4b-f0624a86acf7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:56.508758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-66f69482-15d6-4c4a-bbea-131afb40900a req-fb0a1a05-0a22-40e2-ba4b-f0624a86acf7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.523039 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-66f69482-15d6-4c4a-bbea-131afb40900a req-fb0a1a05-0a22-40e2-ba4b-f0624a86acf7 service nova] Creating event network-vif-plugged:c20dba85-cf5f-4b11-b841-d340e90a025a for instance 088f74bc-3359-48f9-951b-a8ffed40674d on n-h2-854653-7 Nov 03 03:53:56.528885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-66f69482-15d6-4c4a-bbea-131afb40900a req-fb0a1a05-0a22-40e2-ba4b-f0624a86acf7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039794 Nov 03 03:53:56.534705 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 383/804] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:56.541600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-718596958", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:56.591815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:56.605139 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1367e76-d8d3-41b1-8ae4-27f7c943bb07 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.413347 Nov 03 03:53:56.621884 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 422/805] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:56 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:56.629481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:56.635243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:56.639293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:53:56.644124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:56.644626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:56.645800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.646789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:56.647259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:56.647693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:56.976813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:56.987181 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2cc42261-5122-4364-a813-2c93ce2016fe tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.366794 Nov 03 03:53:56.990851 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 423/806] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:56 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:57.010735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:57.015032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.015778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.017933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.019652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.023589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.023589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.047150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:53:57.052128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:53:57.052128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:53:57.052128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:53:57.052128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:53:57.064734 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c47b3b89-846e-42be-b7be-03a56b45d90e tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061412 Nov 03 03:53:57.065411 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 424/807] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:53:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:53:57.065645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.066308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.066897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.067798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.068422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.068918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.080405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854653-7", "block_migration": true, "disk_over_commit": false}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:57.082582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:57.093894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:53:57.094418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.094934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.095423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.096805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.097975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.098734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.101241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for user 74ac442756f54baa8b70bb302b35b95c and project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:53:57.107330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:53:57.119069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:53:57.122728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:53:57.133381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Lazy-loading 'flavor' on Instance uuid f0c54136-4fb8-491b-990e-282f64369489 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:53:57.147946 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f0c54136-4fb8-491b-990e-282f64369489 while it is in vm_state suspended Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Request method failure captured: Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489/action HTTP/1.1 Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 97 Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsSkRdPfi8W1e9BwEiqBh2dN_nZWUdmZ1VjBy6Ps6yiBaxk1_wdjuvJGxRtJT0bpg86PWPn1xLhjC1SH2ul0yahT2vDP4YQCB1KNGpM4aiAoMr9TZ53X9zzXZCFNfP2gygUMfHPzPScHkKlBYiNsqq7wbsAu_og9qoJASY96VzSAXA Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 18d0005cea504bb0980fd7d26ecb683e Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-LiveMigrationNegativeTest-1675715281 Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:53:57.150461 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/18d0005cea504bb0980fd7d26ecb683e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_18d0005cea504bb0980fd7d26ecb683e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/18d0005cea504bb0980fd7d26ecb683e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/18d0005cea504bb0980fd7d26ecb683e"}]}] Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-LiveMigrationNegativeTest-1675715281 Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 18d0005cea504bb0980fd7d26ecb683e Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1675715281 Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-LiveMigrationNegativeTest-1675715281-project-admin Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: af17b260aaf24c0599b633aae48669d2 Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-LiveMigrationNegativeTest-1675715281-project-admin Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: {"os-migrateLive": {"host": "n-h1-854653-7", "block_migration": true, "disk_over_commit": false}} Nov 03 03:53:57.152085 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'os-migrateLive' instance f0c54136-4fb8-491b-990e-282f64369489 while it is in vm_state suspended Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f0c54136-4fb8-491b-990e-282f64369489', 'body': {'os-migrateLive': {'host': 'n-h1-854653-7', 'block_migration': True, 'disk_over_commit': False}}} Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 03 03:53:57.152977 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0c54136-4fb8-491b-990e-282f64369489 in vm_state suspended. Cannot live_migrate while the instance is in this state. Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:53:57.154290 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance f0c54136-4fb8-491b-990e-282f64369489 while it is in vm_state suspended Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance f0c54136-4fb8-491b-990e-282f64369489 while it is in vm_state suspended Nov 03 03:53:57.155706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:53:57.158319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f0c54136-4fb8-491b-990e-282f64369489 while it is in vm_state suspended {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:53:57.159507 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15a7629a-7c50-48d1-a68c-4179e8a4f0a6 tempest-LiveMigrationNegativeTest-1675715281 tempest-LiveMigrationNegativeTest-1675715281-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489/action" status: 409 len: 155 microversion: 2.1 time: 0.085517 Nov 03 03:53:57.165204 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 425/808] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:53:57 2022] POST /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489/action => generated 155 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:53:57.172072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:57.172072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:57.178971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.179874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.180506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.181621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.182169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.182694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.310964 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e366214b-9355-4d45-97e7-730e728136a7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774141 Nov 03 03:53:57.312762 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 384/809] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:53:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:53:57.319675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:57.321033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:57.328916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.329937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.330785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.331997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.332864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.333695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.369269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:53:57.431510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:57.439723 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-514e07f1-2b93-4fb3-9f75-c7c63a0119d1 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.272598 Nov 03 03:53:57.445640 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 426/810] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:57 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:57.461959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8fbba461-7b51-4d57-a275-78d575bcd755 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:57.467524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8fbba461-7b51-4d57-a275-78d575bcd755 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:57.581107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8fbba461-7b51-4d57-a275-78d575bcd755 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:57.590130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8fbba461-7b51-4d57-a275-78d575bcd755 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1212 microversion: 2.1 time: 0.141761 Nov 03 03:53:57.606594 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 427/811] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:57 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1212 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:57.629725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:57.631819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:57.644548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.645951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.646583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.647496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.648139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.648771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.846791 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-adff5967-9f59-4236-9d35-5962a0e571e3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 204 len: 0 microversion: 2.1 time: 0.532317 Nov 03 03:53:57.848303 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 385/812] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:53:57 2022] DELETE /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:53:57.857123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:57.858290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:57.869497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.870332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.870779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.871967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:57.872773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:57.873590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:57.894610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:57.917629 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae2fee1c-0db1-4743-b22b-9122b022b624 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.292707 Nov 03 03:53:57.925128 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 428/813] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:57 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:58.015098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:58.015550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:58.028737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.029066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.029521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.030241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.030708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.031148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.245255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:58.255857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-278a50dd-c56e-4b2c-bc22-0790426b51b9 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1466 microversion: 2.1 time: 0.403430 Nov 03 03:53:58.256533 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 386/814] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:57 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1466 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:58.344285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:58.360126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8bad9093-a407-4446-bf24-d3c94c855d49 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.349041 Nov 03 03:53:58.361178 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 429/815] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:58 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:53:58.468597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:58.469436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:58.478170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.479026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.479699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.480838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.481619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.482162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.551442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-379e42d3-b376-4201-8afc-e256408f14db req-893c15e2-9763-4277-ba9e-cd2ce65436f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8", "name": "network-vif-plugged", "status": "completed", "tag": "65bafe43-c6c3-4f47-b466-9725fb6e19e4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:53:58.564614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-379e42d3-b376-4201-8afc-e256408f14db req-893c15e2-9763-4277-ba9e-cd2ce65436f2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.565160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-379e42d3-b376-4201-8afc-e256408f14db req-893c15e2-9763-4277-ba9e-cd2ce65436f2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.565594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-379e42d3-b376-4201-8afc-e256408f14db req-893c15e2-9763-4277-ba9e-cd2ce65436f2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.577227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-379e42d3-b376-4201-8afc-e256408f14db req-893c15e2-9763-4277-ba9e-cd2ce65436f2 service nova] Creating event network-vif-plugged:65bafe43-c6c3-4f47-b466-9725fb6e19e4 for instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 on n-h1-854653-7 Nov 03 03:53:58.582853 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-379e42d3-b376-4201-8afc-e256408f14db req-893c15e2-9763-4277-ba9e-cd2ce65436f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039062 Nov 03 03:53:58.587484 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 430/816] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:53:58.638839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:58.641669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:58.651931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.653957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.654581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.657095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.657771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.658366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.741426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:58.753049 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4594b9b7-f827-49ae-85da-af9a039151bc tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.288508 Nov 03 03:53:58.753630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:58.757335 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 387/817] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:58 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:58.763474 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-086ee6a6-2a94-410a-8854-d5e14a6cc8b1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1216 microversion: 2.1 time: 0.149822 Nov 03 03:53:58.765731 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 431/818] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:58 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:58.944871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:58.945892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:58.952358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.953272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.955808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:58.955808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:58.955808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:58.956569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:59.286472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:59.287158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:59.295378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:59.296137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:59.296774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:59.297771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:59.299087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:59.299692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:59.395339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:59.411771 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4aa4969-5950-4610-899b-1a37c6e7da55 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1371 microversion: 2.1 time: 0.468705 Nov 03 03:53:59.439781 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 388/819] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:58 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1371 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:59.446377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:59.447301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:59.456141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:59.458076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:59.458768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:59.459820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:59.460981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:59.461671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:59.667923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:53:59.692486 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e42ad16b-11e1-4feb-907d-646620cdf7db tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1466 microversion: 2.1 time: 0.416665 Nov 03 03:53:59.693637 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 432/820] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:59 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1466 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:53:59.777166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:53:59.777972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:53:59.786853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:59.787349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:59.795369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:53:59.795369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:53:59.796103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:53:59.796561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:00.034827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:00.088998 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-427ee69b-6103-4179-b26e-38cd8f68c5bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.647583 Nov 03 03:54:00.090963 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 389/821] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:59 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:00.106541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:00.107981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:00.118697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:00.119526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:00.120151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:00.121390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:00.131035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:00.134014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:00.141357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:00.159129 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00cd97dd-dad1-4e9b-956a-77fb9c52468e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1319 microversion: 2.1 time: 0.385258 Nov 03 03:54:00.160919 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 433/822] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:53:59 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:00.179767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1831423146", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3d4e1408-03b0-41eb-a50f-9f05a231f5f3"}], "security_groups": [{"name": "tempest-securitygroup--754757221"}], "key_name": "tempest-keypair-1301571029", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:00.247425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:00.257691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f65bc0f3-ccae-4e74-b142-154c18faccbb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1264 microversion: 2.1 time: 0.165450 Nov 03 03:54:00.258526 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 390/823] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:00 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:00.343697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] validate_networks() for [('3d4e1408-03b0-41eb-a50f-9f05a231f5f3', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:00.449160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:00.454180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:00.467159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:00.469103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:00.471056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:00.472006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:00.474071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:00.474747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:00.736732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:00.745620 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-63ee2c22-5526-4f8f-b6d2-f49615577095 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1557 microversion: 2.1 time: 0.305727 Nov 03 03:54:00.746203 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 391/824] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:00 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1557 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:00.752681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1494901275", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "f004922e-d064-49aa-9c71-6a282c3fe25b"}], "security_groups": [{"name": "tempest-securitygroup--1033277668"}], "key_name": "tempest-keypair-644447059", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:00.934544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] validate_networks() for [('f004922e-d064-49aa-9c71-6a282c3fe25b', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:00.988874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Getting quotas for project 988963f3904b448591fadbaf28367442. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:00.996434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Getting quotas for user ce31ba9aca1943b0975f0cd17dad4633 and project 988963f3904b448591fadbaf28367442. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:01.031152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:01.032921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:01.033794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:01.035311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:01.037316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:01.054677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.057176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.057176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.057176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.057747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.058405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.081969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:01.092646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Getting quotas for project 988963f3904b448591fadbaf28367442. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:01.112844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Getting quotas for user ce31ba9aca1943b0975f0cd17dad4633 and project 988963f3904b448591fadbaf28367442. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:01.149710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:54:01.160071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:54:01.337121 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a96d7595-bb28-4e98-8f2c-1625012f00b8 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.174264 Nov 03 03:54:01.346153 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 434/825] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:00 2022] POST /compute/v2.1/servers => generated 408 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:54:01.352219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:01.353184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:01.365543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.366848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.367233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.368077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.368602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.369676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.445555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.446164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.446730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.447643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lazy-loading 'fault' on Instance uuid f0c54136-4fb8-491b-990e-282f64369489 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:01.554597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:01.583161 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4441225f-417d-49ed-851d-3adbd5c1f08d tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 200 len: 1309 microversion: 2.1 time: 0.217327 Nov 03 03:54:01.597709 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 435/826] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:01 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:01.597709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:01.600562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:01.620964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.623632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.624095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.633990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.636201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.639992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.732248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:01.732767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:01.733419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:01.733931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:01.734445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:01.770101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.774945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.775606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.777765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.779155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.780589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.854389 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0c674eb5-6a0f-40e0-8e7e-cccc9440bf17 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.267557 Nov 03 03:54:01.855772 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 436/827] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 03:54:01 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-interface => generated 285 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:01.860508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:01.865661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-93dfa9fd-7e1e-4dc8-bc46-794800c80b34 req-21effe21-de26-405d-b5ca-7f2f821b897a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c54136-4fb8-491b-990e-282f64369489", "name": "network-vif-deleted", "tag": "6c663de4-1de1-41ef-a17e-743a818165b0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:01.894174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for user c4a4d4a61500400faf673aa67ff8be39 and project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:01.896209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93dfa9fd-7e1e-4dc8-bc46-794800c80b34 req-21effe21-de26-405d-b5ca-7f2f821b897a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:01.903299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93dfa9fd-7e1e-4dc8-bc46-794800c80b34 req-21effe21-de26-405d-b5ca-7f2f821b897a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:01.903752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93dfa9fd-7e1e-4dc8-bc46-794800c80b34 req-21effe21-de26-405d-b5ca-7f2f821b897a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:01.962788 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-93dfa9fd-7e1e-4dc8-bc46-794800c80b34 req-21effe21-de26-405d-b5ca-7f2f821b897a service nova] Creating event network-vif-deleted:6c663de4-1de1-41ef-a17e-743a818165b0 for instance f0c54136-4fb8-491b-990e-282f64369489 on n-h2-854653-7 Nov 03 03:54:01.978992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:54:01.989634 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-93dfa9fd-7e1e-4dc8-bc46-794800c80b34 req-21effe21-de26-405d-b5ca-7f2f821b897a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131758 Nov 03 03:54:01.993569 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 437/828] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:02.002960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:54:02.007169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:02.009518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:02.030314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:02.030842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:02.031293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:02.032069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:02.033138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:02.033770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:02.212222 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ee3957b-4061-48b9-8400-22e140d4030d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.463525 Nov 03 03:54:02.213757 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 392/829] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:54:02.221459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:02.223571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:02.234010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:02.234648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:02.235785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:02.236951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:02.237389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:02.238014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:02.543976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:02.553601 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d5d8b90-3a9e-426f-8fc9-71133c537d66 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.558187 Nov 03 03:54:02.555320 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 438/830] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:01 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:02.578685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:02.583055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:02.597937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:02.599020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:02.599529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:02.600962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:02.601566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:02.603627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:02.767011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:02.796915 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a2c4d81-d75f-4c8e-affa-7ea8f2b47129 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1468 microversion: 2.1 time: 0.581384 Nov 03 03:54:02.813478 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 393/831] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:02 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1468 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:02.821695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41fc012e-ea30-4a01-84dc-80b934a3be10 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:02.822325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41fc012e-ea30-4a01-84dc-80b934a3be10 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:02.855633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:02.864656 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36359825-085b-4333-a708-55f048ce2cff tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.308104 Nov 03 03:54:02.869808 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 439/832] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:02 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:02.882413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dba092a0-17f8-422d-bf9f-894444c1de92 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:02.883323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dba092a0-17f8-422d-bf9f-894444c1de92 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:03.028078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41fc012e-ea30-4a01-84dc-80b934a3be10 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:03.041008 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41fc012e-ea30-4a01-84dc-80b934a3be10 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1278 microversion: 2.1 time: 0.225227 Nov 03 03:54:03.041766 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 394/833] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:02 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:03.046391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:03.051793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: f0c54136-4fb8-491b-990e-282f64369489] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:03.063083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dba092a0-17f8-422d-bf9f-894444c1de92 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:03.072028 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dba092a0-17f8-422d-bf9f-894444c1de92 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1234 microversion: 2.1 time: 0.198611 Nov 03 03:54:03.087998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 440/834] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:02 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1234 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:03.097110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:03.097599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.098142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:03.098936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.099888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.100651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.103669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.104155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.106532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.107223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.107854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.108803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.109480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.111170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.139392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lazy-loading 'flavor' on Instance uuid 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:03.142484 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] HTTP exception thrown: Instance f0c54136-4fb8-491b-990e-282f64369489 could not be found. Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Request method failure captured: Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 HTTP/1.1 Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzsRo92oMFKQ3p9WrAzaDHJtn1CRUSEXNP_zVRPFuRSqTGydNm42zEnJ2kICrIHJ_p9eOUrc0yfxO7IGQpoBZe_9qjezlyX9Oyeq1v47tfu9yXr_UxGtYOwST0H9CLQTMG6n6z8lXjYsDv4-5TmudwmLXyg9oGNCInzzXAhkbDpuN6E Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a5523210923a49b89034225825178521 Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveMigrationNegativeTest-1294060845 Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:03.150421 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a5523210923a49b89034225825178521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a5523210923a49b89034225825178521", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a5523210923a49b89034225825178521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a5523210923a49b89034225825178521"}]}] Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveMigrationNegativeTest-1294060845 Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a5523210923a49b89034225825178521 Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1294060845 Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveMigrationNegativeTest-1294060845-project Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d9d3efcb99604673aac5857ce3f98e51 Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveMigrationNegativeTest-1294060845-project Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f0c54136-4fb8-491b-990e-282f64369489 could not be found. Nov 03 03:54:03.154777 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f0c54136-4fb8-491b-990e-282f64369489'} Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c54136-4fb8-491b-990e-282f64369489 could not be found. Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:03.155611 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c54136-4fb8-491b-990e-282f64369489 could not be found. Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c54136-4fb8-491b-990e-282f64369489 could not be found. Nov 03 03:54:03.156902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:03.158691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Returning 404 to user: Instance f0c54136-4fb8-491b-990e-282f64369489 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:03.158691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61208fd2-3ae4-4079-a924-c5e283da6408 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489" status: 404 len: 111 microversion: 2.1 time: 0.109225 Nov 03 03:54:03.158691 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 395/835] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:03 2022] GET /compute/v2.1/servers/f0c54136-4fb8-491b-990e-282f64369489 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:03.164463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:03.164965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:03.183844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.184542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.184773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.185533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.190867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.191368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.224746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:03.319910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:03.562805 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca2a01e3-14f2-4f12-acd9-8256bfd63582 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8/action" status: 202 len: 0 microversion: 2.1 time: 0.472759 Nov 03 03:54:03.563887 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 441/836] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:54:03 2022] POST /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:54:03.572847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:03.578369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:03.606683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.614231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.615809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.620956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.621693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.622324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.675941 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e47de238-582e-4ff3-b6d2-7352c353df8c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 204 len: 0 microversion: 2.1 time: 0.515118 Nov 03 03:54:03.677041 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 396/837] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:03 2022] DELETE /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:03.685572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:03.686891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:03.698919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.717353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.728968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:03.731487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:03.732171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:03.733813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.013936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:04.029855 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b687a6cd-8258-4768-b1d2-afef51f94dd2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.348797 Nov 03 03:54:04.031202 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 397/838] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:03 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:04.037921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:04.038605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:04.052998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.054709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.054709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.055552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.056022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.056529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.559725 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-489738b4-3287-4164-a202-01e07822684c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1627 microversion: 2.1 time: 0.991367 Nov 03 03:54:04.561363 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 442/839] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:03 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1627 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:04.584779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:04.584779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:04.592767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.593552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.594157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.596479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.597695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.598295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.622634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:04.631028 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-380f266e-354b-43c5-8435-2dedea098d6b tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1473 microversion: 2.1 time: 0.598603 Nov 03 03:54:04.631623 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 398/840] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:04 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1473 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:04.638071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:04.638700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:04.660615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.661194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.672293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.673719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.674225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.674682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.873578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:04.879877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:04.886977 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-29a6081d-4b68-4e71-b828-ff7a7dc77e25 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1330 microversion: 2.1 time: 0.253374 Nov 03 03:54:04.887920 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 399/841] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:04 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1330 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:04.906836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:04.918913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:04.933234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.935187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.935887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.936921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:04.937752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:04.938410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:04.974548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:04.992928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-318243fa-b651-4080-8675-f2f0c9e5d7be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.427667 Nov 03 03:54:04.993557 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 443/842] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:04 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:05.004949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-20a60854-d715-419a-8475-19701083da27 req-4ba79772-268e-426a-ac36-c06f8e36c9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a6e84a-57a6-4788-9864-9263e9f2e08d", "tag": "78c74cd3-8416-43d4-86d6-a1a41c25566e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:05.026078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-20a60854-d715-419a-8475-19701083da27 req-4ba79772-268e-426a-ac36-c06f8e36c9e2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.028843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-20a60854-d715-419a-8475-19701083da27 req-4ba79772-268e-426a-ac36-c06f8e36c9e2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.029529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-20a60854-d715-419a-8475-19701083da27 req-4ba79772-268e-426a-ac36-c06f8e36c9e2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.058521 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-20a60854-d715-419a-8475-19701083da27 req-4ba79772-268e-426a-ac36-c06f8e36c9e2 service nova] Creating event network-changed:78c74cd3-8416-43d4-86d6-a1a41c25566e for instance 05a6e84a-57a6-4788-9864-9263e9f2e08d on n-h2-854653-7 Nov 03 03:54:05.073328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-20a60854-d715-419a-8475-19701083da27 req-4ba79772-268e-426a-ac36-c06f8e36c9e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078413 Nov 03 03:54:05.073956 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 444/843] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:05.080287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c8a7d6c0-a5a1-441f-a7d9-b5cd755e8ed5 req-3f43b738-01a0-47e3-a8d2-c8c2b6788433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "088f74bc-3359-48f9-951b-a8ffed40674d", "tag": "c20dba85-cf5f-4b11-b841-d340e90a025a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:05.105304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:05.107487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8a7d6c0-a5a1-441f-a7d9-b5cd755e8ed5 req-3f43b738-01a0-47e3-a8d2-c8c2b6788433 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.107968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8a7d6c0-a5a1-441f-a7d9-b5cd755e8ed5 req-3f43b738-01a0-47e3-a8d2-c8c2b6788433 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.108589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8a7d6c0-a5a1-441f-a7d9-b5cd755e8ed5 req-3f43b738-01a0-47e3-a8d2-c8c2b6788433 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.117813 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48a431d9-7d15-4b7e-bde7-b8ac371ca6f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1230 microversion: 2.1 time: 0.227349 Nov 03 03:54:05.134375 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c8a7d6c0-a5a1-441f-a7d9-b5cd755e8ed5 req-3f43b738-01a0-47e3-a8d2-c8c2b6788433 service nova] Creating event network-changed:c20dba85-cf5f-4b11-b841-d340e90a025a for instance 088f74bc-3359-48f9-951b-a8ffed40674d on n-h2-854653-7 Nov 03 03:54:05.140329 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 400/844] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:04 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1230 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:05.140718 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c8a7d6c0-a5a1-441f-a7d9-b5cd755e8ed5 req-3f43b738-01a0-47e3-a8d2-c8c2b6788433 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065123 Nov 03 03:54:05.144740 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 445/845] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:05.159784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-aa7c3717-b516-4040-80a7-ba7d174a468f req-6189bcef-842e-4c95-88c9-0232eb2eae16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "438573f8-4fa5-4eec-980b-a22eda8dbe5b", "name": "network-vif-plugged", "status": "completed", "tag": "eb61c650-8f77-482d-8944-6b25b624e884"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:05.159904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:05.159904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:05.182894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.184078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.184550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.185380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.185900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.187309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.187878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aa7c3717-b516-4040-80a7-ba7d174a468f req-6189bcef-842e-4c95-88c9-0232eb2eae16 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.190348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aa7c3717-b516-4040-80a7-ba7d174a468f req-6189bcef-842e-4c95-88c9-0232eb2eae16 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.191864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aa7c3717-b516-4040-80a7-ba7d174a468f req-6189bcef-842e-4c95-88c9-0232eb2eae16 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.216003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-aa7c3717-b516-4040-80a7-ba7d174a468f req-6189bcef-842e-4c95-88c9-0232eb2eae16 service nova] Creating event network-vif-plugged:eb61c650-8f77-482d-8944-6b25b624e884 for instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b on n-h1-854653-7 Nov 03 03:54:05.223784 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-aa7c3717-b516-4040-80a7-ba7d174a468f req-6189bcef-842e-4c95-88c9-0232eb2eae16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077443 Nov 03 03:54:05.224909 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 446/846] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:05.596470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:05.601088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:05.620239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.623022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.625101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.627708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.629290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.630634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.644323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:05.656877 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b9e356f-f9d5-4d67-ab5b-ee258f54b6f7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.514017 Nov 03 03:54:05.660029 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 401/847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:05 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:05.704029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:05.704891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:05.732247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.732761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.733239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:05.734456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:05.735196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:05.736569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.130680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:06.134331 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3fbb29be-39bb-48f7-814c-b4441713f62a tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1610 microversion: 2.1 time: 0.549538 Nov 03 03:54:06.137118 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 447/848] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:05 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1610 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:06.153319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:06.154651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:06.159374 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4254725f-4bc0-4074-8a08-4876b6481bc3 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1473 microversion: 2.1 time: 0.495690 Nov 03 03:54:06.162314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 402/849] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:05 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1473 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:06.163710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.166746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.167905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.175821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:06.176941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:06.177855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.178933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.179477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.199384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.199894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.200349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.201090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.201561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.201994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.357981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:06.367717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f73e1ff-b3d8-4ca9-9ce6-88de89489dab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1336 microversion: 2.1 time: 0.224284 Nov 03 03:54:06.382880 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 448/850] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:06 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1336 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:06.397414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:06.397414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:06.399746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.400398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.401053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.402003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.402991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.403603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.580446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:06.599143 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5cb01d9f-2be6-4a5b-9b8f-f60a8d9d6115 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1294 microversion: 2.1 time: 0.214846 Nov 03 03:54:06.606267 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 449/851] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:06 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1294 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:06.624415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:06.625500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:06.637061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:06.643827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.645436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.645880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.648962 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1ec120d-892e-4b00-a273-b141b5fbc167 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.485397 Nov 03 03:54:06.649538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.650251 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 403/852] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:06 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:06.652241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.652723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.686157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:06.688057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:06.695107 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] HTTP exception thrown: Cannot 'migrate' instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 while it is in vm_state suspended Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Request method failure captured: Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8/action HTTP/1.1 Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 15 Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsrPpTpvtT0ouscU3nyC-_hwQ21QRXVpcdOXxXUnFNMUHlPegQ82c13lpsGeifIsXAtcWAdOMJZINjDQ8H5AvFpEe-HEwbHKW_QiCLLrRGoDUuDhcBuDocstl6suQZPR9IT5P7kyTSjFOzsX8YszIeJy_T4fgLFk5fhl9N6k656EJU Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:54:06.696827 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_177180df8d38453190155d17c8b1c216", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/177180df8d38453190155d17c8b1c216"}]}] Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0581529e855d4362967f5ae3fdcb9001 Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: {"migrate": {}} Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:06.699545 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'migrate' instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 while it is in vm_state suspended Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8', 'body': {'migrate': {}}} Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 in vm_state suspended. Cannot resize while the instance is in this state. Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.700479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 while it is in vm_state suspended Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.701998 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.703408 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:06.703408 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:06.703408 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 while it is in vm_state suspended Nov 03 03:54:06.703408 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.703408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Returning 409 to user: Cannot 'migrate' instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 while it is in vm_state suspended {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:06.703408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd1758d4-432b-47fb-9121-d19175a11e5c tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8/action" status: 409 len: 148 microversion: 2.1 time: 0.089766 Nov 03 03:54:06.703408 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 450/853] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:54:06 2022] POST /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8/action => generated 148 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:06.707687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.709133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.714676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.714676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.714676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.714676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.716022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7ce9044-c348-411d-a373-7096e78a4ee0 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7ce9044-c348-411d-a373-7096e78a4ee0 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Request method failure captured: Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6/action HTTP/1.1 Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 39 Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsrPpTpvtT0ouscU3nyC-_hwQ21QRXVpcdOXxXUnFNMUHlPegQ82c13lpsGeifIsXAtcWAdOMJZINjDQ8H5AvFpEe-HEwbHKW_QiCLLrRGoDUuDhcBuDocstl6suQZPR9IT5P7kyTSjFOzsX8YszIeJy_T4fgLFk5fhl9N6k656EJU Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:54:06.719977 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_177180df8d38453190155d17c8b1c216", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/177180df8d38453190155d17c8b1c216"}]}] Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0581529e855d4362967f5ae3fdcb9001 Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: {"os-resetState": {"state": "invalid"}} Nov 03 03:54:06.721667 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '80f9a4af-f9ed-4f4b-9bca-dd78047a73b6', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'invalid' Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.722520 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:54:06.724072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 03 03:54:06.725436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.725436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7ce9044-c348-411d-a373-7096e78a4ee0 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:06.725436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7ce9044-c348-411d-a373-7096e78a4ee0 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6/action" status: 400 len: 144 microversion: 2.1 time: 0.012218 Nov 03 03:54:06.726447 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 451/854] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:54:06 2022] POST /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6/action => generated 144 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 03 03:54:06.736703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e0f612b-afdd-4a99-a103-4b6bae0bc737 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e0f612b-afdd-4a99-a103-4b6bae0bc737 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Request method failure captured: Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6/action HTTP/1.1 Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 31 Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsrPpTpvtT0ouscU3nyC-_hwQ21QRXVpcdOXxXUnFNMUHlPegQ82c13lpsGeifIsXAtcWAdOMJZINjDQ8H5AvFpEe-HEwbHKW_QiCLLrRGoDUuDhcBuDocstl6suQZPR9IT5P7kyTSjFOzsX8YszIeJy_T4fgLFk5fhl9N6k656EJU Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:54:06.741517 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_177180df8d38453190155d17c8b1c216", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/177180df8d38453190155d17c8b1c216"}]}] Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0581529e855d4362967f5ae3fdcb9001 Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: {"os-resetState": {"state": 1}} Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:06.743254 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '80f9a4af-f9ed-4f4b-9bca-dd78047a73b6', 'body': {'os-resetState': {'state': 1}}} Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 1 Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:06.744182 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 03 03:54:06.745847 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.747232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e0f612b-afdd-4a99-a103-4b6bae0bc737 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:06.747902 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7e0f612b-afdd-4a99-a103-4b6bae0bc737 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6/action" status: 400 len: 120 microversion: 2.1 time: 0.016480 Nov 03 03:54:06.749995 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 452/855] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:54:06 2022] POST /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6/action => generated 120 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:54:06.761909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-769e3a30-39ce-4c34-80f4-311bd20bd8a7 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:06.764460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-769e3a30-39ce-4c34-80f4-311bd20bd8a7 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Failed to fetch instance by id 999 {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 03 03:54:06.765126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-769e3a30-39ce-4c34-80f4-311bd20bd8a7 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-769e3a30-39ce-4c34-80f4-311bd20bd8a7 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Request method failure captured: Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 37 Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzsrPpTpvtT0ouscU3nyC-_hwQ21QRXVpcdOXxXUnFNMUHlPegQ82c13lpsGeifIsXAtcWAdOMJZINjDQ8H5AvFpEe-HEwbHKW_QiCLLrRGoDUuDhcBuDocstl6suQZPR9IT5P7kyTSjFOzsX8YszIeJy_T4fgLFk5fhl9N6k656EJU Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 03:54:06.775000 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_177180df8d38453190155d17c8b1c216", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/177180df8d38453190155d17c8b1c216"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/177180df8d38453190155d17c8b1c216"}]}] Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 177180df8d38453190155d17c8b1c216 Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-274060820 Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0581529e855d4362967f5ae3fdcb9001 Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-274060820-project-admin Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: {"os-resetState": {"state": "error"}} Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:06.776679 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 999 could not be found. Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:06.777607 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 03 03:54:06.779090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:06.780578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-769e3a30-39ce-4c34-80f4-311bd20bd8a7 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:06.781998 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-769e3a30-39ce-4c34-80f4-311bd20bd8a7 tempest-ServersAdminNegativeTestJSON-274060820 tempest-ServersAdminNegativeTestJSON-274060820-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025668 Nov 03 03:54:06.783008 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 453/856] 10.222.0.30 () {60 vars in 1179 bytes} [Thu Nov 3 03:54:06 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:06.792278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:06.793056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:06.801469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.801469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.801469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.801469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:06.801849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:06.802205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:06.830958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:06.983201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:06.993070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-59e55574-162b-4278-8ca1-abd0beea9ba7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1317 microversion: 2.1 time: 0.313601 Nov 03 03:54:06.993663 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 404/857] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:06 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:07.105782 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57b76bfa-40d9-4e6c-a134-a36856c04b92 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 204 len: 0 microversion: 2.1 time: 0.317148 Nov 03 03:54:07.106379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 454/858] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:06 2022] DELETE /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:54:07.115465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:07.116092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:07.123623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.124129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.124577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.125352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.125814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.126812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.188260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:07.189605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:07.199365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.200777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.201454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.205659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.206433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.206951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.327853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:07.336219 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac5fd3ba-e1a8-4aac-ad07-5ddf8315e69f tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1431 microversion: 2.1 time: 0.153980 Nov 03 03:54:07.337358 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 455/859] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:07 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1431 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:07.342158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ba8cd6d9-bc17-48f6-975e-84018aca7817 req-fb047691-5d2a-44ba-aaab-0512c7a0abf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d37b662-d2df-4e08-9286-7985bf484951", "name": "network-vif-deleted", "tag": "fa9e47ab-fb53-402b-a4c9-c2597d798541"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:07.352797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ba8cd6d9-bc17-48f6-975e-84018aca7817 req-fb047691-5d2a-44ba-aaab-0512c7a0abf6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.353315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ba8cd6d9-bc17-48f6-975e-84018aca7817 req-fb047691-5d2a-44ba-aaab-0512c7a0abf6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.353942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ba8cd6d9-bc17-48f6-975e-84018aca7817 req-fb047691-5d2a-44ba-aaab-0512c7a0abf6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.369067 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ba8cd6d9-bc17-48f6-975e-84018aca7817 req-fb047691-5d2a-44ba-aaab-0512c7a0abf6 service nova] Creating event network-vif-deleted:fa9e47ab-fb53-402b-a4c9-c2597d798541 for instance 9d37b662-d2df-4e08-9286-7985bf484951 on n-h1-854653-7 Nov 03 03:54:07.374311 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ba8cd6d9-bc17-48f6-975e-84018aca7817 req-fb047691-5d2a-44ba-aaab-0512c7a0abf6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035582 Nov 03 03:54:07.375238 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 456/860] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:07.396376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:07.397124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:07.403726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.404517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.405149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.406043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.406666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.407832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.450079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:07.457913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fbf2a02a-ba7b-4640-8c48-489e66092c06 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1465 microversion: 2.1 time: 0.346406 Nov 03 03:54:07.458490 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 405/861] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:07 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1465 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:07.553956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:07.561637 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61a6b333-6458-474c-8375-eefb0e46ca1b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.169634 Nov 03 03:54:07.562203 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 457/862] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:07 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:07.623198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:07.623848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:07.629998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.630487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.630924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.631625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.632083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.632513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.678947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:07.679598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:07.686652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.687145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.687595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.688298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:07.689100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:07.690194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:07.732098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:07.743518 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4005ee75-f2cc-44b5-8005-b6dc997936cc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1292 microversion: 2.1 time: 0.123946 Nov 03 03:54:07.749590 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 406/863] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:07 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1292 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:07.909041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:07.919586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-63dda29f-bf40-4785-af3d-70c94413fe3f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.244619 Nov 03 03:54:07.920179 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 458/864] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:07 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:08.015687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:08.016301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:08.026802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.027310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.027752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.028708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.029212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.029650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.177766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:08.186495 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a926539-629e-4cac-8e49-4d79fe626895 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1467 microversion: 2.1 time: 0.174645 Nov 03 03:54:08.187537 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 407/865] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:08 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1467 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:08.211938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:08.212952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:08.219437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.219964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.220433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.221427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.221897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.222423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.359465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:08.360830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:08.367215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.367780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.369595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.373240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.373902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.374501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.401321 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1de9b172-69d9-4255-a791-d9a2663df816 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1618 microversion: 2.1 time: 0.193157 Nov 03 03:54:08.408982 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 459/866] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:08 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1618 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:08.482051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:08.483004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:08.493840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.494921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:08.497806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.500163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.502676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.503344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.503797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.504650 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-343ebbb5-0982-4316-9c57-9f2bfec224d4 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1431 microversion: 2.1 time: 0.149035 Nov 03 03:54:08.508338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 408/867] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:08 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1431 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:08.598350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:08.600410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:08.632011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.635126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.636222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.638520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.639006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.642820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.786130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:08.798752 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-393a044e-0863-4c22-b5cc-18ad3a67f31a tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1465 microversion: 2.1 time: 0.321269 Nov 03 03:54:08.799991 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 460/868] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:08 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1465 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:08.819159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1529053242", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "54bb3703-e5fe-4369-a8d8-c04bd950e0ab"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:08.832006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:08.842283 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c332bf75-cff1-45c5-8131-fef5ca1da87c tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.261794 Nov 03 03:54:08.843704 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 409/869] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:08 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:08.849806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:08.850425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:08.857002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.857714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.858316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.865921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.865921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.865921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:08.897874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:08.968835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:08.976050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8eb0d820-40b0-4fab-8b5a-bee4b3a917a1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1292 microversion: 2.1 time: 0.131185 Nov 03 03:54:08.977005 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 410/870] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:08 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:08.982132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:08.982980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:08.991718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:08.993050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:08.999293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.000416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.001223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.002018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.572293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:09.573051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:09.573811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:09.574473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:09.575082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:09.577088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:09.585346 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16b8388c-4fca-4cd6-9b5d-89b155759d16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.606864 Nov 03 03:54:09.586774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.589241 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 411/871] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:08 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:09.589496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.590433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.591822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.592599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.593237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.596894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:09.602578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:09.612396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.612898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.613371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.614314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.614867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.615229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.656792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:09.666332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.666508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Getting quotas for user 5549f09dcdbe44b0a0d2cfa9c923d8aa and project 357cb1993e9b45d6a7150d5a35a2376a. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:09.667148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.667754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.668373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lazy-loading 'fault' on Instance uuid 9d37b662-d2df-4e08-9286-7985bf484951 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:09.697719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:54:09.707932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:54:09.759999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d3efcb99604673aac5857ce3f98e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5523210923a49b89034225825178521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:09.774909 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abd96742-a346-43aa-9b82-30f2c4ed8790 tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 200 len: 1308 microversion: 2.1 time: 0.184080 Nov 03 03:54:09.782859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 412/872] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:09 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:09.787579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7b611f2d-d5f2-45c3-a6ac-9fcce1052b48 req-5acb198e-70a8-419a-8fee-2346c9926e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75dd9e96-ffb8-4a3d-85bc-93048462e7c3", "tag": "f2c71efc-0782-4dee-95e0-3e193e5222bf"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:09.809288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b611f2d-d5f2-45c3-a6ac-9fcce1052b48 req-5acb198e-70a8-419a-8fee-2346c9926e2d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.810075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b611f2d-d5f2-45c3-a6ac-9fcce1052b48 req-5acb198e-70a8-419a-8fee-2346c9926e2d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.810706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b611f2d-d5f2-45c3-a6ac-9fcce1052b48 req-5acb198e-70a8-419a-8fee-2346c9926e2d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.828952 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7b611f2d-d5f2-45c3-a6ac-9fcce1052b48 req-5acb198e-70a8-419a-8fee-2346c9926e2d service nova] Creating event network-changed:f2c71efc-0782-4dee-95e0-3e193e5222bf for instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 on n-h2-854653-7 Nov 03 03:54:09.836770 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7b611f2d-d5f2-45c3-a6ac-9fcce1052b48 req-5acb198e-70a8-419a-8fee-2346c9926e2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052761 Nov 03 03:54:09.837695 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 413/873] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:09.856313 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac5bcdf4-d10f-49d7-94f6-f24b9f11c547 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053691 Nov 03 03:54:09.858312 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 461/874] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:54:09.870509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:09.871548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:09.884108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.885275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.886136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:09.887445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:09.888295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:09.888904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.143773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:10.149981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:10.154660 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee365772-1699-4e61-b2d5-f84ff7ad181e tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1465 microversion: 2.1 time: 0.294872 Nov 03 03:54:10.155846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7e94431-7750-4dfc-9658-3435c9fc0be0 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1191360180", "id": 2087461487, "os-flavor-access:is_public": "True"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:10.185350 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 462/875] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:09 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1465 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:10.194562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:10.195202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:10.213845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.214369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.214822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.215542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.216008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.216442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.268482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:10.280145 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7e94431-7750-4dfc-9658-3435c9fc0be0 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.440627 Nov 03 03:54:10.281069 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 414/876] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 03:54:09 2022] POST /compute/v2.1/flavors => generated 471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:54:10.286954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07cbecc2-c071-4ce2-9f49-c1f9cc5f0936 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:10.287834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07cbecc2-c071-4ce2-9f49-c1f9cc5f0936 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:10.388551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07cbecc2-c071-4ce2-9f49-c1f9cc5f0936 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:10.396717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=27 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:10.398826 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07cbecc2-c071-4ce2-9f49-c1f9cc5f0936 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1217 microversion: 2.1 time: 0.116532 Nov 03 03:54:10.399914 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 415/877] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:10 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:10.405168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:10.406000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:10.416480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.417278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.423777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.424831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.425547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.426080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.463742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:10.474051 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e1109bd-5327-4309-8841-121e7cf87c90 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.286638 Nov 03 03:54:10.476148 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 463/878] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:10 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:10.500259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-67342227-809a-49af-91ff-163dc42c3723 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:10.603063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:10.612724 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-985ff87d-83d6-408b-9cf1-d1382ceb3b44 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.211541 Nov 03 03:54:10.625153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 416/879] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:10 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:10.625153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6b596624-edba-484d-a502-a1498f10d570 req-9ed379af-9538-4cdc-b51f-ae222d649ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8", "name": "network-vif-deleted", "tag": "65bafe43-c6c3-4f47-b466-9725fb6e19e4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:10.628651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b596624-edba-484d-a502-a1498f10d570 req-9ed379af-9538-4cdc-b51f-ae222d649ae9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.629270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b596624-edba-484d-a502-a1498f10d570 req-9ed379af-9538-4cdc-b51f-ae222d649ae9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.629802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b596624-edba-484d-a502-a1498f10d570 req-9ed379af-9538-4cdc-b51f-ae222d649ae9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.642475 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6b596624-edba-484d-a502-a1498f10d570 req-9ed379af-9538-4cdc-b51f-ae222d649ae9 service nova] Creating event network-vif-deleted:65bafe43-c6c3-4f47-b466-9725fb6e19e4 for instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 on n-h1-854653-7 Nov 03 03:54:10.648089 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6b596624-edba-484d-a502-a1498f10d570 req-9ed379af-9538-4cdc-b51f-ae222d649ae9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033050 Nov 03 03:54:10.652265 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 417/880] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:10.658145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:10.658964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:10.665615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.667473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.667473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.667473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.668185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.668704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.778265 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-67342227-809a-49af-91ff-163dc42c3723 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors/2087461487/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.291102 Nov 03 03:54:10.778877 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 464/881] 10.222.0.30 () {62 vars in 1265 bytes} [Thu Nov 3 03:54:10 2022] POST /compute/v2.1/flavors/2087461487/os-extra_specs => generated 62 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:10.791337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe4cb913-b766-4a2f-9d84-c01b8d048b58 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:10.803401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:10.843589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:10.852877 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d9e8694-f675-48fa-9f50-edd45d98d5e7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.199141 Nov 03 03:54:10.853522 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 418/882] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:10 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:10.858941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:10.861758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] [instance: 9d37b662-d2df-4e08-9286-7985bf484951] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:10.866438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.867152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.867597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.868764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:10.869388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:10.869827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:10.880318 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe4cb913-b766-4a2f-9d84-c01b8d048b58 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/2087461487" status: 202 len: 0 microversion: 2.86 time: 0.093359 Nov 03 03:54:10.881063 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 465/883] 10.222.0.30 () {60 vars in 1202 bytes} [Thu Nov 3 03:54:10 2022] DELETE /compute/v2.1/flavors/2087461487 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:54:10.887020 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] HTTP exception thrown: Instance 9d37b662-d2df-4e08-9286-7985bf484951 could not be found. Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Request method failure captured: Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 HTTP/1.1 Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzsRo92oMFKQ3p9WrAzaDHJtn1CRUSEXNP_zVRPFuRSqTGydNm42zEnJ2kICrIHJ_p9eOUrc0yfxO7IGQpoBZe_9qjezlyX9Oyeq1v47tfu9yXr_UxGtYOwST0H9CLQTMG6n6z8lXjYsDv4-5TmudwmLXyg9oGNCInzzXAhkbDpuN6E Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a5523210923a49b89034225825178521 Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveMigrationNegativeTest-1294060845 Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:10.888764 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a5523210923a49b89034225825178521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a5523210923a49b89034225825178521", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a5523210923a49b89034225825178521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a5523210923a49b89034225825178521"}]}] Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveMigrationNegativeTest-1294060845 Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a5523210923a49b89034225825178521 Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1294060845 Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveMigrationNegativeTest-1294060845-project Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d9d3efcb99604673aac5857ce3f98e51 Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveMigrationNegativeTest-1294060845-project Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 9d37b662-d2df-4e08-9286-7985bf484951 could not be found. Nov 03 03:54:10.891483 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '9d37b662-d2df-4e08-9286-7985bf484951'} Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d37b662-d2df-4e08-9286-7985bf484951 could not be found. Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:10.892255 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d37b662-d2df-4e08-9286-7985bf484951 could not be found. Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d37b662-d2df-4e08-9286-7985bf484951 could not be found. Nov 03 03:54:10.896767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:10.897910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] Returning 404 to user: Instance 9d37b662-d2df-4e08-9286-7985bf484951 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:10.897910 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b2d71f3-902b-49e7-a438-c9d170187b3c tempest-LiveMigrationNegativeTest-1294060845 tempest-LiveMigrationNegativeTest-1294060845-project] 10.222.0.30 "GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951" status: 404 len: 111 microversion: 2.1 time: 0.035695 Nov 03 03:54:10.897910 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 419/884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:10 2022] GET /compute/v2.1/servers/9d37b662-d2df-4e08-9286-7985bf484951 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:10.901948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2f8a710-27e3-4e0b-9483-231c5044daf2 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:10.927768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2f8a710-27e3-4e0b-9483-231c5044daf2 tempest-FlavorMetadataValidation-1755052653 tempest-FlavorMetadataValidation-1755052653-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.034472 Nov 03 03:54:10.928359 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 466/885] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:54:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:54:11.179833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:11.180458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:11.197662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.198366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.198811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.199726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.200183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.200612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.205388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:11.235967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.236769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.237463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.238166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lazy-loading 'fault' on Instance uuid 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:11.426046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:11.426952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:11.441183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.441689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.442136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.443534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.444066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.444505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.569706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:11.581473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8dbdc491-0b42-4f97-b368-34b5994c8641 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 200 len: 1309 microversion: 2.1 time: 0.406783 Nov 03 03:54:11.582381 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 420/886] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:11 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 1309 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:11.587762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:11.588828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:11.598090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:11.603520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.615624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.615624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.615784 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-69e6a9d0-d702-499a-a72e-bcb84b43c5ad tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1221 microversion: 2.1 time: 0.185238 Nov 03 03:54:11.615784 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 467/887] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:11 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:11.615944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.615944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.615944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.616167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2607d21d-22f0-4b6a-a487-02dd09e1faff req-08335535-c7ce-45be-ab7e-3cd8d9793d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6e84a-57a6-4788-9864-9263e9f2e08d", "name": "network-vif-plugged", "status": "completed", "tag": "78c74cd3-8416-43d4-86d6-a1a41c25566e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:11.621784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2607d21d-22f0-4b6a-a487-02dd09e1faff req-08335535-c7ce-45be-ab7e-3cd8d9793d89 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.622512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2607d21d-22f0-4b6a-a487-02dd09e1faff req-08335535-c7ce-45be-ab7e-3cd8d9793d89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.623153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2607d21d-22f0-4b6a-a487-02dd09e1faff req-08335535-c7ce-45be-ab7e-3cd8d9793d89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.636514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2607d21d-22f0-4b6a-a487-02dd09e1faff req-08335535-c7ce-45be-ab7e-3cd8d9793d89 service nova] Creating event network-vif-plugged:78c74cd3-8416-43d4-86d6-a1a41c25566e for instance 05a6e84a-57a6-4788-9864-9263e9f2e08d on n-h2-854653-7 Nov 03 03:54:11.642501 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2607d21d-22f0-4b6a-a487-02dd09e1faff req-08335535-c7ce-45be-ab7e-3cd8d9793d89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033182 Nov 03 03:54:11.643442 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 468/888] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:11.660273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:11.661406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:11.669574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.671027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.671813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.673123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.673826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.674798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.809221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:11.816751 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1e03bad-0b2c-454f-b760-f7364160cea4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.233078 Nov 03 03:54:11.830138 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 421/889] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:11 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:11.875307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f4452098-1672-4087-b7f2-01fbe6b64181 req-a9f4658e-6ccb-4fb7-9fc2-7f35c1a7a2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ddb0bd-101b-4c9e-92fa-76855b9e6ec9", "tag": "1b137398-13a0-4268-8495-d732181a2eb9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:11.878171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:11.886573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f4452098-1672-4087-b7f2-01fbe6b64181 req-a9f4658e-6ccb-4fb7-9fc2-7f35c1a7a2d0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.887132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f4452098-1672-4087-b7f2-01fbe6b64181 req-a9f4658e-6ccb-4fb7-9fc2-7f35c1a7a2d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.887611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f4452098-1672-4087-b7f2-01fbe6b64181 req-a9f4658e-6ccb-4fb7-9fc2-7f35c1a7a2d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.902468 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f4452098-1672-4087-b7f2-01fbe6b64181 req-a9f4658e-6ccb-4fb7-9fc2-7f35c1a7a2d0 service nova] Creating event network-changed:1b137398-13a0-4268-8495-d732181a2eb9 for instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 on n-h2-854653-7 Nov 03 03:54:11.918481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:11.918923 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f4452098-1672-4087-b7f2-01fbe6b64181 req-a9f4658e-6ccb-4fb7-9fc2-7f35c1a7a2d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055343 Nov 03 03:54:11.924492 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 422/890] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:11.925468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:11.926018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:11.928358 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0b72eb1f-1dff-4d59-afdf-3badf08e1ec6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.283668 Nov 03 03:54:11.938837 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 469/891] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:11 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:11.943544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.944290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.944802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:11.945596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:11.946118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:11.946658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.142577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:12.154811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1fbadc73-13c3-4f9b-811b-91c6532274d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.234115 Nov 03 03:54:12.155433 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 423/892] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:11 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:12.620175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:12.621792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:12.632160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:12.632839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:12.634434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.635242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.635934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.637156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.639059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.640380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.659891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.660194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.660653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.664024 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] HTTP exception thrown: Instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 could not be found. Nov 03 03:54:12.665258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.670062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.670062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Request method failure captured: Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 HTTP/1.1 Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzspGl_BopVIWUF9KpSeLmuj4UPeV7001WQrkonLXpRa_jI8e04750PDrh1ZW0fxbcTW7O2tf_wmDNA_ZlDPvMMA-iVVtRYU6HUZHZSZWs6OIib8BTyV1vOS7AFiAdZyCgFldYSS7Xv2-wcqxsSIwrDXlbdTiYa-hVrBSYy8-843uTs Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 823aa65f33fb44f2b70a9c6c5342cd76 Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-174278852 Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:12.670395 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/823aa65f33fb44f2b70a9c6c5342cd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_823aa65f33fb44f2b70a9c6c5342cd76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/823aa65f33fb44f2b70a9c6c5342cd76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/823aa65f33fb44f2b70a9c6c5342cd76"}]}] Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-174278852 Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 823aa65f33fb44f2b70a9c6c5342cd76 Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-174278852 Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-174278852-project Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: dcb2b44cf2e44553ae1e83b97cabc1b2 Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-174278852-project Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 could not be found. Nov 03 03:54:12.671819 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8'} Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 could not be found. Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:12.673833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 could not be found. Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 could not be found. Nov 03 03:54:12.678049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:12.681078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Returning 404 to user: Instance 4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:12.681078 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9c697b4-9427-41e4-b28c-8cf9b48e98ef tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8" status: 404 len: 111 microversion: 2.1 time: 0.060767 Nov 03 03:54:12.681078 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 470/893] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:12 2022] GET /compute/v2.1/servers/4b5ae8b3-4f65-4ed4-89a3-dc3821b55be8 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:12.688480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:12.689246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:12.695444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.695942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.696389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.697139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.697611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.698049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.729125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:12.751589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:12.759909 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eb6ffc68-bd3b-453e-8614-1c14ea37832e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1213 microversion: 2.1 time: 0.131989 Nov 03 03:54:12.775496 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 424/894] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:12 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1213 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:12.840970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:12.841616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:12.848096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.848583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.849047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:12.849743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:12.850199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:12.850630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.002366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:13.012398 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-574eb98b-a76f-4ec9-9c19-1bdb97f7a3f4 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.175296 Nov 03 03:54:13.025048 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 425/895] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:12 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:13.025048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:13.025048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:13.031256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.032056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.033285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.034065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.034581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.035021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.060532 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5951eb09-0655-4a1a-9458-b3c89e942ff2 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 204 len: 0 microversion: 2.1 time: 0.375103 Nov 03 03:54:13.062353 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 471/896] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:12 2022] DELETE /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:13.071149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:13.071866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:13.092018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.092519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.092965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.093710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.094172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.095183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.291465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:13.300913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48c3fd8f-047d-4d52-919f-2d9913c44680 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.285976 Nov 03 03:54:13.305948 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 426/897] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:13 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:13.307101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:13.313328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:13.313950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:13.320159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.320700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.321239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.322122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.322582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.323244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.323717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-180f4700-29d5-4e74-82d6-3833ca70464f tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1476 microversion: 2.1 time: 0.257098 Nov 03 03:54:13.324541 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 472/898] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:13 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:13.459946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:13.469332 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac7896ab-0b0c-4ef6-809a-6a3897b93c1a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.166302 Nov 03 03:54:13.470341 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 427/899] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:13 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:13.784758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:13.785404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:13.792129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.792613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.793072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.793771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:13.794223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:13.794648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:13.862295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:13.870012 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23489d29-a319-46ff-bf1c-9f313e7896b3 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1269 microversion: 2.1 time: 0.089920 Nov 03 03:54:13.870565 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 473/900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:13 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:14.040005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:14.040628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:14.047136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.048158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.048607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.049343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.049806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.058355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.189231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:14.197556 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d9d383f-4aa8-4402-a9ae-ff53339d64c1 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.161308 Nov 03 03:54:14.198142 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 428/901] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:14 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:14.323976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:14.324515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:14.330353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.330841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.331283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.331979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.332434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.332860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.351902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:14.352534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:14.358611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.359101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.359544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.361290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.361750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.367248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.545106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:14.552953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:14.554684 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70705cd7-cb3e-4cf8-b751-2d606f9241a8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.234520 Nov 03 03:54:14.556998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 474/902] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:14 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:14.562997 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8cafdbcc-767f-4108-9e33-79633c67f629 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1476 microversion: 2.1 time: 0.215880 Nov 03 03:54:14.564142 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 429/903] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:14 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:14.564781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:14.565432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:14.574950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.575378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.575812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.576515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.576968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.577417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.722237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:14.730835 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e5fc2b11-c6f6-458e-904b-adba3469a140 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1312 microversion: 2.1 time: 0.169809 Nov 03 03:54:14.745651 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 475/904] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:14 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:14.897102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:14.898541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:14.912214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.913176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.913966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.914982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:14.915652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:14.916323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:14.990463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:14.998832 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-00ad5a41-96b6-4569-ad48-d6fd6f1fbfc6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1269 microversion: 2.1 time: 0.109202 Nov 03 03:54:15.000190 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 430/905] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:14 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1269 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:15.219901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:15.220513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:15.244911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:15.245495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:15.249369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:15.249369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:15.250343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:15.253620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:15.491109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:15.508014 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-59d6152d-0347-45dc-9c1b-be9804abc25b tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.288080 Nov 03 03:54:15.508649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 476/906] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:15 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:15.580117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:15.580726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:15.587049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:15.587736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:15.599049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:15.601080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:15.601608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:15.602103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:15.602826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:15.603275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:15.603692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:15.604227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:15.604782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:15.605710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:15.607930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:15.608545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:15.965839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:15.991127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:15.994688 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-021fa227-da1d-4f20-8eff-119fa7bd0294 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.415509 Nov 03 03:54:16.014033 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 431/907] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:15 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:16.014232 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19a962bd-bd24-467a-8c7c-7fc998df7915 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1476 microversion: 2.1 time: 0.421807 Nov 03 03:54:16.014232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 477/908] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:15 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1476 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:16.014232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7f3a5202-2f0b-4111-ad72-b6924c550788 req-58698beb-6391-4d17-b3ed-0ba56e5b125a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f9a4af-f9ed-4f4b-9bca-dd78047a73b6", "name": "network-vif-deleted", "tag": "a1012c07-a912-4c33-84aa-608dd2cc4371"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:16.024652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.028786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:16.042018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7f3a5202-2f0b-4111-ad72-b6924c550788 req-58698beb-6391-4d17-b3ed-0ba56e5b125a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.044564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7f3a5202-2f0b-4111-ad72-b6924c550788 req-58698beb-6391-4d17-b3ed-0ba56e5b125a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.045283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7f3a5202-2f0b-4111-ad72-b6924c550788 req-58698beb-6391-4d17-b3ed-0ba56e5b125a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.052114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.052493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.052958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.053725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.056500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.057083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.080050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7f3a5202-2f0b-4111-ad72-b6924c550788 req-58698beb-6391-4d17-b3ed-0ba56e5b125a service nova] Creating event network-vif-deleted:a1012c07-a912-4c33-84aa-608dd2cc4371 for instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 on n-h2-854653-7 Nov 03 03:54:16.085493 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7f3a5202-2f0b-4111-ad72-b6924c550788 req-58698beb-6391-4d17-b3ed-0ba56e5b125a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078627 Nov 03 03:54:16.086690 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 478/909] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:16.092724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.094146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:16.102830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.103563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.104483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.105472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.106988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.107658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.243520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:16.256586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d5388f9-2234-4c60-9b7d-f1219be1b5b0 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1277 microversion: 2.1 time: 0.163555 Nov 03 03:54:16.260275 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 479/910] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:16 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:16.382120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:16.393842 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f1a70bd-d87c-4dd5-8e89-3e971e4e6dde tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1461 microversion: 2.1 time: 0.393521 Nov 03 03:54:16.394770 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 432/911] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:15 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1461 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:16.527244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Calling method '.version_select at 0x7ff7f97aeb80>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.529131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.529947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.530391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.545156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.545334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-54ae7223-2ce6-4674-af72-baabebec87d2 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Calling method '.version_select at 0x7ff7f971dee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.545698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.546141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.557244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.557865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.558370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.565633 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1403953c-f931-4c51-82d0-77bf7b6b7c67 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.304241 Nov 03 03:54:16.572025 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 480/912] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:54:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:16.572025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:16.573890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:16.580743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.582058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.582546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.583533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.583991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.584418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.630772 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-54ae7223-2ce6-4674-af72-baabebec87d2 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1" status: 200 len: 371 microversion: 2.1 time: 0.234900 Nov 03 03:54:16.631500 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 433/913] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 03:54:16 2022] GET /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1 => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:16.636182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.637033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:16.645207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.645922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.646597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.647469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.648103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.651692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.675724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:16.681649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Old instance type m1.heat2, new instance type m1.heat {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 03:54:16.689224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:16.689643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:16.690116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:16.690530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:16.690935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:16.779851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:16.801721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:16.809827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28184268-c6e3-47b3-ab61-4d15482bfbad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.177157 Nov 03 03:54:16.810685 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 434/914] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:16 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:16.815999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Calling method '.version_select at 0x7ff7faef4160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.817750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.818390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.819020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.832221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.832708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.833224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.872434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.872931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.873410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.880049 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6143d9c9-899b-44cd-a522-9b07661c49d1 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h2-854653-7/servers" status: 200 len: 907 microversion: 2.1 time: 0.068194 Nov 03 03:54:16.880619 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 435/915] 10.222.0.30 () {58 vars in 1212 bytes} [Thu Nov 3 03:54:16 2022] GET /compute/v2.1/os-hypervisors/n-h2-854653-7/servers => generated 907 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:16.885062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f971d310>, body: {"quota_set": {"ram": "5120"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:16.924582 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8532f2d9-9bdf-49bc-bb72-25431b68cecb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d/action" status: 202 len: 0 microversion: 2.1 time: 0.356799 Nov 03 03:54:16.928692 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 481/916] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:54:16 2022] POST /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:54:16.933510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Calling method '.version_select at 0x7ff7f9e27700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.937296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.937296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.937600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.953565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.954117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.954646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.963685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.964176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.964486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.964619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.964962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.965396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.965507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.965859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.966291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.971128 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7a2cc77f-a3bb-4170-aaf2-9f91b7a5ae84 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041494 Nov 03 03:54:16.971715 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 482/917] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:54:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:16.976470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:16.977488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:16.983375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.983857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.984294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:16.985800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:16.986274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:16.986692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.127285 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8f455c4-cd0d-4d0b-a069-9caa1d8d79b4 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1" status: 200 len: 328 microversion: 2.1 time: 0.245497 Nov 03 03:54:17.128107 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 436/918] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:16 2022] PUT /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1 => generated 328 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:17.137466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Calling method '.version_select at 0x7ff7f98f7af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:17.140632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.141583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.142190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.158530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.159830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.160540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.170899 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad732e01-e2e7-490f-8cab-457ba148cb24 tempest-HypervisorAdminUnderV252Test-1799326162 tempest-HypervisorAdminUnderV252Test-1799326162-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/n-h2-854653-7/search" status: 200 len: 104 microversion: 2.1 time: 0.039989 Nov 03 03:54:17.202184 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 437/919] 10.222.0.30 () {58 vars in 1209 bytes} [Thu Nov 3 03:54:17 2022] GET /compute/v2.1/os-hypervisors/n-h2-854653-7/search => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:17.202184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:17.202184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:17.202616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:17.204515 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de24cacf-781b-4d35-9810-de41d8c4b12e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1470 microversion: 2.1 time: 0.231415 Nov 03 03:54:17.206259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.207123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.207812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.208770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.209523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.210534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.218985 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 483/920] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:16 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:17.229641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:17.230626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:17.240559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.241448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.242170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.242965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.243503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.246284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.290863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.291487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.292026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.292588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lazy-loading 'fault' on Instance uuid 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:17.365219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:17.375928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b960eb0-e376-4bea-8ed9-86ed53fef0ee tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1311 microversion: 2.1 time: 0.155015 Nov 03 03:54:17.377341 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 484/921] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:17 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:17.388140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41baff58-3069-4d09-bc4c-442fef10dc28 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:17.447274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:17.459957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:17.469928 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-098531a0-2e6a-4599-ab90-6de8578e8637 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.295091 Nov 03 03:54:17.470526 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 438/922] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:17 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:17.475639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:17.478846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:17.484280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.486008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.486695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.487644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.488362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.489229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.492854 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41baff58-3069-4d09-bc4c-442fef10dc28 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1" status: 202 len: 0 microversion: 2.1 time: 0.112881 Nov 03 03:54:17.493535 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 485/923] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 03:54:17 2022] DELETE /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:54:17.504770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52e4476b-2764-419d-873d-acb0e5729d0c tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Calling method '.version_select at 0x7ff7f9bde4c0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:17.661262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=27 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:17.681313 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52e4476b-2764-419d-873d-acb0e5729d0c tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1" status: 200 len: 371 microversion: 2.1 time: 0.179699 Nov 03 03:54:17.681313 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 486/924] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 03:54:17 2022] GET /compute/v2.1/os-quota-sets/e20ef2688d52444f8867db3525ae47a1 => generated 371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:17.709443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:17.726009 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82509c62-2327-447f-8776-3873c2281b5b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.254069 Nov 03 03:54:17.726601 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 439/925] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:17 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:17.834579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:17.835205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:17.842037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.843005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.843931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:17.845601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:17.846338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:17.846991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.057909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-503b1688-2488-4909-9c2d-75aba156893d req-2856e7e0-5196-4361-a92d-2c5b7819aa66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd9e96-ffb8-4a3d-85bc-93048462e7c3", "name": "network-vif-plugged", "status": "completed", "tag": "f2c71efc-0782-4dee-95e0-3e193e5222bf"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:18.076801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-503b1688-2488-4909-9c2d-75aba156893d req-2856e7e0-5196-4361-a92d-2c5b7819aa66 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.080203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-503b1688-2488-4909-9c2d-75aba156893d req-2856e7e0-5196-4361-a92d-2c5b7819aa66 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.084628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-503b1688-2488-4909-9c2d-75aba156893d req-2856e7e0-5196-4361-a92d-2c5b7819aa66 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.119882 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-503b1688-2488-4909-9c2d-75aba156893d req-2856e7e0-5196-4361-a92d-2c5b7819aa66 service nova] Creating event network-vif-plugged:f2c71efc-0782-4dee-95e0-3e193e5222bf for instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 on n-h2-854653-7 Nov 03 03:54:18.147165 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-503b1688-2488-4909-9c2d-75aba156893d req-2856e7e0-5196-4361-a92d-2c5b7819aa66 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092828 Nov 03 03:54:18.147864 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 440/926] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:18.157299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7105c8d4-66d4-41f7-a15c-79c7a471b243 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Calling method '.version_select at 0x7ff7f962d040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:18.202539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:18.216584 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ab00ec28-5048-4252-9afa-916c878532f3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.386258 Nov 03 03:54:18.217197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 487/927] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:17 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:18.232329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:18.235815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:18.255445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.258033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.258857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.262833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.265476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.266199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.567725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:18.577346 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24b1e074-7881-48f2-a323-5313c4f622e8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1470 microversion: 2.1 time: 0.348848 Nov 03 03:54:18.579099 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 488/928] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:18 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:18.584578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:18.585544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:18.599445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.599947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.600389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.605205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.605769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.606227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.656519 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7105c8d4-66d4-41f7-a15c-79c7a471b243 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.506760 Nov 03 03:54:18.658133 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 441/929] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 03:54:18 2022] GET /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc/defaults => generated 371 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:18.671898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:18.672792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:18.693776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.694482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.695097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.695983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.697756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.698231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.706867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.707844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.707844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.708242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lazy-loading 'fault' on Instance uuid 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:18.784916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcb2b44cf2e44553ae1e83b97cabc1b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '823aa65f33fb44f2b70a9c6c5342cd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:18.806349 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e5b1e106-e2ac-41ec-b889-621fcb6549f4 tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 200 len: 1311 microversion: 2.1 time: 0.225904 Nov 03 03:54:18.807259 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 489/930] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:18 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 1311 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:18.830089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:18.830089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:18.831118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.831623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.832068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:18.832784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:18.833275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:18.833705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.003526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:19.019092 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fad622fe-0c0b-4281-b3b0-291b9b0fe8bd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.356946 Nov 03 03:54:19.019867 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 442/931] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:18 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:19.025182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8e33c8d0-085f-4bb7-ba68-efefa6b866e9 req-303e4975-84e6-4e22-952e-f42a28ebcdbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d", "tag": "63707c83-0f80-4bc8-868c-0a91a8f0ace2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:19.036573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e33c8d0-085f-4bb7-ba68-efefa6b866e9 req-303e4975-84e6-4e22-952e-f42a28ebcdbd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.036573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e33c8d0-085f-4bb7-ba68-efefa6b866e9 req-303e4975-84e6-4e22-952e-f42a28ebcdbd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.036861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e33c8d0-085f-4bb7-ba68-efefa6b866e9 req-303e4975-84e6-4e22-952e-f42a28ebcdbd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.037362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:19.048418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52a97c04-4b50-4ca8-a4db-457389d919d7 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.240045 Nov 03 03:54:19.049192 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 490/932] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:18 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:19.051309 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8e33c8d0-085f-4bb7-ba68-efefa6b866e9 req-303e4975-84e6-4e22-952e-f42a28ebcdbd service nova] Creating event network-changed:63707c83-0f80-4bc8-868c-0a91a8f0ace2 for instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d on n-h2-854653-7 Nov 03 03:54:19.066031 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8e33c8d0-085f-4bb7-ba68-efefa6b866e9 req-303e4975-84e6-4e22-952e-f42a28ebcdbd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043609 Nov 03 03:54:19.073692 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 443/933] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:19.097833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9573040>, body: {"quota_set": {"ram": "5120"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:19.240269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:19.241846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:19.251395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.252076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.252710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.253455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.254069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.254664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.262159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.262727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.263175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.263973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.264460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.264936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.282322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=7 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:19.417139 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-155c4e74-7fe1-42f5-adaa-17fa764114fe tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54" status: 200 len: 328 microversion: 2.1 time: 0.324764 Nov 03 03:54:19.419807 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 491/934] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:19 2022] PUT /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54 => generated 328 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:19.432853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Calling method '.version_select at 0x7ff7f943caf0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:19.435911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:19.444951 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9c105901-3252-49e8-a0b0-f999bcd918fc tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1403 microversion: 2.1 time: 0.208683 Nov 03 03:54:19.445664 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 444/935] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:19 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1403 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:19.540405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.541194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.541787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.542941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.543631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.544269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.570890 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ab08508-3da4-4095-b8ea-e69f6fea5e32 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54/detail" status: 200 len: 916 microversion: 2.1 time: 0.141753 Nov 03 03:54:19.571528 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 492/936] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:54:19 2022] GET /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54/detail => generated 916 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:19.601368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:19.602105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:19.611952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.612546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.616333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.616333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.616333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.616333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.794273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:19.805937 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1e1a4fa-e1ba-4568-ac73-c131b549300c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1470 microversion: 2.1 time: 0.207744 Nov 03 03:54:19.822563 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 445/937] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:19 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1470 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:19.833493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:19.834153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] [instance: 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:19.850975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.851509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.851954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.852673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:19.853177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:19.853606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:19.878581 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] HTTP exception thrown: Instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 could not be found. Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Request method failure captured: Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 HTTP/1.1 Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzspGl_BopVIWUF9KpSeLmuj4UPeV7001WQrkonLXpRa_jI8e04750PDrh1ZW0fxbcTW7O2tf_wmDNA_ZlDPvMMA-iVVtRYU6HUZHZSZWs6OIib8BTyV1vOS7AFiAdZyCgFldYSS7Xv2-wcqxsSIwrDXlbdTiYa-hVrBSYy8-843uTs Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 823aa65f33fb44f2b70a9c6c5342cd76 Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-174278852 Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:19.880320 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/823aa65f33fb44f2b70a9c6c5342cd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_823aa65f33fb44f2b70a9c6c5342cd76", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/823aa65f33fb44f2b70a9c6c5342cd76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/823aa65f33fb44f2b70a9c6c5342cd76"}]}] Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-174278852 Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 823aa65f33fb44f2b70a9c6c5342cd76 Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-174278852 Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-174278852-project Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: dcb2b44cf2e44553ae1e83b97cabc1b2 Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-174278852-project Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 could not be found. Nov 03 03:54:19.881776 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '80f9a4af-f9ed-4f4b-9bca-dd78047a73b6'} Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 could not be found. Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:19.882587 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 could not be found. Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 could not be found. Nov 03 03:54:19.883881 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:19.885113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] Returning 404 to user: Instance 80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:19.885113 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f206f3fe-2f60-4988-b42d-f8239e6c1fde tempest-ServersAdminNegativeTestJSON-174278852 tempest-ServersAdminNegativeTestJSON-174278852-project] 10.222.0.30 "GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6" status: 404 len: 111 microversion: 2.1 time: 0.053046 Nov 03 03:54:19.885293 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 493/938] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:19 2022] GET /compute/v2.1/servers/80f9a4af-f9ed-4f4b-9bca-dd78047a73b6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:20.053921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:20.055986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:20.067179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.068111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.068765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.070053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.070853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.071438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.075032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:20.075873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:20.078972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:20.082634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.083302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.083932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.084659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.085151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.085580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.285538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:20.299963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:20.300144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b6f5a8a2-7e6c-4e1a-b152-08f18bc41c61 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.254464 Nov 03 03:54:20.310345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 446/939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:20 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:20.316266 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2b9974a-2eeb-4888-afb3-4c2f04a3016c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.245611 Nov 03 03:54:20.317103 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 494/940] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:20 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:20.403491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f98eed30>, body: {"quota_set": {"ram": "2048"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:20.476046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:20.476953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:20.484059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.484559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.491303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.492052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.492555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.493001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.663836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.664357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.664805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.665582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.666048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.666480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.667068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:20.676016 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-02780d08-7179-4ccb-8dbd-a669d0ba7fad tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1589 microversion: 2.1 time: 0.204133 Nov 03 03:54:20.676829 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 495/941] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:20 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1589 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:20.701421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.701906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.704164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.704164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.704164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.704608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.705358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:20.706055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:20.720261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.722868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.723472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.724114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.724585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.725466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.745777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:20.871845 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75060b57-5c22-4dc4-b7b5-ddbfcfb39b93 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54?user_id=d913550c870b43b8880714107688eaf1" status: 200 len: 328 microversion: 2.1 time: 0.472567 Nov 03 03:54:20.872488 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 447/942] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 03:54:20 2022] PUT /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54?user_id=d913550c870b43b8880714107688eaf1 => generated 328 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:20.875324 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac937c8c-9357-400c-965f-7245fa17e8ba tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179973 Nov 03 03:54:20.876054 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 496/943] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 03:54:20 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:20.884188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:20.884533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f4df54de-ff06-4a8b-b5db-2e48eb2849fc tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Calling method '.version_select at 0x7ff7f9899a60>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:20.884950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:20.892369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.893089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.893831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:20.894689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:20.896068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:20.896654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:21.075574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:21.085639 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cf9f431-16fa-4cc2-9861-a49b4bade3f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1470 microversion: 2.1 time: 0.211449 Nov 03 03:54:21.087247 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 448/944] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:20 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:21.149151 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f4df54de-ff06-4a8b-b5db-2e48eb2849fc tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54?user_id=d913550c870b43b8880714107688eaf1" status: 200 len: 370 microversion: 2.1 time: 0.268786 Nov 03 03:54:21.162452 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 497/945] 10.222.0.30 () {58 vars in 1323 bytes} [Thu Nov 3 03:54:20 2022] GET /compute/v2.1/os-quota-sets/5d313458a35c492fafbaf7bfc06ebf54?user_id=d913550c870b43b8880714107688eaf1 => generated 370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:21.323994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:21.324948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:21.332465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:21.332968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:21.333480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:21.334491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:21.335106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:21.335778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:21.346761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:21.347906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:21.360486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:21.361411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:21.362542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:21.363816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:21.364593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:21.365665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:21.586894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:21.602441 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad485ad9-8f5f-486c-bf65-a2d32383255e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.282892 Nov 03 03:54:21.624786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 449/946] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:21 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:21.630272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-950da259-8d82-4e09-b7fb-d6eacf673130 req-2ab9b798-a72c-41ed-91cf-7008ad892a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ddb0bd-101b-4c9e-92fa-76855b9e6ec9", "name": "network-vif-plugged", "status": "completed", "tag": "1b137398-13a0-4268-8495-d732181a2eb9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:21.652794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-950da259-8d82-4e09-b7fb-d6eacf673130 req-2ab9b798-a72c-41ed-91cf-7008ad892a48 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:21.652794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-950da259-8d82-4e09-b7fb-d6eacf673130 req-2ab9b798-a72c-41ed-91cf-7008ad892a48 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:21.653550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-950da259-8d82-4e09-b7fb-d6eacf673130 req-2ab9b798-a72c-41ed-91cf-7008ad892a48 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:21.671731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:21.680646 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-950da259-8d82-4e09-b7fb-d6eacf673130 req-2ab9b798-a72c-41ed-91cf-7008ad892a48 service nova] Creating event network-vif-plugged:1b137398-13a0-4268-8495-d732181a2eb9 for instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 on n-h2-854653-7 Nov 03 03:54:21.682411 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-acf1809f-d8c7-47f5-aeab-bd0a145b37dd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.343097 Nov 03 03:54:21.683846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 498/947] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:21 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:21.694993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-950da259-8d82-4e09-b7fb-d6eacf673130 req-2ab9b798-a72c-41ed-91cf-7008ad892a48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081847 Nov 03 03:54:21.695695 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 450/948] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:22.030517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a825fc21-c825-4f06-a893-f442246f60f1 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Calling method '.version_select at 0x7ff7f9c9d280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:22.114825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:22.116398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:22.132217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.134503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.134958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:22.135712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.138863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.139313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:22.301685 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a825fc21-c825-4f06-a893-f442246f60f1 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.274905 Nov 03 03:54:22.303026 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 499/949] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 03:54:22 2022] GET /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc/defaults => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:22.314916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f94b70d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:22.390317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.391542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.392152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:22.393096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.396935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.396935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:22.402048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:22.419466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f805294e-6876-4060-a0ad-e2a5bf6185c6 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1470 microversion: 2.1 time: 0.310916 Nov 03 03:54:22.423566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 451/950] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:22 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:22.633937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:22.634778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:22.643008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.643648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.645066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:22.645066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.645481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.645706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:22.801501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:22.811057 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e88501e-4c2b-4b40-8b75-6f409a2a8fc8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1360 microversion: 2.1 time: 0.181954 Nov 03 03:54:22.825216 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 452/951] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:22 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:22.825216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:22.825216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:22.825730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.826434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.826902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:22.827730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:22.828223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:22.828689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:23.030315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:23.042249 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16496e15-698f-4fa4-8166-718b9b67582a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.229230 Nov 03 03:54:23.043188 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 453/952] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:22 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:23.048884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:23.050150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:23.059225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:23.060348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:23.061056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:23.062015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:23.062473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:23.063810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:23.233127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:23.245265 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ff048837-99ed-46b4-9d14-7846933a0679 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1589 microversion: 2.1 time: 0.200985 Nov 03 03:54:23.246535 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 454/953] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:23 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1589 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:23.259461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5b14fee4-e8f5-4cc6-ba3f-7253a2a651c1 req-532ed50e-7f40-4f6f-bba6-f7ea392d3f0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75dd9e96-ffb8-4a3d-85bc-93048462e7c3", "tag": "f2c71efc-0782-4dee-95e0-3e193e5222bf"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:23.304450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5b14fee4-e8f5-4cc6-ba3f-7253a2a651c1 req-532ed50e-7f40-4f6f-bba6-f7ea392d3f0b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:23.459950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5b14fee4-e8f5-4cc6-ba3f-7253a2a651c1 req-532ed50e-7f40-4f6f-bba6-f7ea392d3f0b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:23.459950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5b14fee4-e8f5-4cc6-ba3f-7253a2a651c1 req-532ed50e-7f40-4f6f-bba6-f7ea392d3f0b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:23.459950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5b14fee4-e8f5-4cc6-ba3f-7253a2a651c1 req-532ed50e-7f40-4f6f-bba6-f7ea392d3f0b service nova] Creating event network-changed:f2c71efc-0782-4dee-95e0-3e193e5222bf for instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 on n-h2-854653-7 Nov 03 03:54:23.459950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5b14fee4-e8f5-4cc6-ba3f-7253a2a651c1 req-532ed50e-7f40-4f6f-bba6-f7ea392d3f0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137527 Nov 03 03:54:23.459950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 455/954] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:23.461747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:23.461747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:23.466198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:23.467316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:23.467791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:23.471208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:23.471693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:23.472138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:23.741601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:23.755022 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b489c05-c24b-4352-aa24-70b9bb237d12 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1470 microversion: 2.1 time: 0.313154 Nov 03 03:54:23.761163 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 456/955] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:23 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:23.840346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:23.840979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:23.852922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:23.857821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:23.858245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:23.861174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:23.861780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:23.862938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.087993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:24.099004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ecbc3370-a0ae-42f1-a3f7-f228a92f9880 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1542 microversion: 2.1 time: 0.264380 Nov 03 03:54:24.099858 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 457/956] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:23 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1542 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:24.109661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:24.114174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:24.125887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.126760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.127427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.128364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.129141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.129826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.150432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93704a56-dc30-4d1a-9949-e5f764355848 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc" status: 200 len: 329 microversion: 2.1 time: 1.839512 Nov 03 03:54:24.159470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 500/957] 10.222.0.30 () {60 vars in 1263 bytes} [Thu Nov 3 03:54:22 2022] PUT /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc => generated 329 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:24.191335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:24.193798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:24.208198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.209775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.213469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.213469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.213469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.214644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.374880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1cd2f1b7-2dbf-48e9-88df-be6112def8be tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211228 Nov 03 03:54:24.376013 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 501/958] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 03:54:24 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-interface => generated 284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:24.381052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:24.394422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f97ae9d0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:24.394641 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-668af845-d1b8-4d1f-a250-c93e53392497 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.287827 Nov 03 03:54:24.395387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 458/959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:24 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:24.634376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Calling method '.version_select at 0x7ff7f9c9baf0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:24.636551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.637162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.637699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.654477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.655434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.656134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.660361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:24.669465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.670410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.670924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.679275 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3afe4ac0-b6ad-4573-a0c2-20c167094d9f tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.199103 Nov 03 03:54:24.690208 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 459/960] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 03:54:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:54:24.697322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.697928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Calling method '.version_select at 0x7ff7f9dc0c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:24.698073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.698619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.699430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.699938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.700114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.700424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.700847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.700973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.717737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.718381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.719791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.727191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04f1522b-ae34-4653-a6df-cd936d1c1bad tempest-HypervisorAdminV228Test-597090092 tempest-HypervisorAdminV228Test-597090092-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 717 microversion: 2.28 time: 0.032312 Nov 03 03:54:24.728159 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 460/961] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 03:54:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 717 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:54:24.787822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:24.788541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:24.795050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.796407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.801306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:24.802438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:24.803233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:24.803937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:25.031088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:25.051644 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b4a526bc-6caf-4cda-9884-51aa3aa1e64d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.271116 Nov 03 03:54:25.052542 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 461/962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:24 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:25.341580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b473260-3162-488c-8a94-204ec149f071 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f9ad5a60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:25.407807 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3b473260-3162-488c-8a94-204ec149f071 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431" status: 200 len: 637 microversion: 2.1 time: 0.067878 Nov 03 03:54:25.409548 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 462/963] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:54:25 2022] GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431 => generated 637 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:25.427049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:25.428256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:25.435817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:25.436589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:25.437240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:25.438177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:25.438817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:25.439614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:25.861166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:25.869071 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42440e69-97c8-4adf-b193-ba335daf974a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.447431 Nov 03 03:54:25.870022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 463/964] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:25 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:25.874806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-faaabb08-7c25-412b-a387-f242e71b8f17 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update_all', calling method: .version_select at 0x7ff7f94e9700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:25.930024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-faaabb08-7c25-412b-a387-f242e71b8f17 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:25.935011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-faaabb08-7c25-412b-a387-f242e71b8f17 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:25.990512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=23,nova_api:UPDATE=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:26.429377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-faaabb08-7c25-412b-a387-f242e71b8f17 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 61 microversion: 2.1 time: 0.558028 Nov 03 03:54:26.434598 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 464/965] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:25 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 61 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:26.439014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-de8bb7d3-3bf6-4bf7-9119-2650ca7e03d1 req-1f949faa-76b0-4959-9394-f40a111989b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d", "name": "network-vif-plugged", "status": "completed", "tag": "63707c83-0f80-4bc8-868c-0a91a8f0ace2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:26.449102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-de8bb7d3-3bf6-4bf7-9119-2650ca7e03d1 req-1f949faa-76b0-4959-9394-f40a111989b8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:26.451782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-de8bb7d3-3bf6-4bf7-9119-2650ca7e03d1 req-1f949faa-76b0-4959-9394-f40a111989b8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:26.451782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-de8bb7d3-3bf6-4bf7-9119-2650ca7e03d1 req-1f949faa-76b0-4959-9394-f40a111989b8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:26.460854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-de8bb7d3-3bf6-4bf7-9119-2650ca7e03d1 req-1f949faa-76b0-4959-9394-f40a111989b8 service nova] Creating event network-vif-plugged:63707c83-0f80-4bc8-868c-0a91a8f0ace2 for instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d on n-h2-854653-7 Nov 03 03:54:26.465702 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-de8bb7d3-3bf6-4bf7-9119-2650ca7e03d1 req-1f949faa-76b0-4959-9394-f40a111989b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034354 Nov 03 03:54:26.466645 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 465/966] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:26.472543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d0b6d50f-f01a-4e80-8a1a-9ac8312781e6 req-b0628129-c221-4033-a8cb-09a83f05b1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ddb0bd-101b-4c9e-92fa-76855b9e6ec9", "tag": "1b137398-13a0-4268-8495-d732181a2eb9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:26.482106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d0b6d50f-f01a-4e80-8a1a-9ac8312781e6 req-b0628129-c221-4033-a8cb-09a83f05b1c0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:26.482593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d0b6d50f-f01a-4e80-8a1a-9ac8312781e6 req-b0628129-c221-4033-a8cb-09a83f05b1c0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:26.483030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d0b6d50f-f01a-4e80-8a1a-9ac8312781e6 req-b0628129-c221-4033-a8cb-09a83f05b1c0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:26.494819 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d0b6d50f-f01a-4e80-8a1a-9ac8312781e6 req-b0628129-c221-4033-a8cb-09a83f05b1c0 service nova] Creating event network-changed:1b137398-13a0-4268-8495-d732181a2eb9 for instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 on n-h2-854653-7 Nov 03 03:54:26.499820 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d0b6d50f-f01a-4e80-8a1a-9ac8312781e6 req-b0628129-c221-4033-a8cb-09a83f05b1c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031723 Nov 03 03:54:26.501420 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 466/967] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:26.506722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:26.507435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:26.514983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:26.515472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:26.516479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:26.517253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:26.517748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:26.518178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:26.691719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:26.703152 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2975de60-3806-4c44-a0ae-0992e6a576bc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.200284 Nov 03 03:54:26.704877 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 467/968] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:26 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:26.722897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99a73c56-1ac4-49c4-98ca-d17b38084995 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f9619f70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:26.804329 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80490f5b-8d62-4ae0-9abf-d141fff45d39 tempest-QuotasAdminTestJSON-998604690 tempest-QuotasAdminTestJSON-998604690-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc" status: 200 len: 329 microversion: 2.1 time: 2.426805 Nov 03 03:54:26.805855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 502/969] 10.222.0.30 () {60 vars in 1263 bytes} [Thu Nov 3 03:54:24 2022] PUT /compute/v2.1/os-quota-sets/01f7bb0503a9459388adbca00bb961fc => generated 329 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:26.902079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:26.904049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:26.918092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:26.918604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:26.919054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:26.920672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:26.921198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:26.921687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:27.073113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:27.083346 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-430aed8a-eadc-416e-aa22-e0c3f28eb477 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.193248 Nov 03 03:54:27.084974 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 503/970] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:26 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:27.141191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99a73c56-1ac4-49c4-98ca-d17b38084995 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "DELETE /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.434711 Nov 03 03:54:27.142275 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 468/971] 10.222.0.30 () {58 vars in 1296 bytes} [Thu Nov 3 03:54:26 2022] DELETE /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata/os_version => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:27.153230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a534f67b-c5c6-4f8e-9ab0-0ff2d6cd6277 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f9c9d280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:27.198135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a534f67b-c5c6-4f8e-9ab0-0ff2d6cd6277 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 37 microversion: 2.1 time: 0.051509 Nov 03 03:54:27.199217 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 504/972] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:54:27 2022] GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 37 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:27.211438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-22093aad-6499-4d86-9026-5c04dfb6b5a7 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update_all', calling method: .version_select at 0x7ff7f9619b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:27.279772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-22093aad-6499-4d86-9026-5c04dfb6b5a7 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:27.285975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-22093aad-6499-4d86-9026-5c04dfb6b5a7 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:27.673279 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-22093aad-6499-4d86-9026-5c04dfb6b5a7 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 61 microversion: 2.1 time: 0.467211 Nov 03 03:54:27.674109 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 469/973] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:27 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 61 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 03:54:27.688088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f4a221a-de5e-4d5a-88b9-a1a1d9f92017 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f94b7280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:27.730244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:27.730920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:27.738959 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f4a221a-de5e-4d5a-88b9-a1a1d9f92017 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.057487 Nov 03 03:54:27.739964 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 505/974] 10.222.0.30 () {58 vars in 1290 bytes} [Thu Nov 3 03:54:27 2022] GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata/os_distro => generated 33 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:27.740741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:27.741270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:27.741712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:27.742524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:27.744783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:27.745847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:27.751768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c32e9b40-7dab-4258-9e71-30c1ec3b174b tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update_all', calling method: .version_select at 0x7ff7f94729d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:27.813803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c32e9b40-7dab-4258-9e71-30c1ec3b174b tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:27.819548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c32e9b40-7dab-4258-9e71-30c1ec3b174b tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:27.916838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:27.926196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80c537cd-0ba4-437a-9038-ac1f2af3f708 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.200996 Nov 03 03:54:27.927375 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 470/975] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:27 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:28.038700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c32e9b40-7dab-4258-9e71-30c1ec3b174b tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 61 microversion: 2.1 time: 0.292216 Nov 03 03:54:28.039518 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 506/976] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:27 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 61 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:28.049578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bbe7e6d0-15f8-4f3c-b042-6db0d901eddd tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f962d310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:28.100027 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bbe7e6d0-15f8-4f3c-b042-6db0d901eddd tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 61 microversion: 2.1 time: 0.054369 Nov 03 03:54:28.106880 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 471/977] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:54:28 2022] GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 61 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:28.113369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:28.113693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f09b30fe-369f-4e15-b15b-7c0bf59c6088 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update_all', calling method: .version_select at 0x7ff7f9472e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:28.114743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:28.121840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:28.122592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:28.123259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:28.124220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:28.124846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:28.126162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:28.178695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f09b30fe-369f-4e15-b15b-7c0bf59c6088 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:28.207552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f09b30fe-369f-4e15-b15b-7c0bf59c6088 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:28.331004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:28.344710 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a502bb12-d445-4ce1-ad78-abc9b1dae36e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1317 microversion: 2.1 time: 0.236121 Nov 03 03:54:28.345811 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 472/978] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:28 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:28.448666 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f09b30fe-369f-4e15-b15b-7c0bf59c6088 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 61 microversion: 2.1 time: 0.341001 Nov 03 03:54:28.454002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 507/979] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:28 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 61 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:28.458967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a2b4d38e-a260-4c69-b4ac-bcbde04b9e53 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update_all', calling method: .version_select at 0x7ff7f9b8d8b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:28.510217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a2b4d38e-a260-4c69-b4ac-bcbde04b9e53 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:28.515970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a2b4d38e-a260-4c69-b4ac-bcbde04b9e53 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:28.916190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a2b4d38e-a260-4c69-b4ac-bcbde04b9e53 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 64 microversion: 2.1 time: 0.460419 Nov 03 03:54:28.916869 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 473/980] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:28 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 64 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 03:54:28.926263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c152337-a59c-4b2a-b046-146135188502 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f9472700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:28.957275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:28.958135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:28.965236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:28.965994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:28.966511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:28.967913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:28.968537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:28.969607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:28.973926 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c152337-a59c-4b2a-b046-146135188502 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 64 microversion: 2.1 time: 0.051453 Nov 03 03:54:28.974503 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 508/981] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:54:28 2022] GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 64 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:28.988421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-01b28932-579a-42d3-8703-088c2a2c99af tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update_all', calling method: .version_select at 0x7ff7f94788b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:29.058980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-01b28932-579a-42d3-8703-088c2a2c99af tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:29.066228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-01b28932-579a-42d3-8703-088c2a2c99af tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:29.124196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:29.133177 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c77c4f24-0d99-4b84-a319-7a9e1d7c2a01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.182370 Nov 03 03:54:29.133936 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 474/982] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:28 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:29.370702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:29.371628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:29.378914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:29.379691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:29.380206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:29.381148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:29.382008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:29.382518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:29.472178 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-01b28932-579a-42d3-8703-088c2a2c99af tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 61 microversion: 2.1 time: 0.488043 Nov 03 03:54:29.472775 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 509/983] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:28 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 61 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:29.482821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06311e95-6e9e-45b5-806d-4b47e94df995 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update', calling method: .version_select at 0x7ff7f9e68b80>, body: {"meta": {"os_version": "alt"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:29.540293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-06311e95-6e9e-45b5-806d-4b47e94df995 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:29.542516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:29.545696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-06311e95-6e9e-45b5-806d-4b47e94df995 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:29.551183 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d40ab22-0973-4d12-b7df-9fce27b7720b tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1466 microversion: 2.1 time: 0.184629 Nov 03 03:54:29.551784 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 475/984] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:29 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1466 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:29.573265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:29.573884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:29.579832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:29.580327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:29.580776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:29.581508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:29.581966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:29.584998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:29.756018 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d385cd51-0375-4a87-8cbb-0c82cd54b5a9 tempest-ServersOnMultiNodesTest-1793985713 tempest-ServersOnMultiNodesTest-1793985713-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1617 microversion: 2.1 time: 0.186182 Nov 03 03:54:29.756869 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 476/985] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:29 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1617 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:29.786650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:29.786650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:29.791188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:29.791693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:29.792115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:29.792869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:29.793356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:29.793796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:29.819434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:29.899276 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06311e95-6e9e-45b5-806d-4b47e94df995 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.420985 Nov 03 03:54:29.901186 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 510/986] 10.222.0.30 () {60 vars in 1313 bytes} [Thu Nov 3 03:54:29 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata/os_version => generated 31 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 03:54:29.911328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ea65162-e1bb-40ea-858e-450313d78342 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f9478700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:29.955905 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ea65162-e1bb-40ea-858e-450313d78342 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 58 microversion: 2.1 time: 0.049120 Nov 03 03:54:29.956700 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 511/987] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:54:29 2022] GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 58 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 03:54:29.966812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3e42a2ed-be2d-4375-8b0e-48cc43d8636a tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'update_all', calling method: .version_select at 0x7ff7f9b23b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:30.017322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:30.020884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3e42a2ed-be2d-4375-8b0e-48cc43d8636a tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:30.026117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3e42a2ed-be2d-4375-8b0e-48cc43d8636a tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:30.139195 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b906439-e70e-4266-b0ba-99bf5d605ec4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 204 len: 0 microversion: 2.1 time: 0.358778 Nov 03 03:54:30.139868 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 477/988] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:29 2022] DELETE /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:54:30.149049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:30.149936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:30.157148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:30.157644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:30.158086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:30.158793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:30.159245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:30.160041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:30.372134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:30.389736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cabb1e2-552f-44ff-991e-b37cbb3a0ba9 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1472 microversion: 2.1 time: 0.244775 Nov 03 03:54:30.390318 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 478/989] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:30 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:30.403880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:30.408081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:30.411661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:30.412358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:30.412802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:30.413581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:30.414054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:30.414489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:30.432765 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3e42a2ed-be2d-4375-8b0e-48cc43d8636a tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 61 microversion: 2.1 time: 0.469706 Nov 03 03:54:30.438466 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 512/990] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:29 2022] PUT /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 61 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 03:54:30.444376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65152e09-b6a0-4af4-a8c5-5ba71ac2cf32 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Action: 'create', calling method: .version_select at 0x7ff7f9491ca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:30.495844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-65152e09-b6a0-4af4-a8c5-5ba71ac2cf32 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:30.501348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-65152e09-b6a0-4af4-a8c5-5ba71ac2cf32 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Getting quotas for user c6b56e97d8c14f69aac45f8e5a79df4c and project 3bfe1291a96e4a589e3248529c8c2883. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:30.571814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:30.583954 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f13be4f-4030-4004-82dc-145b81656bab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.191294 Nov 03 03:54:30.583954 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 479/991] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:30 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:30.975076 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65152e09-b6a0-4af4-a8c5-5ba71ac2cf32 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "POST /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 85 microversion: 2.1 time: 0.535002 Nov 03 03:54:30.976193 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 513/992] 10.222.0.30 () {60 vars in 1281 bytes} [Thu Nov 3 03:54:30 2022] POST /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 85 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:30.987165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7be036a2-d56b-402a-bb20-4b431c1fe864 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] Calling method '.version_select at 0x7ff7f9ce51f0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:30.995741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=7 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:31.045170 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7be036a2-d56b-402a-bb20-4b431c1fe864 tempest-ImagesMetadataTestJSON-949017734 tempest-ImagesMetadataTestJSON-949017734-project] 10.222.0.30 "GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata" status: 200 len: 85 microversion: 2.1 time: 0.063120 Nov 03 03:54:31.050982 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 480/993] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:54:30 2022] GET /compute/v2.1/images/ca1cd9e1-0643-4506-83c6-10451e6aa431/metadata => generated 85 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:54:31.415087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:31.415748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:31.422143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:31.422634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:31.423253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:31.424185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:31.425121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:31.425876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:31.606750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:31.607374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:31.617765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:31.619076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:31.619076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:31.631905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:31.632754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:31.633400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:31.654076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:31.668456 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f8a7525-012c-4ab3-93cb-44e8276a7c03 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1472 microversion: 2.1 time: 0.258258 Nov 03 03:54:31.678148 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 514/994] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:31 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:31.857101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:31.868588 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b402c5d5-5bce-4607-a9f9-8c96290f23b4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.266304 Nov 03 03:54:31.882924 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 481/995] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:31 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:32.080661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42805597-894b-41ad-8a10-df4fb3ec8e13 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Calling method '.version_select at 0x7ff7f94ae670>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:32.152422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42805597-894b-41ad-8a10-df4fb3ec8e13 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 371 microversion: 2.1 time: 0.220191 Nov 03 03:54:32.153828 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 515/996] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 03:54:31 2022] GET /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:32.166668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9861700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:32.247175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:32.247670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:32.248116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:32.248867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:32.249345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:32.249783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:32.266445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:32.411759 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-177291b3-e901-4de4-82c0-fbce511dbcc8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 328 microversion: 2.1 time: 0.248522 Nov 03 03:54:32.412618 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 482/997] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:32 2022] PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 328 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:32.619429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8976c1b1-07f6-47f6-b381-21df15adb18f req-3a5393d1-3dad-49c8-9f2d-b8a2ce6853bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d", "name": "network-vif-deleted", "tag": "63707c83-0f80-4bc8-868c-0a91a8f0ace2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:32.638055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8976c1b1-07f6-47f6-b381-21df15adb18f req-3a5393d1-3dad-49c8-9f2d-b8a2ce6853bc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:32.638836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8976c1b1-07f6-47f6-b381-21df15adb18f req-3a5393d1-3dad-49c8-9f2d-b8a2ce6853bc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:32.639481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8976c1b1-07f6-47f6-b381-21df15adb18f req-3a5393d1-3dad-49c8-9f2d-b8a2ce6853bc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:32.655892 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8976c1b1-07f6-47f6-b381-21df15adb18f req-3a5393d1-3dad-49c8-9f2d-b8a2ce6853bc service nova] Creating event network-vif-deleted:63707c83-0f80-4bc8-868c-0a91a8f0ace2 for instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d on n-h2-854653-7 Nov 03 03:54:32.666586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8976c1b1-07f6-47f6-b381-21df15adb18f req-3a5393d1-3dad-49c8-9f2d-b8a2ce6853bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060297 Nov 03 03:54:32.667548 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 516/998] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:32.708597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:32.709462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:32.729579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:32.730082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:32.730532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:32.744393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:32.745007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:32.748090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:32.763324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:32.943596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1876055593", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:33.027372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:33.029738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:33.036302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f729188f-9668-442f-9a2b-bd8093b0abda tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1430 microversion: 2.1 time: 0.333914 Nov 03 03:54:33.040239 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 517/999] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:32 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1430 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:33.050132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:33.063513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:33.079242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:33.080165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:33.080883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:33.082517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:33.083244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:33.084775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:33.390620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:33.391046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:33.391526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:33.391929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:33.392341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:33.412558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:33.413497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:33.414529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:33.415591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:33.417586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:33.418973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:33.439922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:33.453141 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de5b1e73-433a-42a4-a6f3-069f6170e530 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.406565 Nov 03 03:54:33.465536 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 518/1000] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:33 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:33.473685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Getting quotas for project 9cc01f004116430cbb84db4919624d09. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:33.495040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Getting quotas for user f0417152e2784993bb07e5ea0cd228cc and project 9cc01f004116430cbb84db4919624d09. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:33.535274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.utils [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] cores quota exceeded for 9cc01f004116430cbb84db4919624d09, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127594) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 03 03:54:33.536501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Request method failure captured: Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 145 Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt2dFptajhSjQk0djUIdYhKmtsDGV_mFu-I1H1nIbar3A-Kt7syOU4VBzOMey4BBMZbELg4z1l_fUXwurhn_iJVFO61HB4RbsgUZ1Q2gy_Sw31Iwm0e_gcvgXewgeJjNTPCBrrKTzdfKz2zVupRitfUcSEYRSXlph6DpqPqKDJrapY Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:33.572167 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9cc01f004116430cbb84db4919624d09", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9cc01f004116430cbb84db4919624d09"}]}] Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f0417152e2784993bb07e5ea0cd228cc Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1876055593", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} Nov 03 03:54:33.574516 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1876055593', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452'}}} Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 03 03:54:33.576241 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:33.579634 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:33.583211 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fde9a6f7-bc08-42a1-afca-dfcdbe527d41 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.933298 Nov 03 03:54:33.588812 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 483/1001] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:32 2022] POST /compute/v2.1/servers => generated 111 bytes in 935 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:54:33.590524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9478ee0>, body: {"quota_set": {"cores": 20}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:33.909951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:33.910605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:33.910874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:33.911611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:33.914954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:33.915409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:34.064412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:34.065044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:34.108454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:34.109779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:34.110742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:34.112635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:34.114933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:34.115544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:34.151567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:34.212707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:34.223334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:34.223869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:34.230363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:34.231341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lazy-loading 'fault' on Instance uuid b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:34.237302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f581e6d-1523-4151-a87d-6965e33a7197 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 329 microversion: 2.1 time: 0.660415 Nov 03 03:54:34.238335 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 519/1002] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:33 2022] PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 329 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:34.253158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2380da34-c94e-410a-885c-f86ece60ae60 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Calling method '.version_select at 0x7ff7f94783a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:34.317379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:34.329320 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17baafd0-a280-44db-9d0e-18bd30ac3223 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 200 len: 1307 microversion: 2.1 time: 0.270781 Nov 03 03:54:34.329895 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 484/1003] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:34 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 1307 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:34.474636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:34.475272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:34.489516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:34.490731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:34.491852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:34.492831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:34.493814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:34.503055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:34.517233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2380da34-c94e-410a-885c-f86ece60ae60 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 371 microversion: 2.1 time: 0.268726 Nov 03 03:54:34.518529 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 520/1004] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 03:54:34 2022] GET /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:34.531440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9461c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:34.722395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:34.732432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-725ce6cb-4da3-4b26-ba56-9d48ec990354 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.263974 Nov 03 03:54:34.733785 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 485/1005] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:34 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:34.827963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:34.829418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:34.831139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:34.832089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:34.834498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:34.836341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.032140 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e017df5-1a4e-4965-a5d3-b98533c1de5a tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 328 microversion: 2.1 time: 0.505904 Nov 03 03:54:35.033067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 521/1006] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:34 2022] PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 328 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:35.215451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-608986514", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:35.292555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:35.537477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a47c0d5-6fa7-47d7-8fd4-67412f34bf6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Calling method '.version_select at 0x7ff7f9431040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:35.567371 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-0a47c0d5-6fa7-47d7-8fd4-67412f34bf6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] HTTP exception thrown: Image not found. Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a47c0d5-6fa7-47d7-8fd4-67412f34bf6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Request method failure captured: Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/14a3b298-d56b-4a21-88bb-1e5cfcc10448/metadata/os_distro HTTP/1.1 Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzt7ste3p4LqMVkFO3_eZGIkvKvSGDONQtqqnD-T9O6WTgT-KKgCT8b6ePeSe0m2w-jgyCNyczJiyZ4bn9HEcL-3tL_-LhDVhsR5BJMxgmGvnUxr9frfXmDWQC0kbKOaXYdY-g0_En6xYNK76mC1qH9y5TtuleQNA7xJMLJUrTp8y-c Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:35.598716 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_015f8f43566647c2974f87113ddc4131", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/015f8f43566647c2974f87113ddc4131"}]}] Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: b6c7a79524924943a496365ae7f0bbdd Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'image_id': '14a3b298-d56b-4a21-88bb-1e5cfcc10448', 'id': 'os_distro'} Nov 03 03:54:35.600099 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:35.600914 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 14a3b298-d56b-4a21-88bb-1e5cfcc10448 Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:35.603185 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 14a3b298-d56b-4a21-88bb-1e5cfcc10448 could not be found. Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:54:35.604399 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.607473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a47c0d5-6fa7-47d7-8fd4-67412f34bf6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:35.610842 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a47c0d5-6fa7-47d7-8fd4-67412f34bf6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] 10.222.0.30 "DELETE /compute/v2.1/images/14a3b298-d56b-4a21-88bb-1e5cfcc10448/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.271656 Nov 03 03:54:35.610842 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 522/1007] 10.222.0.30 () {58 vars in 1293 bytes} [Thu Nov 3 03:54:35 2022] DELETE /compute/v2.1/images/14a3b298-d56b-4a21-88bb-1e5cfcc10448/metadata/os_distro => generated 62 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:35.612325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:35.614821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:35.626342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.630818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.631617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.632526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.637629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.638347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.669304 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d could not be found. Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d HTTP/1.1 Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:35.670768 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d could not be found. Nov 03 03:54:35.672316 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d'} Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d could not be found. Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:35.673292 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d could not be found. Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d could not be found. Nov 03 03:54:35.674813 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.676325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:35.676325 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1020005-e72a-4f7c-ab97-03026ebb6ec2 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d" status: 404 len: 111 microversion: 2.1 time: 0.070263 Nov 03 03:54:35.677328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 523/1008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:35 2022] GET /compute/v2.1/servers/b4ed98a3-e3c3-4bcb-b62f-e6beda3e1c7d => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:35.687661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:35.687817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37e72008-4bbd-4f49-b87a-0b002fe0aafe tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Calling method '.version_select at 0x7ff7f9478430>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:35.688525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:35.689257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:35.689847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:35.690435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:35.715036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.715543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.715987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.722631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.723634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.724090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.726403 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-37e72008-4bbd-4f49-b87a-0b002fe0aafe tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] HTTP exception thrown: Image not found. Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37e72008-4bbd-4f49-b87a-0b002fe0aafe tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Request method failure captured: Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/images/8b958749-3008-4be6-8d59-41a7239209e1/metadata/os_version HTTP/1.1 Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzt7ste3p4LqMVkFO3_eZGIkvKvSGDONQtqqnD-T9O6WTgT-KKgCT8b6ePeSe0m2w-jgyCNyczJiyZ4bn9HEcL-3tL_-LhDVhsR5BJMxgmGvnUxr9frfXmDWQC0kbKOaXYdY-g0_En6xYNK76mC1qH9y5TtuleQNA7xJMLJUrTp8y-c Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:35.729171 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_015f8f43566647c2974f87113ddc4131", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/015f8f43566647c2974f87113ddc4131"}]}] Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: b6c7a79524924943a496365ae7f0bbdd Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'image_id': '8b958749-3008-4be6-8d59-41a7239209e1', 'id': 'os_version'} Nov 03 03:54:35.730735 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:35.731597 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8b958749-3008-4be6-8d59-41a7239209e1 Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:35.732903 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b958749-3008-4be6-8d59-41a7239209e1 could not be found. Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:54:35.734709 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:54:35.736790 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.741037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37e72008-4bbd-4f49-b87a-0b002fe0aafe tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:35.741037 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37e72008-4bbd-4f49-b87a-0b002fe0aafe tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] 10.222.0.30 "GET /compute/v2.1/images/8b958749-3008-4be6-8d59-41a7239209e1/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.060839 Nov 03 03:54:35.741037 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 524/1009] 10.222.0.30 () {58 vars in 1293 bytes} [Thu Nov 3 03:54:35 2022] GET /compute/v2.1/images/8b958749-3008-4be6-8d59-41a7239209e1/metadata/os_version => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:35.747140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:35.747856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:35.760065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.761264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.762197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.764245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.765929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.766636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.801444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Getting quotas for project 9cc01f004116430cbb84db4919624d09. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:35.810505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:35.814318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Getting quotas for user f0417152e2784993bb07e5ea0cd228cc and project 9cc01f004116430cbb84db4919624d09. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:35.847603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.utils [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] instances quota exceeded for 9cc01f004116430cbb84db4919624d09, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127594) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 03 03:54:35.848158 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Request method failure captured: Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 144 Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt2dFptajhSjQk0djUIdYhKmtsDGV_mFu-I1H1nIbar3A-Kt7syOU4VBzOMey4BBMZbELg4z1l_fUXwurhn_iJVFO61HB4RbsgUZ1Q2gy_Sw31Iwm0e_gcvgXewgeJjNTPCBrrKTzdfKz2zVupRitfUcSEYRSXlph6DpqPqKDJrapY Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:35.853439 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9cc01f004116430cbb84db4919624d09", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9cc01f004116430cbb84db4919624d09"}]}] Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f0417152e2784993bb07e5ea0cd228cc Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-608986514", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} Nov 03 03:54:35.854947 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-608986514', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452'}}} Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 03 03:54:35.855838 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.857123 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.858606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.860374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.860374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.860374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:35.860374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:35.860374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 03 03:54:35.860374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.860374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:35.862145 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50b76fb6-1879-4246-9e12-1be8400d0fea tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.651865 Nov 03 03:54:35.862813 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 486/1010] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:35 2022] POST /compute/v2.1/servers => generated 119 bytes in 653 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:54:35.867793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42d1a4eb-0e31-4245-84a0-084dd4c816ec tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Calling method '.version_select at 0x7ff7f94544c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:35.892212 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-42d1a4eb-0e31-4245-84a0-084dd4c816ec tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] HTTP exception thrown: Image not found. Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42d1a4eb-0e31-4245-84a0-084dd4c816ec tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Request method failure captured: Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/images/c969a1da-964f-432d-8027-83666baa5d6c/metadata HTTP/1.1 Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt7ste3p4LqMVkFO3_eZGIkvKvSGDONQtqqnD-T9O6WTgT-KKgCT8b6ePeSe0m2w-jgyCNyczJiyZ4bn9HEcL-3tL_-LhDVhsR5BJMxgmGvnUxr9frfXmDWQC0kbKOaXYdY-g0_En6xYNK76mC1qH9y5TtuleQNA7xJMLJUrTp8y-c Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:35.897502 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_015f8f43566647c2974f87113ddc4131", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/015f8f43566647c2974f87113ddc4131"}]}] Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b6c7a79524924943a496365ae7f0bbdd Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'image_id': 'c969a1da-964f-432d-8027-83666baa5d6c'} Nov 03 03:54:35.899123 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:35.900075 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c969a1da-964f-432d-8027-83666baa5d6c Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:35.901394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c969a1da-964f-432d-8027-83666baa5d6c could not be found. Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:54:35.905841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:35.907966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42d1a4eb-0e31-4245-84a0-084dd4c816ec tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:35.909320 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42d1a4eb-0e31-4245-84a0-084dd4c816ec tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] 10.222.0.30 "GET /compute/v2.1/images/c969a1da-964f-432d-8027-83666baa5d6c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.038466 Nov 03 03:54:35.919603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 487/1011] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:54:35 2022] GET /compute/v2.1/images/c969a1da-964f-432d-8027-83666baa5d6c/metadata => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:35.929300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:35.929925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:35.936705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.937757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.938203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:35.938913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:35.939374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:35.939811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:36.106771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:36.131374 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-21b885cc-4b5e-48a9-8ffe-12d0b497bc1f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 204 len: 0 microversion: 2.1 time: 0.386724 Nov 03 03:54:36.131374 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 525/1012] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:35 2022] DELETE /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:36.150443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2fb6aed9-8619-4cfa-82e1-f524ccd45c82 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.194821 Nov 03 03:54:36.153832 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 488/1013] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:35 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:36.160040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9461a60>, body: {"quota_set": {"instances": 10}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:36.175163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07f5c051-b242-41f2-8f83-453b899da1eb tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Action: 'update_all', calling method: .version_select at 0x7ff7f971d310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:36.215177 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-07f5c051-b242-41f2-8f83-453b899da1eb tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] HTTP exception thrown: Image not found. Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07f5c051-b242-41f2-8f83-453b899da1eb tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Request method failure captured: Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/images/60a87806-b721-4ed9-b263-c6d32991197c/metadata HTTP/1.1 Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 57 Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt7ste3p4LqMVkFO3_eZGIkvKvSGDONQtqqnD-T9O6WTgT-KKgCT8b6ePeSe0m2w-jgyCNyczJiyZ4bn9HEcL-3tL_-LhDVhsR5BJMxgmGvnUxr9frfXmDWQC0kbKOaXYdY-g0_En6xYNK76mC1qH9y5TtuleQNA7xJMLJUrTp8y-c Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:36.217791 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_015f8f43566647c2974f87113ddc4131", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/015f8f43566647c2974f87113ddc4131"}]}] Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b6c7a79524924943a496365ae7f0bbdd Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 03:54:36.219879 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'image_id': '60a87806-b721-4ed9-b263-c6d32991197c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:36.220787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60a87806-b721-4ed9-b263-c6d32991197c Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:36.221978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60a87806-b721-4ed9-b263-c6d32991197c could not be found. Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:36.223364 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:54:36.224677 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.233914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07f5c051-b242-41f2-8f83-453b899da1eb tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:36.235354 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07f5c051-b242-41f2-8f83-453b899da1eb tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] 10.222.0.30 "PUT /compute/v2.1/images/60a87806-b721-4ed9-b263-c6d32991197c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.079120 Nov 03 03:54:36.236419 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 489/1014] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 03:54:36 2022] PUT /compute/v2.1/images/60a87806-b721-4ed9-b263-c6d32991197c/metadata => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:36.242730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:36.243877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:36.252626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:36.253722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:36.254365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:36.255118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:36.255590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:36.256230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:36.398165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:36.398762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:36.399216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:36.403649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:36.403649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:36.403649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:36.440895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:36.449226 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da92aa90-d4ff-4b91-91c6-95cb5e866ce5 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1473 microversion: 2.1 time: 0.211383 Nov 03 03:54:36.461039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 490/1015] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:36 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1473 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:36.461039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b35f41bb-5ef6-4b28-b97e-7377c622be01 tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Action: 'update', calling method: .version_select at 0x7ff7f94560d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:36.478824 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b35f41bb-5ef6-4b28-b97e-7377c622be01 tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] HTTP exception thrown: Image not found. Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b35f41bb-5ef6-4b28-b97e-7377c622be01 tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Request method failure captured: Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/images/a9a838cd-4b87-4bca-a3cf-66f72af9508d/metadata/os_distro HTTP/1.1 Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 30 Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt7ste3p4LqMVkFO3_eZGIkvKvSGDONQtqqnD-T9O6WTgT-KKgCT8b6ePeSe0m2w-jgyCNyczJiyZ4bn9HEcL-3tL_-LhDVhsR5BJMxgmGvnUxr9frfXmDWQC0kbKOaXYdY-g0_En6xYNK76mC1qH9y5TtuleQNA7xJMLJUrTp8y-c Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:36.480920 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_015f8f43566647c2974f87113ddc4131", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/015f8f43566647c2974f87113ddc4131"}]}] Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b6c7a79524924943a496365ae7f0bbdd Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: {"meta": {"os_distro": "alt"}} Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 03:54:36.482677 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'image_id': 'a9a838cd-4b87-4bca-a3cf-66f72af9508d', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:36.488870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a9a838cd-4b87-4bca-a3cf-66f72af9508d Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:36.494219 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9a838cd-4b87-4bca-a3cf-66f72af9508d could not be found. Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:36.495779 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:54:36.497155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.498645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b35f41bb-5ef6-4b28-b97e-7377c622be01 tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:36.498645 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b35f41bb-5ef6-4b28-b97e-7377c622be01 tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] 10.222.0.30 "PUT /compute/v2.1/images/a9a838cd-4b87-4bca-a3cf-66f72af9508d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.031222 Nov 03 03:54:36.498645 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 491/1016] 10.222.0.30 () {60 vars in 1310 bytes} [Thu Nov 3 03:54:36 2022] PUT /compute/v2.1/images/a9a838cd-4b87-4bca-a3cf-66f72af9508d/metadata/os_distro => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:36.498645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03e16f34-5404-4a43-ba17-062b1d84ed6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Action: 'create', calling method: .version_select at 0x7ff7f9428d30>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:36.530390 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-03e16f34-5404-4a43-ba17-062b1d84ed6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] HTTP exception thrown: Image not found. Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03e16f34-5404-4a43-ba17-062b1d84ed6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Request method failure captured: Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/images/db371462-bb93-4e76-af65-eea3f887fa81/metadata HTTP/1.1 Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 57 Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt7ste3p4LqMVkFO3_eZGIkvKvSGDONQtqqnD-T9O6WTgT-KKgCT8b6ePeSe0m2w-jgyCNyczJiyZ4bn9HEcL-3tL_-LhDVhsR5BJMxgmGvnUxr9frfXmDWQC0kbKOaXYdY-g0_En6xYNK76mC1qH9y5TtuleQNA7xJMLJUrTp8y-c Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:36.533063 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_015f8f43566647c2974f87113ddc4131", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/015f8f43566647c2974f87113ddc4131"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/015f8f43566647c2974f87113ddc4131"}]}] Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 015f8f43566647c2974f87113ddc4131 Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-643404735 Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b6c7a79524924943a496365ae7f0bbdd Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-643404735-project Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 03:54:36.534521 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'image_id': 'db371462-bb93-4e76-af65-eea3f887fa81', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:36.535375 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID db371462-bb93-4e76-af65-eea3f887fa81 Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:54:36.536445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image db371462-bb93-4e76-af65-eea3f887fa81 could not be found. Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:36.538686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:54:36.540098 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:36.542058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03e16f34-5404-4a43-ba17-062b1d84ed6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:36.542827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03e16f34-5404-4a43-ba17-062b1d84ed6d tempest-ImagesMetadataNegativeTestJSON-643404735 tempest-ImagesMetadataNegativeTestJSON-643404735-project] 10.222.0.30 "POST /compute/v2.1/images/db371462-bb93-4e76-af65-eea3f887fa81/metadata" status: 404 len: 62 microversion: 2.1 time: 0.053938 Nov 03 03:54:36.543592 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 492/1017] 10.222.0.30 () {60 vars in 1281 bytes} [Thu Nov 3 03:54:36 2022] POST /compute/v2.1/images/db371462-bb93-4e76-af65-eea3f887fa81/metadata => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:36.589780 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa49c672-8cae-47f1-8545-b0e3c49e6fd6 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 329 microversion: 2.1 time: 0.434918 Nov 03 03:54:36.590356 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 526/1018] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:36 2022] PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 329 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:36.610374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14f6cfb6-2fea-4728-b074-b00075de32e8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Calling method '.version_select at 0x7ff7f94563a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:36.737028 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14f6cfb6-2fea-4728-b074-b00075de32e8 tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 371 microversion: 2.1 time: 0.131599 Nov 03 03:54:36.744912 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 493/1019] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 03:54:36 2022] GET /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:36.751150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f9472af0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:36.851576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:36.852427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:36.853088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:36.854023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:36.854900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:36.855497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:36.994076 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f58b71a-e921-4f6a-9cf1-4eddfe91f9af tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 325 microversion: 2.1 time: 0.247957 Nov 03 03:54:36.995261 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 527/1020] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:36 2022] PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 325 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:37.184769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-673055870", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:37.188711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:37.189361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:37.208245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:37.208775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:37.209191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:37.209894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:37.210345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:37.210774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:37.274396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:37.457672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:37.465499 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-049a73b2-9908-412e-9cef-31adb0a2db10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.287410 Nov 03 03:54:37.466083 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 494/1021] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:37 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:37.496560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:37.499028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:37.534819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:37.537780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:37.538247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:37.538999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:37.539473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:37.539905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:37.607003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:37.607497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:37.608073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:37.608618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:37.608941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:37.621568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:37.622147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:37.622804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:37.623725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:37.624405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:37.625102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:37.668882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Getting quotas for project 9cc01f004116430cbb84db4919624d09. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:37.683042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Getting quotas for user f0417152e2784993bb07e5ea0cd228cc and project 9cc01f004116430cbb84db4919624d09. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:37.717309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.utils [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] ram quota exceeded for 9cc01f004116430cbb84db4919624d09, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127593) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 03 03:54:37.719935 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Request method failure captured: Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 144 Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzt2dFptajhSjQk0djUIdYhKmtsDGV_mFu-I1H1nIbar3A-Kt7syOU4VBzOMey4BBMZbELg4z1l_fUXwurhn_iJVFO61HB4RbsgUZ1Q2gy_Sw31Iwm0e_gcvgXewgeJjNTPCBrrKTzdfKz2zVupRitfUcSEYRSXlph6DpqPqKDJrapY Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:37.724748 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9cc01f004116430cbb84db4919624d09", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9cc01f004116430cbb84db4919624d09"}]}] Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f0417152e2784993bb07e5ea0cd228cc Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-673055870", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} Nov 03 03:54:37.728674 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-673055870', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452'}}} Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 03 03:54:37.729626 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:37.730911 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:37.732361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c4fb742b-6f8d-44f7-87c5-6e3cbf2cbdc3 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.545652 Nov 03 03:54:37.735369 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 528/1022] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:37 2022] POST /compute/v2.1/servers => generated 110 bytes in 547 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:37.751312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f94ae5e0>, body: {"quota_set": {"ram": 51200}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:37.784228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:37.792696 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02f43a9e-2086-45c8-ab77-cf995052dab6 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1473 microversion: 2.1 time: 0.302299 Nov 03 03:54:37.794515 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 495/1023] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:37 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:38.096209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:38.096716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:38.097575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:38.099340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:38.100144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:38.100753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:38.333156 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20262b1b-d138-4af4-bfc5-8e98749f12ca tempest-QuotasAdminNegativeTest-1477534300 tempest-QuotasAdminNegativeTest-1477534300-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 200 len: 329 microversion: 2.1 time: 0.595561 Nov 03 03:54:38.334095 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 529/1024] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:37 2022] PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 329 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:38.347217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-819eb4f7-edfe-4d44-8481-8f3ae3bbf705 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Action: 'update', calling method: .version_select at 0x7ff7f94cbd30>, body: {"quota_set": {"ram": 0}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:38.357558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-819eb4f7-edfe-4d44-8481-8f3ae3bbf705 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f0417152e2784993bb07e5ea0cd228cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cc01f004116430cbb84db4919624d09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-819eb4f7-edfe-4d44-8481-8f3ae3bbf705 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Request method failure captured: Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 HTTP/1.1 Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 25 Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt2dFptajhSjQk0djUIdYhKmtsDGV_mFu-I1H1nIbar3A-Kt7syOU4VBzOMey4BBMZbELg4z1l_fUXwurhn_iJVFO61HB4RbsgUZ1Q2gy_Sw31Iwm0e_gcvgXewgeJjNTPCBrrKTzdfKz2zVupRitfUcSEYRSXlph6DpqPqKDJrapY Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:38.363219 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9cc01f004116430cbb84db4919624d09", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9cc01f004116430cbb84db4919624d09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9cc01f004116430cbb84db4919624d09"}]}] Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 9cc01f004116430cbb84db4919624d09 Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1519536929 Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f0417152e2784993bb07e5ea0cd228cc Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-QuotasAdminNegativeTest-1519536929-project Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: {"quota_set": {"ram": 0}} Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 03 03:54:38.376230 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '9cc01f004116430cbb84db4919624d09', 'body': {'quota_set': {'ram': 0}}} Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:38.377843 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:38.379533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-819eb4f7-edfe-4d44-8481-8f3ae3bbf705 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-819eb4f7-edfe-4d44-8481-8f3ae3bbf705 tempest-QuotasAdminNegativeTest-1519536929 tempest-QuotasAdminNegativeTest-1519536929-project] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09" status: 403 len: 116 microversion: 2.1 time: 0.022777 Nov 03 03:54:38.380763 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 496/1025] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 03:54:38 2022] PUT /compute/v2.1/os-quota-sets/9cc01f004116430cbb84db4919624d09 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:54:38.496602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:38.497635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:38.514141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:38.516309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:38.519262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:38.522055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:38.523345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:38.523969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:38.750596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-fab64850-a92c-4718-b6e6-a40e32bfc8fe req-d98e27ad-dac0-4686-89d3-3dc034312dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "438573f8-4fa5-4eec-980b-a22eda8dbe5b", "name": "network-vif-deleted", "tag": "eb61c650-8f77-482d-8944-6b25b624e884"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:38.766609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fab64850-a92c-4718-b6e6-a40e32bfc8fe req-d98e27ad-dac0-4686-89d3-3dc034312dde service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:38.767447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fab64850-a92c-4718-b6e6-a40e32bfc8fe req-d98e27ad-dac0-4686-89d3-3dc034312dde service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:38.768119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fab64850-a92c-4718-b6e6-a40e32bfc8fe req-d98e27ad-dac0-4686-89d3-3dc034312dde service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:38.781842 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-fab64850-a92c-4718-b6e6-a40e32bfc8fe req-d98e27ad-dac0-4686-89d3-3dc034312dde service nova] Creating event network-vif-deleted:eb61c650-8f77-482d-8944-6b25b624e884 for instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b on n-h1-854653-7 Nov 03 03:54:38.791704 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-fab64850-a92c-4718-b6e6-a40e32bfc8fe req-d98e27ad-dac0-4686-89d3-3dc034312dde service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047197 Nov 03 03:54:38.793136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 497/1026] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:38.821651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:38.822545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:38.836009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:38.837670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:38.838144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:38.839125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:38.842591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:38.842591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:38.965107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:38.967460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:38.978429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e62e2514-361f-4598-9aa5-2652d7c6d2a8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.486537 Nov 03 03:54:38.981491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 530/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:38 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:38.983256 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bfd26045-037b-4362-89b7-52b60ac9f30a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1431 microversion: 2.1 time: 0.166377 Nov 03 03:54:38.985710 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 498/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:38 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1431 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:39.930466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Calling method '.version_select at 0x7ff7f93f0ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:39.942186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:39.942673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:39.943109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:39.943846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:39.944357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:39.944924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:39.967928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-168cb8bd-cc4e-448b-b784-84a34fbf1c1b tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.215909 Nov 03 03:54:40.012574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:40.024494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:40.029602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:40.030117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:40.030570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:40.033119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:40.033553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:40.033999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:40.039154 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 531/1029] 10.222.0.30 () {58 vars in 1122 bytes} [Thu Nov 3 03:54:39 2022] GET /compute/v2.1/limits => generated 511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:40.097720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:40.109688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:40.143534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:40.144038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:40.147770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:40.148527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:40.148999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:40.149459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:40.235757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:40.250182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:40.251567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:40.255783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:40.255783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lazy-loading 'fault' on Instance uuid 438573f8-4fa5-4eec-980b-a22eda8dbe5b {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:40.369376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:40.377628 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-22d20858-6558-471e-bb21-d9d2fe6c0469 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 200 len: 1307 microversion: 2.1 time: 0.337199 Nov 03 03:54:40.378439 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 532/1030] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:40 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:40.384422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1610433365", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:40.459867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:40.505956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:40.517692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4e36d11-9b8c-4d55-90f6-04dee9faeec1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1475 microversion: 2.1 time: 0.509661 Nov 03 03:54:40.518660 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 499/1031] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:40 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1475 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:41.220979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Getting quotas for project 0866f8d5dfa34efaac9caccdc3465413. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:41.234266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Getting quotas for user 8c56a9c3e940447a84c7fce2361f6b78 and project 0866f8d5dfa34efaac9caccdc3465413. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:41.281570 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Request method failure captured: Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 1752 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzt_-2mgL7ajcpKIzVSaA0aODbUMUKQIgwN8S0yeuYe2HKAk4xDqW4f_qcXUsSGA3QF4FlUQ5gAjoOB7O34aSnzSpVLhJ4YcongL9Q7ahJJdjtzLn89O70lCpwyJyrKhNN9dQTwqZEkX6G5jd_m_EzGtsEuDODHDR4ZlJiVGKSrqnNk Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0866f8d5dfa34efaac9caccdc3465413 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1539148980 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0866f8d5dfa34efaac9caccdc3465413"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0866f8d5dfa34efaac9caccdc3465413", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0866f8d5dfa34efaac9caccdc3465413"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0866f8d5dfa34efaac9caccdc3465413"}]}] Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1539148980 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0866f8d5dfa34efaac9caccdc3465413 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1539148980 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 8c56a9c3e940447a84c7fce2361f6b78 Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1610433365", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:41.285141 n-d-854653-7 devstack@n-api.service[127593]: exception: Maximum number of metadata items exceeds 128 Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1610433365', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:41.287316 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-189b6b5b-9666-40d3-9e41-a0b645045a93 tempest-AbsoluteLimitsNegativeTestJSON-1539148980 tempest-AbsoluteLimitsNegativeTestJSON-1539148980-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.909360 Nov 03 03:54:41.291788 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 533/1032] 10.222.0.30 () {60 vars in 1148 bytes} [Thu Nov 3 03:54:40 2022] POST /compute/v2.1/servers => generated 87 bytes in 912 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:54:41.409323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:41.411107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 438573f8-4fa5-4eec-980b-a22eda8dbe5b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:41.429480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:41.429985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:41.440603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:41.441450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:41.441993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:41.446959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:41.486667 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b could not be found. Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b HTTP/1.1 Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b could not be found. Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '438573f8-4fa5-4eec-980b-a22eda8dbe5b'} Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b could not be found. Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b could not be found. Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:41.494590 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b could not be found. Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance 438573f8-4fa5-4eec-980b-a22eda8dbe5b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:41.503517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a5c627fb-a29d-4b9e-bf92-c70628d8b3bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b" status: 404 len: 111 microversion: 2.1 time: 0.100426 Nov 03 03:54:41.511029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:41.511733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:41.518202 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 500/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:41 2022] GET /compute/v2.1/servers/438573f8-4fa5-4eec-980b-a22eda8dbe5b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:41.542328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:41.548201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:41.551182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:41.551782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:41.553701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:41.559633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:41.560376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:41.565925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:41.568739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:41.573353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:41.574292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:41.575220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:41.575866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:41.578937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:41.697735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:42.180111 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7449fa1d-51b6-4ec0-bfe3-4bed88159446 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 204 len: 0 microversion: 2.1 time: 0.663822 Nov 03 03:54:42.180111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 534/1034] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:41 2022] DELETE /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:42.190539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:42.195342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:42.217253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:42.223623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:42.227780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:42.229832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:42.230324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:42.230760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:42.473984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:42.496703 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-924eec32-2c16-490b-8770-3e396fc5f580 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1474 microversion: 2.1 time: 0.957800 Nov 03 03:54:42.498838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 501/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:41 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1474 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:42.660652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:42.671179 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2008f8b-49ef-4d9a-bb13-63b4b6c5fa2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1473 microversion: 2.1 time: 0.492259 Nov 03 03:54:42.672354 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 535/1036] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:42 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1473 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:43.339191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-15324e31-1f31-4bd6-9bd1-ec679f754e4d req-613f498c-f7f6-41e6-ab56-7fc1ba4463c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6e84a-57a6-4788-9864-9263e9f2e08d", "name": "network-vif-unplugged", "status": "completed", "tag": "78c74cd3-8416-43d4-86d6-a1a41c25566e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:43.357740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-15324e31-1f31-4bd6-9bd1-ec679f754e4d req-613f498c-f7f6-41e6-ab56-7fc1ba4463c5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:43.358473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-15324e31-1f31-4bd6-9bd1-ec679f754e4d req-613f498c-f7f6-41e6-ab56-7fc1ba4463c5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:43.362882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-15324e31-1f31-4bd6-9bd1-ec679f754e4d req-613f498c-f7f6-41e6-ab56-7fc1ba4463c5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:43.384156 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-15324e31-1f31-4bd6-9bd1-ec679f754e4d req-613f498c-f7f6-41e6-ab56-7fc1ba4463c5 service nova] Creating event network-vif-unplugged:78c74cd3-8416-43d4-86d6-a1a41c25566e for instance 05a6e84a-57a6-4788-9864-9263e9f2e08d on n-h1-854653-7 Nov 03 03:54:43.399103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-15324e31-1f31-4bd6-9bd1-ec679f754e4d req-613f498c-f7f6-41e6-ab56-7fc1ba4463c5 service nova] Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:54:43.418216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-15324e31-1f31-4bd6-9bd1-ec679f754e4d req-613f498c-f7f6-41e6-ab56-7fc1ba4463c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085235 Nov 03 03:54:43.419990 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 502/1037] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:43.525495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:43.527819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:43.563595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:43.564206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:43.566562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:43.568896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:43.576913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:43.578655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:43.698500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:43.699328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:43.717614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:43.720215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:43.721307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:43.724134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:43.724936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:43.725824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:44.438934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:44.450923 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ef8f101-9104-4488-a33b-efb52af62a3f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1473 microversion: 2.1 time: 0.758152 Nov 03 03:54:44.468881 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 503/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:43 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1473 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:44.472986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:44.484499 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e3b9a40c-5c76-4ad2-bad4-519b559c5cd5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1474 microversion: 2.1 time: 0.965349 Nov 03 03:54:44.487339 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 536/1039] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:43 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1474 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:44.909476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-05caeefb-49ad-46bd-b184-ad044e763e2f req-dc1e4e59-68d8-4e52-8962-cff812556b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ed1e03-ada4-4c50-83f4-90801903c28b", "name": "network-vif-deleted", "tag": "09035df0-e0e5-447c-88fa-26d50d1c7fbb"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:44.922892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-05caeefb-49ad-46bd-b184-ad044e763e2f req-dc1e4e59-68d8-4e52-8962-cff812556b5c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:44.924897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-05caeefb-49ad-46bd-b184-ad044e763e2f req-dc1e4e59-68d8-4e52-8962-cff812556b5c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:44.925534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-05caeefb-49ad-46bd-b184-ad044e763e2f req-dc1e4e59-68d8-4e52-8962-cff812556b5c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:44.946993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-05caeefb-49ad-46bd-b184-ad044e763e2f req-dc1e4e59-68d8-4e52-8962-cff812556b5c service nova] Creating event network-vif-deleted:09035df0-e0e5-447c-88fa-26d50d1c7fbb for instance 07ed1e03-ada4-4c50-83f4-90801903c28b on n-h1-854653-7 Nov 03 03:54:44.956694 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-05caeefb-49ad-46bd-b184-ad044e763e2f req-dc1e4e59-68d8-4e52-8962-cff812556b5c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053224 Nov 03 03:54:44.966914 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 504/1040] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:45.288288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f10030d6-ca29-44a9-b013-8249b814df90"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:45.291292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:45.311870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:45.312899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:45.315215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:45.315973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:45.319502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:45.322435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:45.475340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:45.477904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:45.495394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:45.497541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:45.500878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:45.504745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:45.505506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:45.518320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:45.643022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:45.643485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:45.643938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:45.644403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lazy-loading 'fault' on Instance uuid 07ed1e03-ada4-4c50-83f4-90801903c28b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:45.771036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:45.859541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:45.872448 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02a81c92-b9fb-4732-8624-fba438490938 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 200 len: 1307 microversion: 2.1 time: 0.399470 Nov 03 03:54:45.885419 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 505/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:45 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 1307 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:45.899696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:45.900741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:45.918753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:45.920566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:45.925890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:45.926894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:45.927547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:45.928405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.348118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:46.365832 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-55145c45-b76d-4799-a1c6-b6b737082d5f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1474 microversion: 2.1 time: 0.477551 Nov 03 03:54:46.366863 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 506/1042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:45 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1474 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:46.402001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0a63b25f-2b22-48a5-96c9-26cb65fefb1a req-7c082362-1d98-47e5-9ccb-f363208fc6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a6e84a-57a6-4788-9864-9263e9f2e08d", "tag": "78c74cd3-8416-43d4-86d6-a1a41c25566e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:46.416594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a63b25f-2b22-48a5-96c9-26cb65fefb1a req-7c082362-1d98-47e5-9ccb-f363208fc6a5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.417487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a63b25f-2b22-48a5-96c9-26cb65fefb1a req-7c082362-1d98-47e5-9ccb-f363208fc6a5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.418151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a63b25f-2b22-48a5-96c9-26cb65fefb1a req-7c082362-1d98-47e5-9ccb-f363208fc6a5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.432574 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0a63b25f-2b22-48a5-96c9-26cb65fefb1a req-7c082362-1d98-47e5-9ccb-f363208fc6a5 service nova] Creating event network-changed:78c74cd3-8416-43d4-86d6-a1a41c25566e for instance 05a6e84a-57a6-4788-9864-9263e9f2e08d on n-h1-854653-7 Nov 03 03:54:46.439565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-0a63b25f-2b22-48a5-96c9-26cb65fefb1a req-7c082362-1d98-47e5-9ccb-f363208fc6a5 service nova] Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:54:46.455493 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0a63b25f-2b22-48a5-96c9-26cb65fefb1a req-7c082362-1d98-47e5-9ccb-f363208fc6a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086575 Nov 03 03:54:46.456772 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 507/1043] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:46.646730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-88216be5-6024-4a8d-a303-462c1c75030e tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "POST /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.364269 Nov 03 03:54:46.653054 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 537/1044] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 03:54:45 2022] POST /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments => generated 194 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:46.710883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=57 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:46.795290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:46.801297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.805809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.806327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.807155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.807683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.808659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.878137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9486cf2f-ba7a-431d-8d3c-649483cbd966 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.419894 Nov 03 03:54:46.879277 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 508/1045] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:54:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:46.894136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:46.900064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:46.901393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 07ed1e03-ada4-4c50-83f4-90801903c28b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:46.913212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.914309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.915705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.918371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.918903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.919320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.919712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.920413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.920659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.921759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.922233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.922668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.935731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:46.944905 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance 07ed1e03-ada4-4c50-83f4-90801903c28b could not be found. Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b HTTP/1.1 Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 07ed1e03-ada4-4c50-83f4-90801903c28b could not be found. Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '07ed1e03-ada4-4c50-83f4-90801903c28b'} Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ed1e03-ada4-4c50-83f4-90801903c28b could not be found. Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ed1e03-ada4-4c50-83f4-90801903c28b could not be found. Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:46.947419 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ed1e03-ada4-4c50-83f4-90801903c28b could not be found. Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance 07ed1e03-ada4-4c50-83f4-90801903c28b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:46.951573 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42bcb4d1-ed9b-435a-a782-c71c3229f047 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b" status: 404 len: 111 microversion: 2.1 time: 0.053232 Nov 03 03:54:46.953332 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 509/1046] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:46 2022] GET /compute/v2.1/servers/07ed1e03-ada4-4c50-83f4-90801903c28b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:46.965507 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b6a8120-8b1c-496d-a361-6468614bd8e7 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-854653-7" status: 200 len: 578 microversion: 2.1 time: 0.077744 Nov 03 03:54:46.966173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:46.966941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:46.969536 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 538/1047] 10.222.0.30 () {58 vars in 1172 bytes} [Thu Nov 3 03:54:46 2022] GET /compute/v2.1/os-services?host=n-d-854653-7 => generated 578 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:46.987784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.989574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:46.990188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.990735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.991648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:46.993529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:46.994098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:46.996832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.005960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.005960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.005960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.005960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.005960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.056920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:47.067138 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39cb3ea9-a609-487b-8ac5-9a40ee80adce tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087855 Nov 03 03:54:47.087665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:47.088261 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 539/1048] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:54:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:47.093938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:47.097632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.098263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.104536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.105541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.106133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.106672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.155239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4839337-8342-4881-8cc6-cfaf39549874 tempest-ServicesAdminTestJSON-963446336 tempest-ServicesAdminTestJSON-963446336-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.065579 Nov 03 03:54:47.156789 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 540/1049] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:54:47 2022] GET /compute/v2.1/os-services => generated 944 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:47.391736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:47.392912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:47.407448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.408648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.410853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.412909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.414783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.416189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.472012 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e4c0a3ae-d7d1-4945-b76d-d5e11f71d911 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 204 len: 0 microversion: 2.1 time: 0.513306 Nov 03 03:54:47.472652 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 510/1050] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:46 2022] DELETE /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:47.482494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:47.483481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:47.498312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.501833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.502581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.503778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.505995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.506601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.551059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:47.924331 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d13fb4ba-28b7-4acd-9278-9b1a75a2dc55 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 204 len: 0 microversion: 2.1 time: 0.431276 Nov 03 03:54:47.924331 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 511/1051] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:47 2022] DELETE /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:54:47.928429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:47.929547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:47.941877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.942549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.943307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.945696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:47.946499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:47.950070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:47.966624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:47.986302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-888b4fea-1b99-4d61-90dc-47ce263a2968 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1472 microversion: 2.1 time: 0.596209 Nov 03 03:54:48.010971 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 541/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:47 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1472 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:48.225123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:48.232841 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce6366dc-017f-4d3a-b7a1-269284664e7f tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1475 microversion: 2.1 time: 0.309787 Nov 03 03:54:48.249757 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 512/1053] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:47 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1475 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:49.018490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:49.019793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:49.028703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:49.030106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:49.030856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:49.031808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:49.032476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:49.033196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:49.265304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:49.266544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:49.275861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:49.283152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:49.285412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:49.286071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:49.287880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:49.289993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:49.290661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:49.351404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:49.363283 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b6b9e4c-667a-46b2-a23b-522ee555a1ec tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1472 microversion: 2.1 time: 0.349551 Nov 03 03:54:49.364546 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 542/1054] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:49 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:49.678950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:49.695462 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45a99270-cc6a-4090-a20d-3256dea1c5bf tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1475 microversion: 2.1 time: 0.429700 Nov 03 03:54:49.695462 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 513/1055] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:49 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1475 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:50.395421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:50.396075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:50.432088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:50.434609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:50.438555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:50.441414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:50.442315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:50.444491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:50.721416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:50.722098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:50.732328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:50.737375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:50.737992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:50.738943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:50.739573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:50.740153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:50.963423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:50.978098 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44db30e8-5b07-4d19-95ac-4e6d0b31b783 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1472 microversion: 2.1 time: 0.593238 Nov 03 03:54:50.993050 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 543/1056] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:50 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1472 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:51.293377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=63 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:51.371457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:51.386465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71d15190-fec5-43e3-897f-fdd63124d014 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1475 microversion: 2.1 time: 0.667584 Nov 03 03:54:51.390867 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 514/1057] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:50 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1475 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:51.569852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2a42e0f2-31c1-49a0-8b9d-9bfbaa3e26a6 req-de4e88ae-4f88-4a08-8c41-1480039a693b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5", "name": "network-vif-deleted", "tag": "41b4ae7a-5902-4ee5-b545-38667d17f6d4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:51.585814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2a42e0f2-31c1-49a0-8b9d-9bfbaa3e26a6 req-de4e88ae-4f88-4a08-8c41-1480039a693b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:51.587143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2a42e0f2-31c1-49a0-8b9d-9bfbaa3e26a6 req-de4e88ae-4f88-4a08-8c41-1480039a693b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:51.587668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2a42e0f2-31c1-49a0-8b9d-9bfbaa3e26a6 req-de4e88ae-4f88-4a08-8c41-1480039a693b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:51.588322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1212781915", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "2752c8c3-e485-420b-a57b-73b9e6895e51"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:51.668361 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2a42e0f2-31c1-49a0-8b9d-9bfbaa3e26a6 req-de4e88ae-4f88-4a08-8c41-1480039a693b service nova] Creating event network-vif-deleted:41b4ae7a-5902-4ee5-b545-38667d17f6d4 for instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 on n-h2-854653-7 Nov 03 03:54:51.687501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2a42e0f2-31c1-49a0-8b9d-9bfbaa3e26a6 req-de4e88ae-4f88-4a08-8c41-1480039a693b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122336 Nov 03 03:54:51.691207 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 515/1058] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:51.723979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] validate_networks() for [('2752c8c3-e485-420b-a57b-73b9e6895e51', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:52.011403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:52.013581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:52.031366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:52.042079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:52.042865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:52.045235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:52.046685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:52.048616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:53.099654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:53.137995 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5ccb10f2-d9a2-4bbe-a607-d560b69f897d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1469 microversion: 2.1 time: 1.129959 Nov 03 03:54:53.139117 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 516/1059] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:52 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1469 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:53.156222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:53.159268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:53.186106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:53.187338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:53.187787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:53.191902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:53.192638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:53.193137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:53.689559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:53.705499 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-32c5df7e-8c9a-49d2-b15c-38f5a21e0914 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1475 microversion: 2.1 time: 0.562383 Nov 03 03:54:53.718555 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 517/1060] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:53 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1475 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:53.718555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:53.718555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:53.718555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:53.718555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:53.718555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:53.719264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:53.719897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:53.720473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:53.954423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:53.955400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:53.956036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:53.956625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:53.957851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:53.970349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:53.973947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:53.973947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:53.973947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:53.973947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:53.973947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:53.984544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=28 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:54.005641 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98fbfc62-3a9f-405e-9642-e4fffae8052a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d/action" status: 204 len: 0 microversion: 2.1 time: 0.297045 Nov 03 03:54:54.008050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 518/1061] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:54:53 2022] POST /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d/action => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:54.039090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:54.042917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for user 7ebbc13908db44e88853d5c14c8e2102 and project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:54.069044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:54:54.075333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:54:54.295891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5e5044c7-cedb-406e-b08f-11e355fa1854 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.005056 Nov 03 03:54:54.296538 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 544/1062] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 03:54:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3010 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 03 03:54:54.309331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1104345419", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:54.355470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:54.356688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:54.384551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:54.387721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:54.390051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:54.396531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:54.398089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:54.402230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:54.432718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:55.183230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:55.207758 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4bab32fa-2d2b-4f07-89d6-90750527ccaf tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1469 microversion: 2.1 time: 0.905545 Nov 03 03:54:55.208656 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 545/1063] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:54 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1469 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:55.226895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6beed7e9-79f0-45e4-9a5d-ff1f3c44d0f3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:55.227723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6beed7e9-79f0-45e4-9a5d-ff1f3c44d0f3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:55.294685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:55.295136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:55.295622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:55.296599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:55.297038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:55.321808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:55.324236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:55.325856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:55.329365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:55.329365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:55.329365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:55.341044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6beed7e9-79f0-45e4-9a5d-ff1f3c44d0f3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:55.350802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6beed7e9-79f0-45e4-9a5d-ff1f3c44d0f3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:55.352512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6beed7e9-79f0-45e4-9a5d-ff1f3c44d0f3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:55.354025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Getting quotas for project 75abb61bee2f4e6dadffbd21b8ad0096. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:55.359829 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6beed7e9-79f0-45e4-9a5d-ff1f3c44d0f3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1262 microversion: 2.25 time: 0.135584 Nov 03 03:54:55.363580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Getting quotas for user 713b3bde635745918bd322e07a240519 and project 75abb61bee2f4e6dadffbd21b8ad0096. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:55.375769 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 546/1064] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:54:55 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1262 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:54:55.386751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-842cc8ef-d7df-4f38-b9e8-13cd29361f27 req-542a70a6-f23d-4138-8a13-94b79e70fb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb682fda-192b-4143-937c-92dd4e7c5a23", "name": "network-vif-deleted", "tag": "44a5439b-effe-4ab4-8b8d-2b01e36f09f5"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:55.393927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:54:55.397099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:54:55.410606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-842cc8ef-d7df-4f38-b9e8-13cd29361f27 req-542a70a6-f23d-4138-8a13-94b79e70fb05 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:55.416876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-842cc8ef-d7df-4f38-b9e8-13cd29361f27 req-542a70a6-f23d-4138-8a13-94b79e70fb05 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:55.417473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-842cc8ef-d7df-4f38-b9e8-13cd29361f27 req-542a70a6-f23d-4138-8a13-94b79e70fb05 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:55.444329 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-842cc8ef-d7df-4f38-b9e8-13cd29361f27 req-542a70a6-f23d-4138-8a13-94b79e70fb05 service nova] Creating event network-vif-deleted:44a5439b-effe-4ab4-8b8d-2b01e36f09f5 for instance eb682fda-192b-4143-937c-92dd4e7c5a23 on n-h1-854653-7 Nov 03 03:54:55.452179 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-842cc8ef-d7df-4f38-b9e8-13cd29361f27 req-542a70a6-f23d-4138-8a13-94b79e70fb05 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075056 Nov 03 03:54:55.456896 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 547/1065] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:55.471226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:55.475260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:55.495556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:55.496426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:55.497094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:55.499003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:55.499696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:55.500537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:55.575766 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-93f39835-673c-4ad5-a2e3-34b94bf4a261 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.565798 Nov 03 03:54:55.579979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:55.580858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:55.581543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:55.582210 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 519/1066] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:54:55.586099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lazy-loading 'fault' on Instance uuid eb682fda-192b-4143-937c-92dd4e7c5a23 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:54:55.604630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1f2aaed-4068-4c40-a351-5c0e3d220b07 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:55.605789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b1f2aaed-4068-4c40-a351-5c0e3d220b07 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:55.670047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:55.687076 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b92d5f96-0398-402c-9aa0-4e6d29a4dacb tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 200 len: 1309 microversion: 2.1 time: 0.228169 Nov 03 03:54:55.702980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 548/1067] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:55 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:55.965240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b1f2aaed-4068-4c40-a351-5c0e3d220b07 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:55.978037 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1f2aaed-4068-4c40-a351-5c0e3d220b07 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1217 microversion: 2.1 time: 0.393912 Nov 03 03:54:55.978625 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 520/1068] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:55 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1217 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:56.236105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:56.241076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:56.248223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.249507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.250147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.251094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.258943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.259503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.389006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:56.390242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:56.408634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.411957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.413546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.415841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.417751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.420011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.671396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:56.681935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:56.683416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:56.684646 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0743aa7-d5ee-41b8-99e9-762a1466a811 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1258 microversion: 2.25 time: 0.300566 Nov 03 03:54:56.689971 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 521/1069] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:54:56 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1258 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:54:56.706402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:56.723295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:56.726211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: eb682fda-192b-4143-937c-92dd4e7c5a23] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:56.728673 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5f81d15-fea8-409c-80a5-94360ddcbdd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1469 microversion: 2.1 time: 0.496763 Nov 03 03:54:56.734418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 549/1070] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:56 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1469 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:56.752618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.754598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.754598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.754598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.755513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.756369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.775347 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance eb682fda-192b-4143-937c-92dd4e7c5a23 could not be found. Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 HTTP/1.1 Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance eb682fda-192b-4143-937c-92dd4e7c5a23 could not be found. Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'eb682fda-192b-4143-937c-92dd4e7c5a23'} Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb682fda-192b-4143-937c-92dd4e7c5a23 could not be found. Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb682fda-192b-4143-937c-92dd4e7c5a23 could not be found. Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:56.777672 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb682fda-192b-4143-937c-92dd4e7c5a23 could not be found. Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.784887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance eb682fda-192b-4143-937c-92dd4e7c5a23 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:56.786271 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-daaed899-5943-403e-9006-35e6417bd585 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23" status: 404 len: 111 microversion: 2.1 time: 0.071013 Nov 03 03:54:56.789332 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 522/1071] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:56 2022] GET /compute/v2.1/servers/eb682fda-192b-4143-937c-92dd4e7c5a23 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:56.803740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:56.804377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:56.811352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.812437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.813126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.814736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.814736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.815421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.831504 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 could not be found. Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 HTTP/1.1 Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 could not be found. Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5'} Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 could not be found. Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 could not be found. Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:54:56.833897 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 could not be found. Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance 1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:54:56.840826 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4faf339f-6a99-4b20-b4d6-395be5f5bc4e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5" status: 404 len: 111 microversion: 2.1 time: 0.044281 Nov 03 03:54:56.843431 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 550/1072] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:56 2022] GET /compute/v2.1/servers/1cc7cbfc-b0ef-41b5-8062-6841b14cdbb5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:54:56.850798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05a10d58-b21e-4cdf-ad68-65ef15c51d1c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:56.949913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05a10d58-b21e-4cdf-ad68-65ef15c51d1c tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/7f3feee2-6ae4-48b8-b755-6e98ff81572d" status: 204 len: 0 microversion: 2.1 time: 0.104929 Nov 03 03:54:56.951072 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 523/1073] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 03:54:56 2022] DELETE /compute/v2.1/os-server-groups/7f3feee2-6ae4-48b8-b755-6e98ff81572d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:54:56.960832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:56.961659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:56.975145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.975659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.976108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:56.976824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:56.980893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:56.985841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:57.004320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b98a95e-9b22-4efc-9b44-d2618932690d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:57.004979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6b98a95e-9b22-4efc-9b44-d2618932690d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:57.072950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:57.133482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6b98a95e-9b22-4efc-9b44-d2618932690d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:57.145233 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b98a95e-9b22-4efc-9b44-d2618932690d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1217 microversion: 2.1 time: 0.145015 Nov 03 03:54:57.160524 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 524/1074] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:56 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:57.481576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c87f8d3e-df59-4b93-9a38-b4a780912116 req-7753f58b-af78-4cba-8c5f-9737b0cf2f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6e84a-57a6-4788-9864-9263e9f2e08d", "name": "network-vif-plugged", "status": "completed", "tag": "78c74cd3-8416-43d4-86d6-a1a41c25566e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:57.525947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c87f8d3e-df59-4b93-9a38-b4a780912116 req-7753f58b-af78-4cba-8c5f-9737b0cf2f44 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:57.526971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c87f8d3e-df59-4b93-9a38-b4a780912116 req-7753f58b-af78-4cba-8c5f-9737b0cf2f44 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:57.527741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c87f8d3e-df59-4b93-9a38-b4a780912116 req-7753f58b-af78-4cba-8c5f-9737b0cf2f44 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:57.549982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c87f8d3e-df59-4b93-9a38-b4a780912116 req-7753f58b-af78-4cba-8c5f-9737b0cf2f44 service nova] Creating event network-vif-plugged:78c74cd3-8416-43d4-86d6-a1a41c25566e for instance 05a6e84a-57a6-4788-9864-9263e9f2e08d on n-h1-854653-7 Nov 03 03:54:57.563178 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c87f8d3e-df59-4b93-9a38-b4a780912116 req-7753f58b-af78-4cba-8c5f-9737b0cf2f44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082873 Nov 03 03:54:57.564319 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 525/1075] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:54:57.594658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15ea3bd7-bf00-4ccd-b9c4-b501c907e1f4 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 204 len: 0 microversion: 2.1 time: 0.638142 Nov 03 03:54:57.595998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 551/1076] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:56 2022] DELETE /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:57.605155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:57.605857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:57.614922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:57.615433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:57.615881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:57.616602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:57.617090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:57.617527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:57.658281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:54:57.722903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:57.723643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:57.730811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:57.731379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:57.732139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:57.733866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:57.738529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:57.738529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:57.843022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:57.851831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:57.855093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:57.856236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e3cd75f4-dc54-4a29-a225-b46546453ef1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1314 microversion: 2.25 time: 0.140143 Nov 03 03:54:57.856795 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 552/1077] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:54:57 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:54:57.864132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:57.864945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:57.876124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:57.876633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:57.877814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:57.878562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:57.879068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:57.879690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.047390 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18b10c5e-8b2b-4e31-ac5d-1dcb1ff46b53 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 204 len: 0 microversion: 2.1 time: 0.446559 Nov 03 03:54:58.052260 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 526/1078] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:54:57 2022] DELETE /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:54:58.062316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:58.063049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:58.089726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.090259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.090697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.091428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.097675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.100355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.112133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:58.557505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:58.566051 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85811500-e68c-4185-9e48-e00a85b36e20 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 200 len: 1475 microversion: 2.1 time: 0.512233 Nov 03 03:54:58.567079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:58.567388 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 527/1079] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:58 2022] GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 1475 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:58.572290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:58.573238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:58.578351 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-45c89dea-d8c2-4cec-9673-38d8ef353b74 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1461 microversion: 2.1 time: 0.720227 Nov 03 03:54:58.580469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.581240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.581838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.582707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.583323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.583928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.593964 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 553/1080] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:57 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1461 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:58.602205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:58.602840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:58.613535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.614465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.615290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.616180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.621447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.622096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.706621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:58.715003 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b10224d-a24a-4b1e-851a-606e82b6254b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1221 microversion: 2.1 time: 0.146339 Nov 03 03:54:58.717052 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 528/1081] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:58 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:58.883979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:58.888931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:58.894111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.894508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.895164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.896121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:58.896770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:58.897928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:58.942277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:58.950804 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ca6d6c3-2450-4c42-83a5-3ad74ca7c6ca tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1461 microversion: 2.1 time: 0.352555 Nov 03 03:54:58.957709 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 554/1082] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:58 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1461 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:54:58.984386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a1cf53b8-5f74-4a42-bc62-f5fe5feaac35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'create', calling method: .version_select at 0x7ff7f927b820>, body: {"keypair": {"name": "tempest-keypair-1134022048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkxYxNh+NP3wUMC5AyQWAZkwMI/+ATBxNGMkwJ14lkW2zMN5CdeG/AaORCJwDAEh7DibKpnp381zx8FBvWLhJv70Qdb/bZvmaJcTSMKzqYl1/ffj0QS0xFYzCu3yuuNAw=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:58.986043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:58.996700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:58.998325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:59.000116 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d104685-59de-4b4a-b3cc-d37cf694a2e2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1322 microversion: 2.25 time: 0.122393 Nov 03 03:54:59.001517 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 529/1083] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:54:58 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1322 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:54:59.001925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a1cf53b8-5f74-4a42-bc62-f5fe5feaac35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for project 68cd41e9643b443b81b22489194213c7. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:59.008319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a1cf53b8-5f74-4a42-bc62-f5fe5feaac35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for user 74ac442756f54baa8b70bb302b35b95c and project 68cd41e9643b443b81b22489194213c7. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:59.027309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:54:59.126630 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a1cf53b8-5f74-4a42-bc62-f5fe5feaac35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.147310 Nov 03 03:54:59.127732 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 555/1084] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:54:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:54:59.205005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-371499781", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "25261195-157d-4c7b-8cfb-4fb3b385217e"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:54:59.286258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] validate_networks() for [('25261195-157d-4c7b-8cfb-4fb3b385217e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:54:59.595055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:59.596002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:59.608431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:59.608431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:59.608431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:59.608431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:59.608431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:59.608431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:59.817732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:54:59.818231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:54:59.819087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:54:59.819514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:54:59.819974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:54:59.834287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:59.834795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:59.835240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:59.835982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:59.836449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:59.836897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:59.866328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:54:59.871687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:54:59.875934 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fdde6ac1-c712-4b12-aece-5561bf6b0c2d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 200 len: 1475 microversion: 2.1 time: 0.286505 Nov 03 03:54:59.882163 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 556/1085] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:59 2022] GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 1475 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:54:59.882163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:54:59.882367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for user baa7ebbbe2c14c82b5a07fef33cc214a and project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:54:59.883182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:54:59.890119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:59.890940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:59.891582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:59.892489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:54:59.893190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:54:59.893825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:54:59.896247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:54:59.898644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:54:59.989933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:00.004492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-86624adb-bf30-4157-9f78-5130f6a9edf6 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1213 microversion: 2.1 time: 0.125906 Nov 03 03:55:00.005355 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 557/1086] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:54:59 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:00.031637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:00.032327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:00.039246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:00.039860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:00.040405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:00.041275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:00.041846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:00.042379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:00.132667 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b686e6d-06fa-441e-b1ac-96f28bfe5b0f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014881 Nov 03 03:55:00.135439 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 530/1087] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:54:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:55:00.150188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8d2759d-623a-470b-8454-1a2799bcaf83 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:00.152742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8d2759d-623a-470b-8454-1a2799bcaf83 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:00.195768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:00.203413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:00.207448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:00.209883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:00.212124 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7dc4b776-bbd5-433c-81b2-d2a4e6a35b15 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1332 microversion: 2.25 time: 0.184084 Nov 03 03:55:00.213310 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 558/1088] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:00 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1332 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:55:00.307363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8d2759d-623a-470b-8454-1a2799bcaf83 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:00.322987 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8d2759d-623a-470b-8454-1a2799bcaf83 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1214 microversion: 2.1 time: 0.180604 Nov 03 03:55:00.328022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 531/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:00 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:00.917976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:00.919206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:00.928210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:00.929106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:00.929794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:00.930802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:00.931491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:00.932416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:01.028779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:01.029509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:01.053460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:01.054481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:01.055171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:01.056779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:01.059377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:01.062733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:01.234296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:01.243146 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7750ad90-0894-49ef-8bf3-02d7257a912d tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1269 microversion: 2.1 time: 0.219199 Nov 03 03:55:01.249960 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 532/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:01 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:01.254920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-06ba8136-62b9-4025-976d-365a02bf9036 req-224c88e6-7ce9-4e60-9c20-b29e9932f965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0559920c-7ef3-41c1-a19b-908e2f345a0b", "name": "network-vif-deleted", "tag": "0733053d-83ad-4f44-ad78-c2f1c3894f57"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:01.281043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-06ba8136-62b9-4025-976d-365a02bf9036 req-224c88e6-7ce9-4e60-9c20-b29e9932f965 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:01.283911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-06ba8136-62b9-4025-976d-365a02bf9036 req-224c88e6-7ce9-4e60-9c20-b29e9932f965 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:01.284474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-06ba8136-62b9-4025-976d-365a02bf9036 req-224c88e6-7ce9-4e60-9c20-b29e9932f965 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:01.311095 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-06ba8136-62b9-4025-976d-365a02bf9036 req-224c88e6-7ce9-4e60-9c20-b29e9932f965 service nova] Creating event network-vif-deleted:0733053d-83ad-4f44-ad78-c2f1c3894f57 for instance 0559920c-7ef3-41c1-a19b-908e2f345a0b on n-h1-854653-7 Nov 03 03:55:01.321002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-06ba8136-62b9-4025-976d-365a02bf9036 req-224c88e6-7ce9-4e60-9c20-b29e9932f965 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068144 Nov 03 03:55:01.321002 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 533/1091] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:01.329765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:01.347029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:01.357068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:01.357893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:01.358588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:01.371608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:01.375261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:01.376770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:01.458136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:01.474090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-34d8e259-aaef-4aad-852a-2ab2ecdc5bec tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 200 len: 1475 microversion: 2.1 time: 0.567685 Nov 03 03:55:01.502198 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 559/1092] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:00 2022] GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 1475 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:01.516020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8d57d9b4-af8b-4de1-8b16-e752fed3bd22 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:01.516646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8d57d9b4-af8b-4de1-8b16-e752fed3bd22 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:01.799630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8d57d9b4-af8b-4de1-8b16-e752fed3bd22 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:01.827203 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8d57d9b4-af8b-4de1-8b16-e752fed3bd22 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1214 microversion: 2.1 time: 0.323730 Nov 03 03:55:01.828054 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 560/1093] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:01 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:02.159584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:02.175983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:02.177719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:02.181004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-036bf03e-0192-4f06-94a2-727607f8a685 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.856980 Nov 03 03:55:02.185197 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 534/1094] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:01 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:02.271704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:02.272447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:02.312425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:02.319504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:02.320573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:02.324174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:02.330211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:02.335268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:02.514127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:02.515304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:02.530485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:02.530991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:02.531435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:02.537740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:02.538452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:02.539065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:02.543561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:02.565734 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c900d419-7fc8-4edf-a504-f88b35087621 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1275 microversion: 2.1 time: 0.297882 Nov 03 03:55:02.566332 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 561/1095] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:02 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:02.684478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-267834d1-b254-490c-884d-83dc7fcd587e req-88ebb037-efb6-4530-b523-9a8b9e6148ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac54f27-7411-4e64-a59a-25eb34ef7eb4", "name": "network-vif-deleted", "tag": "234ef2f1-6a7d-409d-8151-536e381d8502"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:02.696369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-267834d1-b254-490c-884d-83dc7fcd587e req-88ebb037-efb6-4530-b523-9a8b9e6148ae service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:02.697251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-267834d1-b254-490c-884d-83dc7fcd587e req-88ebb037-efb6-4530-b523-9a8b9e6148ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:02.703957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-267834d1-b254-490c-884d-83dc7fcd587e req-88ebb037-efb6-4530-b523-9a8b9e6148ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:02.721053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-267834d1-b254-490c-884d-83dc7fcd587e req-88ebb037-efb6-4530-b523-9a8b9e6148ae service nova] Creating event network-vif-deleted:234ef2f1-6a7d-409d-8151-536e381d8502 for instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 on n-h1-854653-7 Nov 03 03:55:02.727782 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-267834d1-b254-490c-884d-83dc7fcd587e req-88ebb037-efb6-4530-b523-9a8b9e6148ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047894 Nov 03 03:55:02.731656 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 562/1096] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:55:02.853100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:02.855056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:02.869992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:02.870506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:02.870964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:02.871696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:02.872164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:02.872599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:03.197097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:03.207430 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d7a4ad7-3f8e-4f01-b5c3-3dd8f643859a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 200 len: 1433 microversion: 2.1 time: 0.697362 Nov 03 03:55:03.208247 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 535/1097] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:02 2022] GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 1433 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:03.213215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:03.213898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:03.221139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:03.221701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:03.222387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:03.223158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:03.223802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:03.224240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:03.245558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:03.257771 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-738fd0b0-2a35-479f-9b5e-7da58d51838f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1266 microversion: 2.1 time: 0.407863 Nov 03 03:55:03.258661 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 563/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:02 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:03.592778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:03.593479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:03.600756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:03.601276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:03.601720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:03.602434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:03.602896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:03.603329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:03.626307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:03.638322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:03.639842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:03.640993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-116eb913-af6a-4af7-af00-a0556a8d16d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.431508 Nov 03 03:55:03.645366 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 536/1099] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:03 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:03.906594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:03.935307 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da66fcfa-e5be-47e3-8508-02abc5e36831 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.343112 Nov 03 03:55:03.937536 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 564/1100] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:03 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:04.230399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.231976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 8ac54f27-7411-4e64-a59a-25eb34ef7eb4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:04.245720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.246357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.247363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.249930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.250512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.253819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.271833 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 could not be found. Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 HTTP/1.1 Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 could not be found. Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8ac54f27-7411-4e64-a59a-25eb34ef7eb4'} Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 could not be found. Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 could not be found. Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:04.273783 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.278563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:04.278563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:04.278563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:04.278563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:04.278563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:04.278563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 could not be found. Nov 03 03:55:04.278563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.279927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance 8ac54f27-7411-4e64-a59a-25eb34ef7eb4 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:04.280926 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86ea366a-4e47-4c8f-994f-f9c1371b47bd tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4" status: 404 len: 111 microversion: 2.1 time: 0.054391 Nov 03 03:55:04.282625 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 537/1101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:04 2022] GET /compute/v2.1/servers/8ac54f27-7411-4e64-a59a-25eb34ef7eb4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:55:04.288818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.289723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:04.307025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.307793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.308018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.308435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.308668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 0559920c-7ef3-41c1-a19b-908e2f345a0b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:04.309392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.309965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.310521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.318697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.319704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.320376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.321346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.331536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.334414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.357249 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance 0559920c-7ef3-41c1-a19b-908e2f345a0b could not be found. Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b HTTP/1.1 Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0559920c-7ef3-41c1-a19b-908e2f345a0b could not be found. Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0559920c-7ef3-41c1-a19b-908e2f345a0b'} Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0559920c-7ef3-41c1-a19b-908e2f345a0b could not be found. Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0559920c-7ef3-41c1-a19b-908e2f345a0b could not be found. Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:04.359767 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0559920c-7ef3-41c1-a19b-908e2f345a0b could not be found. Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance 0559920c-7ef3-41c1-a19b-908e2f345a0b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bbe5f425-da50-4c75-8366-eba235223095 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b" status: 404 len: 111 microversion: 2.1 time: 0.067718 Nov 03 03:55:04.368136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 538/1102] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:04 2022] GET /compute/v2.1/servers/0559920c-7ef3-41c1-a19b-908e2f345a0b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:55:04.394740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9da4a280-262a-463a-8f4d-9ff42e758488 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.425089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:04.435318 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d0e648dc-a0bd-4139-8294-9b9272d5989a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1266 microversion: 2.1 time: 0.151398 Nov 03 03:55:04.436548 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 565/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:04 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:04.441349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:04.538474 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9da4a280-262a-463a-8f4d-9ff42e758488 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/fa87d659-57c4-49f8-9f9a-3812226b8b89" status: 204 len: 0 microversion: 2.1 time: 0.155837 Nov 03 03:55:04.541071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 539/1104] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 03:55:04 2022] DELETE /compute/v2.1/os-server-groups/fa87d659-57c4-49f8-9f9a-3812226b8b89 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:55:04.550722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.551736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:04.556128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:04.561401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.562175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.562768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.563910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.564447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.565529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.594535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:55:04.663393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-788cbd8f-295c-41c8-820d-446ca3680f7b tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '.version_select at 0x7ff7f9861700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.666832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-788cbd8f-295c-41c8-820d-446ca3680f7b tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.667315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-788cbd8f-295c-41c8-820d-446ca3680f7b tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.667988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-788cbd8f-295c-41c8-820d-446ca3680f7b tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.680969 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-788cbd8f-295c-41c8-820d-446ca3680f7b tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.021162 Nov 03 03:55:04.681600 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 540/1105] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:55:04 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:04.700695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.701356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:04.709831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.711935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.711935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.711935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.712575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:04.713041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:04.955579 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39028405-9edb-4c54-8cbf-ed079280ca8a tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "DELETE /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 204 len: 0 microversion: 2.1 time: 0.407936 Nov 03 03:55:04.955949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:04.956736 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 566/1106] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:55:04 2022] DELETE /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:55:04.962196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c1a3920-311b-4e9e-b1e1-f512aab7308a tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:04.966675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:04.969169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:04.970474 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-713558ef-55f3-4561-8cc1-574b0d556e89 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.277885 Nov 03 03:55:04.971627 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 541/1107] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:04 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:04.976702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-bf2e7a9b-013a-4435-b829-21a489dfeb9c req-aadc0e59-3dd1-4f14-bf29-c9a216acb844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a8b2ed9-05a6-4f4a-b8c4-2cd266662985", "tag": "450f08dc-4ccc-4a7b-a22a-21e428fb7d29"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:04.987026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bf2e7a9b-013a-4435-b829-21a489dfeb9c req-aadc0e59-3dd1-4f14-bf29-c9a216acb844 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:04.992010 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c1a3920-311b-4e9e-b1e1-f512aab7308a tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033962 Nov 03 03:55:04.992603 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 567/1108] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:55:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:05.003425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:05.003517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bf2e7a9b-013a-4435-b829-21a489dfeb9c req-aadc0e59-3dd1-4f14-bf29-c9a216acb844 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.003621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:05.003728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bf2e7a9b-013a-4435-b829-21a489dfeb9c req-aadc0e59-3dd1-4f14-bf29-c9a216acb844 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.008911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.009753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.010202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.010989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.011448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.011880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.020010 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-bf2e7a9b-013a-4435-b829-21a489dfeb9c req-aadc0e59-3dd1-4f14-bf29-c9a216acb844 service nova] Creating event network-changed:450f08dc-4ccc-4a7b-a22a-21e428fb7d29 for instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 on n-h1-854653-7 Nov 03 03:55:05.035456 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-bf2e7a9b-013a-4435-b829-21a489dfeb9c req-aadc0e59-3dd1-4f14-bf29-c9a216acb844 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062250 Nov 03 03:55:05.036340 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 542/1109] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:05.044821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:05.047005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:05.066598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.067510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.068157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.069271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.069892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.070659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.372559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:05.378111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:05.382837 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82b305e1-5b36-4ef9-8df8-708c63b62d2c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.388260 Nov 03 03:55:05.383749 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 568/1110] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:04 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:05.393188 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e58bfcc-181e-4ea1-b62e-7d0c20fbd5ef tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1470 microversion: 2.1 time: 0.349358 Nov 03 03:55:05.393188 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 543/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:05 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:05.393188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5567a22c-0fde-448b-9851-167b5fef7c78 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1682173339", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:05.398590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5a990fed-4e34-40b3-a20c-8dab1333abf1 req-3d175354-73c8-4180-b2d5-0441ce3a56ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74914149-185f-4400-9df8-cc7132fb7cdf", "tag": "3d61c39b-2b5c-4d82-806d-4907f6f7ee1e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:05.409295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a990fed-4e34-40b3-a20c-8dab1333abf1 req-3d175354-73c8-4180-b2d5-0441ce3a56ae service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.409773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a990fed-4e34-40b3-a20c-8dab1333abf1 req-3d175354-73c8-4180-b2d5-0441ce3a56ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.410199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a990fed-4e34-40b3-a20c-8dab1333abf1 req-3d175354-73c8-4180-b2d5-0441ce3a56ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.421340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5a990fed-4e34-40b3-a20c-8dab1333abf1 req-3d175354-73c8-4180-b2d5-0441ce3a56ae service nova] Creating event network-changed:3d61c39b-2b5c-4d82-806d-4907f6f7ee1e for instance 74914149-185f-4400-9df8-cc7132fb7cdf on n-h1-854653-7 Nov 03 03:55:05.426055 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5a990fed-4e34-40b3-a20c-8dab1333abf1 req-3d175354-73c8-4180-b2d5-0441ce3a56ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031179 Nov 03 03:55:05.426632 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 569/1112] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:05.431811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:05.435114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:05.440289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.440713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.441208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.441917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.442368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.442789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.472235 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6117424-57e7-46a6-b0a4-049e9f5bf8bb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Nov 03 03:55:05.472782 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 570/1113] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:55:05 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:05.477200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:05.477800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:05.483392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.483873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.484308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.484996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.485739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.486164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.495736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5567a22c-0fde-448b-9851-167b5fef7c78 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.106815 Nov 03 03:55:05.497721 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 544/1114] 10.222.0.30 () {60 vars in 1146 bytes} [Thu Nov 3 03:55:05 2022] POST /compute/v2.1/flavors => generated 499 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:05.501756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:05.502313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:05.508154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.508648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.509124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.509837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.510302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.510740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.554583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:05.562971 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f0f680d-2a05-4b03-9210-8bf603ae2238 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1274 microversion: 2.1 time: 0.089114 Nov 03 03:55:05.563542 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 571/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:05 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:05.568481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3866348-9696-4e88-b49a-657e6168d891 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:05.576243 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3866348-9696-4e88-b49a-657e6168d891 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011717 Nov 03 03:55:05.576792 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 572/1116] 10.222.0.30 () {58 vars in 1182 bytes} [Thu Nov 3 03:55:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:55:05.656730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lazy-loading 'services' on Instance uuid 088f74bc-3359-48f9-951b-a8ffed40674d {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:05.677998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-418499834", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "bfea094b-54bf-4696-b299-ab9360307d29"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:05.733836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:55:05.911594 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2887ed3a-ce95-4d38-aa77-4c69bbb2c914 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "DELETE /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments/f10030d6-ca29-44a9-b013-8249b814df90" status: 202 len: 0 microversion: 2.1 time: 0.413764 Nov 03 03:55:05.912392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 545/1117] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 03:55:05 2022] DELETE /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments/f10030d6-ca29-44a9-b013-8249b814df90 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:55:05.950137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:55:05.950520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:55:05.950978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:55:05.951387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:55:05.951854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:55:05.961242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.961534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.961977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.962707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:05.963233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:05.963661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:05.989757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:55:05.994911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for user 74ac442756f54baa8b70bb302b35b95c and project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:55:05.996568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:05.997304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:06.004089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.005357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.005357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.006108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.006632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.007051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.007649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:55:06.010029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:55:06.128231 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9e87a21-4fec-441c-91c2-f5551a08584f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454959 Nov 03 03:55:06.129177 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 573/1118] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:55:06.142707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60084940-d199-4b13-b3a9-e7f2ea19647b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:06.143336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60084940-d199-4b13-b3a9-e7f2ea19647b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:06.155169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:06.164354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:06.165861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:06.167032 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd5a5cfd-3147-492f-abda-d49eccdeacaf tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.174910 Nov 03 03:55:06.167929 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 546/1119] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:05 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:06.211961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-60084940-d199-4b13-b3a9-e7f2ea19647b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:06.220372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60084940-d199-4b13-b3a9-e7f2ea19647b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1278 microversion: 2.1 time: 0.081631 Nov 03 03:55:06.233380 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 574/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:06 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:06.408092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:06.408889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:06.412078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:06.413034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:06.416894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.418241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.418771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.419559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.419957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.420401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.420657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.420971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.421489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.422375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.422827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.423446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.622256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:06.633564 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-632926d0-2afc-4ed3-8a01-f84b6cdbc03d tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1470 microversion: 2.1 time: 0.225772 Nov 03 03:55:06.634160 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 575/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:06 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:06.650017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:06.650877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:06.651987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:06.658862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.659368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.659899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.665339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:06.665458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-258588be-5b91-4c9d-aaa5-5e15cc833549 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.258496 Nov 03 03:55:06.665581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:06.665581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:06.665752 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 547/1122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:06 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:06.734327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:06.742792 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6bb27bc-4195-4dca-966f-c6bf46225cfd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1284 microversion: 2.1 time: 0.107059 Nov 03 03:55:06.757037 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 576/1123] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:06 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:07.197046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:07.197917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:07.205133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.205929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.206510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.207788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.210121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.213318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.247643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:07.250580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:07.263653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.265393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.267091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.268347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.269154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.273965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.379708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:07.415990 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3019e476-8483-4b02-b0ea-766ad9af65d9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1282 microversion: 2.1 time: 0.175273 Nov 03 03:55:07.430621 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 577/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:07 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:07.444511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:07.456033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:07.457169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Searching by: {'deleted': False, 'project_id': '988963f3904b448591fadbaf28367442'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 03:55:07.463186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.463983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.464735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.465792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.466516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.467781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.503570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 03:55:07.531143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:07.543697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:07.546643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:07.548462 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c2a396c-c235-4e20-83fb-34ac866271d5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.357617 Nov 03 03:55:07.561109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70f6be73-8926-40a5-ae59-8bab4aa05bab tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.117298 Nov 03 03:55:07.561109 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 578/1125] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 03:55:07 2022] GET /compute/v2.1/servers => generated 340 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:07.562824 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 548/1126] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:07 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:07.568046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:07.572025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:07.573816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Searching by: {'deleted': False, 'project_id': '988963f3904b448591fadbaf28367442'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 03:55:07.581173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.584540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.584540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.584540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.584540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.584540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.659530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:07.660549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:07.668648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.670924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.671802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.684496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.685848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.687797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.705240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 03:55:07.714126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:07.884073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:07.892326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:07.893247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:07.894035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:07.983020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:08.009955 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2de6bc5f-6537-46ef-8884-339574138277 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1470 microversion: 2.1 time: 0.354198 Nov 03 03:55:08.011962 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 549/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:07 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:08.023615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:08.024522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:08.056466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.057699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.061684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.062506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.062923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.063364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.075421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:08.118919 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31f01dd5-e5ad-4203-a30b-c66c948c2194 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.556520 Nov 03 03:55:08.130004 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 579/1128] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:55:07 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:08.150076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:08.151613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:08.161736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.163029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.164151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.165078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.166074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.166833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.520941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:08.532520 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4bb49b2a-056e-4408-be13-a33b4c68449b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.518743 Nov 03 03:55:08.533341 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 550/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:08 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:08.539038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-65eb8401-9b94-4216-a95c-286c34d136b7 req-af0ba308-33c6-4004-90b4-1f5537d9e873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bb3703-e5fe-4369-a8d8-c04bd950e0ab", "name": "network-vif-deleted", "tag": "965270ad-8778-4af5-9ceb-f4a595bdad96"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:08.551026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-65eb8401-9b94-4216-a95c-286c34d136b7 req-af0ba308-33c6-4004-90b4-1f5537d9e873 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.552443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-65eb8401-9b94-4216-a95c-286c34d136b7 req-af0ba308-33c6-4004-90b4-1f5537d9e873 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.553142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-65eb8401-9b94-4216-a95c-286c34d136b7 req-af0ba308-33c6-4004-90b4-1f5537d9e873 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.575070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-65eb8401-9b94-4216-a95c-286c34d136b7 req-af0ba308-33c6-4004-90b4-1f5537d9e873 service nova] Creating event network-vif-deleted:965270ad-8778-4af5-9ceb-f4a595bdad96 for instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab on n-h2-854653-7 Nov 03 03:55:08.581602 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-65eb8401-9b94-4216-a95c-286c34d136b7 req-af0ba308-33c6-4004-90b4-1f5537d9e873 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046716 Nov 03 03:55:08.582655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:08.588621 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 551/1130] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:08.592838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4aa827a4-b3ed-4317-8dac-5a06af5f7d3a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.453189 Nov 03 03:55:08.594358 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 580/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:08 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:08.599534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:08.600542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:08.602859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6be333fd-cb33-4435-948e-1e229b5e6763 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:08.625543 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6be333fd-cb33-4435-948e-1e229b5e6763 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035097 Nov 03 03:55:08.628049 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 552/1132] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:55:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:08.629040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.631286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.631841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.633516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.634130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.634626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.638592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:08.646075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:08.655051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.655548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.655995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.660890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.661855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.662295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.721361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:08.731241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bed81efe-4e89-4b3f-b298-e17d942ebc88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1330 microversion: 2.1 time: 0.135633 Nov 03 03:55:08.732236 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 581/1133] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:08 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1330 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:08.839114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:08.847780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:08.849307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:08.850485 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f89e7224-7b0d-463e-80b0-7b854e2c832b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.221319 Nov 03 03:55:08.851052 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 553/1134] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:08 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:08.983919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:08.984429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:08.990817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.991379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.991824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:08.992522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:08.992980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:08.993444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.018989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:55:09.034917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:09.035704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:09.042078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.042707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.043399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.044264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.044967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.046075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.094040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.094924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.100356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.103074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lazy-loading 'fault' on Instance uuid 54bb3703-e5fe-4369-a8d8-c04bd950e0ab {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:09.150839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:09.162407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5ee2d6a5-1c55-4f30-829f-a11ce8fe9795 tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1305 microversion: 2.1 time: 0.131555 Nov 03 03:55:09.163509 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 554/1135] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:09 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1305 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:09.315140 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84435a0d-158d-419c-a228-a2bdd7a89a56 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "DELETE /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 204 len: 0 microversion: 2.1 time: 0.335111 Nov 03 03:55:09.317435 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 582/1136] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:55:08 2022] DELETE /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:55:09.336312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:09.336936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:09.343898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.344513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.347137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.347914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.348511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.348830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.503561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:09.512364 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3127e8a1-957f-4aa7-a908-1706c881d379 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1714 microversion: 2.1 time: 0.180804 Nov 03 03:55:09.517075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 555/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:09 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1714 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:09.556200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:09.556913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:09.563850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.564348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.564790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.565528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.565985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.566411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.622814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:09.623495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:09.629334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.629833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.630265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.630960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.631418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.631844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.752711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:09.761484 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a5834ca0-a5b7-4a05-b5e5-9aaf415763a9 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.209491 Nov 03 03:55:09.762366 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 583/1138] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:09 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:09.767653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:09.768498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:09.774833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.775535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.776194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.777133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.777784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.778446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.809064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:09.822058 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c91b266-81bd-493d-8186-b7ac5b58b253 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.202967 Nov 03 03:55:09.828746 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 556/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:09 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:09.828746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:09.829411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:09.836403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.836911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.837718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.838458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.838927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.839364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.866441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:09.955081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:09.964843 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27a64844-84f7-4fef-ae13-3808eb6fc6b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1348 microversion: 2.1 time: 0.140745 Nov 03 03:55:09.966096 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 557/1140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:09 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1348 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:09.970874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:09.971487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:09.978692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.979096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.979793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:09.980706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:09.981391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:09.982063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.129261 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c698301c-2a18-4677-8815-806de1ff73fb tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1811 microversion: 2.1 time: 0.361195 Nov 03 03:55:10.130338 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 584/1141] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:09 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1811 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:10.152300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:10.156077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.156795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.157462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.158411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.159224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.159867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.190491 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7aec7818-f0c6-4943-8478-1208d046b733 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042102 Nov 03 03:55:10.191779 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 585/1142] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:55:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:55:10.196763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:10.197644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:10.219886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:10.222395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.225739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.226453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.230853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:10.232350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:10.236659 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d0c94c2-a350-4322-a7e2-8b30b52139d8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.269474 Nov 03 03:55:10.237159 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 558/1143] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:09 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:10.245002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.246924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.248899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.319913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.321233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.322057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.322645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lazy-loading 'fault' on Instance uuid 54bb3703-e5fe-4369-a8d8-c04bd950e0ab {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:10.402923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5549f09dcdbe44b0a0d2cfa9c923d8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '357cb1993e9b45d6a7150d5a35a2376a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:10.412024 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5bd6dbe4-e94e-496f-b4de-64e8d74d70be tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 200 len: 1305 microversion: 2.1 time: 0.218919 Nov 03 03:55:10.420006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 586/1144] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:10 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 1305 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:10.537387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:10.541873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:10.553855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=18 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:10.556577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.559627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.561497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.564329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.564329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.565829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.632366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a6a8c7e4-bf4e-483a-800c-dc846deb280e req-688a5d4f-de4b-4b2c-b03c-94ce29bf671f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18ffe8f-e3ae-4756-80f7-b670c11ac21b", "tag": "b93accd4-93b2-459f-ba68-787589f6b74d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:10.649111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:10.661051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a6a8c7e4-bf4e-483a-800c-dc846deb280e req-688a5d4f-de4b-4b2c-b03c-94ce29bf671f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.664276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a6a8c7e4-bf4e-483a-800c-dc846deb280e req-688a5d4f-de4b-4b2c-b03c-94ce29bf671f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.664919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a6a8c7e4-bf4e-483a-800c-dc846deb280e req-688a5d4f-de4b-4b2c-b03c-94ce29bf671f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.693700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a6a8c7e4-bf4e-483a-800c-dc846deb280e req-688a5d4f-de4b-4b2c-b03c-94ce29bf671f service nova] Creating event network-changed:b93accd4-93b2-459f-ba68-787589f6b74d for instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b on n-h2-854653-7 Nov 03 03:55:10.711250 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a6a8c7e4-bf4e-483a-800c-dc846deb280e req-688a5d4f-de4b-4b2c-b03c-94ce29bf671f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080243 Nov 03 03:55:10.712791 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 587/1145] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:55:10.728849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-aed3f819-3145-4e95-9a09-d2dbf969f426 req-5bf70ac0-4375-4458-b0b2-2097f08f221d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74914149-185f-4400-9df8-cc7132fb7cdf", "name": "network-vif-plugged", "status": "completed", "tag": "3d61c39b-2b5c-4d82-806d-4907f6f7ee1e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:10.740491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aed3f819-3145-4e95-9a09-d2dbf969f426 req-5bf70ac0-4375-4458-b0b2-2097f08f221d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.740982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aed3f819-3145-4e95-9a09-d2dbf969f426 req-5bf70ac0-4375-4458-b0b2-2097f08f221d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.741448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aed3f819-3145-4e95-9a09-d2dbf969f426 req-5bf70ac0-4375-4458-b0b2-2097f08f221d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.755372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-aed3f819-3145-4e95-9a09-d2dbf969f426 req-5bf70ac0-4375-4458-b0b2-2097f08f221d service nova] Creating event network-vif-plugged:3d61c39b-2b5c-4d82-806d-4907f6f7ee1e for instance 74914149-185f-4400-9df8-cc7132fb7cdf on n-h1-854653-7 Nov 03 03:55:10.761088 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-aed3f819-3145-4e95-9a09-d2dbf969f426 req-5bf70ac0-4375-4458-b0b2-2097f08f221d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036976 Nov 03 03:55:10.762268 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 588/1146] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:10.787786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:10.788494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:10.794873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.795407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.795850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.796709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.797205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.797636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.923380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:10.939549 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40167541-d5a0-49ae-aabd-903ef58d16b5 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1714 microversion: 2.1 time: 0.404790 Nov 03 03:55:10.940598 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 559/1147] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:10 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1714 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:10.946062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:10.946987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:10.963968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.964666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.965217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:10.966068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:10.966642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:10.969276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.077405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:11.092903 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-18f3b715-0df2-4381-bccd-b77882164a59 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.308559 Nov 03 03:55:11.097984 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 589/1148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:10 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:11.103399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:11.104967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:11.112744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.113616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.114397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.115696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.116432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.117264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.194177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:11.214800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3086a17-fc5f-4b61-858f-1647f6e93547 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.272859 Nov 03 03:55:11.215984 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 560/1149] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:10 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:11.230633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:11.237445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-772af37a-4848-4136-8613-f2ea1bf378f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1336 microversion: 2.1 time: 0.138002 Nov 03 03:55:11.247267 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 590/1150] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:11 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1336 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:11.264652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:11.265271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:11.271717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.272209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.272643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.273999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.273999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.274230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.435614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:11.436796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] [instance: 54bb3703-e5fe-4369-a8d8-c04bd950e0ab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:11.465777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.466276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.466712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.467499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.467982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.468415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.524884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:11.527015 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] HTTP exception thrown: Instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab could not be found. Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Request method failure captured: Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab HTTP/1.1 Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrMWCOw-2aLlabM5lQtfc25gmGErAwEhWcM6PSo2V4_OaSZ0YLPN-qfy-nYyhaMWu8EtYfFF3NmBAUG2LIDAqTQZ-rtnhT90LZW36WldRvybmw9hH5Ha3WQBPg2MOu7tgqLc0jSLeE-ySTOrwHiZBKS2-70b_H1Spogwdw-ueQ1U5o Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_357cb1993e9b45d6a7150d5a35a2376a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/357cb1993e9b45d6a7150d5a35a2376a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/357cb1993e9b45d6a7150d5a35a2376a"}]}] Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 357cb1993e9b45d6a7150d5a35a2376a Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1748808063 Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 5549f09dcdbe44b0a0d2cfa9c923d8aa Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersOnMultiNodesTest-1748808063-project Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab could not be found. Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '54bb3703-e5fe-4369-a8d8-c04bd950e0ab'} Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab could not be found. Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab could not be found. Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:11.529924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab could not be found. Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] Returning 404 to user: Instance 54bb3703-e5fe-4369-a8d8-c04bd950e0ab could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:11.533798 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8280e1e6-e75d-46ec-b867-ceecca255e3e tempest-ServersOnMultiNodesTest-1748808063 tempest-ServersOnMultiNodesTest-1748808063-project] 10.222.0.30 "GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab" status: 404 len: 111 microversion: 2.1 time: 0.098386 Nov 03 03:55:11.536035 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 591/1151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:11 2022] GET /compute/v2.1/servers/54bb3703-e5fe-4369-a8d8-c04bd950e0ab => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:55:11.538588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:11.540042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:11.541476 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dadc86a0-8421-4ba5-8f69-5ff23937556b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1362 microversion: 2.25 time: 0.281528 Nov 03 03:55:11.543485 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 561/1152] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:11 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:11.968590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:11.969588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:11.979790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.981608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.984387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:11.985513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:11.986205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:11.989638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:12.121492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:12.122730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:12.137975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:12.139779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:12.139907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:12.142032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:12.142506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:12.142939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:12.219023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:12.229122 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1bc36e44-913d-40ec-85e8-076ebfebaa4e tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1714 microversion: 2.1 time: 0.265204 Nov 03 03:55:12.234934 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 592/1153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:11 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1714 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:12.247031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:12.247671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:12.270350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:12.272613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:12.274964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:12.278069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:12.279148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:12.280169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:12.888649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:12.903298 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07e86067-a235-4ab6-aafa-f9e491806069 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.787370 Nov 03 03:55:12.910090 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 562/1154] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:12 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:12.911860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:12.912667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:12.938219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:12.941767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:12.942438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:12.945660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:12.945660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:12.945660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.089870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:13.102148 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-795f3cb1-a409-4617-b69c-afdf4155748c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.865737 Nov 03 03:55:13.103847 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 593/1155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:12 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:13.117463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:13.121066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:13.140770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.142910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.145062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.146342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.148220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.150685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.398266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:13.415681 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2957584a-108b-41b9-8945-553b925e8e10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.510496 Nov 03 03:55:13.430086 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 563/1156] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:12 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:13.440766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:13.443125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:13.449137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.449870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.450635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.451368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.451977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.452668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.499950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90a93262-40e4-4d3c-b815-f3fb58e46876 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074816 Nov 03 03:55:13.508538 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 564/1157] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:55:13 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:55:13.514083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:13.522541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:13.529272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:13.530437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:13.534284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:13.535436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dcd93fa7-7e74-4623-8910-8f01654ec96f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1558 microversion: 2.25 time: 0.426568 Nov 03 03:55:13.536837 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 594/1158] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:13 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1558 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:13.549783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-cf9881a5-8140-4089-b9c8-a5f8b8ac0a10 req-b7df46ce-535f-4e02-b6e9-56d4d89d1a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75dd9e96-ffb8-4a3d-85bc-93048462e7c3", "name": "network-vif-deleted", "tag": "f2c71efc-0782-4dee-95e0-3e193e5222bf"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:13.560412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.560950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.561427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.566261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.566840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.567462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.578730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cf9881a5-8140-4089-b9c8-a5f8b8ac0a10 req-b7df46ce-535f-4e02-b6e9-56d4d89d1a1b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.578730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cf9881a5-8140-4089-b9c8-a5f8b8ac0a10 req-b7df46ce-535f-4e02-b6e9-56d4d89d1a1b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.578730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cf9881a5-8140-4089-b9c8-a5f8b8ac0a10 req-b7df46ce-535f-4e02-b6e9-56d4d89d1a1b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.603734 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-cf9881a5-8140-4089-b9c8-a5f8b8ac0a10 req-b7df46ce-535f-4e02-b6e9-56d4d89d1a1b service nova] Creating event network-vif-deleted:f2c71efc-0782-4dee-95e0-3e193e5222bf for instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 on n-h2-854653-7 Nov 03 03:55:13.609677 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-cf9881a5-8140-4089-b9c8-a5f8b8ac0a10 req-b7df46ce-535f-4e02-b6e9-56d4d89d1a1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066159 Nov 03 03:55:13.610535 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 595/1159] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:55:13.696616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce31ba9aca1943b0975f0cd17dad4633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '988963f3904b448591fadbaf28367442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:13.707916 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5841a777-627b-4808-9936-052965a0e73a tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 200 len: 1647 microversion: 2.1 time: 0.198202 Nov 03 03:55:13.708500 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 565/1160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:13 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 1647 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:13.738706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:13.742387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:13.750832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.751623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.752753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.753905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.754531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.755123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.858160 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f871589e-48bb-4e92-9196-de37030878fb tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125705 Nov 03 03:55:13.859176 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 566/1161] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:55:13 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d/os-volume_attachments => generated 25 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:55:13.877245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ff9cb8e-4bf2-4432-a1a4-23ec96c375c6", "device": "/dev/xvdb"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:13.887061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:13.935939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.936490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.940848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:13.943063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:13.943608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:13.947219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:14.037888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:14.040384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:14.056524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:14.061763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:14.063102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:14.064179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:14.068026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:14.070385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:14.334064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:14.360459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:14.376984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid 74914149-185f-4400-9df8-cc7132fb7cdf {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:14.437344 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-62941629-0fa8-450e-9b94-f9f65474dec9 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 2051 microversion: 2.25 time: 0.825374 Nov 03 03:55:14.438603 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 596/1162] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:13 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 2051 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:14.453070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:14.453991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:14.461747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:14.462442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:14.463036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:14.463910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:14.464808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:14.466136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:14.616006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:14.642563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82eebd6c-0058-4481-be53-99d49c08dca0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.202601 Nov 03 03:55:14.644474 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 597/1163] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:14 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:14.671652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:14.672448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:14.690118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:14.690610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:14.696911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:14.697941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:14.700201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:14.700201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:14.726934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:55:14.968031 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61023528-556e-4501-8963-554c743ba978 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "POST /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103678 Nov 03 03:55:14.973497 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 567/1164] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 03:55:13 2022] POST /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments => generated 194 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:14.984441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:14.989324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:15.002690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.008731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.008731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.008731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.008731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.008731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.111336 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a72e90b-bb76-4bc7-bb4a-2c1211ad9f30 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "DELETE /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 204 len: 0 microversion: 2.1 time: 0.465333 Nov 03 03:55:15.111929 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 598/1165] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:55:14 2022] DELETE /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:55:15.123347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:15.125387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:15.134349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.134870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.135336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.136048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.136751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.137410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.168179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:15.176894 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd01ba51-eaaa-4ac0-b8d6-955979f59e95 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.201400 Nov 03 03:55:15.177590 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 568/1166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:14 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:15.182360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:15.183388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:15.189749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.190480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.191332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.192261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.192944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.193473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.343783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:15.358311 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2303dcf8-b5d3-4e9c-915d-c7b225f41808 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.239902 Nov 03 03:55:15.359147 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 599/1167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:15 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:15.366460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:15.367899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] [instance: 75dd9e96-ffb8-4a3d-85bc-93048462e7c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:15.383898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.385516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.386279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.386738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid 74914149-185f-4400-9df8-cc7132fb7cdf {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:15.389889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.389889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.389889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.409253 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] HTTP exception thrown: Instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 could not be found. Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Request method failure captured: Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 HTTP/1.1 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYztRvC7K6ysso9693I6hMl8k2PkVsnWdn2umBrHASRUfgNDudh2qNjXlrsmxsU5l5MurhGYiM-5qhehQ7fIjHnb296JCKGfGZKps7clQONIs6RRwy0T6Fcglixdr7UYD_6CIE36_4wBSuVmUyfVCoGPNlisI6pmdqosUkzSNPna0JPI Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 988963f3904b448591fadbaf28367442 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestManualDisk-1278717424 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/988963f3904b448591fadbaf28367442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_988963f3904b448591fadbaf28367442", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/988963f3904b448591fadbaf28367442"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/988963f3904b448591fadbaf28367442"}]}] Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestManualDisk-1278717424 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 988963f3904b448591fadbaf28367442 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestManualDisk-1278717424 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestManualDisk-1278717424-project Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ce31ba9aca1943b0975f0cd17dad4633 Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestManualDisk-1278717424-project Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 could not be found. Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '75dd9e96-ffb8-4a3d-85bc-93048462e7c3'} Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 could not be found. Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 could not be found. Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:15.410918 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 could not be found. Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Returning 404 to user: Instance 75dd9e96-ffb8-4a3d-85bc-93048462e7c3 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5e990852-6a17-487c-8b5f-b09b0c949961 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3" status: 404 len: 111 microversion: 2.1 time: 0.051303 Nov 03 03:55:15.420144 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 600/1168] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:15 2022] GET /compute/v2.1/servers/75dd9e96-ffb8-4a3d-85bc-93048462e7c3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:55:15.421299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:15.421908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:15.428178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.428666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.429177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.430004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.430453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.430871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.453439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1de7c745-76a6-4a8c-a063-1b3daeb6401e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 2051 microversion: 2.25 time: 0.274538 Nov 03 03:55:15.454035 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 569/1169] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:15 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 2051 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:15.458739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8162ebff-efea-4688-9887-704622b0c5ac req-07eaaf32-3709-4639-969b-bb5ae7fadfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8b2ed9-05a6-4f4a-b8c4-2cd266662985", "name": "network-vif-plugged", "status": "completed", "tag": "450f08dc-4ccc-4a7b-a22a-21e428fb7d29"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:15.470732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8162ebff-efea-4688-9887-704622b0c5ac req-07eaaf32-3709-4639-969b-bb5ae7fadfe8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.471505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8162ebff-efea-4688-9887-704622b0c5ac req-07eaaf32-3709-4639-969b-bb5ae7fadfe8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.472254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8162ebff-efea-4688-9887-704622b0c5ac req-07eaaf32-3709-4639-969b-bb5ae7fadfe8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.486624 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8162ebff-efea-4688-9887-704622b0c5ac req-07eaaf32-3709-4639-969b-bb5ae7fadfe8 service nova] Creating event network-vif-plugged:450f08dc-4ccc-4a7b-a22a-21e428fb7d29 for instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 on n-h1-854653-7 Nov 03 03:55:15.494919 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8162ebff-efea-4688-9887-704622b0c5ac req-07eaaf32-3709-4639-969b-bb5ae7fadfe8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039425 Nov 03 03:55:15.496204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 570/1170] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:15.507279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-09008dc8-d30b-4dc6-a94d-4377587cd3a3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] Calling method '.version_select at 0x7ff7f92f79d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:15.612443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-09008dc8-d30b-4dc6-a94d-4377587cd3a3 tempest-ServersTestManualDisk-1278717424 tempest-ServersTestManualDisk-1278717424-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301571029" status: 202 len: 0 microversion: 2.1 time: 0.114358 Nov 03 03:55:15.613152 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 571/1171] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 03:55:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301571029 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:55:15.618741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:15.629037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.629927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.630615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.636400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.637172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.637787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.641554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:15.653119 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2c0d0f4-f30b-4917-9380-1a24a94cf607 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1682 microversion: 2.1 time: 0.235588 Nov 03 03:55:15.683540 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 601/1172] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:15 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:15.683540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b6b1fb31-6117-40bb-84d8-6971f6124763 req-95edce0f-d9a2-4f42-b913-8bd497cfce75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b033176-fb9d-429b-a068-6e8914bdc171", "tag": "bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:15.696343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b6b1fb31-6117-40bb-84d8-6971f6124763 req-95edce0f-d9a2-4f42-b913-8bd497cfce75 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.697093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b6b1fb31-6117-40bb-84d8-6971f6124763 req-95edce0f-d9a2-4f42-b913-8bd497cfce75 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.697685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b6b1fb31-6117-40bb-84d8-6971f6124763 req-95edce0f-d9a2-4f42-b913-8bd497cfce75 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.700073 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-019e3e79-53df-4da8-8c37-196afb6376bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.085973 Nov 03 03:55:15.714494 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 572/1173] 10.222.0.30 () {60 vars in 1217 bytes} [Thu Nov 3 03:55:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:55:15.718652 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b6b1fb31-6117-40bb-84d8-6971f6124763 req-95edce0f-d9a2-4f42-b913-8bd497cfce75 service nova] Creating event network-changed:bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9 for instance 2b033176-fb9d-429b-a068-6e8914bdc171 on n-h2-854653-7 Nov 03 03:55:15.724236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b6b1fb31-6117-40bb-84d8-6971f6124763 req-95edce0f-d9a2-4f42-b913-8bd497cfce75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051019 Nov 03 03:55:15.725263 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 602/1174] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:15.727541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:15.728315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:15.731215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854653-7", "block_migration": "auto"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:15.734510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:15.742070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.742568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.743014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.743865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.744324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.744752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.747588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.748640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.749114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.749878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:15.757931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:15.760793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:15.786013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'flavor' on Instance uuid 74914149-185f-4400-9df8-cc7132fb7cdf {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:15.803517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Going to try to live migrate instance to n-h2-854653-7 {{(pid=127593) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:55:15.930244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:15.940891 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2581536-b1b0-4648-9a03-ad41480cb604 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.224333 Nov 03 03:55:15.940891 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 573/1175] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:15 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:16.199664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:16.200958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:16.207583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.208319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.208918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:16.209910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.210538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.210969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:16.394002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:16.410128 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90500076-1864-48fc-a4f9-37bc8e565c32 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.214193 Nov 03 03:55:16.410924 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 574/1176] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:16 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:16.425601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:16.426208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:16.436312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.436802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.442031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:16.442783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.443258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.448220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:16.633421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:16.642105 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23c0286e-16c0-4eba-b54b-d2da0ef6dc16 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.220215 Nov 03 03:55:16.643053 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 575/1177] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:16 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:16.683749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:16.684410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:16.690738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.691367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.691910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:16.693097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.693698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.694222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:16.893102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:16.906118 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d2db182-9800-454c-8ffd-c8e87a864762 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1682 microversion: 2.1 time: 0.226629 Nov 03 03:55:16.909712 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 576/1178] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:16 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:16.963471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:16.966135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:16.975261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.976232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.976941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:16.978028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:16.981281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:16.982080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:17.251439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:17.262298 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d145ee6-716f-455c-9b0f-3a8171bad040 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1317 microversion: 2.1 time: 0.302559 Nov 03 03:55:17.277631 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 577/1179] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:16 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:17.439281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:17.440451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:17.457224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:17.458954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:17.460280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:17.461148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:17.464062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:17.465826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:17.881632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=24 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:17.910512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:17.927642 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-903919f5-c3cc-4623-85ac-601eb43722e3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.494167 Nov 03 03:55:17.953110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 578/1180] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:17 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:17.958452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:17.959076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:17.965491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:17.966322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:17.966995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:17.967972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:17.968632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:17.969288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.149997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:18.157874 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3075fede-4a9e-45ee-8bec-e1c937bf2361 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.203560 Nov 03 03:55:18.158692 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 579/1181] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:17 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:18.163696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ab6a1e8a-af29-4b68-b584-87c79ff1282b req-2c8767a6-6400-4936-a900-c174c4118a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18ffe8f-e3ae-4756-80f7-b670c11ac21b", "name": "network-vif-plugged", "status": "completed", "tag": "b93accd4-93b2-459f-ba68-787589f6b74d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:18.174948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ab6a1e8a-af29-4b68-b584-87c79ff1282b req-2c8767a6-6400-4936-a900-c174c4118a54 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:18.175728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ab6a1e8a-af29-4b68-b584-87c79ff1282b req-2c8767a6-6400-4936-a900-c174c4118a54 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:18.176555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ab6a1e8a-af29-4b68-b584-87c79ff1282b req-2c8767a6-6400-4936-a900-c174c4118a54 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.189990 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ab6a1e8a-af29-4b68-b584-87c79ff1282b req-2c8767a6-6400-4936-a900-c174c4118a54 service nova] Creating event network-vif-plugged:b93accd4-93b2-459f-ba68-787589f6b74d for instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b on n-h2-854653-7 Nov 03 03:55:18.195126 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ab6a1e8a-af29-4b68-b584-87c79ff1282b req-2c8767a6-6400-4936-a900-c174c4118a54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035010 Nov 03 03:55:18.195727 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 580/1182] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:18.201747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:18.202458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:18.209382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:18.209902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:18.210386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.211312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:18.211948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:18.212384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.332030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:18.340752 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ff7985e7-df1e-45da-a3d6-02fda8b1a341 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1614 microversion: 2.1 time: 0.143566 Nov 03 03:55:18.341753 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 581/1183] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:18 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1614 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:18.346928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:18.347569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:18.354112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:18.354612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:18.355058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.355775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:18.356695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:18.357174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.550501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:18.561869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-474c8812-23b5-4fd8-b5d7-38b2732916d2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1467 microversion: 2.1 time: 0.217610 Nov 03 03:55:18.563174 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 582/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:18 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1467 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:18.588420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1172262842", "metadata": {"image_type": "test"}}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:18.592133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:18.600285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:18.601671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:18.604873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.604873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:18.604873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:18.604873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:18.649279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:18.657590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Getting quotas for project 75abb61bee2f4e6dadffbd21b8ad0096. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:55:18.663765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Getting quotas for user 713b3bde635745918bd322e07a240519 and project 75abb61bee2f4e6dadffbd21b8ad0096. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:55:19.677123 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bbc2e8ca-0dfb-42c8-9dd9-db71273d203e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "POST /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985/action" status: 202 len: 0 microversion: 2.1 time: 1.090893 Nov 03 03:55:19.683332 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 583/1185] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:55:18 2022] POST /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985/action => generated 0 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 03 03:55:19.690908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:19.691744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:19.699425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50fa1733-f69c-44ee-89d5-301aaf9dde58 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf/action" status: 202 len: 0 microversion: 2.25 time: 3.972357 Nov 03 03:55:19.700061 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 603/1186] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 03:55:15 2022] POST /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf/action => generated 0 bytes in 3974 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:55:19.706589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-61b24084-4b21-4cec-bf8a-33b40e2f40de req-98972338-bb2f-4b26-b625-770066b24552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "088f74bc-3359-48f9-951b-a8ffed40674d", "name": "network-vif-deleted", "tag": "c20dba85-cf5f-4b11-b841-d340e90a025a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:19.733147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:19.733147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:19.733147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:19.733147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:19.733536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:19.738540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:19.743376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-61b24084-4b21-4cec-bf8a-33b40e2f40de req-98972338-bb2f-4b26-b625-770066b24552 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:19.748660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-61b24084-4b21-4cec-bf8a-33b40e2f40de req-98972338-bb2f-4b26-b625-770066b24552 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:19.752058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-61b24084-4b21-4cec-bf8a-33b40e2f40de req-98972338-bb2f-4b26-b625-770066b24552 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:19.753424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:19.791425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-61b24084-4b21-4cec-bf8a-33b40e2f40de req-98972338-bb2f-4b26-b625-770066b24552 service nova] Creating event network-vif-deleted:c20dba85-cf5f-4b11-b841-d340e90a025a for instance 088f74bc-3359-48f9-951b-a8ffed40674d on n-h2-854653-7 Nov 03 03:55:19.811140 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-61b24084-4b21-4cec-bf8a-33b40e2f40de req-98972338-bb2f-4b26-b625-770066b24552 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099651 Nov 03 03:55:19.812892 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 604/1187] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:19.826674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:19.828704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:19.854038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:19.854038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:19.854038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:19.859090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:19.859879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:19.860747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:20.168848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:20.383357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:20.397470 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b9ed70e-ac2a-47d3-b269-e38c479cf821 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1314 microversion: 2.1 time: 0.717880 Nov 03 03:55:20.398457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 584/1188] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:19 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:20.408306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:20.408934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:20.439306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:20.441310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:20.441772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:20.442512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:20.442981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:20.443413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:20.443743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:20.457628 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-906e5abf-c872-4fed-b12b-7f5de9c61320 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.641595 Nov 03 03:55:20.461865 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 605/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:19 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:20.479346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8223af4d-4918-42a7-8eff-62e75ea03e77 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f91e6ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:20.536455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:20.536962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:20.537428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:20.537896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lazy-loading 'fault' on Instance uuid 088f74bc-3359-48f9-951b-a8ffed40674d {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:20.638196 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8223af4d-4918-42a7-8eff-62e75ea03e77 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.175617 Nov 03 03:55:20.638842 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 606/1190] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:20 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:20.650594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:20.651549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:20.656269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd22f5b843d4d82851147c1f2a89342', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ae4739f59d4d14bad947b274c240ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:20.683469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:20.684041 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69dfd185-4640-4ff6-bd6b-4cb9c3fb83c5 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 200 len: 1331 microversion: 2.1 time: 0.281300 Nov 03 03:55:20.685058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:20.689600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:20.690698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:20.691707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:20.692373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:20.714296 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 585/1191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:20 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 1331 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:20.874869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:20.885980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:20.886396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:20.888001 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-59c47d9b-7ac4-45a3-a22d-160b4e6dac7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.246707 Nov 03 03:55:20.888614 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 607/1192] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:20 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:21.428404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:21.429680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:21.444498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.445238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.445801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.446650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.447220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.447762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.511989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:21.512637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:21.559859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.580731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.584689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.589640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.590138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.590580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.750424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:21.759718 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-09349ff8-3d59-485c-bf9b-e0427526eb72 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1500 microversion: 2.1 time: 0.335662 Nov 03 03:55:21.763816 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 586/1193] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:21 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1500 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:21.772196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9738fbff-a294-4e49-b841-ba73db38958c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f92cd940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:21.857654 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9738fbff-a294-4e49-b841-ba73db38958c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.091195 Nov 03 03:55:21.866594 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 587/1194] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:21 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:21.871682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:21.872541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:21.879781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.880560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.881209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.882098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.882726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.883327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.905880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:21.906465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] HTTP exception thrown: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Request method failure captured: Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d HTTP/1.1 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzr1xN4HplCFQdr-b9-GTuCP4E-dnkE1VYkW8QPqr1UOMsJo1jvss6pPy_SY_0YnwTqIUb7LgqzjBkaMV9qWI6n3ejG_iw-bYXzof5T9dGeokr9YFB1E32UnAy0pBqr-2U2tGqYG87H6wPu-1TVX_hVNasECECQp6bNwnK0XX_og5qM Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 11ae4739f59d4d14bad947b274c240ee Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ae4739f59d4d14bad947b274c240ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ae4739f59d4d14bad947b274c240ee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ae4739f59d4d14bad947b274c240ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ae4739f59d4d14bad947b274c240ee"}]}] Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 11ae4739f59d4d14bad947b274c240ee Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachSCSIVolumeTestJSON-478931485-project Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 0fd22f5b843d4d82851147c1f2a89342 Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-478931485-project Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '088f74bc-3359-48f9-951b-a8ffed40674d'} Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:21.910047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:21.915109 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:21.915109 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:21.915109 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:21.915109 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:21.915109 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:21.915109 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:21.915109 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:55:21.918381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Returning 404 to user: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:21.920205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27a09668-444b-481e-b183-b756c2cededa tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 404 len: 111 microversion: 2.1 time: 0.051771 Nov 03 03:55:21.924577 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 588/1195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:21 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:55:21.927578 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aefdf702-00e7-4f73-878f-40ee41c9dab3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.439992 Nov 03 03:55:21.928183 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 608/1196] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:21 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:21.931194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:21.936027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:21.936846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:21.944292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:21.951628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.952378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.953213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.954672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.955572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.956158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.959044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.959781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.960208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.960958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:21.961473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:21.961901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:21.995378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:55:22.122394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:22.136748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:22.136748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:22.139283 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-129dfd97-3edf-48f9-8ea0-2b9580f96f61 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.209555 Nov 03 03:55:22.140475 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 609/1197] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:21 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:22.146597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d31d9d1e-cf4d-4a6d-957e-db4d209756f6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '.version_select at 0x7ff7f91e6820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:22.221785 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d31d9d1e-cf4d-4a6d-957e-db4d209756f6 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518352839" status: 202 len: 0 microversion: 2.1 time: 0.079668 Nov 03 03:55:22.223101 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 610/1198] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 03:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1518352839 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:55:22.287819 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6da32ad5-b026-43e7-881e-e57768a0c777 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 204 len: 0 microversion: 2.1 time: 0.361475 Nov 03 03:55:22.289307 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 589/1199] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:55:21 2022] DELETE /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:55:22.299037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:22.300992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:22.314750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:22.318651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:22.319015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:22.320299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:22.322979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:22.324617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:22.845700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:22.866687 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec3d977b-5ec2-4fa4-a352-2eb1b8888fe1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1506 microversion: 2.1 time: 0.571289 Nov 03 03:55:22.879118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bedebe4c-82b6-4b63-ac52-501c8ad7d0fe tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f92f70d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:22.884388 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 611/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:22 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:22.955832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:22.956555 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bedebe4c-82b6-4b63-ac52-501c8ad7d0fe tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.086334 Nov 03 03:55:22.958358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:22.958751 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 590/1201] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:22 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:22.969680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:22.970193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:22.970640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:22.971355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:22.971816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:22.972248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:23.171564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:23.172770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:23.188228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:23.189066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:23.189820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:23.191260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:23.193436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:23.194130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:23.300294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:23.312474 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9123aba-2492-4479-ba56-ab1dc81cafd8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.361449 Nov 03 03:55:23.331181 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 612/1202] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:22 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:23.667092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:23.676699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:23.683576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:23.686400 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-677e1d91-0e7a-4e98-8617-fcac513e5a0e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.520798 Nov 03 03:55:23.688433 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 591/1203] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:23 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:23.893509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:23.894279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:23.906658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:23.907590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:23.909655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:23.911784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:23.914043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:23.914765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:23.942556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:23.972920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3eaf95eb-6bdd-4df5-b503-05d0be47fe22 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f921c040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:24.043028 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3eaf95eb-6bdd-4df5-b503-05d0be47fe22 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.074949 Nov 03 03:55:24.044151 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 592/1204] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:23 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:24.137264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:24.150328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47ff9891-d632-4a5e-ad10-a86c7b73b6e0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1506 microversion: 2.1 time: 0.262092 Nov 03 03:55:24.155761 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 613/1205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:23 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:24.336990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:24.338330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:24.353378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:24.354309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:24.354760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:24.355501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:24.356129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:24.356673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:24.541891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:24.551407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e549011-ef66-47da-a36e-ca705006c380 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.219389 Nov 03 03:55:24.551995 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 593/1206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:24 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:24.715635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:24.716976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:24.724227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:24.724807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:24.725287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:24.725996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:24.726467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:24.726899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:24.874323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:24.882610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:24.884093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:24.885321 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8cbfb562-ff92-4892-87cb-3a7c98dab3a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.173877 Nov 03 03:55:24.886210 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 614/1207] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:24 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:25.059748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-902460b2-af77-4f84-baba-360d7f3163a3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f924d940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:25.123793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c79a0523-cf14-40b8-b095-fbf65499db25 req-984c16a3-7cbe-48dc-b039-a9f24218ac8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74914149-185f-4400-9df8-cc7132fb7cdf", "name": "network-vif-unplugged", "status": "completed", "tag": "3d61c39b-2b5c-4d82-806d-4907f6f7ee1e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:25.132225 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-902460b2-af77-4f84-baba-360d7f3163a3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.077079 Nov 03 03:55:25.133183 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 594/1208] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:25 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:25.140451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c79a0523-cf14-40b8-b095-fbf65499db25 req-984c16a3-7cbe-48dc-b039-a9f24218ac8f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:25.140976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c79a0523-cf14-40b8-b095-fbf65499db25 req-984c16a3-7cbe-48dc-b039-a9f24218ac8f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:25.141406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c79a0523-cf14-40b8-b095-fbf65499db25 req-984c16a3-7cbe-48dc-b039-a9f24218ac8f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:25.153252 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c79a0523-cf14-40b8-b095-fbf65499db25 req-984c16a3-7cbe-48dc-b039-a9f24218ac8f service nova] Creating event network-vif-unplugged:3d61c39b-2b5c-4d82-806d-4907f6f7ee1e for instance 74914149-185f-4400-9df8-cc7132fb7cdf on n-h1-854653-7 Nov 03 03:55:25.159138 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c79a0523-cf14-40b8-b095-fbf65499db25 req-984c16a3-7cbe-48dc-b039-a9f24218ac8f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041750 Nov 03 03:55:25.160395 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 615/1209] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:25.174026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:25.174650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:25.182050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:25.183015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:25.183469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:25.184187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:25.185179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:25.194394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:25.361936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:25.373534 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2ad1fea1-7c2a-46bf-957b-172f05deafaf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1506 microversion: 2.1 time: 0.203660 Nov 03 03:55:25.374501 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 595/1210] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:25 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:25.582074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:25.586245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:25.601921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:25.604697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:25.605656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:25.611086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:25.611994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:25.612664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:25.899713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:25.914064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:25.915433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:25.920631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:25.931449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bfa81cbc-d562-41c7-ac96-fdff8fd84d23 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.358013 Nov 03 03:55:25.934654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:25.937712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:25.941932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:25.941932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:25.945003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:25.945732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:25.950658 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 616/1211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:25 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:26.148172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40563151-cd87-40ea-b69f-13ab4a1f24df tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f91af3a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:26.230591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40563151-cd87-40ea-b69f-13ab4a1f24df tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.086493 Nov 03 03:55:26.232742 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 617/1212] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:26 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:26.399573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3264656a-bb77-4e55-86ed-600f7c262be1 req-9c5e6f14-65fc-428c-aab7-85e352e786bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b033176-fb9d-429b-a068-6e8914bdc171", "name": "network-vif-plugged", "status": "completed", "tag": "bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:26.431624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3264656a-bb77-4e55-86ed-600f7c262be1 req-9c5e6f14-65fc-428c-aab7-85e352e786bb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:26.434563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3264656a-bb77-4e55-86ed-600f7c262be1 req-9c5e6f14-65fc-428c-aab7-85e352e786bb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:26.434563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3264656a-bb77-4e55-86ed-600f7c262be1 req-9c5e6f14-65fc-428c-aab7-85e352e786bb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:26.436370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:26.447013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:26.453056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:26.454352 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6cb7c68a-79ea-437a-b1b1-470fafeb43ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.546816 Nov 03 03:55:26.458400 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 596/1213] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:25 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:26.474020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:26.474563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:26.484210 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3264656a-bb77-4e55-86ed-600f7c262be1 req-9c5e6f14-65fc-428c-aab7-85e352e786bb service nova] Creating event network-vif-plugged:bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9 for instance 2b033176-fb9d-429b-a068-6e8914bdc171 on n-h2-854653-7 Nov 03 03:55:26.492227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3264656a-bb77-4e55-86ed-600f7c262be1 req-9c5e6f14-65fc-428c-aab7-85e352e786bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099868 Nov 03 03:55:26.493907 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 618/1214] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:26.494961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:26.495474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:26.495923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:26.496642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:26.497130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:26.497609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:26.670535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:26.683354 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-56e1d971-9a07-4634-b222-d4b66a306eda tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1299 microversion: 2.1 time: 0.220077 Nov 03 03:55:26.701300 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 597/1215] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:26 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:26.964693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:26.965787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:26.974649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:26.975545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:26.976214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:26.977823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:26.978472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:26.979954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:27.180833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-732b6356-75e6-4c7a-a915-7e4c0b352a04 req-78133fb8-bc96-40d4-ae73-6d2147e9590b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18ffe8f-e3ae-4756-80f7-b670c11ac21b", "name": "network-vif-deleted", "tag": "b93accd4-93b2-459f-ba68-787589f6b74d"}, {"name": "network-changed", "server_uuid": "74914149-185f-4400-9df8-cc7132fb7cdf", "tag": "3d61c39b-2b5c-4d82-806d-4907f6f7ee1e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:27.200346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-732b6356-75e6-4c7a-a915-7e4c0b352a04 req-78133fb8-bc96-40d4-ae73-6d2147e9590b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:27.202388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-732b6356-75e6-4c7a-a915-7e4c0b352a04 req-78133fb8-bc96-40d4-ae73-6d2147e9590b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:27.203063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-732b6356-75e6-4c7a-a915-7e4c0b352a04 req-78133fb8-bc96-40d4-ae73-6d2147e9590b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:27.227495 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-732b6356-75e6-4c7a-a915-7e4c0b352a04 req-78133fb8-bc96-40d4-ae73-6d2147e9590b service nova] Creating event network-vif-deleted:b93accd4-93b2-459f-ba68-787589f6b74d for instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b on n-h2-854653-7 Nov 03 03:55:27.230334 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-732b6356-75e6-4c7a-a915-7e4c0b352a04 req-78133fb8-bc96-40d4-ae73-6d2147e9590b service nova] Creating event network-changed:3d61c39b-2b5c-4d82-806d-4907f6f7ee1e for instance 74914149-185f-4400-9df8-cc7132fb7cdf on n-h1-854653-7 Nov 03 03:55:27.246316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-732b6356-75e6-4c7a-a915-7e4c0b352a04 req-78133fb8-bc96-40d4-ae73-6d2147e9590b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.070822 Nov 03 03:55:27.247249 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 598/1216] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:55:27.259175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec6cb2db-7555-4bc4-8b93-1eb2fa406d6b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9233820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:27.353172 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec6cb2db-7555-4bc4-8b93-1eb2fa406d6b tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.098491 Nov 03 03:55:27.354299 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 599/1217] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:27 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:27.434586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:27.447431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e4f5fc8-f0b7-4260-a509-8af783106379 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1378 microversion: 2.1 time: 0.490121 Nov 03 03:55:27.462907 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 619/1218] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:26 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1378 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:27.486443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:27.487496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:27.499589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:27.501700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:27.502295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:27.503091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:27.505445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:27.507817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:27.710825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:27.711838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:27.722663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:27.724037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:27.724719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:27.725869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:27.727438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:27.728097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:27.804755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:27.805498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:27.806038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:27.807792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lazy-loading 'fault' on Instance uuid e18ffe8f-e3ae-4756-80f7-b670c11ac21b {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:27.964342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:27.976681 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d38b4c93-7199-43f5-986e-848551ed1f0d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 200 len: 1304 microversion: 2.1 time: 0.272915 Nov 03 03:55:27.983433 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 620/1219] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:27 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 1304 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:28.369352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31168ca3-8ed0-4ae5-8599-5eb550567431 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f927b550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:28.439171 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31168ca3-8ed0-4ae5-8599-5eb550567431 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.073587 Nov 03 03:55:28.440272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 621/1220] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:28 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:28.473632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:28.474851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:28.487287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:28.487791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:28.488245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:28.488937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:28.492721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:28.494001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:28.784185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:28.798321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:28.799860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:28.806924 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb012657-ac80-4f9a-b44f-c9b2a481f1a0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 1.325384 Nov 03 03:55:28.811944 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 600/1221] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:27 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:55:28.829217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9dc97793-d441-413b-b391-d51d31f88d7e req-e9c1c932-f0b6-442b-a187-769f53e94910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8b2ed9-05a6-4f4a-b8c4-2cd266662985", "name": "network-vif-plugged", "status": "completed", "tag": "450f08dc-4ccc-4a7b-a22a-21e428fb7d29"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:28.849534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9dc97793-d441-413b-b391-d51d31f88d7e req-e9c1c932-f0b6-442b-a187-769f53e94910 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:28.854698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9dc97793-d441-413b-b391-d51d31f88d7e req-e9c1c932-f0b6-442b-a187-769f53e94910 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:28.856783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9dc97793-d441-413b-b391-d51d31f88d7e req-e9c1c932-f0b6-442b-a187-769f53e94910 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:28.876265 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9dc97793-d441-413b-b391-d51d31f88d7e req-e9c1c932-f0b6-442b-a187-769f53e94910 service nova] Creating event network-vif-plugged:450f08dc-4ccc-4a7b-a22a-21e428fb7d29 for instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 on n-h1-854653-7 Nov 03 03:55:28.883943 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9dc97793-d441-413b-b391-d51d31f88d7e req-e9c1c932-f0b6-442b-a187-769f53e94910 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071191 Nov 03 03:55:28.884789 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 601/1222] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:28.922848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:28.937167 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bf744f32-c11a-446e-bdd4-0702f90e2484 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1527 microversion: 2.1 time: 0.467342 Nov 03 03:55:28.958820 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 622/1223] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:28 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1527 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:28.966701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:28.967437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:28.981219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:28.982820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:28.984164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:28.985515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:28.987401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:28.988056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:29.015467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:29.016477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:29.026659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:29.030962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:29.033771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:29.034727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:29.038924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:29.039645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:29.080431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b HTTP/1.1 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e18ffe8f-e3ae-4756-80f7-b670c11ac21b'} Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:29.085038 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:29.090010 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:29.090010 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:29.090010 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:29.090010 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:29.090010 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:29.090010 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 03:55:29.090010 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:29.097821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:29.097821 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba058300-a27a-4492-995b-47eaa5be6785 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 404 len: 111 microversion: 2.1 time: 0.090493 Nov 03 03:55:29.099065 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 623/1224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:29 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 03:55:29.432551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:29.446155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-759418211", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "25261195-157d-4c7b-8cfb-4fb3b385217e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:29.463368 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-323e162e-84d0-4e42-9a6e-82f1d2b9cf9f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1527 microversion: 2.1 time: 0.501852 Nov 03 03:55:29.463978 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 602/1225] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:28 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1527 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:29.517443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a454cb3-123e-43a4-b838-1dd31ec39727 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f92f7550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:29.616398 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a454cb3-123e-43a4-b838-1dd31ec39727 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.125255 Nov 03 03:55:29.625060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 603/1226] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:29 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:29.625273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] validate_networks() for [('25261195-157d-4c7b-8cfb-4fb3b385217e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:55:29.626932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e417434e-8842-4d07-a3ee-cf1cdf74e33b tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:29.719901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e417434e-8842-4d07-a3ee-cf1cdf74e33b tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/bfea094b-54bf-4696-b299-ab9360307d29" status: 202 len: 0 microversion: 2.1 time: 0.099472 Nov 03 03:55:29.724065 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 604/1227] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:55:29 2022] DELETE /compute/v2.1/flavors/bfea094b-54bf-4696-b299-ab9360307d29 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:55:29.728991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b07e25b9-96d1-4cc2-9b0a-cc29b6b94091 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:29.781695 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b07e25b9-96d1-4cc2-9b0a-cc29b6b94091 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056294 Nov 03 03:55:29.782557 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 605/1228] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 03:55:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:29.805386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:29.808285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:29.822874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:29.824789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:29.825982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:29.830738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:29.831695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:29.832892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:30.112718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:30.123506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Old instance type tempest-test_resize_flavor_-1682173339, new instance type m1.heat {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 03:55:30.161118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:55:30.161553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:55:30.162269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:55:30.162924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:55:30.163841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:55:30.573759 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95e652eb-6d72-4f5b-aef5-be5c2e4f375c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171/action" status: 202 len: 0 microversion: 2.1 time: 0.772388 Nov 03 03:55:30.574384 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 606/1229] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:55:29 2022] POST /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171/action => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:55:30.585898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:30.597211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:30.615919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:30.616676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:30.617412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:30.618333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:30.619001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:30.619581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:30.663031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:30.940466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:55:30.941003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:55:30.941833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:55:30.942273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:55:30.942827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:55:30.969212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:30.970881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:30.971640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:30.975415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:30.976191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:30.978443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:31.028137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:55:31.039088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for user baa7ebbbe2c14c82b5a07fef33cc214a and project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:55:31.079605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:55:31.082573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:55:31.243882 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a1eb4109-ed11-44f7-82fe-b6ceef191917 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802934 Nov 03 03:55:31.248384 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 624/1230] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:55:31.275271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:31.281439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:31.329108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:31.331958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:31.336266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:31.339275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:31.341996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:31.343456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:31.739733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:31.751500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:31.756755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:31.761276 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ed1d0e2-9570-4ad2-8d37-d43ef7812d6b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 1.177583 Nov 03 03:55:31.781160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 607/1231] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:30 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:31.791151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ac885a8-f637-4e05-a247-6838fd46b6d4 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f934cee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:31.871734 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ac885a8-f637-4e05-a247-6838fd46b6d4 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.089110 Nov 03 03:55:31.875808 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 608/1232] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:31 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:31.885784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:31.886676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:31.906066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:31.907199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:31.912150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:31.915464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:31.916123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:31.917040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:31.919620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:31.926398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0924f1a0-681d-494d-a5f8-7ebfae317279 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1536 microversion: 2.1 time: 0.674738 Nov 03 03:55:31.930321 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 625/1233] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:31 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1536 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:31.944294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6807d268-5158-4c3b-99b0-a0967cc4e8b5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:31.944926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6807d268-5158-4c3b-99b0-a0967cc4e8b5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:31.969089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:32.132767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6807d268-5158-4c3b-99b0-a0967cc4e8b5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:32.143745 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6807d268-5158-4c3b-99b0-a0967cc4e8b5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1214 microversion: 2.1 time: 0.212266 Nov 03 03:55:32.145167 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 626/1234] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:31 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:32.158009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:32.158634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:32.184298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.185636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.186293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.187265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.187892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.189635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.210941 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] HTTP exception thrown: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Request method failure captured: Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d HTTP/1.1 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzr1xN4HplCFQdr-b9-GTuCP4E-dnkE1VYkW8QPqr1UOMsJo1jvss6pPy_SY_0YnwTqIUb7LgqzjBkaMV9qWI6n3ejG_iw-bYXzof5T9dGeokr9YFB1E32UnAy0pBqr-2U2tGqYG87H6wPu-1TVX_hVNasECECQp6bNwnK0XX_og5qM Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 11ae4739f59d4d14bad947b274c240ee Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ae4739f59d4d14bad947b274c240ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ae4739f59d4d14bad947b274c240ee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ae4739f59d4d14bad947b274c240ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ae4739f59d4d14bad947b274c240ee"}]}] Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 11ae4739f59d4d14bad947b274c240ee Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachSCSIVolumeTestJSON-478931485-project Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0fd22f5b843d4d82851147c1f2a89342 Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-478931485-project Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '088f74bc-3359-48f9-951b-a8ffed40674d'} Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:32.217091 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Returning 404 to user: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e266593b-c0f7-4b4a-bd0b-75047702a93d tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "DELETE /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 404 len: 111 microversion: 2.1 time: 0.072677 Nov 03 03:55:32.226835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 627/1235] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:55:32 2022] DELETE /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:55:32.229680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:32.230709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] [instance: 088f74bc-3359-48f9-951b-a8ffed40674d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:32.241941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.242337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.242790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.255953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.262460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.267961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.299705 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] HTTP exception thrown: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Request method failure captured: Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d HTTP/1.1 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzr1xN4HplCFQdr-b9-GTuCP4E-dnkE1VYkW8QPqr1UOMsJo1jvss6pPy_SY_0YnwTqIUb7LgqzjBkaMV9qWI6n3ejG_iw-bYXzof5T9dGeokr9YFB1E32UnAy0pBqr-2U2tGqYG87H6wPu-1TVX_hVNasECECQp6bNwnK0XX_og5qM Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 11ae4739f59d4d14bad947b274c240ee Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ae4739f59d4d14bad947b274c240ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_11ae4739f59d4d14bad947b274c240ee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/11ae4739f59d4d14bad947b274c240ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/11ae4739f59d4d14bad947b274c240ee"}]}] Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 11ae4739f59d4d14bad947b274c240ee Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-478931485 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachSCSIVolumeTestJSON-478931485-project Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0fd22f5b843d4d82851147c1f2a89342 Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-478931485-project Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '088f74bc-3359-48f9-951b-a8ffed40674d'} Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:55:32.303833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.308547 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:55:32.308547 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:55:32.308547 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:55:32.308547 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:55:32.308547 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:55:32.308547 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. Nov 03 03:55:32.308547 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:55:32.317593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] Returning 404 to user: Instance 088f74bc-3359-48f9-951b-a8ffed40674d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:55:32.317593 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3047d58e-d3b2-4ae5-aabe-fa34a13bfd33 tempest-AttachSCSIVolumeTestJSON-478931485 tempest-AttachSCSIVolumeTestJSON-478931485-project] 10.222.0.30 "GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d" status: 404 len: 111 microversion: 2.1 time: 0.093468 Nov 03 03:55:32.319810 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 628/1236] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:32 2022] GET /compute/v2.1/servers/088f74bc-3359-48f9-951b-a8ffed40674d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:55:32.667911 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eb327d6b-9c3f-4e6c-aaf5-08dc051e7b19 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1857 microversion: 2.1 time: 0.783593 Nov 03 03:55:32.671554 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 609/1237] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:31 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1857 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:32.703075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854653-7", "block_migration": true, "disk_over_commit": false}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:32.708566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:32.737660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.739742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.742616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.743669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.746323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.747015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.787909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:32.788532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:32.796820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.797353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.797843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.798500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:32.798964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:32.799389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:32.829998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lazy-loading 'flavor' on Instance uuid 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:32.864530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Going to try to live migrate instance to n-h1-854653-7 {{(pid=127593) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:55:33.177200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:33.191048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:33.198542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:33.200011 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08363654-9400-4c13-8f11-ee324dac4f00 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.415998 Nov 03 03:55:33.201245 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 610/1238] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:32 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:55:33.214001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17bd79d7-6494-401a-80e1-cf7de8a3ed6c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f93d29d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:33.320548 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17bd79d7-6494-401a-80e1-cf7de8a3ed6c tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.117497 Nov 03 03:55:33.321858 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 611/1239] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:33 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:33.334021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:33.335877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:33.353497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:33.355303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:33.358554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:33.359808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:33.360715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:33.362872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:33.773907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:33.788608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53ec2f6e-3558-473f-8bff-0e27f73aaddd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1536 microversion: 2.1 time: 0.465043 Nov 03 03:55:33.791570 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 612/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:33 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1536 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:34.246851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-301398497", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "3a42706c-ac03-458e-a832-5b2b4cf0f95c"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:34.400778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] validate_networks() for [('3a42706c-ac03-458e-a832-5b2b4cf0f95c', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:55:35.386922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:55:35.387601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:55:35.388371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:55:35.389811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:55:35.390430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:55:35.407326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:35.407830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:35.408274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:35.409046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:35.409502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:35.409971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:35.455761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Getting quotas for project f29a96f192994136aa4c5e83816502c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:55:35.468679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Getting quotas for user 42bf39c4aa0f4d2ea1155c3ad5f6a074 and project f29a96f192994136aa4c5e83816502c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:55:35.507854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:55:35.510423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:55:35.678265 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e6aa216d-e715-415a-8b6c-ae38da66a5f0 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871706 Nov 03 03:55:35.679477 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 613/1241] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:55:35.688558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:35.689248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:35.698046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:35.698552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:35.699105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:35.699830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:35.700321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:35.700752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:35.838177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:35.857902 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ffb85d30-8513-45d1-894d-d7d58ba77bd4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1284 microversion: 2.1 time: 0.173223 Nov 03 03:55:35.859040 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 614/1242] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:35 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:35.871327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:35.884224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:35.924211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:35.924827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:35.926884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:35.929150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:35.930786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:35.933564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:36.276270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:36.290487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:36.296734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:36.299202 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc894a40-cd1e-4a6f-b6a7-1bb00ad7c808 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.438501 Nov 03 03:55:36.308212 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 615/1243] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:35 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:36.313581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7e9a155-58f4-4d70-8802-f8cda68acb3f tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f921ca60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:36.375703 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7e9a155-58f4-4d70-8802-f8cda68acb3f tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.066034 Nov 03 03:55:36.376513 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 616/1244] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:36 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:36.389966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:36.391292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:36.399025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:36.399790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:36.400442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:36.401372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:36.402003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:36.402603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:36.721376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:36.746777 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef8364c8-14da-4be2-928f-138e698e516d tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1536 microversion: 2.1 time: 0.357768 Nov 03 03:55:36.764770 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 617/1245] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:36 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1536 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:36.770642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e7afb66-1f38-40ca-93fa-04fca055b13e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:36.771603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e7afb66-1f38-40ca-93fa-04fca055b13e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:36.982138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e7afb66-1f38-40ca-93fa-04fca055b13e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:36.996796 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e7afb66-1f38-40ca-93fa-04fca055b13e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1231 microversion: 2.1 time: 0.230530 Nov 03 03:55:37.000134 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 618/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:36 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1231 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:37.009308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:37.025704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:37.031802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.032385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.032892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:37.033722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.034382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.034754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:37.119091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:37.137197 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-289c4575-1169-4916-8b2c-dc4863c3e8ec tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1272 microversion: 2.1 time: 0.134567 Nov 03 03:55:37.138864 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 619/1247] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:37 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:37.287733 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-242ab1cd-f455-4ca1-874c-aa91e26b070d tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/action" status: 202 len: 0 microversion: 2.1 time: 4.587764 Nov 03 03:55:37.292982 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 629/1248] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:55:32 2022] POST /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/action => generated 0 bytes in 4596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:55:37.303628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:37.305448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:37.315460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.316333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.317225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:37.318291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.319156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.320135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:37.332932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:37.336112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:37.344689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.345555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.346173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:37.347104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.347582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.348022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:37.603806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:37.606395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:37.639782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:37.643251 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-00862283-1042-4aa5-8352-efd4d74dcb67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.336969 Nov 03 03:55:37.646039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 620/1249] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:37 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:37.646777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:37.649173 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d140aea6-37ec-43a1-953e-c4fa0e26c0b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.322972 Nov 03 03:55:37.652783 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 630/1250] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:37 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:37.661470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8709e2e-7a21-42eb-a17e-60a0f108a659 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9206700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:37.734861 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8709e2e-7a21-42eb-a17e-60a0f108a659 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.087362 Nov 03 03:55:37.736087 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 621/1251] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:37 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:37.776515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:37.776515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:37.794480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.799922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.805000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:37.805000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:37.805000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:37.805000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.032907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:38.033249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:38.048419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.051532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.055666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.057946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.067501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.068461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.262620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:38.264433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:38.282335 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf415285-bb3e-4a5a-a330-f53a3b792490 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1235 microversion: 2.1 time: 0.254820 Nov 03 03:55:38.285160 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c211eb45-74f1-4b6e-af43-78b5ef466811 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1536 microversion: 2.1 time: 0.518779 Nov 03 03:55:38.285596 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 622/1252] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:38 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1235 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:38.288548 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 631/1253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:37 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1536 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:38.293703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:38.295067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:38.301852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.302732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.311128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.319522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.321339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.321784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.494914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:38.505178 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf19a9d1-082a-46d0-8ae9-4641ca9eb1c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1272 microversion: 2.1 time: 0.217197 Nov 03 03:55:38.505762 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 623/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:38 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1272 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:38.672175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:38.673195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:38.682157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:38.682641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:38.696402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:38.699363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.700601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.704664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.705366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.705996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.706369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.708624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.708624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.708624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:38.709629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:38.710156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:38.712879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:39.036577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:39.052893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:39.057564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:39.063560 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-81cdad0e-01b3-4fc1-b68f-604ea10c604c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1568 microversion: 2.25 time: 0.383749 Nov 03 03:55:39.070024 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 624/1255] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:38 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:55:39.071653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-445da278-b32d-41e1-8d2b-a3da959a2104 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f90fb4c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:39.109439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:39.125876 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eaf34ab1-bd72-4b27-a0be-97d6f7fb7945 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.453686 Nov 03 03:55:39.127911 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 632/1256] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:38 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:39.164703 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-445da278-b32d-41e1-8d2b-a3da959a2104 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.097577 Nov 03 03:55:39.167413 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 625/1257] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:39 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:39.321097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:39.322712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:39.325791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:39.328146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:39.345229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:39.348841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:39.349633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:39.350613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:39.351292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:39.351879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:39.354422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:39.355546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:39.359097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:39.360581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:39.361596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:39.362687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:39.491400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:39.500521 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cac1fa27-2c66-408d-baf0-83e2b4111f25 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1283 microversion: 2.1 time: 0.193890 Nov 03 03:55:39.517728 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 633/1258] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:39 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1283 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:39.544537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:39.545205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:39.567290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:39.567719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:39.568155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:39.568877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:39.569369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:39.574318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:40.268922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:40.275900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:40.282689 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cda897c5-37aa-4156-afd8-a2e1fbdb6d09 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1272 microversion: 2.1 time: 0.758677 Nov 03 03:55:40.283612 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 634/1259] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:39 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1272 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:40.288924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:40.289576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:40.315261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:40.315774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:40.316212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:40.316936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:40.319813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:40.321565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:40.720110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:40.735661 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03e476a4-819a-4829-a65f-95c237381ef0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1536 microversion: 2.1 time: 1.427500 Nov 03 03:55:40.735955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:40.739766 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 626/1260] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:39 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1536 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:40.744301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:40.746049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:40.746935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:40.754460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:40.755278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:40.755886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:40.756450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:40.757619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:40.757752 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-99c5da00-52f9-40af-a607-38642b2b3144 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1558 microversion: 2.25 time: 0.473161 Nov 03 03:55:40.770420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:40.773389 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 635/1261] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:40 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1558 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:40.777217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:40.779306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7e6da84-d639-4cb9-9c43-3a469c24b444 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f91789d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:40.875888 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7e6da84-d639-4cb9-9c43-3a469c24b444 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.101031 Nov 03 03:55:40.882382 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 636/1262] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:40 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:40.887374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:40.889793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:40.923138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:40.923838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:40.924467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:40.925961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:40.927416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:40.935093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:41.000654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:41.217644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:41.229198 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e0ce0909-b18b-4b86-bb54-c9d744fe03c4 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1289 microversion: 2.1 time: 0.345592 Nov 03 03:55:41.246278 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 637/1263] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:40 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1289 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:41.280196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f92da0f9-cb08-466f-98fd-37285d5f1066 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '.version_select at 0x7ff7f92afc10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:41.290915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92da0f9-cb08-466f-98fd-37285d5f1066 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:41.293188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92da0f9-cb08-466f-98fd-37285d5f1066 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:41.293966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92da0f9-cb08-466f-98fd-37285d5f1066 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:41.326868 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f92da0f9-cb08-466f-98fd-37285d5f1066 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 3452 microversion: 2.25 time: 0.088141 Nov 03 03:55:41.328264 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 638/1264] 10.222.0.30 () {60 vars in 1184 bytes} [Thu Nov 3 03:55:41 2022] GET /compute/v2.1/os-migrations => generated 3452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:41.335154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:41.336879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:41.345389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:41.345911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:41.346316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:41.347377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:41.348019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:41.348604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:41.462096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:41.470320 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-faa6da42-d28e-42e1-84c6-7a841b60d0d6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.729307 Nov 03 03:55:41.492880 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 627/1265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:40 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:41.503035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:41.506440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:41.520405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:41.525256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:41.525928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:41.527037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:41.527796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:41.528432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:41.901136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:41.925957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6722df39-a4d6-4201-a8cb-09a560ecf49e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1314 microversion: 2.1 time: 0.595614 Nov 03 03:55:41.932840 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 639/1266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:41 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:41.942576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:41.945411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:41.963989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:41.978868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:41.985581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:41.985581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:41.997048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:42.000515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:42.051516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid 74914149-185f-4400-9df8-cc7132fb7cdf {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:55:42.106075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33764922-39ba-4708-880d-9cde9fbf55a0 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 2051 microversion: 2.25 time: 0.611904 Nov 03 03:55:42.113743 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 628/1267] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:41 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 2051 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:42.126059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5f751e4-0ab2-4e64-9e67-effa26009e56 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9156af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:42.140451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:42.279762 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b5f751e4-0ab2-4e64-9e67-effa26009e56 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.164317 Nov 03 03:55:42.280368 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 629/1268] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:42 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:42.297727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:42.298450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:42.314883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:42.327302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:42.327984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:42.328769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:42.335591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:42.338664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:42.722131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:42.734632 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91b2d947-c81d-4738-9994-f955f0992f7f tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1289 microversion: 2.1 time: 0.449121 Nov 03 03:55:42.736980 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 630/1269] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:42 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1289 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:42.745268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2086340332", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "2752c8c3-e485-420b-a57b-73b9e6895e51"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:42.905760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] validate_networks() for [('2752c8c3-e485-420b-a57b-73b9e6895e51', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:55:43.668203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:43.682222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1058303b-329e-4d75-841c-89582bd76cbc tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 1.747499 Nov 03 03:55:43.685111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 640/1270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:41 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:43.711694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:43.716726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:43.733717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:43.736187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:43.736187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:43.736187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:43.736187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:43.741129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:45.128288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:45.137640 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c25130f2-8e16-4ebd-903e-e7c21e05fe3a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 1.430327 Nov 03 03:55:45.143439 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 641/1271] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:43 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:45.163925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:45.164497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:45.180569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:45.184366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:45.188156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:45.188156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:45.188156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:45.188156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:45.431350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:46.115372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:46.132574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41ad3ec5-343d-4d8b-9a72-23e94c25aa15 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1314 microversion: 2.1 time: 0.964185 Nov 03 03:55:46.136354 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 642/1272] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:45 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1314 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:46.141860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22a8bf66-a387-4a2f-8063-78923710c8da tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9160040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:46.248657 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-22a8bf66-a387-4a2f-8063-78923710c8da tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.110387 Nov 03 03:55:46.265415 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 643/1273] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:46 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:46.271291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:46.285735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:46.287154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:46.287691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:46.288126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:46.288862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:46.297910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:46.298707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:46.936590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:46.957233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f99c13a7-4d08-4e26-85cb-6898e3f4710a tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1331 microversion: 2.1 time: 0.686383 Nov 03 03:55:46.958853 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 644/1274] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:46 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1331 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:46.968253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:46.969176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:46.989557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:46.990433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:46.991348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:46.993865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:46.994891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:46.995923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:46.997521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:47.042933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:55:47.043848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:55:47.044757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:55:47.045732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:55:47.046566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:55:47.062630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:47.064341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:47.066119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:47.067137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:47.070075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:47.070902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:47.119447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:55:47.127951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for user 7ebbc13908db44e88853d5c14c8e2102 and project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:55:47.147045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:55:47.150170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:55:47.377471 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23460131-acd0-47de-8cac-d3c86f576342 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.630901 Nov 03 03:55:47.380426 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 631/1275] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 03:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 03:55:47.385932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e255fe1d-4d95-4131-b1ca-a8b193a78710 req-7345751c-bbae-4c09-b632-f8a158bb5b8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaed2ca2-aa0c-4edc-ba31-ff198664526c", "tag": "940b24fe-c4f2-4f73-9a41-bb9896bc86e0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:47.422840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e255fe1d-4d95-4131-b1ca-a8b193a78710 req-7345751c-bbae-4c09-b632-f8a158bb5b8d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:47.423809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e255fe1d-4d95-4131-b1ca-a8b193a78710 req-7345751c-bbae-4c09-b632-f8a158bb5b8d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:47.424712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e255fe1d-4d95-4131-b1ca-a8b193a78710 req-7345751c-bbae-4c09-b632-f8a158bb5b8d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:47.443089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:47.446170 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e255fe1d-4d95-4131-b1ca-a8b193a78710 req-7345751c-bbae-4c09-b632-f8a158bb5b8d service nova] Creating event network-changed:940b24fe-c4f2-4f73-9a41-bb9896bc86e0 for instance eaed2ca2-aa0c-4edc-ba31-ff198664526c on n-h2-854653-7 Nov 03 03:55:47.461811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e255fe1d-4d95-4131-b1ca-a8b193a78710 req-7345751c-bbae-4c09-b632-f8a158bb5b8d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079181 Nov 03 03:55:47.463962 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 632/1276] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:47.469701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:47.470716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:47.479028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:47.479913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:47.480586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:47.484132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:47.484918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:47.485907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:48.424386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:48.435214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcab9549-b402-4db6-bd75-ce17940ef3c1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 1.473688 Nov 03 03:55:48.440516 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 645/1277] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:46 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:48.461798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:48.464800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:48.487438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:48.488263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:48.489557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:48.492325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:48.493570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:48.495366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.001536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:49.017913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-947b79ae-688b-4b56-beac-11dd2a7805b1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 1.552440 Nov 03 03:55:49.018658 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 633/1278] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:47 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:49.023478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-468188cc-b7e1-4478-a415-54002f54a5be tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f911c820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:49.108395 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-468188cc-b7e1-4478-a415-54002f54a5be tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.088354 Nov 03 03:55:49.117099 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 634/1279] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:49 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:49.124714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:49.129952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:49.141186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:49.145666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:49.146235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.147184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:49.147652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:49.148100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.216447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:49.242867 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8330c010-7b06-467a-a0fb-4abc06b4918f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1314 microversion: 2.1 time: 0.797849 Nov 03 03:55:49.252518 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 646/1280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:48 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:49.265905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:49.273745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:49.298624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:49.313546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:49.313806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:49.314109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:49.314565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.315301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:49.315767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:49.316200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.320195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:49.325647 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e6089bf-9cca-4ed1-be13-450424e12dfa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1266 microversion: 2.25 time: 0.203667 Nov 03 03:55:49.326846 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 635/1281] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:49 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:49.334420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1a568ab7-fd71-4e1e-bddf-a2bb101874df req-dd0c7647-77f3-4c77-aca5-143b2eb46c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f03de5-3dc9-4702-b487-b59a45832ce7", "tag": "bb198cb5-9f5a-4ac7-a332-d139f1571ce3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:49.374750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a568ab7-fd71-4e1e-bddf-a2bb101874df req-dd0c7647-77f3-4c77-aca5-143b2eb46c95 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:49.377431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a568ab7-fd71-4e1e-bddf-a2bb101874df req-dd0c7647-77f3-4c77-aca5-143b2eb46c95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:49.378063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a568ab7-fd71-4e1e-bddf-a2bb101874df req-dd0c7647-77f3-4c77-aca5-143b2eb46c95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.419140 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1a568ab7-fd71-4e1e-bddf-a2bb101874df req-dd0c7647-77f3-4c77-aca5-143b2eb46c95 service nova] Creating event network-changed:bb198cb5-9f5a-4ac7-a332-d139f1571ce3 for instance f1f03de5-3dc9-4702-b487-b59a45832ce7 on n-h1-854653-7 Nov 03 03:55:49.429381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1a568ab7-fd71-4e1e-bddf-a2bb101874df req-dd0c7647-77f3-4c77-aca5-143b2eb46c95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099686 Nov 03 03:55:49.432853 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 636/1282] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:49.468545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:49.470894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:49.488045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:49.489234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:49.490681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.493785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:49.494516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:49.497440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:49.987858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:50.001998 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6026e812-8d08-422c-976c-c9f3e8563f2f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.539090 Nov 03 03:55:50.002913 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 637/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:49 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:50.045201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:50.045822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:50.055117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:50.055615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:50.056056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:50.056765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:50.057310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:50.057743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:50.066464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:50.076187 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ceac27e7-6894-4c34-b16b-e0d87f3fa289 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1331 microversion: 2.1 time: 0.822287 Nov 03 03:55:50.094246 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 647/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:49 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1331 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:50.127462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b8017d5-12e5-451e-b9a2-4d570236993e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9160550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:50.274566 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b8017d5-12e5-451e-b9a2-4d570236993e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.150164 Nov 03 03:55:50.275394 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 648/1285] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:50 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:50.304564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:50.313859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:50.349910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:50.359140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:50.361314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:50.368495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:50.369606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:50.374856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:50.411911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:50.423789 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c544d1fc-b419-4225-8a74-6585a7a399ba tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.385392 Nov 03 03:55:50.429385 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 638/1286] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:50 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:50.435158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:50.436617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:50.467305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:50.469916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:50.471399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:50.474224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:50.474938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:50.475572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:51.014972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:51.028751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:51.031074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:51.038514 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a677d88d-fd48-4691-9129-9cb4e93c0967 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1322 microversion: 2.25 time: 0.607939 Nov 03 03:55:51.039525 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 639/1287] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:50 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:51.046609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:51.047224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:51.066137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:51.066739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:51.069984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:51.078385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:51.079077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:51.079633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:51.404151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:51.414031 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cad69789-da90-4145-ac01-048db79d5a14 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1314 microversion: 2.1 time: 1.127533 Nov 03 03:55:51.422081 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 649/1288] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:50 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:51.425108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:51.430980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:51.445727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:51.446705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:51.447353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:51.448258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:51.451437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:51.452067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:51.948406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:51.985576 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92935071-fcf5-470a-b9eb-b3a8b6b004f3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.943031 Nov 03 03:55:51.988749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 640/1289] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:51 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:51.994906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc066ce1-cdd6-4b34-ae22-d615bb4dfb66 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f92f7670>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:52.067515 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc066ce1-cdd6-4b34-ae22-d615bb4dfb66 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.077521 Nov 03 03:55:52.068923 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 641/1290] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:51 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:52.078404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:52.085379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:52.095772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:52.101627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:52.106380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:52.106380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:52.106380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:52.106380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:52.453650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:52.462325 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b66a45c-aa0a-4304-a1ef-85ca725214ca tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1331 microversion: 2.1 time: 1.044739 Nov 03 03:55:52.464846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 650/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:51 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1331 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:52.491422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:52.491422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:52.511161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:52.511669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:52.516796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:52.523094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:52.534668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:52.535620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:52.717660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:52.733841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:52.742478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:52.747440 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5f85f26c-3172-4c38-b585-4dc235223767 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1322 microversion: 2.25 time: 0.257541 Nov 03 03:55:52.748079 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 651/1292] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:52 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:52.786087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a466fadc-e6c1-406e-aa9c-dc912390f737 req-7ba5b88a-25bc-46dd-a835-7f2a484d64af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaed2ca2-aa0c-4edc-ba31-ff198664526c", "name": "network-vif-plugged", "status": "completed", "tag": "940b24fe-c4f2-4f73-9a41-bb9896bc86e0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:52.821542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a466fadc-e6c1-406e-aa9c-dc912390f737 req-7ba5b88a-25bc-46dd-a835-7f2a484d64af service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:52.824095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a466fadc-e6c1-406e-aa9c-dc912390f737 req-7ba5b88a-25bc-46dd-a835-7f2a484d64af service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:52.825980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a466fadc-e6c1-406e-aa9c-dc912390f737 req-7ba5b88a-25bc-46dd-a835-7f2a484d64af service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:52.867585 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a466fadc-e6c1-406e-aa9c-dc912390f737 req-7ba5b88a-25bc-46dd-a835-7f2a484d64af service nova] Creating event network-vif-plugged:940b24fe-c4f2-4f73-9a41-bb9896bc86e0 for instance eaed2ca2-aa0c-4edc-ba31-ff198664526c on n-h2-854653-7 Nov 03 03:55:52.885564 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a466fadc-e6c1-406e-aa9c-dc912390f737 req-7ba5b88a-25bc-46dd-a835-7f2a484d64af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107634 Nov 03 03:55:52.890864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 652/1293] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:52.910079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:52.912080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:52.932761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:52.939271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:52.940134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:52.942508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:52.943905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:52.946622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:53.503738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:53.537949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c722230a-4613-47d5-8c19-0be37bf62399 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 1.464614 Nov 03 03:55:53.539935 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 642/1294] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:52 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:53.552327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:53.553237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:53.563039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:53.564966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:53.567215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:53.567215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:53.567215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:53.568683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:54.012594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:54.017513 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2c82662-9ba5-4ddd-ad70-1f02065d7983 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1314 microversion: 2.1 time: 1.124796 Nov 03 03:55:54.023468 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 653/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:52 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1314 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:54.029185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-251818e6-803d-47c3-b36d-ec4d2d8e67fd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f912cca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:54.103658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-251818e6-803d-47c3-b36d-ec4d2d8e67fd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.078934 Nov 03 03:55:54.113582 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 654/1296] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:54 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:54.119286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:54.120362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:54.127131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:54.128423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:54.129155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:54.130123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:54.130807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:54.131460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:54.134717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:54.150743 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07fa3bc2-bc9c-4b0c-a10b-179e4e330990 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.609436 Nov 03 03:55:54.155891 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 643/1297] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:53 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:54.156897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:54.159443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:54.168781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:54.171839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:54.172594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:54.179202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:54.179888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:54.180590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:54.445666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:54.460435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:54.468259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:54.471457 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-66c4ff71-7481-41ba-93e9-fdbba2502dd0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1320 microversion: 2.25 time: 0.319088 Nov 03 03:55:54.474679 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 644/1298] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:54 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:54.567160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:54.567854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:54.579862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:54.583332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:54.588894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:54.588894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:54.588894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:54.588894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:55.287311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:55.296211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba7d116f-eb8f-4943-a3b7-8c01737d6762 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1331 microversion: 2.1 time: 1.181102 Nov 03 03:55:55.297203 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 655/1299] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:54 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1331 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:55.304864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:55.305549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:55.312514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:55.313026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:55.313465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:55.314198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:55.314764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:55.315080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:55.540648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:55.560246 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95896525-e2f0-4c92-87a9-108d703a99c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.994844 Nov 03 03:55:55.560246 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 645/1300] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:54 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:55.562986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83b60556-a87d-4621-a327-ac094e62c6cd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f92cdd30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:55.648970 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83b60556-a87d-4621-a327-ac094e62c6cd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1422 microversion: 2.1 time: 0.089377 Nov 03 03:55:55.651105 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 646/1301] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:55 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:55.658181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:55.659357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:55.672050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:55.672549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:55.672999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:55.673817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:55.674276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:55.674903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:55.870935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:55.879028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:55.884401 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-18e0fd6b-df0f-46c3-8a17-2fbfc4a48829 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 200 len: 1500 microversion: 2.1 time: 0.585940 Nov 03 03:55:55.886271 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 656/1302] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:55 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 1500 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:55.921623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:55.922694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:55.931005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:55.931827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:55.932446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:55.935321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:55.935321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:55.935321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:56.104714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:56.116471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:56.121543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:56.123898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac130fec-b5cf-4abe-9ab8-e91b024da454 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1320 microversion: 2.25 time: 0.233819 Nov 03 03:55:56.126144 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 657/1303] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:55 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:56.254913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:56.263796 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-396d1d54-4970-49f2-ae8c-b8b1fe01e987 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.611516 Nov 03 03:55:56.264480 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 647/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:55 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:56.320988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:56.322308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:56.330621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:56.331778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:56.332397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:56.334506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:56.336053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:56.337220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:56.593844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:56.594880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:56.608154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:56.609650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:56.611284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:56.612902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:56.613648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:56.615064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:56.796546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:56.816432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-067c95cb-0040-4b11-a99a-e12ad6a15d12 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1331 microversion: 2.1 time: 0.500649 Nov 03 03:55:56.819276 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 658/1305] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:56 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1331 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:56.828959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a07c25b-57d9-473c-8807-c0182949ae64 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f91af040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:56.901070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a07c25b-57d9-473c-8807-c0182949ae64 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1431 microversion: 2.1 time: 0.080495 Nov 03 03:55:56.911165 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 659/1306] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:56 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1431 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:56.916988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7c03e633-843a-4b8e-a95c-7e04e03c1de7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f912caf0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:57.003813 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7c03e633-843a-4b8e-a95c-7e04e03c1de7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 200 len: 1431 microversion: 2.1 time: 0.089134 Nov 03 03:55:57.007835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 660/1307] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:56 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 1431 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:57.024395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:57.028476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:57.037610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.038255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.038801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.039628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.040328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.040968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.058176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:57.084803 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cff082b-914d-487a-9b42-e88e2f3360fe tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.500318 Nov 03 03:55:57.085425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 648/1308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:56 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:57.150729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:57.151505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:57.157008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:57.159310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.160010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.160572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.161594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.162109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.162592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.523644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:57.527963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:57.537370 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe9e7a94-7fb2-4d3b-96bd-f138394684b3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1480 microversion: 2.1 time: 0.518998 Nov 03 03:55:57.545877 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 661/1309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:57 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1480 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:57.551247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:57.558437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:57.570928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.571655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.572295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.573226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.573849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.574967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.639242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:57.651984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:57.654042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:57.655466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d3950ca0-752e-4e6d-8f44-993d0a41344d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.508784 Nov 03 03:55:57.680160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 649/1310] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:57 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:57.692830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8e42bf65-6399-4333-b764-b96153881839 req-25b63682-deb0-4ff7-8c58-be4cc09e3e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f03de5-3dc9-4702-b487-b59a45832ce7", "name": "network-vif-plugged", "status": "completed", "tag": "bb198cb5-9f5a-4ac7-a332-d139f1571ce3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:57.705383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e42bf65-6399-4333-b764-b96153881839 req-25b63682-deb0-4ff7-8c58-be4cc09e3e3f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.705889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e42bf65-6399-4333-b764-b96153881839 req-25b63682-deb0-4ff7-8c58-be4cc09e3e3f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.706464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e42bf65-6399-4333-b764-b96153881839 req-25b63682-deb0-4ff7-8c58-be4cc09e3e3f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.719329 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8e42bf65-6399-4333-b764-b96153881839 req-25b63682-deb0-4ff7-8c58-be4cc09e3e3f service nova] Creating event network-vif-plugged:bb198cb5-9f5a-4ac7-a332-d139f1571ce3 for instance f1f03de5-3dc9-4702-b487-b59a45832ce7 on n-h1-854653-7 Nov 03 03:55:57.727065 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8e42bf65-6399-4333-b764-b96153881839 req-25b63682-deb0-4ff7-8c58-be4cc09e3e3f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044736 Nov 03 03:55:57.727874 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 650/1311] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:55:57.846219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:57.847649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:57.857343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.858126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.858807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:57.859945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:57.861102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:57.861923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:58.422957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:58.431831 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f15dabae-122d-41a0-a2d0-33d91dbb3224 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1331 microversion: 2.1 time: 0.591957 Nov 03 03:55:58.436592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:58.438963 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 651/1312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:57 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1331 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:58.443846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:58.445749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:58.451938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:58.458469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:58.458469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:58.458469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:58.458469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:58.458469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:58.458898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14a53e65-5c9b-4e2a-9535-3553d054ea35 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.909594 Nov 03 03:55:58.458898 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 662/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:57 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:58.572888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:58.573701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:58.580131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:58.581944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:58.582559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:58.583341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:58.583870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:58.584364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:58.859612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:58.872124 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8d23944-fbaa-4aae-a4ca-85fde48c261b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.431952 Nov 03 03:55:58.873979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 652/1314] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:58 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:55:58.895568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:58.897329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:58.910162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:58.910931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:58.911713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:58.912902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:58.913861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:58.914670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:58.962510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:58.974729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9bf5ab38-4881-4ddd-bb38-750e40e564a2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1467 microversion: 2.1 time: 0.405586 Nov 03 03:55:58.975763 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 663/1315] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:58 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1467 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:55:59.000734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8849ae85-94e8-4c3a-b87a-3f078c28fad0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9142ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:59.090991 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8849ae85-94e8-4c3a-b87a-3f078c28fad0 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/9282dbed-69cc-4288-b866-d4c7962a81f1" status: 200 len: 784 microversion: 2.1 time: 0.090483 Nov 03 03:55:59.094285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 664/1316] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:55:58 2022] GET /compute/v2.1/images/9282dbed-69cc-4288-b866-d4c7962a81f1 => generated 784 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:59.106302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17a48cca-d3a2-47ce-ada5-fdb245568e69"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:55:59.108713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:55:59.115242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:59.115743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:59.116187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:59.116891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:55:59.117388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:55:59.117802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:55:59.211802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:59.219207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:55:59.224361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:59.224361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:55:59.224797 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef715982-726a-4cdf-abac-22216a1b417a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.348969 Nov 03 03:55:59.225860 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 653/1317] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:55:58 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:55:59.230789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e984f47-4f0d-4c2d-980e-81caf9d3799f tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:55:59.239257 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e984f47-4f0d-4c2d-980e-81caf9d3799f tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012140 Nov 03 03:55:59.240318 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 654/1318] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:55:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:55:59.266151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2961957f-2c5f-4f1f-ab03-ec4d622a0953 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f911c9d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:00.011621 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a12628b4-ef8e-4598-a02f-8e747bc04be1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909144 Nov 03 03:56:00.019121 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 665/1319] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 03:55:59 2022] POST /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:00.025981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-860369be-4e4d-42eb-b870-3a0a8a4f05a2 req-95e37feb-d732-4715-a58d-fd0a5f20373d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b0ee6b-7653-4811-8177-e49f8fbc62d5", "tag": "3ec28101-cd78-498e-95a0-58c0353148ab"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:00.038231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-860369be-4e4d-42eb-b870-3a0a8a4f05a2 req-95e37feb-d732-4715-a58d-fd0a5f20373d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.039004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-860369be-4e4d-42eb-b870-3a0a8a4f05a2 req-95e37feb-d732-4715-a58d-fd0a5f20373d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.039659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-860369be-4e4d-42eb-b870-3a0a8a4f05a2 req-95e37feb-d732-4715-a58d-fd0a5f20373d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.061512 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-860369be-4e4d-42eb-b870-3a0a8a4f05a2 req-95e37feb-d732-4715-a58d-fd0a5f20373d service nova] Creating event network-changed:3ec28101-cd78-498e-95a0-58c0353148ab for instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 on n-h1-854653-7 Nov 03 03:56:00.073059 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-860369be-4e4d-42eb-b870-3a0a8a4f05a2 req-95e37feb-d732-4715-a58d-fd0a5f20373d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050204 Nov 03 03:56:00.079241 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 666/1320] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:00.085585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:00.086653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:00.094296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.095088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.095811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.096837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.097648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.098262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.373374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:00.385927 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be807e38-e631-4378-9f4f-d0baf3c95658 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1331 microversion: 2.1 time: 0.304993 Nov 03 03:56:00.387884 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 667/1321] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:00 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1331 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:00.392374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:00.393422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:00.401070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.401829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.403066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.404011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.404688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.405387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.701199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:00.714657 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b6f1aa6c-60b1-4d80-aa15-8056e21f7549 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.325696 Nov 03 03:56:00.715270 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 668/1322] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:00 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:00.726747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:00.727401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:00.740666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.743011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.743011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.743011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.743011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.743327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.920430 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2961957f-2c5f-4f1f-ab03-ec4d622a0953 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "DELETE /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 204 len: 0 microversion: 2.1 time: 1.658288 Nov 03 03:56:00.922588 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 655/1323] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:55:59 2022] DELETE /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 0 bytes in 1661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:56:00.932012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:00.932770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:00.944354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.945096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.945715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:00.946870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:00.947491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:00.948345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:01.131486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:01.141715 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-189226c1-3195-4013-9884-54ab3f7defa3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.425367 Nov 03 03:56:01.157317 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 669/1324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:00 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:01.157317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8ccc0d1-0bb7-4358-a58e-0722dc9b1c6e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9142dc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:01.195616 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-c8ccc0d1-0bb7-4358-a58e-0722dc9b1c6e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] HTTP exception thrown: Image not found. Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8ccc0d1-0bb7-4358-a58e-0722dc9b1c6e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Request method failure captured: Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e HTTP/1.1 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuNMgNNhe-tlG_WV5u7dPtab38MpG6KNz6Bl0uMrhjzBM72FDY7oK4EBeRh710itvxm5Rt9wrbcDvWBgolHGTrjkt72zSlqrC5UDZ04zrg3kthmhkLRFvzd8ynbhfcYdRbP8bQi_sFikSm1oGNVM5brVlU7eoINqYXSqAgPioD9L2I Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 75abb61bee2f4e6dadffbd21b8ad0096 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75abb61bee2f4e6dadffbd21b8ad0096"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75abb61bee2f4e6dadffbd21b8ad0096", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75abb61bee2f4e6dadffbd21b8ad0096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75abb61bee2f4e6dadffbd21b8ad0096"}]}] Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 75abb61bee2f4e6dadffbd21b8ad0096 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesOneServerTestJSON-602042427-project Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 713b3bde635745918bd322e07a240519 Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesOneServerTestJSON-602042427-project Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '6d19d16b-5360-4dc8-9e16-296a9f72943e'} Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6d19d16b-5360-4dc8-9e16-296a9f72943e Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:56:01.202551 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6d19d16b-5360-4dc8-9e16-296a9f72943e could not be found. Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8ccc0d1-0bb7-4358-a58e-0722dc9b1c6e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:01.206858 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8ccc0d1-0bb7-4358-a58e-0722dc9b1c6e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 404 len: 62 microversion: 2.1 time: 0.060130 Nov 03 03:56:01.211069 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 670/1325] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:01 2022] GET /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:56:01.221905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-588616792"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:01.225884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:01.234270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:01.235012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:01.236348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:01.237485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:01.237942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:01.238378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:01.323136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:01.335467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:01.339192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:01.347516 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77483178-ea17-4578-9e8d-9606112d4ee8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.423774 Nov 03 03:56:01.370557 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 656/1326] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:00 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:01.419022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:01.422359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:01.433983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:01.434484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:01.434921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:01.435860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:01.436110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:01.436536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:01.813843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:01.825340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7805aaf5-90df-4336-8498-ddb5de508eae tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1535 microversion: 2.1 time: 0.411554 Nov 03 03:56:01.827077 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 657/1327] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:01 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1535 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:01.851766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6d10369b-accf-44d7-bc89-bf48cac3b76a req-57f02013-1c57-4142-b6b2-11c01957ec64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8b2ed9-05a6-4f4a-b8c4-2cd266662985", "name": "network-vif-unplugged", "status": "completed", "tag": "450f08dc-4ccc-4a7b-a22a-21e428fb7d29"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:01.875341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6d10369b-accf-44d7-bc89-bf48cac3b76a req-57f02013-1c57-4142-b6b2-11c01957ec64 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:01.876136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6d10369b-accf-44d7-bc89-bf48cac3b76a req-57f02013-1c57-4142-b6b2-11c01957ec64 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:01.876800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6d10369b-accf-44d7-bc89-bf48cac3b76a req-57f02013-1c57-4142-b6b2-11c01957ec64 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:01.894404 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6d10369b-accf-44d7-bc89-bf48cac3b76a req-57f02013-1c57-4142-b6b2-11c01957ec64 service nova] Creating event network-vif-unplugged:450f08dc-4ccc-4a7b-a22a-21e428fb7d29 for instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 on n-h1-854653-7 Nov 03 03:56:01.901885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6d10369b-accf-44d7-bc89-bf48cac3b76a req-57f02013-1c57-4142-b6b2-11c01957ec64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072792 Nov 03 03:56:01.907657 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 658/1328] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:01.927983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:01.928849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:01.937583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:01.938141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:01.938591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:01.939311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:01.939956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:01.940552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:02.024976 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f91b0c34-5120-4136-a4c8-fcf70be574e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "POST /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985/action" status: 202 len: 0 microversion: 2.1 time: 0.808563 Nov 03 03:56:02.029408 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 671/1329] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:01 2022] POST /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 03:56:02.045190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ac01d55-ba9e-4575-b811-d06cb58c83c5 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'create', calling method: .version_select at 0x7ff7fd63de50>, body: {"pool": "6d2ab465-64b6-4819-b014-15c6774f2465"} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:02.335130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:02.348710 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53592f4c-aa69-41c8-a1c7-7d36be17dae5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.438838 Nov 03 03:56:02.368989 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 659/1330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:01 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:02.389278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-66b439e4-f454-48f0-b609-8457403c80d5 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9165ca0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:02.463679 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-66b439e4-f454-48f0-b609-8457403c80d5 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.085762 Nov 03 03:56:02.467471 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 660/1331] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:02 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:02.479114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:02.479753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:02.495322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:02.498055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:02.501732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:02.502978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:02.503687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:02.505103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:02.780764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:02.793544 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7527e557-8972-4c11-9066-4a50754267e4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.323003 Nov 03 03:56:02.811936 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 661/1332] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:02 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:02.818149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a8a6d53a-26c2-4039-ab5e-58f50b1b2acf req-014f603b-41cf-44a7-acdb-f3c212f8bf93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ddb0bd-101b-4c9e-92fa-76855b9e6ec9", "name": "network-vif-unplugged", "status": "completed", "tag": "1b137398-13a0-4268-8495-d732181a2eb9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:02.834947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8a6d53a-26c2-4039-ab5e-58f50b1b2acf req-014f603b-41cf-44a7-acdb-f3c212f8bf93 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:02.834947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8a6d53a-26c2-4039-ab5e-58f50b1b2acf req-014f603b-41cf-44a7-acdb-f3c212f8bf93 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:02.834947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8a6d53a-26c2-4039-ab5e-58f50b1b2acf req-014f603b-41cf-44a7-acdb-f3c212f8bf93 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:02.866950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a8a6d53a-26c2-4039-ab5e-58f50b1b2acf req-014f603b-41cf-44a7-acdb-f3c212f8bf93 service nova] Creating event network-vif-unplugged:1b137398-13a0-4268-8495-d732181a2eb9 for instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 on n-h2-854653-7 Nov 03 03:56:02.878643 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a8a6d53a-26c2-4039-ab5e-58f50b1b2acf req-014f603b-41cf-44a7-acdb-f3c212f8bf93 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064071 Nov 03 03:56:02.880386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 662/1333] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:02.892585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:02.897217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:02.916219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:02.918560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:02.918560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:02.918560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:02.919032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:02.919679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:03.125069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:03.133586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:03.135050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:03.136180 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b723bf63-e14d-4bee-a60d-b0a39a15d0d9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.254158 Nov 03 03:56:03.143804 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 663/1334] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:02 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:03.373134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:03.373910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:03.403897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:03.404533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:03.404966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:03.405748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:03.406215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:03.406647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:04.196626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:04.207402 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33094c32-4c63-4e2a-8900-6fe425523d77 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1541 microversion: 2.1 time: 0.839271 Nov 03 03:56:04.214345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 664/1335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:03 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1541 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:04.228356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c196ee1-dd5a-4b1c-850c-8a5f1236d9e1 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9129310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:04.326736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c196ee1-dd5a-4b1c-850c-8a5f1236d9e1 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.110360 Nov 03 03:56:04.329564 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 665/1336] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:04 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:04.345093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:04.346739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:04.361619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:04.362322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:04.363278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:04.364185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:04.366659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:04.367313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:05.091261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:05.101220 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-242f3c73-f318-48d9-877c-99dd64541554 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.770270 Nov 03 03:56:05.102334 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 666/1337] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:04 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:05.113777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:05.114820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:05.124437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:05.125065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:05.127879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:05.127879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:05.127879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:05.157290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:05.501185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:05.521772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:05.523445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:05.531019 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8693dec7-69a6-4bed-ad82-8aa50afabe8b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.427376 Nov 03 03:56:05.547152 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 667/1338] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:05 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:05.846798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cbf4c89d-c480-41ed-834c-279168501656 req-4e527ca5-bb3c-4062-9683-64f00e7735a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ddb0bd-101b-4c9e-92fa-76855b9e6ec9", "tag": "1b137398-13a0-4268-8495-d732181a2eb9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:05.866600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cbf4c89d-c480-41ed-834c-279168501656 req-4e527ca5-bb3c-4062-9683-64f00e7735a7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:05.873616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cbf4c89d-c480-41ed-834c-279168501656 req-4e527ca5-bb3c-4062-9683-64f00e7735a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:05.874074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cbf4c89d-c480-41ed-834c-279168501656 req-4e527ca5-bb3c-4062-9683-64f00e7735a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:05.892359 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ac01d55-ba9e-4575-b811-d06cb58c83c5 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.861179 Nov 03 03:56:05.892946 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 672/1339] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 03:56:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:05.903096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:05.905362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:05.905943 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cbf4c89d-c480-41ed-834c-279168501656 req-4e527ca5-bb3c-4062-9683-64f00e7735a7 service nova] Creating event network-changed:1b137398-13a0-4268-8495-d732181a2eb9 for instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 on n-h2-854653-7 Nov 03 03:56:05.922103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=75 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:05.923125 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cbf4c89d-c480-41ed-834c-279168501656 req-4e527ca5-bb3c-4062-9683-64f00e7735a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.378085 Nov 03 03:56:05.926596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:05.926724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 668/1340] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:05.926834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:05.926834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:05.929087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:05.929671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:05.930122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:05.933885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-863479d5-3321-4824-9bb1-5c0ff2852229 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f911c8b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:06.054638 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-863479d5-3321-4824-9bb1-5c0ff2852229 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.127182 Nov 03 03:56:06.087125 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 669/1341] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:05 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:06.099395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'action', calling method: .version_select at 0x7ff7fb948e50>, body: {"addFloatingIp": {"address": "172.25.8.120"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:06.109129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:06.125948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:06.129234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:06.130992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:06.133383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:06.133874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:06.138240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:06.290146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:56:06.291178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquired lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:56:06.335843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:06.346533 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b57007a-5d5a-4ae5-a4a8-96fe0b88e2cb tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1540 microversion: 2.1 time: 0.452470 Nov 03 03:56:06.351575 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 673/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:05 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1540 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:06.359174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:06.361728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:06.377146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:06.377714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:06.378155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:06.378891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:06.379354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:06.379784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:06.858108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:06.882222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0fdc72f1-bf8e-4850-b90d-200e9ca8d3fc tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.529359 Nov 03 03:56:06.884290 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 674/1343] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:06 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:06.891199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:06.893328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:06.936790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:06.939803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:06.940632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:06.942115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:06.943812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:06.944887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:07.419571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:07.428723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:07.452037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:07.461175 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93e55aa3-7845-4833-8fec-ec3ebcb8e154 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.575372 Nov 03 03:56:07.465253 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 675/1344] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:06 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:07.484466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f72f414-78fb-4674-af58-ebc2d6b7f3f7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9142ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:07.559971 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f72f414-78fb-4674-af58-ebc2d6b7f3f7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.092732 Nov 03 03:56:07.560870 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 676/1345] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:07 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:07.571229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:07.573411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:07.584013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:07.584707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:07.586355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:07.588767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:07.592517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:07.593093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:07.630533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:08.076771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:08.091954 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44a5eb98-6925-4c43-b335-6e7fb4abefe2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1472 microversion: 2.1 time: 0.529232 Nov 03 03:56:08.102793 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 677/1346] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:07 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1472 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:08.130770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:08.131401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:08.144202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:08.144711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:08.145189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:08.145909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:08.146373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:08.146807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:08.469268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:08.483942 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fb3c96ca-36d7-4dbe-b18f-1d94e4aa7065 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.363868 Nov 03 03:56:08.484994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 678/1347] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:08 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:08.490770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-39fbf794-2df2-4fec-9dbd-bcb31536fe51 req-2b7f2bd2-7a9e-4ca7-9cea-86295ac02a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b033176-fb9d-429b-a068-6e8914bdc171", "name": "network-vif-unplugged", "status": "completed", "tag": "bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:08.506892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-39fbf794-2df2-4fec-9dbd-bcb31536fe51 req-2b7f2bd2-7a9e-4ca7-9cea-86295ac02a5a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:08.507505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-39fbf794-2df2-4fec-9dbd-bcb31536fe51 req-2b7f2bd2-7a9e-4ca7-9cea-86295ac02a5a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:08.508014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-39fbf794-2df2-4fec-9dbd-bcb31536fe51 req-2b7f2bd2-7a9e-4ca7-9cea-86295ac02a5a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:08.525437 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-39fbf794-2df2-4fec-9dbd-bcb31536fe51 req-2b7f2bd2-7a9e-4ca7-9cea-86295ac02a5a service nova] Creating event network-vif-unplugged:bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9 for instance 2b033176-fb9d-429b-a068-6e8914bdc171 on n-h2-854653-7 Nov 03 03:56:08.535274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-39fbf794-2df2-4fec-9dbd-bcb31536fe51 req-2b7f2bd2-7a9e-4ca7-9cea-86295ac02a5a service nova] Instance 2b033176-fb9d-429b-a068-6e8914bdc171 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:56:08.546492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-39fbf794-2df2-4fec-9dbd-bcb31536fe51 req-2b7f2bd2-7a9e-4ca7-9cea-86295ac02a5a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059554 Nov 03 03:56:08.547291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 679/1348] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:08.559498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:08.560205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:08.567588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:08.568088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:08.568534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:08.569364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:08.570002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:08.570604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:08.635246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Building network info cache for instance {{(pid=127594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:56:08.833815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:08.855226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:08.858944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:08.861904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8d9d3c92-f123-4560-8c15-6106de8524e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.306304 Nov 03 03:56:08.862724 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 680/1349] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:08 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:08.869169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ac057a0-2f1e-4c80-844a-8ec68f1320f3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f91afb80>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:08.954093 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ac057a0-2f1e-4c80-844a-8ec68f1320f3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.089504 Nov 03 03:56:08.964490 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 681/1350] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:08 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:08.971989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8ddf9af8-2565-49d6-91e6-3518738bbd75 req-936189df-5741-41d5-8383-bda5d59a444a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f03de5-3dc9-4702-b487-b59a45832ce7", "tag": "bb198cb5-9f5a-4ac7-a332-d139f1571ce3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:08.991936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8ddf9af8-2565-49d6-91e6-3518738bbd75 req-936189df-5741-41d5-8383-bda5d59a444a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:08.993183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8ddf9af8-2565-49d6-91e6-3518738bbd75 req-936189df-5741-41d5-8383-bda5d59a444a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:08.994613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8ddf9af8-2565-49d6-91e6-3518738bbd75 req-936189df-5741-41d5-8383-bda5d59a444a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:09.075940 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8ddf9af8-2565-49d6-91e6-3518738bbd75 req-936189df-5741-41d5-8383-bda5d59a444a service nova] Creating event network-changed:bb198cb5-9f5a-4ac7-a332-d139f1571ce3 for instance f1f03de5-3dc9-4702-b487-b59a45832ce7 on n-h1-854653-7 Nov 03 03:56:09.106806 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8ddf9af8-2565-49d6-91e6-3518738bbd75 req-936189df-5741-41d5-8383-bda5d59a444a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138856 Nov 03 03:56:09.107460 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 682/1351] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:09.134722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:09.135958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:09.151382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:09.151925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:09.154827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:09.155736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:09.156230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:09.156666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:09.703299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:09.715608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-88598702-0c53-46f8-a6fb-2e9814bd6207 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1472 microversion: 2.1 time: 0.586103 Nov 03 03:56:09.727835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 683/1352] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:09 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1472 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:56:09.743968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:09.744632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:09.763657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:09.764304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:09.764935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:09.770464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:09.771181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:09.771827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:09.962716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Updating instance_info_cache with network_info: [{"id": "bb198cb5-9f5a-4ac7-a332-d139f1571ce3", "address": "fa:16:3e:d3:e7:1f", "network": {"id": "3a42706c-ac03-458e-a832-5b2b4cf0f95c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1463871772-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f29a96f192994136aa4c5e83816502c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb198cb5-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:56:10.065190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Releasing lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:56:10.066446 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8bd6544-6064-4616-8b7c-ef54845b2b46 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action" status: 202 len: 0 microversion: 2.1 time: 3.977914 Nov 03 03:56:10.067352 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 670/1353] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:06 2022] POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action => generated 0 bytes in 3979 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 03:56:10.075526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:10.078638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:10.088977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:10.091655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:10.092329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:10.092943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:10.093901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:10.094622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:10.095239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:10.131939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:10.144548 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d48cd862-d1e6-43b3-871d-853a243fcdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.411702 Nov 03 03:56:10.154814 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 684/1354] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:09 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:10.162687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fe0ff02-8e86-46ad-a50d-d65f1020978e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7fd66cee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:10.240617 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2fe0ff02-8e86-46ad-a50d-d65f1020978e tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.084270 Nov 03 03:56:10.241225 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 685/1355] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:10 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:10.253871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7a3dd917-588b-4868-9a83-b0939ea0ed48 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'create', calling method: .version_select at 0x7ff7f92af280>, body: {"pool": "6d2ab465-64b6-4819-b014-15c6774f2465"} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:10.404648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:10.421289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:10.422742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:10.423862 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33fd3ed7-e195-4404-9a6b-dfe28d065edc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.355175 Nov 03 03:56:10.438286 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 671/1356] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:10 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:10.752025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:10.752544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:10.760209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:10.761038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:10.762347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:10.763283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:10.767853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:10.767853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:11.031858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:11.047338 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-388eb84f-6a2d-4dce-aa78-823f233daf7f tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1469 microversion: 2.1 time: 0.298967 Nov 03 03:56:11.051339 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 672/1357] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:10 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1469 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:56:11.093568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:11.095647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:11.109616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:11.112427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:11.114839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:11.115709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:11.117818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:11.118363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:11.206574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:11.207640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:11.208286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:11.210342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:11.212304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:11.212927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:11.272928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for project 68cd41e9643b443b81b22489194213c7. Resources: {'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:11.293131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for user 74ac442756f54baa8b70bb302b35b95c and project 68cd41e9643b443b81b22489194213c7. Resources: {'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:11.786954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:11.878983 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-24fc19bf-c15a-493c-8672-8e2cdc25bad0 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171/action" status: 202 len: 0 microversion: 2.1 time: 0.804377 Nov 03 03:56:11.879933 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 673/1358] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:11 2022] POST /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171/action => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:56:11.889101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:11.889458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:11.909283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:11.909789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:11.910228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:11.911006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:11.911638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:11.912074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:12.354655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:12.373092 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ab1c7a0-4c94-4478-8b48-91dc5f3fcadf tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.491588 Nov 03 03:56:12.374783 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 674/1359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:11 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:12.391120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14a42e05-c047-4809-a40f-6cc4e77422bd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9165b80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:12.486435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14a42e05-c047-4809-a40f-6cc4e77422bd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.109113 Nov 03 03:56:12.487006 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 675/1360] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:12 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:12.511826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:12.513546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:12.532161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:12.534539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:12.535860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:12.536740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:12.539524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:12.539993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:13.054378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:13.082915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:13.087704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:13.091790 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cb9f5766-cfeb-442d-84d1-1760d345a077 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.587492 Nov 03 03:56:13.092608 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 676/1361] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:12 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:13.098462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:13.099420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:13.107899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:13.108608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:13.111522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:13.112718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:13.113430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:13.114048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:13.513626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:13.530366 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e50b13dc-44a3-4a9e-ac2a-ebdf434e66ba tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1468 microversion: 2.1 time: 0.435898 Nov 03 03:56:13.545039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 677/1362] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:13 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1468 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:13.545039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0c6b8051-5c79-4564-b0ee-a07788e4e99c req-ed1013a1-eb66-4daf-b063-11daed891ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b0ee6b-7653-4811-8177-e49f8fbc62d5", "name": "network-vif-plugged", "status": "completed", "tag": "3ec28101-cd78-498e-95a0-58c0353148ab"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:13.572949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0c6b8051-5c79-4564-b0ee-a07788e4e99c req-ed1013a1-eb66-4daf-b063-11daed891ada service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:13.573538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0c6b8051-5c79-4564-b0ee-a07788e4e99c req-ed1013a1-eb66-4daf-b063-11daed891ada service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:13.577495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0c6b8051-5c79-4564-b0ee-a07788e4e99c req-ed1013a1-eb66-4daf-b063-11daed891ada service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:13.626198 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0c6b8051-5c79-4564-b0ee-a07788e4e99c req-ed1013a1-eb66-4daf-b063-11daed891ada service nova] Creating event network-vif-plugged:3ec28101-cd78-498e-95a0-58c0353148ab for instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 on n-h1-854653-7 Nov 03 03:56:13.631761 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0c6b8051-5c79-4564-b0ee-a07788e4e99c req-ed1013a1-eb66-4daf-b063-11daed891ada service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098122 Nov 03 03:56:13.632959 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 678/1363] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:13.642439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:13.643334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:13.655276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:13.656133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:13.658615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:13.659676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:13.660714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:13.664483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:14.130413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:14.143583 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48d5052e-7f60-4469-99a2-61b436c825d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.503431 Nov 03 03:56:14.149090 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 679/1364] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:13 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:14.154500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a554dc43-a401-42ea-be5e-2e4588782857 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f9341dc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:14.227934 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a554dc43-a401-42ea-be5e-2e4588782857 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.080894 Nov 03 03:56:14.228766 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 680/1365] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:14 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:14.239297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:14.239960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:14.251106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:14.251746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:14.252304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:14.253118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:14.253643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:14.254139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:14.554739 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7a3dd917-588b-4868-9a83-b0939ea0ed48 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.311658 Nov 03 03:56:14.555349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 686/1366] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 03:56:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:14.563423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:14.567683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:14.568319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:14.575223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:14.575735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:14.576150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:14.577553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:14.578183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:14.578794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:14.581126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:14.582755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:14.584166 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-047e1e59-1c96-44cc-ac5c-9cc451480403 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1362 microversion: 2.25 time: 0.354287 Nov 03 03:56:14.591722 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 681/1367] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:14 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:14.598723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.42"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:14.604880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:14.615200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:14.616095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:14.617997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:14.617997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:14.618603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:14.620458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:14.662241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:56:14.663254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquired lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:56:14.945090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:14.957624 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-719feff5-e1af-4262-9e2d-385a8874a221 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1468 microversion: 2.1 time: 0.393479 Nov 03 03:56:14.958528 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 687/1368] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:14 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1468 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:15.167846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:15.168464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:15.180408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:15.180571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:15.181409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:15.182301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:15.183466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:15.185548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:15.701327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465.", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 03:56:15.703739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Releasing lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:56:15.704381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] HTTP exception thrown: Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465. Nov 03 03:56:15.704381 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-6d62986c-57a8-4941-9cd1-4146b2b98b18'] Nov 03 03:56:15.705373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Request method failure captured: Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action HTTP/1.1 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 45 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzu0Y18tl7wk6VfxBT0gsfiNJyUU2xBZnRSyu1CflMHAuG-D9w2KxCHu-LK_YbFGKp3EU9Ytu70qsX-lEtIK_bvrdA3EoHrHJCliQMFw79AI0iAxjjyKW8dSOVTz7sEiB0djw-Y-MS4w3RMjPtJuJPvUnGctEW6kMPLBzBa3bZv0VM8 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f29a96f192994136aa4c5e83816502c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f29a96f192994136aa4c5e83816502c7"}]}] Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 42bf39c4aa0f4d2ea1155c3ad5f6a074 Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: {"addFloatingIp": {"address": "172.25.8.42"}} Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: exception: Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465. Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-6d62986c-57a8-4941-9cd1-4146b2b98b18'] Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f1f03de5-3dc9-4702-b487-b59a45832ce7', 'body': {'addFloatingIp': {'address': '172.25.8.42'}}} Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 03:56:15.732680 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465. Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62986c-57a8-4941-9cd1-4146b2b98b18'] Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465. Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62986c-57a8-4941-9cd1-4146b2b98b18'] Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465. Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62986c-57a8-4941-9cd1-4146b2b98b18'] Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465. Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d62986c-57a8-4941-9cd1-4146b2b98b18'] Nov 03 03:56:15.738016 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:15.745281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Returning 400 to user: Cannot associate floating IP 172.25.8.42 (8c90d354-5c38-421c-b3ee-141d3cda8c72) with port bb198cb5-9f5a-4ac7-a332-d139f1571ce3 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 6d2ab465-64b6-4819-b014-15c6774f2465. Nov 03 03:56:15.745281 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-6d62986c-57a8-4941-9cd1-4146b2b98b18'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:15.745281 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fcfe2b39-b9ca-4fde-97d9-7b29efd65618 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action" status: 400 len: 380 microversion: 2.1 time: 1.126488 Nov 03 03:56:15.745281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 682/1369] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:14 2022] POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action => generated 380 bytes in 1147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:56:15.745666 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2120912-da81-4e51-a2de-4f6f93745845 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.580688 Nov 03 03:56:15.752300 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 688/1370] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:15 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:56:15.767863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77f799f8-0aa1-49f1-a445-1d95008143a3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f8fb7a60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:15.785410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:15.786178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:15.851557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:15.863188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:15.866824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:15.869988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:15.874558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:15.876013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:15.984669 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77f799f8-0aa1-49f1-a445-1d95008143a3 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1426 microversion: 2.1 time: 0.243948 Nov 03 03:56:15.987220 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 683/1371] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:15 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1426 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:15.995201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8b2ed9-05a6-4f4a-b8c4-2cd266662985", "name": "network-vif-plugged", "status": "completed", "tag": "450f08dc-4ccc-4a7b-a22a-21e428fb7d29"}, {"server_uuid": "2b033176-fb9d-429b-a068-6e8914bdc171", "name": "network-vif-plugged", "status": "completed", "tag": "bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:16.056315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:16.057618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:16.058420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:16.082749 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] Creating event network-vif-plugged:450f08dc-4ccc-4a7b-a22a-21e428fb7d29 for instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 on n-h1-854653-7 Nov 03 03:56:16.083343 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] Creating event network-vif-plugged:bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9 for instance 2b033176-fb9d-429b-a068-6e8914bdc171 on n-h2-854653-7 Nov 03 03:56:16.116805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] Instance 2b033176-fb9d-429b-a068-6e8914bdc171 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:56:16.142632 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-69aa706b-4063-4735-bddd-d3cb76d4bac3 req-0b251d58-4a68-4e87-9b8e-c1233255e986 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.152540 Nov 03 03:56:16.143860 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 684/1372] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:16.161775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d127c166-50c7-4a17-8dd8-720e08ac2145 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '.version_select at 0x7ff7f8f4cd30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:16.856350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:16.876047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:16.881243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:16.882857 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e5492ca5-8f0f-42d5-9c92-79cbf3f476e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1558 microversion: 2.25 time: 1.129334 Nov 03 03:56:16.891632 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 689/1373] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:15 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1558 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:16.891632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:16.891632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:16.914751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:16.922147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:16.922147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:16.922147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:16.922147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:16.922147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:17.524543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:17.536937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00857150-611e-4e7d-8fe5-d12e12f8ed53 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1534 microversion: 2.1 time: 0.652112 Nov 03 03:56:17.542869 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 690/1374] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:16 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1534 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:17.568622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:17.573829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:17.580708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:17.593881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:17.594760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:17.596068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:17.596899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:17.600742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:17.683228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:56:18.756248 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff320a55-03b8-4c81-be48-070ee7c962e8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 204 len: 0 microversion: 2.1 time: 1.211745 Nov 03 03:56:18.757594 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 691/1375] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:56:17 2022] DELETE /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 0 bytes in 1214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:56:18.763677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:18.767264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:18.783317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:18.786135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:18.787956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:18.789039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:18.790899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:18.791598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:18.847560 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d127c166-50c7-4a17-8dd8-720e08ac2145 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/8c90d354-5c38-421c-b3ee-141d3cda8c72" status: 202 len: 0 microversion: 2.1 time: 2.698411 Nov 03 03:56:18.847560 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 685/1376] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:56:16 2022] DELETE /compute/v2.1/os-floating-ips/8c90d354-5c38-421c-b3ee-141d3cda8c72 => generated 0 bytes in 2702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:56:18.852963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:18.854070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:18.879652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:18.887672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:18.888390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:18.893552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:18.894441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:18.898080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:19.131311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:19.145686 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b93de62-655e-463a-8944-8acb929ee284 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1716 microversion: 2.1 time: 0.386477 Nov 03 03:56:19.147078 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 692/1377] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:18 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1716 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:19.165467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26d1911b-7b80-4e81-9f74-6bf5655df622 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f912f820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:19.303774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid 41b0ee6b-7653-4811-8177-e49f8fbc62d5 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:56:19.338250 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d3df3609-5583-4dcc-8147-9b16379c2f6f tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 2051 microversion: 2.25 time: 0.488616 Nov 03 03:56:19.339933 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 686/1378] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:18 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 2051 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:19.463514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1017918911", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "104b7573-1057-4ee0-9f14-0c79e9b07517"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:21.242781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:28.777780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:29.136073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:29.309747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=48 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:29.520434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:32.451208 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26d1911b-7b80-4e81-9f74-6bf5655df622 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1435 microversion: 2.1 time: 13.302801 Nov 03 03:56:32.454944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] validate_networks() for [('104b7573-1057-4ee0-9f14-0c79e9b07517', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:56:32.460634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 693/1379] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:19 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1435 bytes in 13313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:32.465736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:32.466352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:32.472939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:32.473477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:32.473920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:32.474623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:32.475080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:32.475510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:32.700116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:32.708752 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-603582dd-8fe0-4cfd-a15f-887ec7814444 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1527 microversion: 2.1 time: 0.246910 Nov 03 03:56:32.709583 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 694/1380] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:32 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1527 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:32.714850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:32.717115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:32.723820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:32.724518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:32.725491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:32.726488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:32.727492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:32.727937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:32.743366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c HTTP/1.1 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'eaed2ca2-aa0c-4edc-ba31-ff198664526c'} Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:32.745674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:32.751008 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:32.751008 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:32.751008 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:32.751008 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:32.751008 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:32.751008 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:32.751008 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:32.752172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:32.753046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44e027b3-f50b-49a8-bd8c-0a4e66a170a0 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 404 len: 111 microversion: 2.1 time: 0.042322 Nov 03 03:56:32.753613 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 695/1381] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:32 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:56:32.758980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'action', calling method: .version_select at 0x7ff7fb1e9310>, body: {"removeFloatingIp": {"address": "172.25.8.120"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:32.983628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:32.990694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:32.991809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:32.992435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:32.993391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:32.994011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:32.994640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.056959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:56:33.057740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:56:33.060638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:56:33.061256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:56:33.061560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:56:33.071252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.072008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.072937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.073856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.074752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.075309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.095246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Getting quotas for project 69c5a88467bb4b5ca79bfb7562dbf79b. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:33.101086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Getting quotas for user 71097a5704904531909e6adfdbbae98a and project 69c5a88467bb4b5ca79bfb7562dbf79b. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:33.121680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:56:33.129339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:56:33.263028 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-469ab5e9-b01c-4eca-8207-2b9f20b67d9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.921540 Nov 03 03:56:33.263960 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 687/1382] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 13923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:56:33.275577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:33.280426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:33.290667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.295790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.296305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.299180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.300145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.300339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.306394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:56:33.308036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquired lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:56:33.594892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid 41b0ee6b-7653-4811-8177-e49f8fbc62d5 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:56:33.612059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8459c683-5ba2-4111-9bff-a048a32a29bb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 2051 microversion: 2.25 time: 0.346864 Nov 03 03:56:33.614307 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 688/1383] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:33 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 2051 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:33.690120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f591f72b-7178-4132-a8ff-09c7f3ebab70 req-5b361bde-76d5-45f0-b628-97fce816679a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b033176-fb9d-429b-a068-6e8914bdc171", "name": "network-vif-unplugged", "status": "completed", "tag": "bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:33.701727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f591f72b-7178-4132-a8ff-09c7f3ebab70 req-5b361bde-76d5-45f0-b628-97fce816679a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.702597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f591f72b-7178-4132-a8ff-09c7f3ebab70 req-5b361bde-76d5-45f0-b628-97fce816679a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.703438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f591f72b-7178-4132-a8ff-09c7f3ebab70 req-5b361bde-76d5-45f0-b628-97fce816679a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.716775 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f591f72b-7178-4132-a8ff-09c7f3ebab70 req-5b361bde-76d5-45f0-b628-97fce816679a service nova] Creating event network-vif-unplugged:bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9 for instance 2b033176-fb9d-429b-a068-6e8914bdc171 on n-h2-854653-7 Nov 03 03:56:33.722111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f591f72b-7178-4132-a8ff-09c7f3ebab70 req-5b361bde-76d5-45f0-b628-97fce816679a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106170 Nov 03 03:56:33.722753 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 689/1384] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:33.731295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:33.732015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:33.738777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.739274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.739724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.740535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.740931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.741418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.880505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:33.889485 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-961a56b6-4511-4d0e-aedf-5eaff90ba8dd tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1706 microversion: 2.1 time: 0.162804 Nov 03 03:56:33.892595 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 690/1385] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:33 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1706 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:33.894552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-89c2c7d2-3d8b-4aef-a0b1-d98391ba3ffa req-c4eded10-3d5e-43fd-be2d-d72dd33b0765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaed2ca2-aa0c-4edc-ba31-ff198664526c", "name": "network-vif-deleted", "tag": "940b24fe-c4f2-4f73-9a41-bb9896bc86e0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:33.906973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-89c2c7d2-3d8b-4aef-a0b1-d98391ba3ffa req-c4eded10-3d5e-43fd-be2d-d72dd33b0765 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.907482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-89c2c7d2-3d8b-4aef-a0b1-d98391ba3ffa req-c4eded10-3d5e-43fd-be2d-d72dd33b0765 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.907980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-89c2c7d2-3d8b-4aef-a0b1-d98391ba3ffa req-c4eded10-3d5e-43fd-be2d-d72dd33b0765 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.919821 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-89c2c7d2-3d8b-4aef-a0b1-d98391ba3ffa req-c4eded10-3d5e-43fd-be2d-d72dd33b0765 service nova] Creating event network-vif-deleted:940b24fe-c4f2-4f73-9a41-bb9896bc86e0 for instance eaed2ca2-aa0c-4edc-ba31-ff198664526c on n-h2-854653-7 Nov 03 03:56:33.924739 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-89c2c7d2-3d8b-4aef-a0b1-d98391ba3ffa req-c4eded10-3d5e-43fd-be2d-d72dd33b0765 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Nov 03 03:56:33.925515 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 691/1386] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:33.931228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a003bec3-e64c-422d-93e1-9c4bed5022cd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f911c9d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:33.978912 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a003bec3-e64c-422d-93e1-9c4bed5022cd tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 200 len: 1435 microversion: 2.1 time: 0.051794 Nov 03 03:56:33.979486 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 692/1387] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:33 2022] GET /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 1435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:33.983995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:33.984711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:33.992051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.992484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.992923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:33.993657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:33.994146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:33.995110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.247901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:34.256827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9405777c-faa9-48bd-bed3-2588efb45e42 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1527 microversion: 2.1 time: 0.276359 Nov 03 03:56:34.257556 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 693/1388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:33 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1527 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:34.262472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:34.277593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:34.293233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.293739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.294988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.298090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.298580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.299025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.322736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c/os-volume_attachments HTTP/1.1 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': 'eaed2ca2-aa0c-4edc-ba31-ff198664526c'} Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:56:34.332392 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.338605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:34.340271 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-43bfa5b2-e35d-496d-99d8-5316562a17f9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.081389 Nov 03 03:56:34.341066 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 694/1389] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:56:34 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c/os-volume_attachments => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:56:34.346273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab29b1f0-2903-4baf-b527-258f9286855c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:34.347094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab29b1f0-2903-4baf-b527-258f9286855c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:34.420957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab29b1f0-2903-4baf-b527-258f9286855c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:34.436646 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab29b1f0-2903-4baf-b527-258f9286855c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1224 microversion: 2.1 time: 0.094093 Nov 03 03:56:34.437268 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 695/1390] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:34 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:34.459639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:34.464971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.465851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.466530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.467499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.468229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.468849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.510156 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d6e3dad9-dfad-41c7-a62b-63336c5f4af4 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.058563 Nov 03 03:56:34.516165 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 696/1391] 10.222.0.30 () {60 vars in 1217 bytes} [Thu Nov 3 03:56:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:56:34.524677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a79891e-ed15-4c85-a526-7fc42a830c7a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '.version_select at 0x7ff7f9062ee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:34.541079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a79891e-ed15-4c85-a526-7fc42a830c7a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.542202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a79891e-ed15-4c85-a526-7fc42a830c7a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.542650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a79891e-ed15-4c85-a526-7fc42a830c7a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.555366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Building network info cache for instance {{(pid=127593) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:56:34.586629 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a79891e-ed15-4c85-a526-7fc42a830c7a tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2730 microversion: 2.1 time: 0.069157 Nov 03 03:56:34.597408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 697/1392] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:56:34 2022] GET /compute/v2.1/os-migrations => generated 2730 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:34.597408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:34.597408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:34.605775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.606585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.607173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.608113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.608729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.609464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.890139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:34.903905 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db063048-cc89-439c-8509-ebfbfb21e417 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1467 microversion: 2.1 time: 0.314540 Nov 03 03:56:34.918885 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 698/1393] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:34 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1467 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:34.925100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2c113c7-9eb5-4129-b520-8b10409a6444 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:34.935304 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b2c113c7-9eb5-4129-b520-8b10409a6444 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] HTTP exception thrown: Flavor bfea094b-54bf-4696-b299-ab9360307d29 could not be found. Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2c113c7-9eb5-4129-b520-8b10409a6444 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Request method failure captured: Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/flavors/bfea094b-54bf-4696-b299-ab9360307d29 HTTP/1.1 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzr5ugbUvzUXussexRNOiieKEDyHR0fk_E-zvN697KwrXl-OkNP9Nhilvsi2encMZnzwjBCWC3_f0yygfJmsTW92gPGB-7E_yJ_8TpXsmV_HhXWxNDWw-2Vkp0YVD66AbXT5gwZ1XPHvt0vdZZiVoRNMVuhgA5IVOB4Nt9kErdKkOVc Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 7f22db116f324a53b32b3e8aa8433ed0 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-MigrationsAdminTest-211642071 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f22db116f324a53b32b3e8aa8433ed0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7f22db116f324a53b32b3e8aa8433ed0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f22db116f324a53b32b3e8aa8433ed0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7f22db116f324a53b32b3e8aa8433ed0"}]}] Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-MigrationsAdminTest-211642071 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 7f22db116f324a53b32b3e8aa8433ed0 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-MigrationsAdminTest-211642071 Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-MigrationsAdminTest-211642071-project-admin Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: eacef8d3c2ae47519bba70f6424056fe Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-MigrationsAdminTest-211642071-project-admin Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: exception: Flavor bfea094b-54bf-4696-b299-ab9360307d29 could not be found. Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'bfea094b-54bf-4696-b299-ab9360307d29'} Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bfea094b-54bf-4696-b299-ab9360307d29 could not be found. Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor bfea094b-54bf-4696-b299-ab9360307d29 could not be found. Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.943725 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bfea094b-54bf-4696-b299-ab9360307d29 could not be found. Nov 03 03:56:34.948478 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:34.953365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2c113c7-9eb5-4129-b520-8b10409a6444 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Returning 404 to user: Flavor bfea094b-54bf-4696-b299-ab9360307d29 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:34.953365 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b2c113c7-9eb5-4129-b520-8b10409a6444 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/bfea094b-54bf-4696-b299-ab9360307d29" status: 404 len: 109 microversion: 2.1 time: 0.032173 Nov 03 03:56:34.953365 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 699/1394] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:56:34 2022] DELETE /compute/v2.1/flavors/bfea094b-54bf-4696-b299-ab9360307d29 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:56:34.970932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:34.971631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:34.985235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.986811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.989539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:34.990381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:34.990972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:34.992862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:35.297922 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17d0fc45-5749-4cea-a914-b63827a852d7 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5/action" status: 202 len: 0 microversion: 2.25 time: 0.340238 Nov 03 03:56:35.299361 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 700/1395] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 03:56:34 2022] POST /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:56:35.423921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a6cacc16-2137-4be1-8cb0-590d65be85d1 req-1fa1c1be-70c8-4137-a74d-c226b9986900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f03de5-3dc9-4702-b487-b59a45832ce7", "tag": "bb198cb5-9f5a-4ac7-a332-d139f1571ce3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:35.442718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6cacc16-2137-4be1-8cb0-590d65be85d1 req-1fa1c1be-70c8-4137-a74d-c226b9986900 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:35.446931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6cacc16-2137-4be1-8cb0-590d65be85d1 req-1fa1c1be-70c8-4137-a74d-c226b9986900 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:35.447541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6cacc16-2137-4be1-8cb0-590d65be85d1 req-1fa1c1be-70c8-4137-a74d-c226b9986900 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:35.472006 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a6cacc16-2137-4be1-8cb0-590d65be85d1 req-1fa1c1be-70c8-4137-a74d-c226b9986900 service nova] Creating event network-changed:bb198cb5-9f5a-4ac7-a332-d139f1571ce3 for instance f1f03de5-3dc9-4702-b487-b59a45832ce7 on n-h1-854653-7 Nov 03 03:56:35.478675 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a6cacc16-2137-4be1-8cb0-590d65be85d1 req-1fa1c1be-70c8-4137-a74d-c226b9986900 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177804 Nov 03 03:56:35.479476 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 701/1396] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:35.486035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2123230328", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "25261195-157d-4c7b-8cfb-4fb3b385217e"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:35.570091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] validate_networks() for [('25261195-157d-4c7b-8cfb-4fb3b385217e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:56:36.147821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Updating instance_info_cache with network_info: [{"id": "bb198cb5-9f5a-4ac7-a332-d139f1571ce3", "address": "fa:16:3e:d3:e7:1f", "network": {"id": "3a42706c-ac03-458e-a832-5b2b4cf0f95c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1463871772-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f29a96f192994136aa4c5e83816502c7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb198cb5-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127593) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:56:36.245493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Releasing lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:56:36.246441 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d49fa07-2a1d-46c1-91d1-6d59b6106f56 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action" status: 202 len: 0 microversion: 2.1 time: 3.491657 Nov 03 03:56:36.247050 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 696/1397] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:32 2022] POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action => generated 0 bytes in 3493 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 03:56:36.258504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:36.258504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:36.268286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:36.268790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:36.269268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:36.271841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:36.273783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:36.274350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:36.428535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:56:36.431458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:56:36.431458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:56:36.431458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:56:36.431458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:56:36.448096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:36.456204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:36.456916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:36.464041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:36.464800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:36.466361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:36.515385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:36.534783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for user baa7ebbbe2c14c82b5a07fef33cc214a and project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:36.557925 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2bf8550d-cd96-478c-8e5a-3b7c9950c1f1 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1857 microversion: 2.1 time: 0.307348 Nov 03 03:56:36.559072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 697/1398] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:36 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1857 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:36.563415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:56:36.567316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-98175fe4-e60a-4047-a7d0-3d367262df35 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7fd67a5e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:36.576639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:56:36.706979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-56dd8519-ce6b-4ab4-9886-9ec2864e159f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.226025 Nov 03 03:56:36.714598 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 702/1399] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:56:36.720724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-183471567", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:36.852560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:56:37.168778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:56:37.169241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:56:37.169805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:56:37.170223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:56:37.170649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:56:37.179359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.179906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.180566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.181344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.185210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.185210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.213951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:37.213951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Getting quotas for user 74ac442756f54baa8b70bb302b35b95c and project 68cd41e9643b443b81b22489194213c7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:37.226309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:56:37.228484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:56:37.375145 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1dc870c4-859c-49a8-9456-c1fd2cea7103 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657185 Nov 03 03:56:37.378010 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 703/1400] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:56:37.388184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:37.388810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:37.398165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.398718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.399276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.400361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.401421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.401919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.573755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid 41b0ee6b-7653-4811-8177-e49f8fbc62d5 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:56:37.633260 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9ceab22-9aa5-4a36-9609-3098cb48a35c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 2036 microversion: 2.25 time: 0.252611 Nov 03 03:56:37.634078 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 704/1401] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:37 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 2036 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:37.662449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:37.662449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:37.666264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.667004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.667625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.668521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.669394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.670015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.862614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:37.871201 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d91b815f-2799-4d0d-beb4-92adb9e9a7b6 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1324 microversion: 2.1 time: 0.220370 Nov 03 03:56:37.877516 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 705/1402] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:37 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:37.882497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-fc652d9c-42c0-492f-b1ae-5c46485fc874 req-6fe9cfaf-9356-4817-aa3f-1ac83de747eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b033176-fb9d-429b-a068-6e8914bdc171", "name": "network-vif-plugged", "status": "completed", "tag": "bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:37.907427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fc652d9c-42c0-492f-b1ae-5c46485fc874 req-6fe9cfaf-9356-4817-aa3f-1ac83de747eb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.907427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fc652d9c-42c0-492f-b1ae-5c46485fc874 req-6fe9cfaf-9356-4817-aa3f-1ac83de747eb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.907427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fc652d9c-42c0-492f-b1ae-5c46485fc874 req-6fe9cfaf-9356-4817-aa3f-1ac83de747eb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.923879 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-fc652d9c-42c0-492f-b1ae-5c46485fc874 req-6fe9cfaf-9356-4817-aa3f-1ac83de747eb service nova] Creating event network-vif-plugged:bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9 for instance 2b033176-fb9d-429b-a068-6e8914bdc171 on n-h2-854653-7 Nov 03 03:56:37.930721 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-fc652d9c-42c0-492f-b1ae-5c46485fc874 req-6fe9cfaf-9356-4817-aa3f-1ac83de747eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051902 Nov 03 03:56:37.935768 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 706/1403] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:37.936707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-98175fe4-e60a-4047-a7d0-3d367262df35 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "DELETE /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e" status: 204 len: 0 microversion: 2.1 time: 1.374773 Nov 03 03:56:37.937090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 698/1404] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:36 2022] DELETE /compute/v2.1/images/39eae950-4560-4b19-88f5-81aa567cac8e => generated 0 bytes in 1377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:56:37.940049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3da041af-4896-435c-bfe0-e25491975e74 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '.version_select at 0x7ff7f8f61ca0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:37.942655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:37.943286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:37.957292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.958041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.958864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:37.960131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:37.960942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:37.964434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:38.290689 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad75ba15-6659-400a-8f8b-c672e18e571b tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1857 microversion: 2.1 time: 0.352710 Nov 03 03:56:38.293916 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 699/1405] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:37 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1857 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:38.300279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:38.300908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:38.320110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:38.320623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:38.321782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:38.322550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:38.323991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:38.325769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:38.460601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:38.475525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9938adfc-857e-4ea0-812b-60f77334b47e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 200 len: 1219 microversion: 2.1 time: 0.180356 Nov 03 03:56:38.479407 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 700/1406] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:38 2022] GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 1219 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:38.482434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-898fbd56-8f4a-49f1-8eda-cff5a003264a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:38.483379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-898fbd56-8f4a-49f1-8eda-cff5a003264a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:38.569108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-898fbd56-8f4a-49f1-8eda-cff5a003264a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:38.578954 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-898fbd56-8f4a-49f1-8eda-cff5a003264a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1212 microversion: 2.1 time: 0.100984 Nov 03 03:56:38.579855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 701/1407] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:38 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:38.604440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854653-7", "block_migration": "auto"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:38.613489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:38.633466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:38.634416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:38.635794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:38.636809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:38.637602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:38.638440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:38.749077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'flavor' on Instance uuid 41b0ee6b-7653-4811-8177-e49f8fbc62d5 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:56:38.787870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Going to try to live migrate instance to n-h2-854653-7 {{(pid=127593) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:56:39.137146 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3da041af-4896-435c-bfe0-e25491975e74 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/2ac7046b-a3b0-4fb8-bd75-4a2fd88d0447" status: 202 len: 0 microversion: 2.1 time: 1.203969 Nov 03 03:56:39.139957 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 707/1408] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:56:37 2022] DELETE /compute/v2.1/os-floating-ips/2ac7046b-a3b0-4fb8-bd75-4a2fd88d0447 => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:56:39.145756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f952f28-d534-4eb9-bcb9-d7559e5092e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '.version_select at 0x7ff7f8f55040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:39.220363 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-8f952f28-d534-4eb9-bcb9-d7559e5092e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] HTTP exception thrown: Image not found. Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f952f28-d534-4eb9-bcb9-d7559e5092e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Request method failure captured: Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e HTTP/1.1 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuNMgNNhe-tlG_WV5u7dPtab38MpG6KNz6Bl0uMrhjzBM72FDY7oK4EBeRh710itvxm5Rt9wrbcDvWBgolHGTrjkt72zSlqrC5UDZ04zrg3kthmhkLRFvzd8ynbhfcYdRbP8bQi_sFikSm1oGNVM5brVlU7eoINqYXSqAgPioD9L2I Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 75abb61bee2f4e6dadffbd21b8ad0096 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75abb61bee2f4e6dadffbd21b8ad0096"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75abb61bee2f4e6dadffbd21b8ad0096", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75abb61bee2f4e6dadffbd21b8ad0096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75abb61bee2f4e6dadffbd21b8ad0096"}]}] Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 75abb61bee2f4e6dadffbd21b8ad0096 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerTestJSON-602042427-project Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 713b3bde635745918bd322e07a240519 Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerTestJSON-602042427-project Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '6d19d16b-5360-4dc8-9e16-296a9f72943e'} Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6d19d16b-5360-4dc8-9e16-296a9f72943e to delete Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6d19d16b-5360-4dc8-9e16-296a9f72943e could not be found. Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:39.222521 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f952f28-d534-4eb9-bcb9-d7559e5092e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f952f28-d534-4eb9-bcb9-d7559e5092e8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "DELETE /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e" status: 404 len: 62 microversion: 2.1 time: 0.083188 Nov 03 03:56:39.228148 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 708/1409] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:39 2022] DELETE /compute/v2.1/images/6d19d16b-5360-4dc8-9e16-296a9f72943e => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:56:39.238117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:39.238832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:39.247632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:39.248484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:39.249146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:39.250796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:39.251256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:39.251686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:39.344233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lazy-loading 'services' on Instance uuid 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:56:39.683594 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d517421-f66f-4621-b27f-a6339414e25a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments/9ff9cb8e-4bf2-4432-a1a4-23ec96c375c6" status: 202 len: 0 microversion: 2.1 time: 0.456608 Nov 03 03:56:39.687584 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 709/1410] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 03:56:39 2022] DELETE /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments/9ff9cb8e-4bf2-4432-a1a4-23ec96c375c6 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:56:39.689794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:39.690467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:39.696758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:39.697317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:39.697825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:39.698532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:39.698989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:39.699421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:39.725039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:56:40.014287 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f6678c6-2e2e-4e11-94b2-1ec3a5c8055e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 204 len: 0 microversion: 2.1 time: 0.328201 Nov 03 03:56:40.014903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 710/1411] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:56:39 2022] DELETE /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:56:40.022019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:40.022778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:40.030043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:40.030612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:40.031041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:40.031745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:40.032195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:40.032615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:40.039191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:40.175845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:40.184083 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c17c3a1-0554-45e9-98ca-7aa9b3490a95 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1324 microversion: 2.1 time: 0.167989 Nov 03 03:56:40.184673 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 711/1412] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:40 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:40.189350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-45778b2f-eade-4b3c-ba4d-f6b4ab0f7c9d req-b6d31d68-ca60-451f-8ebe-ce73ff35352b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabcad71-c1df-46e2-ac26-6e32ad072279", "tag": "b5dcbf93-99c7-4090-acd4-0c6607cfd984"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:40.199178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-45778b2f-eade-4b3c-ba4d-f6b4ab0f7c9d req-b6d31d68-ca60-451f-8ebe-ce73ff35352b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:40.204957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-45778b2f-eade-4b3c-ba4d-f6b4ab0f7c9d req-b6d31d68-ca60-451f-8ebe-ce73ff35352b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:40.204957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-45778b2f-eade-4b3c-ba4d-f6b4ab0f7c9d req-b6d31d68-ca60-451f-8ebe-ce73ff35352b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:40.212831 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-45778b2f-eade-4b3c-ba4d-f6b4ab0f7c9d req-b6d31d68-ca60-451f-8ebe-ce73ff35352b service nova] Creating event network-changed:b5dcbf93-99c7-4090-acd4-0c6607cfd984 for instance dabcad71-c1df-46e2-ac26-6e32ad072279 on n-h2-854653-7 Nov 03 03:56:40.218630 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-45778b2f-eade-4b3c-ba4d-f6b4ab0f7c9d req-b6d31d68-ca60-451f-8ebe-ce73ff35352b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032826 Nov 03 03:56:40.219236 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 712/1413] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:40.224596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4c7a493-4527-4bf6-921c-9450cafef0dc tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4c7a493-4527-4bf6-921c-9450cafef0dc tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Request method failure captured: Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action HTTP/1.1 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 34 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzu0Y18tl7wk6VfxBT0gsfiNJyUU2xBZnRSyu1CflMHAuG-D9w2KxCHu-LK_YbFGKp3EU9Ytu70qsX-lEtIK_bvrdA3EoHrHJCliQMFw79AI0iAxjjyKW8dSOVTz7sEiB0djw-Y-MS4w3RMjPtJuJPvUnGctEW6kMPLBzBa3bZv0VM8 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f29a96f192994136aa4c5e83816502c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f29a96f192994136aa4c5e83816502c7"}]}] Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 42bf39c4aa0f4d2ea1155c3ad5f6a074 Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: {"addFloatingIp": {"address": ""}} Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f1f03de5-3dc9-4702-b487-b59a45832ce7', 'body': {'addFloatingIp': {'address': ''}}} Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi '' Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:56:40.228513 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4c7a493-4527-4bf6-921c-9450cafef0dc tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e4c7a493-4527-4bf6-921c-9450cafef0dc tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action" status: 400 len: 142 microversion: 2.1 time: 0.009521 Nov 03 03:56:40.233810 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 713/1414] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:40 2022] POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:56:40.235862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:40.236562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:40.243683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:40.244247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:40.244690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:40.245424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:40.245885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:40.246323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:40.272400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:56:40.535522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:40.662677 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6bcd0a60-3543-436d-9f5f-92ab31004177 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 204 len: 0 microversion: 2.1 time: 0.431011 Nov 03 03:56:40.663292 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 714/1415] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:56:40 2022] DELETE /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:56:40.670485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:40.671192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:40.678221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:40.678827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:40.679340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:40.680112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:40.680638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:40.681169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:40.975913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:40.985077 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cff3bb1e-6656-4233-8235-6aedca6ca8c7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1264 microversion: 2.1 time: 0.320588 Nov 03 03:56:40.986068 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 715/1416] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:40 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1264 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:40.991251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:40.993593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:41.001181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.001914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.002353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.003056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.003507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.003934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.045947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf95be50-c1f3-4276-805c-3a2fcefcfa60 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058329 Nov 03 03:56:41.046720 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 716/1417] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:56:40 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:41.056106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5f7bbcd8-617f-41d7-8728-df74fe9e8880 req-95d2206b-23dd-43ca-90e0-2b498cb431c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8b2ed9-05a6-4f4a-b8c4-2cd266662985", "name": "network-vif-unplugged", "status": "completed", "tag": "450f08dc-4ccc-4a7b-a22a-21e428fb7d29"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:41.069746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5f7bbcd8-617f-41d7-8728-df74fe9e8880 req-95d2206b-23dd-43ca-90e0-2b498cb431c9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.070094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5f7bbcd8-617f-41d7-8728-df74fe9e8880 req-95d2206b-23dd-43ca-90e0-2b498cb431c9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.070533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5f7bbcd8-617f-41d7-8728-df74fe9e8880 req-95d2206b-23dd-43ca-90e0-2b498cb431c9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.085960 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5f7bbcd8-617f-41d7-8728-df74fe9e8880 req-95d2206b-23dd-43ca-90e0-2b498cb431c9 service nova] Creating event network-vif-unplugged:450f08dc-4ccc-4a7b-a22a-21e428fb7d29 for instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 on n-h1-854653-7 Nov 03 03:56:41.092002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5f7bbcd8-617f-41d7-8728-df74fe9e8880 req-95d2206b-23dd-43ca-90e0-2b498cb431c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039486 Nov 03 03:56:41.094138 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 717/1418] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:41.102622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:41.103333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:41.110262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.111058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.111500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.112200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.112653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.113103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.204450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:41.215002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3e172c89-d5b5-433f-8324-22504d7538a8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 200 len: 1273 microversion: 2.1 time: 0.119375 Nov 03 03:56:41.219066 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 718/1419] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:41 2022] GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:41.221886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:41.224247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:41.231575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.232065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.232573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.233369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.233824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.234250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.261677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:56:41.262080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquired lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:56:41.377462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Releasing lock "refresh_cache-f1f03de5-3dc9-4702-b487-b59a45832ce7" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:56:41.378043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] HTTP exception thrown: floating IP not found Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Request method failure captured: Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action HTTP/1.1 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 41 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzu0Y18tl7wk6VfxBT0gsfiNJyUU2xBZnRSyu1CflMHAuG-D9w2KxCHu-LK_YbFGKp3EU9Ytu70qsX-lEtIK_bvrdA3EoHrHJCliQMFw79AI0iAxjjyKW8dSOVTz7sEiB0djw-Y-MS4w3RMjPtJuJPvUnGctEW6kMPLBzBa3bZv0VM8 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f29a96f192994136aa4c5e83816502c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f29a96f192994136aa4c5e83816502c7"}]}] Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 42bf39c4aa0f4d2ea1155c3ad5f6a074 Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: {"addFloatingIp": {"address": "0.0.0.0"}} Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: exception: floating IP not found Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f1f03de5-3dc9-4702-b487-b59a45832ce7', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Nov 03 03:56:41.379943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Returning 404 to user: floating IP not found {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8e66db4-02c1-4c39-b0b5-baa9bd525239 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action" status: 404 len: 67 microversion: 2.1 time: 0.163977 Nov 03 03:56:41.386732 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 719/1420] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:41 2022] POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action => generated 67 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:56:41.388363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:41.388999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:41.395734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.396412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.396860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.397610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.398073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.398508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.539793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:41.547673 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c3133fc-cb22-449c-ba4e-c24f71d58bb7 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1473 microversion: 2.1 time: 0.163770 Nov 03 03:56:41.548525 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 720/1421] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:41 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1473 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:41.552959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:41.553592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:41.559918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.560401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.560838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.561561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.562017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.562441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.705171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:41.712850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b4151f2-3c73-4fbd-906f-f47f11696e08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1324 microversion: 2.1 time: 0.163562 Nov 03 03:56:41.713983 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 721/1422] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:41 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:41.718968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a898ebb-9f82-439d-8b8d-412586a94997 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Action: 'action', calling method: .version_select at 0x7ff7fb1e9310>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:41.763911 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9a898ebb-9f82-439d-8b8d-412586a94997 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a898ebb-9f82-439d-8b8d-412586a94997 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Request method failure captured: Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action HTTP/1.1 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 44 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzu0Y18tl7wk6VfxBT0gsfiNJyUU2xBZnRSyu1CflMHAuG-D9w2KxCHu-LK_YbFGKp3EU9Ytu70qsX-lEtIK_bvrdA3EoHrHJCliQMFw79AI0iAxjjyKW8dSOVTz7sEiB0djw-Y-MS4w3RMjPtJuJPvUnGctEW6kMPLBzBa3bZv0VM8 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f29a96f192994136aa4c5e83816502c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f29a96f192994136aa4c5e83816502c7"}]}] Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 42bf39c4aa0f4d2ea1155c3ad5f6a074 Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: {"removeFloatingIp": {"address": "0.0.0.0"}} Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: exception: Floating IP not found for address 0.0.0.0. Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f1f03de5-3dc9-4702-b487-b59a45832ce7', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Nov 03 03:56:41.765726 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a898ebb-9f82-439d-8b8d-412586a94997 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a898ebb-9f82-439d-8b8d-412586a94997 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action" status: 404 len: 88 microversion: 2.1 time: 0.052223 Nov 03 03:56:41.771284 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 722/1423] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:41 2022] POST /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7/action => generated 88 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:56:41.777749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:41.785189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:41.786297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.787001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.787703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.788620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:41.790314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:41.790995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:41.821186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:56:42.257349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f32b9907-3d7a-426f-9258-4fa14b3d148e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 204 len: 0 microversion: 2.1 time: 0.483784 Nov 03 03:56:42.258245 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 723/1424] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:56:41 2022] DELETE /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:56:42.268745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:42.269176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:42.285419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.285950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.286464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.287567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.287979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.288573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.376289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:42.386274 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92a64901-f529-4721-8c30-5f4da8881501 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1282 microversion: 2.1 time: 0.122448 Nov 03 03:56:42.386908 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 724/1425] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:42 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:42.392139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:42.394636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:42.401542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.402102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.402613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.403402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.403960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.404635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.441324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a2703047-4304-473f-8967-5ef2903d302c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053321 Nov 03 03:56:42.441933 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 725/1426] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:56:42 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:42.446662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:42.447817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:42.453822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.454360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.454797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.455496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.455982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.456437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.536630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:42.552903 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b497258-7a69-4247-aa26-8b3f2e98c27b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 200 len: 1217 microversion: 2.1 time: 0.104724 Nov 03 03:56:42.552903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 726/1427] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:42 2022] GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:42.554568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:42.555414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:42.562550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.563289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.564111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.565062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.565724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.566438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.754020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:42.765513 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8c64012-e205-4610-85e3-76a3342aa3d6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1541 microversion: 2.1 time: 0.215710 Nov 03 03:56:42.766684 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 727/1428] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:42 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1541 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:42.773265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:42.774175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:42.782651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.784327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.784991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.785999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:42.787515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:42.788331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:42.794718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:43.003365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:43.019942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9679ee7a-ec07-4b58-91be-6f1010845ee2 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1473 microversion: 2.1 time: 0.251756 Nov 03 03:56:43.021296 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 728/1429] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:42 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1473 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:43.026990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:43.028006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:43.034934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.035802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.036519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.037528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.038204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.038873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.226581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:43.246403 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12835f95-0fca-411a-83b5-95636349317a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1324 microversion: 2.1 time: 0.223412 Nov 03 03:56:43.247167 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 729/1430] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:43 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:43.419173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:43.425206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:43.432864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.433489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.433978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.434912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.435558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.435771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.657522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:43.667070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9312e844-2a2c-4758-a65e-4e52cffbab88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.254623 Nov 03 03:56:43.668896 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 730/1431] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:43 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:43.676909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:43.679645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:43.687970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.688662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.689349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.690671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.691477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.692292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.749953 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec8e24bb-851e-4c17-9f7f-0f93206523b6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079671 Nov 03 03:56:43.751164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 731/1432] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:56:43 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:43.756051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:43.756662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:43.763360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.763854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.764728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.765170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.765631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.766060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.847772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:43.856700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8d8ed22-2186-46a8-9a55-82f2057219a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 200 len: 1219 microversion: 2.1 time: 0.104042 Nov 03 03:56:43.869736 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 732/1433] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:43 2022] GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:43.869736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:43.869736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:43.873726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.885847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.885847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:43.885847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:43.885847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:43.885847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:44.073592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:44.084156 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cbff9080-00b5-43b1-8169-49e46747281c tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1541 microversion: 2.1 time: 0.224422 Nov 03 03:56:44.085410 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 733/1434] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:43 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1541 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:44.108232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:44.110042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:44.122561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:44.123462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:44.124152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:44.134143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:44.137443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:44.137985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:44.421960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:44.432314 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69572648-2d1f-409e-9e37-8b958624dc39 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1473 microversion: 2.1 time: 0.344901 Nov 03 03:56:44.469425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 734/1435] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:44 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1473 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:44.476313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:44.479633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:44.493450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:44.495666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:44.496897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:44.499176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:44.499787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:44.504581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.017071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:45.025216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f13bbd83-0fd6-4d80-86ab-79807df88614 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1324 microversion: 2.1 time: 0.554101 Nov 03 03:56:45.033709 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 735/1436] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:44 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:45.038829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7d0c407f-a89a-4077-a4b1-94e0bb75a121 req-aad7417d-966d-4c15-8144-4ba341499f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabcad71-c1df-46e2-ac26-6e32ad072279", "name": "network-vif-plugged", "status": "completed", "tag": "b5dcbf93-99c7-4090-acd4-0c6607cfd984"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:45.064572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7d0c407f-a89a-4077-a4b1-94e0bb75a121 req-aad7417d-966d-4c15-8144-4ba341499f71 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.065881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7d0c407f-a89a-4077-a4b1-94e0bb75a121 req-aad7417d-966d-4c15-8144-4ba341499f71 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.066329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7d0c407f-a89a-4077-a4b1-94e0bb75a121 req-aad7417d-966d-4c15-8144-4ba341499f71 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.095347 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7d0c407f-a89a-4077-a4b1-94e0bb75a121 req-aad7417d-966d-4c15-8144-4ba341499f71 service nova] Creating event network-vif-plugged:b5dcbf93-99c7-4090-acd4-0c6607cfd984 for instance dabcad71-c1df-46e2-ac26-6e32ad072279 on n-h2-854653-7 Nov 03 03:56:45.102740 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7d0c407f-a89a-4077-a4b1-94e0bb75a121 req-aad7417d-966d-4c15-8144-4ba341499f71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067671 Nov 03 03:56:45.104997 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 736/1437] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:45.125384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:45.126287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:45.133762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.134265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.135381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.136103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.136565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.136984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.523002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:45.535316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36015d4f-729f-4856-a579-0cd1001c689e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.427465 Nov 03 03:56:45.537314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 737/1438] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:45 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:45.552145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:45.554281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:45.565006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.566627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.568212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.569237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.574219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.574219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.607527 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-096ee98a-c049-4e57-9d73-04c5af163555 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068814 Nov 03 03:56:45.612604 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 738/1439] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:56:45 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:45.618009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:45.618892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:45.625512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.629433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.629433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.629433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.629433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.629433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.698869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:45.707586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f2bff96-7d24-4879-9f06-01722e40f0df tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5/action" status: 202 len: 0 microversion: 2.25 time: 7.126398 Nov 03 03:56:45.708426 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 702/1440] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 03:56:38 2022] POST /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5/action => generated 0 bytes in 7128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:56:45.709410 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12262774-88d4-4c9c-87c8-10220bff310f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 200 len: 1219 microversion: 2.1 time: 0.094390 Nov 03 03:56:45.721403 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 739/1441] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:45 2022] GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:45.721572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:45.721572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:45.721738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:45.721738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:45.727525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.727525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.727525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.727525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.727525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.727525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.731221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.731221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.731741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.732551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.733128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.733640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.925636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:45.940700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85d4d6bb-14ec-481a-8359-b1d637996fc6 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1499 microversion: 2.1 time: 0.231076 Nov 03 03:56:45.942562 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 703/1442] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:45 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:45.951059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:45.951685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:45.968385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.972235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.972235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:45.972235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:45.972235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:45.972235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.060158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:46.071937 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f9e3b6bb-c123-4a88-94ce-7c3040c5f4bb tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1473 microversion: 2.1 time: 0.360380 Nov 03 03:56:46.079658 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 740/1443] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:45 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:46.104283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-af492135-b6b8-44b4-a1e6-7fd38216bb7f req-cd8cd8b6-706b-4fa4-b045-1321b8f94190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f03de5-3dc9-4702-b487-b59a45832ce7", "name": "network-vif-deleted", "tag": "bb198cb5-9f5a-4ac7-a332-d139f1571ce3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:46.121523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-af492135-b6b8-44b4-a1e6-7fd38216bb7f req-cd8cd8b6-706b-4fa4-b045-1321b8f94190 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.121745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-af492135-b6b8-44b4-a1e6-7fd38216bb7f req-cd8cd8b6-706b-4fa4-b045-1321b8f94190 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.122217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-af492135-b6b8-44b4-a1e6-7fd38216bb7f req-cd8cd8b6-706b-4fa4-b045-1321b8f94190 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.144054 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-af492135-b6b8-44b4-a1e6-7fd38216bb7f req-cd8cd8b6-706b-4fa4-b045-1321b8f94190 service nova] Creating event network-vif-deleted:bb198cb5-9f5a-4ac7-a332-d139f1571ce3 for instance f1f03de5-3dc9-4702-b487-b59a45832ce7 on n-h1-854653-7 Nov 03 03:56:46.151406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-af492135-b6b8-44b4-a1e6-7fd38216bb7f req-cd8cd8b6-706b-4fa4-b045-1321b8f94190 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067839 Nov 03 03:56:46.152119 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 741/1444] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:46.158279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-02ed4c65-7678-4e38-a574-49aef2a8c7fa req-473b0b56-dc8e-4b0e-adc8-1ec0b0829bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a8b2ed9-05a6-4f4a-b8c4-2cd266662985", "name": "network-vif-deleted", "tag": "450f08dc-4ccc-4a7b-a22a-21e428fb7d29"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:46.168399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-02ed4c65-7678-4e38-a574-49aef2a8c7fa req-473b0b56-dc8e-4b0e-adc8-1ec0b0829bcf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.170437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-02ed4c65-7678-4e38-a574-49aef2a8c7fa req-473b0b56-dc8e-4b0e-adc8-1ec0b0829bcf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.170937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-02ed4c65-7678-4e38-a574-49aef2a8c7fa req-473b0b56-dc8e-4b0e-adc8-1ec0b0829bcf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.172992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:46.181767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:46.183280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:46.183557 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-02ed4c65-7678-4e38-a574-49aef2a8c7fa req-473b0b56-dc8e-4b0e-adc8-1ec0b0829bcf service nova] Creating event network-vif-deleted:450f08dc-4ccc-4a7b-a22a-21e428fb7d29 for instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 on n-h1-854653-7 Nov 03 03:56:46.184451 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79e3e810-867d-4d28-b60c-1c3565a9d2ae tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.239723 Nov 03 03:56:46.185108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 704/1445] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:45 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:46.188491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-02ed4c65-7678-4e38-a574-49aef2a8c7fa req-473b0b56-dc8e-4b0e-adc8-1ec0b0829bcf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Nov 03 03:56:46.189262 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 742/1446] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:46.197841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:46.198628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:46.210158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.210158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.210158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.210158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.211029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.211029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.468477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:46.486212 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b166a86-829e-4dc4-a726-0d89174ef676 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1324 microversion: 2.1 time: 0.292651 Nov 03 03:56:46.491097 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 743/1447] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:46 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:46.561083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:46.561917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:46.571650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.576368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.576368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.576368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.576368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.576368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.623662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:46.628552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:46.633172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.633677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.634098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.635786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.636030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.636589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.672088 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8a80c47-69b9-4ce6-8a55-4889b094d884 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053079 Nov 03 03:56:46.672883 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 744/1448] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 03:56:46 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 03:56:46.734445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:46.736786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:46.737653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:46.745727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.746503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.747299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.748175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.749081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.749861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.764948 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e9abd3d-94e1-46c5-8cdf-f72555d6cf4a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.197303 Nov 03 03:56:46.777239 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 HTTP/1.1 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '060f75ff-1ed7-40dc-8719-39b56ee5cad8'} Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:46.779661 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:46.784477 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:46.784477 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:46.784477 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:46.784477 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:46.784477 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:46.784477 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 03:56:46.784477 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:46.786070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:46.787230 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 705/1449] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:46 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:46.787758 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20058082-bc67-4506-af3a-643294ed2343 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 404 len: 111 microversion: 2.1 time: 0.055943 Nov 03 03:56:46.788369 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 745/1450] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:46 2022] GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:56:46.850300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-854634365", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "25261195-157d-4c7b-8cfb-4fb3b385217e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:46.949706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] validate_networks() for [('25261195-157d-4c7b-8cfb-4fb3b385217e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:56:46.965886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:46.966597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:46.988315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.988315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.988315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:46.988315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:46.988315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:46.988315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.045355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.045887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.046223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.047082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lazy-loading 'fault' on Instance uuid f1f03de5-3dc9-4702-b487-b59a45832ce7 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:56:47.191307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:47.230217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=20 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:47.422144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42bf39c4aa0f4d2ea1155c3ad5f6a074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29a96f192994136aa4c5e83816502c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:47.430370 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e2967ad-b751-4090-8731-ea3d7942ad60 tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 200 len: 1321 microversion: 2.1 time: 0.468538 Nov 03 03:56:47.434224 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 746/1451] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:46 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:47.444267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:47.451485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:47.458519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.459222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.459918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.460958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.462098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.463591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.469441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:47.511192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.511710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.512387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.513875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lazy-loading 'fault' on Instance uuid 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:56:47.589352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713b3bde635745918bd322e07a240519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75abb61bee2f4e6dadffbd21b8ad0096', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:47.602800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-877aebbc-d58d-40d7-a4ea-acfa12430b91 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 200 len: 1307 microversion: 2.1 time: 0.167291 Nov 03 03:56:47.604243 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 747/1452] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:47 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:47.609957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:47.611119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:47.633489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.635303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.635960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.636943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.637594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.638212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.883466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:47.900939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:47.903709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:47.904931 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f86b611-474d-495a-8e00-d437818acf1d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.299520 Nov 03 03:56:47.914537 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 748/1453] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:47 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:47.920933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:47.921602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:47.927933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.928435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.929822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.929822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.930036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:56:47.930497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.930683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:56:47.930777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:56:47.931170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:56:47.931829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.932408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:56:47.942349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.942872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.943318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.944067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:47.944582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:47.945038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:47.964241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:47.969658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for user baa7ebbbe2c14c82b5a07fef33cc214a and project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:47.983651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:56:47.986321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:56:48.085509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:48.094170 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fc922ab3-b1eb-4984-a3a6-acb5f9ff37eb tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1519 microversion: 2.1 time: 0.178105 Nov 03 03:56:48.094745 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 749/1454] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:47 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:48.099361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:48.099976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:48.106574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.107075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.107510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.108307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.108948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.109424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.242167 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6790365-0ac5-4051-b66e-7c82897b6159 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397612 Nov 03 03:56:48.249036 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 706/1455] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:56:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:56:48.254029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-233b50f0-63f1-4833-bef5-4985d54e7911 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'create', calling method: .version_select at 0x7ff7f943c3a0>, body: {"pool": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:48.276892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:48.291811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7ec2f64-9f2d-435a-9990-a7a847169532 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.194235 Nov 03 03:56:48.292422 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 750/1456] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:48 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:48.311689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-08d3f205-a63e-4c8a-aefb-3c9db0277620 req-4a49139d-31e6-4465-a0c2-30609848f34f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:48.331554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-08d3f205-a63e-4c8a-aefb-3c9db0277620 req-4a49139d-31e6-4465-a0c2-30609848f34f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.332119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-08d3f205-a63e-4c8a-aefb-3c9db0277620 req-4a49139d-31e6-4465-a0c2-30609848f34f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.332859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-08d3f205-a63e-4c8a-aefb-3c9db0277620 req-4a49139d-31e6-4465-a0c2-30609848f34f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.348845 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-08d3f205-a63e-4c8a-aefb-3c9db0277620 req-4a49139d-31e6-4465-a0c2-30609848f34f service nova] Creating event network-changed:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h2-854653-7 Nov 03 03:56:48.353720 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-08d3f205-a63e-4c8a-aefb-3c9db0277620 req-4a49139d-31e6-4465-a0c2-30609848f34f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054669 Nov 03 03:56:48.354678 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 751/1457] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:48.361112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ff483d59-c8d8-407c-b3ef-cc29047744d9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:48.361957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ff483d59-c8d8-407c-b3ef-cc29047744d9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:48.463430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff483d59-c8d8-407c-b3ef-cc29047744d9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:48.473455 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ff483d59-c8d8-407c-b3ef-cc29047744d9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1214 microversion: 2.1 time: 0.117282 Nov 03 03:56:48.474203 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 752/1458] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:48 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:48.479857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:48.481735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] [instance: f1f03de5-3dc9-4702-b487-b59a45832ce7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:48.490807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.491312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.491986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.492715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.493218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.493658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.514057 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] HTTP exception thrown: Instance f1f03de5-3dc9-4702-b487-b59a45832ce7 could not be found. Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Request method failure captured: Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 HTTP/1.1 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzu0Y18tl7wk6VfxBT0gsfiNJyUU2xBZnRSyu1CflMHAuG-D9w2KxCHu-LK_YbFGKp3EU9Ytu70qsX-lEtIK_bvrdA3EoHrHJCliQMFw79AI0iAxjjyKW8dSOVTz7sEiB0djw-Y-MS4w3RMjPtJuJPvUnGctEW6kMPLBzBa3bZv0VM8 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f29a96f192994136aa4c5e83816502c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f29a96f192994136aa4c5e83816502c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f29a96f192994136aa4c5e83816502c7"}]}] Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f29a96f192994136aa4c5e83816502c7 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 42bf39c4aa0f4d2ea1155c3ad5f6a074 Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f1f03de5-3dc9-4702-b487-b59a45832ce7 could not be found. Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f1f03de5-3dc9-4702-b487-b59a45832ce7'} Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f03de5-3dc9-4702-b487-b59a45832ce7 could not be found. Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f03de5-3dc9-4702-b487-b59a45832ce7 could not be found. Nov 03 03:56:48.515901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f03de5-3dc9-4702-b487-b59a45832ce7 could not be found. Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] Returning 404 to user: Instance f1f03de5-3dc9-4702-b487-b59a45832ce7 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:48.520921 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ed7c224d-5bad-4e03-8b5f-b44d2253894e tempest-FloatingIPsAssociationNegativeTestJSON-925301710 tempest-FloatingIPsAssociationNegativeTestJSON-925301710-project] 10.222.0.30 "GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7" status: 404 len: 111 microversion: 2.1 time: 0.043937 Nov 03 03:56:48.521958 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 753/1459] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:48 2022] GET /compute/v2.1/servers/f1f03de5-3dc9-4702-b487-b59a45832ce7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:56:48.632992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:48.635484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] [instance: 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:48.642856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.644373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.647388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.648967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.649797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.651329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.684011 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] HTTP exception thrown: Instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 could not be found. Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Request method failure captured: Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 HTTP/1.1 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuNMgNNhe-tlG_WV5u7dPtab38MpG6KNz6Bl0uMrhjzBM72FDY7oK4EBeRh710itvxm5Rt9wrbcDvWBgolHGTrjkt72zSlqrC5UDZ04zrg3kthmhkLRFvzd8ynbhfcYdRbP8bQi_sFikSm1oGNVM5brVlU7eoINqYXSqAgPioD9L2I Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 75abb61bee2f4e6dadffbd21b8ad0096 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75abb61bee2f4e6dadffbd21b8ad0096"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_75abb61bee2f4e6dadffbd21b8ad0096", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/75abb61bee2f4e6dadffbd21b8ad0096"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/75abb61bee2f4e6dadffbd21b8ad0096"}]}] Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 75abb61bee2f4e6dadffbd21b8ad0096 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-602042427 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerTestJSON-602042427-project Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 713b3bde635745918bd322e07a240519 Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerTestJSON-602042427-project Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 could not be found. Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4a8b2ed9-05a6-4f4a-b8c4-2cd266662985'} Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 could not be found. Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 could not be found. Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:48.685948 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.690912 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:48.690912 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:48.690912 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:48.690912 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:48.690912 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:48.690912 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 could not be found. Nov 03 03:56:48.690912 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:48.692922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] Returning 404 to user: Instance 4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:48.694029 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17f71df6-aa0e-4faf-a476-aa072eaeeeb8 tempest-ImagesOneServerTestJSON-602042427 tempest-ImagesOneServerTestJSON-602042427-project] 10.222.0.30 "GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985" status: 404 len: 111 microversion: 2.1 time: 0.068560 Nov 03 03:56:48.702607 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 754/1460] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:48 2022] GET /compute/v2.1/servers/4a8b2ed9-05a6-4f4a-b8c4-2cd266662985 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:56:48.936243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:48.936243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:48.937384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.938369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.939014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:48.940108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:48.940844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:48.941655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:49.361665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:49.374302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:49.376214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:49.377691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1be508f6-715d-4b13-a0d8-29bb25d2a7d7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.451498 Nov 03 03:56:49.378522 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 755/1461] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:48 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:56:49.384706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:49.386151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:49.401488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:49.401992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:49.402594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:49.404542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:49.405247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:49.406248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:49.892885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:49.919612 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2335c1e1-b477-4a74-9468-2e45fb33991e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.538323 Nov 03 03:56:49.919612 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 756/1462] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:49 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:49.945445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:49.946444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:49.954573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:49.955316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:49.955973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:49.956922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:49.957615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:49.958249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:50.124793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:50.141310 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84deb30b-2e2c-4e86-8f43-19f16c26ad4b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1218 microversion: 2.1 time: 0.197163 Nov 03 03:56:50.143871 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 757/1463] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:49 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:50.405782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:50.406387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:50.410455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=98 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:50.414162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:50.414651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:50.415284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:50.416030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:50.416506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:50.416921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:50.830152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:50.847467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:50.854387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:50.857725 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c7ddbde-1278-44b1-8470-f2b09b645d48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.454296 Nov 03 03:56:50.859550 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 758/1464] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:50 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:50.885139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6e33b711-5dbf-4f83-bfb1-29952074fa6c req-b3927134-a892-4422-910c-c6daeb71da75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b0ee6b-7653-4811-8177-e49f8fbc62d5", "name": "network-vif-unplugged", "status": "completed", "tag": "3ec28101-cd78-498e-95a0-58c0353148ab"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:50.936022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6e33b711-5dbf-4f83-bfb1-29952074fa6c req-b3927134-a892-4422-910c-c6daeb71da75 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:50.936961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6e33b711-5dbf-4f83-bfb1-29952074fa6c req-b3927134-a892-4422-910c-c6daeb71da75 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:50.938848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6e33b711-5dbf-4f83-bfb1-29952074fa6c req-b3927134-a892-4422-910c-c6daeb71da75 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:50.979505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6e33b711-5dbf-4f83-bfb1-29952074fa6c req-b3927134-a892-4422-910c-c6daeb71da75 service nova] Creating event network-vif-unplugged:3ec28101-cd78-498e-95a0-58c0353148ab for instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 on n-h1-854653-7 Nov 03 03:56:50.989428 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6e33b711-5dbf-4f83-bfb1-29952074fa6c req-b3927134-a892-4422-910c-c6daeb71da75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128205 Nov 03 03:56:50.991934 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 759/1465] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:50.998560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:51.000551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:51.009451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:51.010422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:51.011017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:51.012367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:51.013005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:51.013609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:51.569444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:51.580179 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12e8a0eb-9dad-42a6-b694-4df4d9aa7062 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.586512 Nov 03 03:56:51.590200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 760/1466] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:50 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:51.599846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:51.600723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:51.620935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:51.621824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:51.622523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:51.623661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:51.624336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:51.625792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:51.816095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:51.832801 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61c172b8-f1f7-4ecf-a259-06ead5af2dc8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1274 microversion: 2.1 time: 0.240194 Nov 03 03:56:51.856665 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 761/1467] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:51 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:51.886690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:51.888369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:51.919058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:51.919058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:51.919479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:51.920477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:51.921274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:51.923549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:52.510293 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-233b50f0-63f1-4833-bef5-4985d54e7911 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.265855 Nov 03 03:56:52.511434 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 707/1468] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 03:56:48 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:52.539836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:52.553486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:52.554961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:52.556181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-59d3f4de-64df-4c71-a3d2-bc12f4eeb99e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.674031 Nov 03 03:56:52.579701 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 762/1469] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:51 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:52.612689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:52.613359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:52.628384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:52.633411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:52.636114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:52.638593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:52.641495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:52.642000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:52.826224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4269b23a-d75f-48ba-aae7-1247544d5f16 tempest-ListImagesTestJSON-255842111 tempest-ListImagesTestJSON-255842111-project] Calling method '.version_select at 0x7ff7f90fb700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:52.925296 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4269b23a-d75f-48ba-aae7-1247544d5f16 tempest-ListImagesTestJSON-255842111 tempest-ListImagesTestJSON-255842111-project] 10.222.0.30 "GET /compute/v2.1/images/9282dbed-69cc-4288-b866-d4c7962a81f1" status: 200 len: 784 microversion: 2.1 time: 0.300608 Nov 03 03:56:52.929910 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 763/1470] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:56:52 2022] GET /compute/v2.1/images/9282dbed-69cc-4288-b866-d4c7962a81f1 => generated 784 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:56:52.955320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-269811205", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "104b7573-1057-4ee0-9f14-0c79e9b07517"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:53.055616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:53.063055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] validate_networks() for [('104b7573-1057-4ee0-9f14-0c79e9b07517', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:56:53.071494 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-949dd38c-fd07-4633-b296-371cfa5ba50c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.462295 Nov 03 03:56:53.071494 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 708/1471] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:52 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:53.084209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:53.085037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:53.097930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:53.099819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:53.101551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:53.108022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:53.110267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:53.111291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:53.264860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:53.297959 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dfee478d-b5be-47dc-a6f5-108098f5fa97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1272 microversion: 2.1 time: 0.214645 Nov 03 03:56:53.302187 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 709/1472] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:53 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1272 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:53.312657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dac84074-553a-452f-bfa6-7a3bfec23fec tempest-ListImagesTestJSON-255842111 tempest-ListImagesTestJSON-255842111-project] Calling method '.version_select at 0x7ff7f9461f70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:53.454063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dac84074-553a-452f-bfa6-7a3bfec23fec tempest-ListImagesTestJSON-255842111 tempest-ListImagesTestJSON-255842111-project] 10.222.0.30 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.153071 Nov 03 03:56:53.455809 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 710/1473] 10.222.0.30 () {58 vars in 1122 bytes} [Thu Nov 3 03:56:53 2022] GET /compute/v2.1/images => generated 445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:53.461890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-84930db1-df34-474e-8275-18978271645a req-e09ce96e-9e6d-417d-a28d-e8a3577915e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b0ee6b-7653-4811-8177-e49f8fbc62d5", "tag": "3ec28101-cd78-498e-95a0-58c0353148ab"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:53.474175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-84930db1-df34-474e-8275-18978271645a req-e09ce96e-9e6d-417d-a28d-e8a3577915e6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:53.474997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-84930db1-df34-474e-8275-18978271645a req-e09ce96e-9e6d-417d-a28d-e8a3577915e6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:53.475605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-84930db1-df34-474e-8275-18978271645a req-e09ce96e-9e6d-417d-a28d-e8a3577915e6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:53.495285 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-84930db1-df34-474e-8275-18978271645a req-e09ce96e-9e6d-417d-a28d-e8a3577915e6 service nova] Creating event network-changed:3ec28101-cd78-498e-95a0-58c0353148ab for instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 on n-h1-854653-7 Nov 03 03:56:53.526891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-84930db1-df34-474e-8275-18978271645a req-e09ce96e-9e6d-417d-a28d-e8a3577915e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061270 Nov 03 03:56:53.526891 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 711/1474] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:53.533954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2283cb3e-fc63-4821-a247-662de5f89285 req-02a8945c-7b4f-44dc-a183-4c5ff5c71f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "name": "network-vif-plugged", "status": "completed", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:53.559207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2283cb3e-fc63-4821-a247-662de5f89285 req-02a8945c-7b4f-44dc-a183-4c5ff5c71f70 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:53.565452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2283cb3e-fc63-4821-a247-662de5f89285 req-02a8945c-7b4f-44dc-a183-4c5ff5c71f70 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:53.578962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2283cb3e-fc63-4821-a247-662de5f89285 req-02a8945c-7b4f-44dc-a183-4c5ff5c71f70 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:53.622012 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2283cb3e-fc63-4821-a247-662de5f89285 req-02a8945c-7b4f-44dc-a183-4c5ff5c71f70 service nova] Creating event network-vif-plugged:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h2-854653-7 Nov 03 03:56:53.637298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2283cb3e-fc63-4821-a247-662de5f89285 req-02a8945c-7b4f-44dc-a183-4c5ff5c71f70 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114284 Nov 03 03:56:53.638365 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 712/1475] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:53.651295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d766f36a-58d7-407f-9af2-68fea70e834c tempest-ListImagesTestJSON-255842111 tempest-ListImagesTestJSON-255842111-project] Calling method '.version_select at 0x7ff7f956fc10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:53.781266 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d766f36a-58d7-407f-9af2-68fea70e834c tempest-ListImagesTestJSON-255842111 tempest-ListImagesTestJSON-255842111-project] 10.222.0.30 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.139539 Nov 03 03:56:53.782471 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 713/1476] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:56:53 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:53.794176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:53.798292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:53.811842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:53.812241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:53.812695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:53.813440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:53.813903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:53.822135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:54.499740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:54.515184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:54.519697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:54.532218 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-66a043f0-effd-4b40-9a93-a2ec374f0477 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.748376 Nov 03 03:56:54.533733 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 714/1477] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:53 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:54.542881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:54.545390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:54.572738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:54.572738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:54.572738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:54.578813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:54.579474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:54.580452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:54.633163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:54.661381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:56:54.663707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:56:54.664204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:56:54.664629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:56:54.665072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:56:54.687505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:54.688469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:54.688924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:54.693699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:54.694237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:54.694693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:54.746925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Getting quotas for project 69c5a88467bb4b5ca79bfb7562dbf79b. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:54.766028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Getting quotas for user 71097a5704904531909e6adfdbbae98a and project 69c5a88467bb4b5ca79bfb7562dbf79b. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:54.800073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:56:54.802975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:56:54.998260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:55.018812 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aad5480e-a410-4913-9ede-69de4bfc3cd3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.483714 Nov 03 03:56:55.019448 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 715/1478] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:54 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:55.041465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dfa7aba4-2fd6-466b-92fd-65896371c820 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.107452 Nov 03 03:56:55.047939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:55.047939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:55.048153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 764/1479] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:56:55.049009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:55.049534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:55.049994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:55.050699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:55.051479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:55.052106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:55.062559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96b1aae1-5483-4cd9-ae5e-de6dab9ac29c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:55.064030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96b1aae1-5483-4cd9-ae5e-de6dab9ac29c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:55.313436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-96b1aae1-5483-4cd9-ae5e-de6dab9ac29c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:55.322531 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96b1aae1-5483-4cd9-ae5e-de6dab9ac29c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1223 microversion: 2.1 time: 0.273516 Nov 03 03:56:55.329149 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 765/1480] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:55 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1223 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:55.406233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:55.418318 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6d87c20-3bd9-4bf9-8bff-1ef709b9288a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.383028 Nov 03 03:56:55.436602 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 716/1481] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:55 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:55.562949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:55.563635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:55.571225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:55.572349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:55.572963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:55.573923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:55.574544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:55.575444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:55.805539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4aff4cd2-0fd1-4525-ad17-375b4b40adf0 req-dae92aea-9965-4b5c-8ef7-3deb799187c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac", "tag": "2bc27388-07a0-4e9f-8c2c-4a2ad6f8e220"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:55.831558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4aff4cd2-0fd1-4525-ad17-375b4b40adf0 req-dae92aea-9965-4b5c-8ef7-3deb799187c8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:55.832602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4aff4cd2-0fd1-4525-ad17-375b4b40adf0 req-dae92aea-9965-4b5c-8ef7-3deb799187c8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:55.833068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4aff4cd2-0fd1-4525-ad17-375b4b40adf0 req-dae92aea-9965-4b5c-8ef7-3deb799187c8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:55.864945 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4aff4cd2-0fd1-4525-ad17-375b4b40adf0 req-dae92aea-9965-4b5c-8ef7-3deb799187c8 service nova] Creating event network-changed:2bc27388-07a0-4e9f-8c2c-4a2ad6f8e220 for instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac on n-h1-854653-7 Nov 03 03:56:55.871869 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4aff4cd2-0fd1-4525-ad17-375b4b40adf0 req-dae92aea-9965-4b5c-8ef7-3deb799187c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068707 Nov 03 03:56:55.871869 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 717/1482] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:56:55.943158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:55.972497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:55.976213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:55.979946 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d4c333ad-955d-4e3f-b60a-0c8773eb9176 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.423018 Nov 03 03:56:55.982302 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 766/1483] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:55 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:56:56.048737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:56.049834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:56.068557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:56.074801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:56.078580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:56.079355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:56.079842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:56.080286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:56.351938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cbb52288-96e0-40b3-a970-ca0d441f728b tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:56.352741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cbb52288-96e0-40b3-a970-ca0d441f728b tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:56.608254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cbb52288-96e0-40b3-a970-ca0d441f728b tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:56.622413 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cbb52288-96e0-40b3-a970-ca0d441f728b tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1223 microversion: 2.1 time: 0.273013 Nov 03 03:56:56.623093 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 767/1484] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:56 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1223 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:56:56.637666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:56.639181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:56.669470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:56.675010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:56.675611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:56.679875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:56.681575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:56.681575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:56.836785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:56.844756 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7766fe04-5470-4537-83b9-c1ac90834cf1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1312 microversion: 2.1 time: 0.802453 Nov 03 03:56:56.845368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 718/1485] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:56 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1312 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:57.008496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:57.009114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:57.020715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:57.021252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:57.021697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:57.032239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:57.032978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:57.033673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:57.107031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:57.129655 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42363ee2-f440-4deb-ba87-b26aff949fbc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.494637 Nov 03 03:56:57.129655 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 768/1486] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:56 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:57.399407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:57.409697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:57.411447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:57.413450 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1b942064-915c-4672-9964-9f4131096e70 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.408886 Nov 03 03:56:57.416226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 719/1487] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:57 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:57.588821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00b2444f-165b-4dfe-925f-f46e404e5abb tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7f9233a60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwdIiDZ6fPRTg8WK+Gvpi2EqApayWFiMOxZgBJuevsa04RjG5crTJ6I+2T657Cfjwg/ermvH6wsOm/ErYVR1g3pHbGmY4WFIPMiVopOAcVpPkrxV9ROSEPixoXaPeL1iw=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00b2444f-165b-4dfe-925f-f46e404e5abb tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 257 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwdIiDZ6fPRTg8WK+Gvpi2EqApayWFiMOxZgBJuevsa04RjG5crTJ6I+2T657Cfjwg/ermvH6wsOm/ErYVR1g3pHbGmY4WFIPMiVopOAcVpPkrxV9ROSEPixoXaPeL1iw=="}} Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwdIiDZ6fPRTg8WK+Gvpi2EqApayWFiMOxZgBJuevsa04RjG5crTJ6I+2T657Cfjwg/ermvH6wsOm/ErYVR1g3pHbGmY4WFIPMiVopOAcVpPkrxV9ROSEPixoXaPeL1iw=='}}} Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 03 03:56:57.593339 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00b2444f-165b-4dfe-925f-f46e404e5abb tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-00b2444f-165b-4dfe-925f-f46e404e5abb tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.142824 Nov 03 03:56:57.597636 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 769/1488] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:56:57 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:56:57.609090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ef3461d-fb7d-4bc9-b8ef-6fe200ae2ea4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7f912f820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-925137707", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:57.631253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8ef3461d-fb7d-4bc9-b8ef-6fe200ae2ea4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:57.636968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8ef3461d-fb7d-4bc9-b8ef-6fe200ae2ea4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for user fb5fcda5cbf64c45966a47596c799ca3 and project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:57.652115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:57.652858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:57.658719 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-8ef3461d-fb7d-4bc9-b8ef-6fe200ae2ea4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:57.661250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:57.661250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:57.661653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:57.662571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:57.663098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:57.663536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ef3461d-fb7d-4bc9-b8ef-6fe200ae2ea4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 2166 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-925137707", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:56:57.667190 n-d-854653-7 devstack@n-api.service[127593]: exception: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-925137707', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:57.669515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ef3461d-fb7d-4bc9-b8ef-6fe200ae2ea4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ef3461d-fb7d-4bc9-b8ef-6fe200ae2ea4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.065403 Nov 03 03:56:57.672280 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 720/1489] 10.222.0.30 () {60 vars in 1160 bytes} [Thu Nov 3 03:56:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:56:57.682404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a14eb40-1d14-40dc-84e6-84ed4bf3babd tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7fd678820>, body: {"keypair": {"name": "tempest-keypair-579050593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkLGrnqTEeSLAZh+9hUTOkT4RV1M5UeLEFuUgETegtvDMG1UK4VZIW06+qbByv4wucJfQY/OJ1W3aGphDl/z1EOvN8sEAM/UToqgGxPNhUaCpnnUckASlu4+gUQOmYQkQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:57.701979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3a14eb40-1d14-40dc-84e6-84ed4bf3babd tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:57.707380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3a14eb40-1d14-40dc-84e6-84ed4bf3babd tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for user fb5fcda5cbf64c45966a47596c799ca3 and project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:57.752254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:57.760668 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1d2f113-e8aa-4615-80d7-5a0c2748b94f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1219 microversion: 2.1 time: 0.114543 Nov 03 03:56:57.761294 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 770/1490] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:57 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:57.799165 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a14eb40-1d14-40dc-84e6-84ed4bf3babd tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121241 Nov 03 03:56:57.801537 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 721/1491] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:56:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:56:57.819678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7479791a-d8cc-40de-8a06-5098a00e513c tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7f8f1e430>, body: {"keypair": {"name": "tempest-keypair-579050593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDsfJuX8jjwQPo6KSpyqQZ2fidU2fw4Mmo3rk5/7ecdtzu8ThkFmAy5h3WUjB4LZ6+xA4+CMbxRyPXBYL7UvsFAMxG6h4ZNOSsXB17usRY9aBBkn0YQuCqTL7k6gqKpqQ=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:57.841370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7479791a-d8cc-40de-8a06-5098a00e513c tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:57.849559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7479791a-d8cc-40de-8a06-5098a00e513c tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for user fb5fcda5cbf64c45966a47596c799ca3 and project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:57.875899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:57.877465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:57.885358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:57.886332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:57.886988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:57.887739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:57.888210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:57.888645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:57.917779 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7479791a-d8cc-40de-8a06-5098a00e513c tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] HTTP exception thrown: Key pair 'tempest-keypair-579050593' already exists. Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7479791a-d8cc-40de-8a06-5098a00e513c tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 272 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: {"keypair": {"name": "tempest-keypair-579050593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDsfJuX8jjwQPo6KSpyqQZ2fidU2fw4Mmo3rk5/7ecdtzu8ThkFmAy5h3WUjB4LZ6+xA4+CMbxRyPXBYL7UvsFAMxG6h4ZNOSsXB17usRY9aBBkn0YQuCqTL7k6gqKpqQ=="}} Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: exception: Key pair 'tempest-keypair-579050593' already exists. Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-579050593', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDsfJuX8jjwQPo6KSpyqQZ2fidU2fw4Mmo3rk5/7ecdtzu8ThkFmAy5h3WUjB4LZ6+xA4+CMbxRyPXBYL7UvsFAMxG6h4ZNOSsXB17usRY9aBBkn0YQuCqTL7k6gqKpqQ=='}}} Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result.read() Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'fb5fcda5cbf64c45966a47596c799ca3-tempest-keypair-579050593' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 03 03:56:57.926841 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi session.flush() Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result.read() Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 03 03:56:57.931921 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'fb5fcda5cbf64c45966a47596c799ca3-tempest-keypair-579050593' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 3, 3, 56, 57, 871120), 'updated_at': None, 'name': 'tempest-keypair-579050593', 'user_id': 'fb5fcda5cbf64c45966a47596c799ca3', 'fingerprint': 'dc:93:20:11:81:9f:de:ea:17:b4:a1:2d:72:73:b4:f4', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDsfJuX8jjwQPo6KSpyqQZ2fidU2fw4Mmo3rk5/7ecdtzu8ThkFmAy5h3WUjB4LZ6+xA4+CMbxRyPXBYL7UvsFAMxG6h4ZNOSsXB17usRY9aBBkn0YQuCqTL7k6gqKpqQ==', 'type': 'ssh'}] Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi keypair.create() Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._create() Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-579050593' already exists. Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 03 03:56:57.936067 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-579050593' already exists. Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-579050593' already exists. Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7479791a-d8cc-40de-8a06-5098a00e513c tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 409 to user: Key pair 'tempest-keypair-579050593' already exists. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7479791a-d8cc-40de-8a06-5098a00e513c tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.112845 Nov 03 03:56:57.944637 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 771/1492] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:56:57 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:56:57.954755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:57.955656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5be9400b-548d-46c6-a030-267f82fd54e7 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Calling method '.version_select at 0x7ff7f921c700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:58.041365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:58.043337 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5be9400b-548d-46c6-a030-267f82fd54e7 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579050593" status: 202 len: 0 microversion: 2.1 time: 0.096688 Nov 03 03:56:58.050738 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 772/1493] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 03:56:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579050593 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:56:58.051277 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d5ca42a9-135a-423f-9f9a-664343adbc52 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1462 microversion: 2.1 time: 0.181838 Nov 03 03:56:58.053716 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 722/1494] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:57 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1462 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:56:58.059305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e738a8a1-9d63-4690-8325-d7dfacfcd2fc tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7f922e4c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCtymtP+rbfGVQUbIB3WtGm6Gv+ka1Iprp4aD9lqKvwnILF0lr67s49gEpuRRuEyxfEXaaVWLRrIvWAQW47OVMp9C7XsJYtHep+FUVESHGt+CGv9ecMt5jjeGH5RR0T9Q=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e738a8a1-9d63-4690-8325-d7dfacfcd2fc tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 247 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCtymtP+rbfGVQUbIB3WtGm6Gv+ka1Iprp4aD9lqKvwnILF0lr67s49gEpuRRuEyxfEXaaVWLRrIvWAQW47OVMp9C7XsJYtHep+FUVESHGt+CGv9ecMt5jjeGH5RR0T9Q=="}} Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCtymtP+rbfGVQUbIB3WtGm6Gv+ka1Iprp4aD9lqKvwnILF0lr67s49gEpuRRuEyxfEXaaVWLRrIvWAQW47OVMp9C7XsJYtHep+FUVESHGt+CGv9ecMt5jjeGH5RR0T9Q=='}}} Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi '' Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:56:58.063116 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e738a8a1-9d63-4690-8325-d7dfacfcd2fc tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e738a8a1-9d63-4690-8325-d7dfacfcd2fc tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.012038 Nov 03 03:56:58.067285 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 773/1495] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:56:58 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:56:58.076613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ea958507-5b51-447f-b9df-84ad66419e45 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7fd6784c0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2051913445", "public_key": " "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:58.077855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:58.078476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:58.085685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.086591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.087046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.088048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.088565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.089034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.095172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ea958507-5b51-447f-b9df-84ad66419e45 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:58.100389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ea958507-5b51-447f-b9df-84ad66419e45 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for user fb5fcda5cbf64c45966a47596c799ca3 and project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:58.117310 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ea958507-5b51-447f-b9df-84ad66419e45 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ea958507-5b51-447f-b9df-84ad66419e45 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 95 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2051913445", "public_key": " "}} Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: exception: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2051913445', 'public_key': ' '}}} Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.119865 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.124799 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.127536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ea958507-5b51-447f-b9df-84ad66419e45 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:58.128391 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ea958507-5b51-447f-b9df-84ad66419e45 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.058216 Nov 03 03:56:58.129282 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 723/1496] 10.222.0.30 () {60 vars in 1158 bytes} [Thu Nov 3 03:56:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:56:58.152449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c97b3ef6-6e90-4e1c-92dc-5f30c5d3bf69 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7f956faf0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkqTXoaORm1wiQHMkt9H163ejqGMQGCbEbFRHR86zgITpLd/jzVj+aUlUsMIt1IavFKy9+RFCzrk2z7xC6NC4xW75Ex/wi7avlkVTZdYpxNOvnnTrLs+LEF11QD4UH/Q=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c97b3ef6-6e90-4e1c-92dc-5f30c5d3bf69 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 507 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkqTXoaORm1wiQHMkt9H163ejqGMQGCbEbFRHR86zgITpLd/jzVj+aUlUsMIt1IavFKy9+RFCzrk2z7xC6NC4xW75Ex/wi7avlkVTZdYpxNOvnnTrLs+LEF11QD4UH/Q=="}} Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkqTXoaORm1wiQHMkt9H163ejqGMQGCbEbFRHR86zgITpLd/jzVj+aUlUsMIt1IavFKy9+RFCzrk2z7xC6NC4xW75Ex/wi7avlkVTZdYpxNOvnnTrLs+LEF11QD4UH/Q=='}}} Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 03 03:56:58.162093 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c97b3ef6-6e90-4e1c-92dc-5f30c5d3bf69 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c97b3ef6-6e90-4e1c-92dc-5f30c5d3bf69 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017289 Nov 03 03:56:58.166694 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 724/1497] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:56:58 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:56:58.170710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:58.170943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:58.177610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.178556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.179420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.180359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.181743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.182257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.337003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:58.345763 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1bcfc8b-2e77-42be-8c01-1ec90b9c4ccf tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1613 microversion: 2.1 time: 0.270159 Nov 03 03:56:58.347979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 774/1498] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:58 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1613 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:58.365469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:58.378918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7593bc0e-e2e3-4d88-9bef-e059a1cfeaa5 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Action: 'create', calling method: .version_select at 0x7ff7f92339d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-866436181", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:58.391906 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4264083a-4170-4954-a433-2e5907e8e2d2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.226335 Nov 03 03:56:58.398004 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 725/1499] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:58 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:58.398367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:56:58.398951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:58.411004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:56:58.417679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7593bc0e-e2e3-4d88-9bef-e059a1cfeaa5 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:56:58.424550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.426970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.426970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.426970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.426970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.427410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.431591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7593bc0e-e2e3-4d88-9bef-e059a1cfeaa5 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Getting quotas for user fb5fcda5cbf64c45966a47596c799ca3 and project ac8bf2721cb644379f6a766546d08a98. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:56:58.466869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7593bc0e-e2e3-4d88-9bef-e059a1cfeaa5 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7593bc0e-e2e3-4d88-9bef-e059a1cfeaa5 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 117 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-866436181", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: exception: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-866436181', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 03 03:56:58.470252 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7593bc0e-e2e3-4d88-9bef-e059a1cfeaa5 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:58.475118 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7593bc0e-e2e3-4d88-9bef-e059a1cfeaa5 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.108729 Nov 03 03:56:58.481585 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 775/1500] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:56:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 03:56:58.482072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:58.482686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:58.491015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'eacef8d3c2ae47519bba70f6424056fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f22db116f324a53b32b3e8aa8433ed0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:58.492047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] flavor_id is None. Assuming migration. {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 03 03:56:58.492750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 03:56:58.493861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.494451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.495163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.495885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.496348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.497161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.676487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:58.687504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:58.689035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:58.690552 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c92af336-85ea-4041-a30e-c83cc8a71c48 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.212691 Nov 03 03:56:58.702507 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 776/1501] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:58 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:56:58.712697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d09f2b80-2d10-433e-a663-1c43d90408a4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Calling method '.version_select at 0x7ff7f8f4b040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:58.730537 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d09f2b80-2d10-433e-a663-1c43d90408a4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-970923650 not found for user fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d09f2b80-2d10-433e-a663-1c43d90408a4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Request method failure captured: Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-970923650 HTTP/1.1 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzwJuAHJ97AEIoyoDejcbajRj0M2CPE2uUCi4BCvQamN7Kf6L3qfIJC9c91HIE3oVjYhwyw_M4oP-RIB4yPury3YwtvbycaOZX_aXWh7-DSdG8YF_iJsc6iW3T4N9UljxY0ulpESc2zXJDtfLSFi2Xn_EGVsL5jIMfdwXTDRGayVOcc Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac8bf2721cb644379f6a766546d08a98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac8bf2721cb644379f6a766546d08a98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac8bf2721cb644379f6a766546d08a98"}]}] Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: ac8bf2721cb644379f6a766546d08a98 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1542970548 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1542970548-project Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: exception: Keypair tempest-keypair-non-existent-970923650 not found for user fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'tempest-keypair-non-existent-970923650'} Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-970923650 not found for user fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.732621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-970923650 not found for user fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-970923650 not found for user fb5fcda5cbf64c45966a47596c799ca3 Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d09f2b80-2d10-433e-a663-1c43d90408a4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] Returning 404 to user: Keypair tempest-keypair-non-existent-970923650 not found for user fb5fcda5cbf64c45966a47596c799ca3 {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d09f2b80-2d10-433e-a663-1c43d90408a4 tempest-KeyPairsNegativeTestJSON-1542970548 tempest-KeyPairsNegativeTestJSON-1542970548-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-970923650" status: 404 len: 144 microversion: 2.1 time: 0.025087 Nov 03 03:56:58.739978 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 777/1502] 10.222.0.30 () {58 vars in 1257 bytes} [Thu Nov 3 03:56:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-970923650 => generated 144 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:56:58.783854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:58.784498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:58.800881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.801638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.802080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.803033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:58.806594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:58.806594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:58.893754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:58.903034 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bdd17278-3d9c-49b3-b497-8cbe4e873f7f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1219 microversion: 2.1 time: 0.123105 Nov 03 03:56:58.917255 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 778/1503] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:58 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:59.112545 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-663d8cac-71e8-4762-8525-447a225f9248 tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517/action" status: 202 len: 0 microversion: 2.1 time: 0.718199 Nov 03 03:56:59.113970 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 726/1504] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:56:58 2022] POST /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:56:59.126539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:59.128814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:59.135084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.135834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.136801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:59.138021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.138752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.139425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:59.420677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:59.421546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:59.434303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.435172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.437646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:59.438647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.441097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.441777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:59.668535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:59.695806 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97954279-e81d-4269-9d19-19e55ed9f1ac tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1471 microversion: 2.1 time: 0.573828 Nov 03 03:56:59.698128 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 779/1505] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:59 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1471 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:56:59.728649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:59.729305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:59.760097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.761409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.762079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:59.766156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.766656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.768587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:59.860690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:56:59.871531 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-830cb377-88bf-4c4d-b25f-a37700c04822 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.453938 Nov 03 03:56:59.872397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 727/1506] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:59 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:56:59.927298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:56:59.927926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:56:59.937188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.937847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.938295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:56:59.939015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:56:59.939478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:56:59.939907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:00.495738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:00.512170 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-793baa62-4022-43f3-8041-8d4446b37263 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1275 microversion: 2.1 time: 0.582245 Nov 03 03:57:00.527697 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 728/1507] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:56:59 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1275 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:00.782098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:00.798949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:00.800681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:00.801957 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c5325c4-ae95-4002-a00e-47d84de425a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 1.080218 Nov 03 03:57:00.802492 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 780/1508] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:56:59 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:00.808234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:00.811535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:00.832581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:00.832581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:00.832581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:00.832581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:00.832581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:00.832581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:00.978984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f70ce075-0f58-44d1-8937-07afb04ecb58 tempest-ListImageFiltersNegativeTestJSON-6597955 tempest-ListImageFiltersNegativeTestJSON-6597955-project] Calling method '.version_select at 0x7ff7f92f5700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:01.011447 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f70ce075-0f58-44d1-8937-07afb04ecb58 tempest-ListImageFiltersNegativeTestJSON-6597955 tempest-ListImageFiltersNegativeTestJSON-6597955-project] HTTP exception thrown: Image not found. Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f70ce075-0f58-44d1-8937-07afb04ecb58 tempest-ListImageFiltersNegativeTestJSON-6597955 tempest-ListImageFiltersNegativeTestJSON-6597955-project] Request method failure captured: Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/images/60d9b14b-d554-4b26-a16b-4fee1f5233a3 HTTP/1.1 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzwL4C8xm1WEAq8HFEZqpIjescmgvwS0_KYhfn28OUdNeqjWq1KHlxZPmnUIuERnQdu-cRw3A7CALnnMr-_KmD-qq_mcnYkXeK2KJARfabofZsVelxvyqQkbstDDcLbuYwDepqRmR0QpUPC6yNxUPj5ebGi6SiLIgO3h71xpNjbjRNA Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 40f953d6a14b43a795065a8d4b24b839 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-6597955 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40f953d6a14b43a795065a8d4b24b839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_40f953d6a14b43a795065a8d4b24b839", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/40f953d6a14b43a795065a8d4b24b839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/40f953d6a14b43a795065a8d4b24b839"}]}] Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-6597955 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 40f953d6a14b43a795065a8d4b24b839 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-6597955 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListImageFiltersNegativeTestJSON-6597955-project Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d75bb58340f34ac291260bd048d661f5 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-6597955-project Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '60d9b14b-d554-4b26-a16b-4fee1f5233a3'} Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60d9b14b-d554-4b26-a16b-4fee1f5233a3 Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 03:57:01.014428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60d9b14b-d554-4b26-a16b-4fee1f5233a3 could not be found. Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f70ce075-0f58-44d1-8937-07afb04ecb58 tempest-ListImageFiltersNegativeTestJSON-6597955 tempest-ListImageFiltersNegativeTestJSON-6597955-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:57:01.019478 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f70ce075-0f58-44d1-8937-07afb04ecb58 tempest-ListImageFiltersNegativeTestJSON-6597955 tempest-ListImageFiltersNegativeTestJSON-6597955-project] 10.222.0.30 "GET /compute/v2.1/images/60d9b14b-d554-4b26-a16b-4fee1f5233a3" status: 404 len: 62 microversion: 2.1 time: 0.488236 Nov 03 03:57:01.036942 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 729/1509] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:57:00 2022] GET /compute/v2.1/images/60d9b14b-d554-4b26-a16b-4fee1f5233a3 => generated 62 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:57:01.036942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:01.036942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:01.069901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:01.070308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:01.071033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:01.072313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:01.072786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:01.073258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:01.304490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:01.312752 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-157cf162-9ef0-47b7-8991-76e4283ce4ae tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1471 microversion: 2.1 time: 0.508533 Nov 03 03:57:01.313348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 781/1510] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:00 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:01.449218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:01.459582 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6f2d872-8d26-4d4e-a27d-20dbc22de887 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.438620 Nov 03 03:57:01.460487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 730/1511] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:01 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:01.536858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:01.537624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:01.549231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:01.550364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:01.550813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:01.551676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:01.552355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:01.553187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:01.836679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:01.838639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:01.857263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:01.861350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:01.861977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:01.862892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:01.866409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:01.870587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:02.015680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:02.015680 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4439190f-cdfc-44a0-8430-75f4864cdbaa tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.421834 Nov 03 03:57:02.015680 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 782/1512] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:01 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:02.110701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:02.125570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:02.127865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:02.129197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-18114a8d-0329-4eef-97ca-883ad2625fb9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1568 microversion: 2.25 time: 0.297929 Nov 03 03:57:02.133612 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 731/1513] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:01 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:57:02.342878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:02.343580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:02.354735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:02.356217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:02.360678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:02.361851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:02.362565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:02.363110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:02.679202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cca63102-4623-4fb4-81b6-4f4b6004e55f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7f92f5790>, body: {"keypair": {"name": "tempest-keypair-1371781646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErhQo/Fll3bTe0IW8YOsIj3LQ2yskaoZYyx/hSZGIGgcgnjP+HDftrsu18dHZ3r0zjzxJ+BXCweyVCJe5QvmoFR0ImQSYRoRwNVnBkHwzdcByalDG9IW4iXs5e6ykx84Q=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:02.697224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=21 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:02.698541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-cca63102-4623-4fb4-81b6-4f4b6004e55f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:02.704901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-cca63102-4623-4fb4-81b6-4f4b6004e55f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:02.861427 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cca63102-4623-4fb4-81b6-4f4b6004e55f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.395120 Nov 03 03:57:02.863690 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 732/1514] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Nov 3 03:57:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 398 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 03 03:57:02.877262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:02.878250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:02.895381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:02.908136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:02.910952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:02.912480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:02.913278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:02.915877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:02.939562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:02.953424 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c35862e9-85b2-4730-aacd-f6f736ab3088 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1471 microversion: 2.1 time: 0.612008 Nov 03 03:57:02.959606 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 783/1515] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:02 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1471 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:02.964126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e6770c4e-aa66-462a-9224-b96ae2997546 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f90fb3a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:02.984635 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e6770c4e-aa66-462a-9224-b96ae2997546 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1371781646" status: 200 len: 513 microversion: 2.2 time: 0.028308 Nov 03 03:57:02.985211 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 784/1516] 10.222.0.30 () {60 vars in 1258 bytes} [Thu Nov 3 03:57:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1371781646 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:02.999903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c3ce644-4ba1-42a4-b172-ecff7c32c65b tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f901b9d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:03.130040 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c3ce644-4ba1-42a4-b172-ecff7c32c65b tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371781646" status: 204 len: 0 microversion: 2.2 time: 0.136462 Nov 03 03:57:03.130749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 785/1517] 10.222.0.30 () {60 vars in 1261 bytes} [Thu Nov 3 03:57:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1371781646 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:03.141648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:03.141648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:03.176043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:03.180631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:03.182857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:03.185927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:03.192462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:03.204111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:03.287949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:03.302520 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8764a6a2-3b12-4fb2-863b-a17e51c1271b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.437320 Nov 03 03:57:03.304302 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 733/1518] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:02 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:03.323933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f032ef2-dce6-4497-9ba0-3a50711c7b31 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7f94143a0>, body: {"keypair": {"name": "tempest-keypair-1935649229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQmngkwqZlhYSCc8sXkrZjArnwAc41hgSmRjDTtrDjH9z7ZwyT9/1VSxYVurPrsV8F7hT9GZJu5qDP/JaPuoGPaUFj90dY0eJvd3GikFroWfIGTDpNt7055Oadw9jpKOw=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:03.365423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-1f032ef2-dce6-4497-9ba0-3a50711c7b31 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:03.379355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-1f032ef2-dce6-4497-9ba0-3a50711c7b31 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:03.513729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f032ef2-dce6-4497-9ba0-3a50711c7b31 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.206787 Nov 03 03:57:03.517484 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 734/1519] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Nov 3 03:57:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 03 03:57:03.526387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:03.527012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:03.548517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:03.551983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:03.551983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:03.551983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:03.551983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:03.551983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:03.572140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:03.582642 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d495843d-3869-49b2-a8a7-2b9365aebb14 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.450509 Nov 03 03:57:03.601045 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 786/1520] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:03 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:03.606609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1ec41f9-4160-49fa-b67e-abb029883ad1 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f911cee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:03.726347 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1ec41f9-4160-49fa-b67e-abb029883ad1 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935649229" status: 204 len: 0 microversion: 2.2 time: 0.135931 Nov 03 03:57:03.728062 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 787/1521] 10.222.0.30 () {60 vars in 1261 bytes} [Thu Nov 3 03:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1935649229 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:03.737650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f485226-3810-488c-88d3-6bb2b1df4482 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7f9165e50>, body: {"keypair": {"name": "tempest-keypair-363592180", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:03.820251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6f485226-3810-488c-88d3-6bb2b1df4482 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:03.840278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:03.843216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6f485226-3810-488c-88d3-6bb2b1df4482 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:03.945491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f485226-3810-488c-88d3-6bb2b1df4482 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.211452 Nov 03 03:57:03.948325 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 788/1522] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Nov 3 03:57:03 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 03 03:57:03.962464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc86f3bd-367b-4a15-926d-362d9ef7e268 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f924d280>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:03.999774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:04.017394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:04.019094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:04.020325 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a527d6dc-230e-4cbc-b6b2-8bb2e53e52d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1543 microversion: 2.25 time: 0.503778 Nov 03 03:57:04.021105 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 735/1523] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:03 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1543 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:04.036651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:04.037323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:04.046602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.047111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.047565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.048301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.048769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.050930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.128706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc86f3bd-367b-4a15-926d-362d9ef7e268 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363592180" status: 204 len: 0 microversion: 2.2 time: 0.171317 Nov 03 03:57:04.129337 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 789/1524] 10.222.0.30 () {60 vars in 1258 bytes} [Thu Nov 3 03:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363592180 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:04.136834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41606476-7d5e-4363-a4ce-7236301001ad tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '.version_select at 0x7ff7f90fb280>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:04.141259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41606476-7d5e-4363-a4ce-7236301001ad tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.142017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41606476-7d5e-4363-a4ce-7236301001ad tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.142474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41606476-7d5e-4363-a4ce-7236301001ad tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.168271 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41606476-7d5e-4363-a4ce-7236301001ad tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 4053 microversion: 2.25 time: 0.037437 Nov 03 03:57:04.178768 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 790/1525] 10.222.0.30 () {60 vars in 1184 bytes} [Thu Nov 3 03:57:04 2022] GET /compute/v2.1/os-migrations => generated 4053 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:04.185196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b036ae8e-56ec-4e5c-9aef-e07f940afa68 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7f9206310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1188505011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8bb7AVn/Fy1XoYP6kNGcRcjzSsf9+RRG757P7AqWYEKb0Ik1uWCEkff0BsjNGan358rNJnhqjVXtttg3k5g7jG/nJfHXQFNJqBCHeHDYvba1gH+OxIjOh5lsNuOLK8fg=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:04.226211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b036ae8e-56ec-4e5c-9aef-e07f940afa68 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:04.232734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b036ae8e-56ec-4e5c-9aef-e07f940afa68 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:04.382583 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b036ae8e-56ec-4e5c-9aef-e07f940afa68 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.193277 Nov 03 03:57:04.382583 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 791/1526] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Nov 3 03:57:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 03 03:57:04.382583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:04.382583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:04.408238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.409030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.409678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.411467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.415728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:04.416063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.416836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.428589 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a8a86b0-a345-4712-96f8-a2ab0c4f81b8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1471 microversion: 2.1 time: 0.405970 Nov 03 03:57:04.433545 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 736/1527] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:04 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:04.459049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c97f5fc4-e039-4b4b-be85-683d3577ed5c req-0b6fa617-08fe-4baf-866d-38a23a80fa84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b39feb3-5f40-46b0-85f8-b17042ace49f", "tag": "e5434394-729e-48d4-90d4-8a47f965e59e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:04.500243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c97f5fc4-e039-4b4b-be85-683d3577ed5c req-0b6fa617-08fe-4baf-866d-38a23a80fa84 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.500474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c97f5fc4-e039-4b4b-be85-683d3577ed5c req-0b6fa617-08fe-4baf-866d-38a23a80fa84 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.501063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c97f5fc4-e039-4b4b-be85-683d3577ed5c req-0b6fa617-08fe-4baf-866d-38a23a80fa84 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.534431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c97f5fc4-e039-4b4b-be85-683d3577ed5c req-0b6fa617-08fe-4baf-866d-38a23a80fa84 service nova] Creating event network-changed:e5434394-729e-48d4-90d4-8a47f965e59e for instance 7b39feb3-5f40-46b0-85f8-b17042ace49f on n-h1-854653-7 Nov 03 03:57:04.547674 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c97f5fc4-e039-4b4b-be85-683d3577ed5c req-0b6fa617-08fe-4baf-866d-38a23a80fa84 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116887 Nov 03 03:57:04.548670 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 737/1528] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:04.561957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:04.563862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:04.570844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.571587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.572032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.572766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:04.573264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:04.573697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:04.717812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:04.934155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid 41b0ee6b-7653-4811-8177-e49f8fbc62d5 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:57:04.962822 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3158358-dad8-4ff9-b712-bae55f5b1f8b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 2036 microversion: 2.25 time: 0.586906 Nov 03 03:57:04.965670 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 792/1529] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:04 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 2036 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:04.972841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-22228602-f7ce-4857-905e-58399e78dd6f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7f924d9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1492065018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwfjOV8EC2Q8MfMpsU+ddMKVCdNvx1qleHFCtIiuiYiSHN0FaH/xuwFjQ30/9JDwPEARnVefDNuo8eg8rFE1VUWdegM7Y26fYqTo9iH1UnepY/ZuS/wyaFFQ3xAvtnhVA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:05.021254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:05.028385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:05.034924 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f35a3db4-894d-44eb-a90f-e60327d7e553 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.484738 Nov 03 03:57:05.038363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-22228602-f7ce-4857-905e-58399e78dd6f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:05.038848 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 738/1530] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:04 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:05.051059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:05.051913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:05.066453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-22228602-f7ce-4857-905e-58399e78dd6f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:05.072991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:05.072991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:05.072991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:05.072991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:05.072991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:05.074041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:05.189256 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-22228602-f7ce-4857-905e-58399e78dd6f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.221782 Nov 03 03:57:05.190184 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 793/1531] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Nov 3 03:57:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 224 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 03 03:57:05.201891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0627e061-aa1f-4a98-a4e9-a194b3a93cde req-9e1e7e87-1ec8-432c-ae51-2b5d9882c827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac", "name": "network-vif-plugged", "status": "completed", "tag": "2bc27388-07a0-4e9f-8c2c-4a2ad6f8e220"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:05.216520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0627e061-aa1f-4a98-a4e9-a194b3a93cde req-9e1e7e87-1ec8-432c-ae51-2b5d9882c827 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:05.216520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0627e061-aa1f-4a98-a4e9-a194b3a93cde req-9e1e7e87-1ec8-432c-ae51-2b5d9882c827 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:05.216520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0627e061-aa1f-4a98-a4e9-a194b3a93cde req-9e1e7e87-1ec8-432c-ae51-2b5d9882c827 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:05.231240 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0627e061-aa1f-4a98-a4e9-a194b3a93cde req-9e1e7e87-1ec8-432c-ae51-2b5d9882c827 service nova] Creating event network-vif-plugged:2bc27388-07a0-4e9f-8c2c-4a2ad6f8e220 for instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac on n-h1-854653-7 Nov 03 03:57:05.240945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0627e061-aa1f-4a98-a4e9-a194b3a93cde req-9e1e7e87-1ec8-432c-ae51-2b5d9882c827 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049151 Nov 03 03:57:05.241773 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 794/1532] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:05.253183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9d3d3a9-3fd8-4a2d-98f4-8e90253a7245 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Action: 'create', calling method: .version_select at 0x7ff7f9233310>, body: {"keypair": {"name": "tempest-keypair-1018292931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME3KJtWhTqqL8HKuNk/P0WOiPkShsnvrLEmh0xxY5yYMHIP51qefo0nJFrHxE4r8OufqYH0Je2+yOjZF0k49TwZm9pPP6zkkaEE+DUeC94lxbUPHvQ9+qW4sSUzixanGQ=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:05.272064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e9d3d3a9-3fd8-4a2d-98f4-8e90253a7245 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:05.283502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e9d3d3a9-3fd8-4a2d-98f4-8e90253a7245 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for user 7ebbc13908db44e88853d5c14c8e2102 and project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:05.337493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:05.344513 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f24f498-5cfa-4796-afcd-c63db23c799a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.304086 Nov 03 03:57:05.345149 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 739/1533] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:05 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:05.350589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14f0f577-7216-43b7-8216-717422f96b84 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7fd67a310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1527585464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMy486E2eLlUr/WeEhFk62S8XzDoD1Q2SnCX2+BdbtESQuC06Du7FeZhe7OZuPSJpNSRpjE2IMm0z+XbTgViwvEXY1/8NMlEpqQWlHsnVqXMd1xGbmpGifHuBWkZ/pjd9A=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:05.367252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-14f0f577-7216-43b7-8216-717422f96b84 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:05.373274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-14f0f577-7216-43b7-8216-717422f96b84 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:05.389650 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9d3d3a9-3fd8-4a2d-98f4-8e90253a7245 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.141914 Nov 03 03:57:05.396982 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 795/1534] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 03:57:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 03:57:05.460801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:05.461798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:05.470882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:05.471669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:05.472293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:05.473255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:05.473888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:05.474698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:05.559242 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14f0f577-7216-43b7-8216-717422f96b84 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.213030 Nov 03 03:57:05.560645 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 740/1535] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Nov 3 03:57:05 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 03 03:57:05.572553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3381e4c7-1f54-46d3-981c-f09fb699de9a tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f9461790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:05.585395 n-d-854653-7 devstack@n-api.service[127593]: WARNING oslo_db.sqlalchemy.utils [None req-3381e4c7-1f54-46d3-981c-f09fb699de9a tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 03 03:57:05.611746 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3381e4c7-1f54-46d3-981c-f09fb699de9a tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.044225 Nov 03 03:57:05.621068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 741/1536] 10.222.0.30 () {60 vars in 1177 bytes} [Thu Nov 3 03:57:05 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:05.627358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce3227a7-6b46-4fcf-ab56-7ba10ba5098d tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f94ae5e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:05.755504 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce3227a7-6b46-4fcf-ab56-7ba10ba5098d tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1527585464" status: 204 len: 0 microversion: 2.2 time: 0.132612 Nov 03 03:57:05.756600 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 742/1537] 10.222.0.30 () {60 vars in 1321 bytes} [Thu Nov 3 03:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1527585464 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:05.766180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d39ae526-141a-4d88-9d03-880f54ad58bc tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f9389ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:05.856366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d39ae526-141a-4d88-9d03-880f54ad58bc tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1492065018" status: 204 len: 0 microversion: 2.2 time: 0.095014 Nov 03 03:57:05.857124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 743/1538] 10.222.0.30 () {60 vars in 1321 bytes} [Thu Nov 3 03:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1492065018 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:57:05.866634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fb297bc-3ea9-4a49-ac94-2448058d88a1 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f95a9550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:06.010882 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7fb297bc-3ea9-4a49-ac94-2448058d88a1 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1188505011" status: 204 len: 0 microversion: 2.2 time: 0.148925 Nov 03 03:57:06.015618 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 744/1539] 10.222.0.30 () {60 vars in 1321 bytes} [Thu Nov 3 03:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1188505011 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:57:06.029104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fee353b3-3f62-4f61-a27e-c92cde5320ce tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7f912c0d0>, body: {"keypair": {"name": "tempest-keypair-1217173443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUeGIN6pFYAjmVayZ64fT7rY2R2/ghZzG3d7Tc3RvkMZRAMmBSaOSJ7mQeWgYT+MH+8deJIjH+2c578hVsGJA1geO8k5vS4ZG+XXXUUkXRHIlDSRTf8qVednLa1F5wnUQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:06.046006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fee353b3-3f62-4f61-a27e-c92cde5320ce tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:06.051508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fee353b3-3f62-4f61-a27e-c92cde5320ce tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:06.151559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:06.160478 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f290483e-df14-4ce3-b430-454d5488d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1471 microversion: 2.1 time: 0.711485 Nov 03 03:57:06.161076 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 796/1540] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:05 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1471 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:06.185905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:06.187714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:06.194544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:06.195272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:06.195426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:06.196438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:06.197122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:06.197520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:06.353473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:06.363546 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b717b38-37ed-4f83-bad1-cf3ffcc2029d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.182733 Nov 03 03:57:06.364135 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 797/1541] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:06 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:06.369059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:06.369861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:06.376051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:06.376539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:06.377233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:06.378160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:06.378828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:06.379268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:06.394024 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fee353b3-3f62-4f61-a27e-c92cde5320ce tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.369346 Nov 03 03:57:06.395540 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 745/1542] 10.222.0.30 () {62 vars in 1199 bytes} [Thu Nov 3 03:57:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 371 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 03 03:57:06.407305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c55dbf37-cdbf-4f16-a04c-8a4a33c02b93 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f93f0af0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:06.418185 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c55dbf37-cdbf-4f16-a04c-8a4a33c02b93 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1217173443" status: 200 len: 513 microversion: 2.2 time: 0.015384 Nov 03 03:57:06.419123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 746/1543] 10.222.0.30 () {60 vars in 1258 bytes} [Thu Nov 3 03:57:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1217173443 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:57:06.431064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6b0d78b-3d79-4f14-8fb7-f3c842541557 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f9414af0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:06.435268 n-d-854653-7 devstack@n-api.service[127593]: WARNING oslo_db.sqlalchemy.utils [None req-a6b0d78b-3d79-4f14-8fb7-f3c842541557 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 03 03:57:06.442935 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6b0d78b-3d79-4f14-8fb7-f3c842541557 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.016017 Nov 03 03:57:06.443825 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 747/1544] 10.222.0.30 () {60 vars in 1177 bytes} [Thu Nov 3 03:57:06 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:57:06.455596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-349508ab-2e03-496d-adea-9bc3e866cf74 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7fd678ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:06.551685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:06.565331 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cacb8d14-35c5-4436-a9c5-5568cb1372e4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.198728 Nov 03 03:57:06.576283 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 798/1545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:06 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:06.584731 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-349508ab-2e03-496d-adea-9bc3e866cf74 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217173443" status: 204 len: 0 microversion: 2.2 time: 0.133275 Nov 03 03:57:06.585829 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 748/1546] 10.222.0.30 () {60 vars in 1261 bytes} [Thu Nov 3 03:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217173443 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:06.597502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Action: 'create', calling method: .version_select at 0x7ff7f9206c10>, body: {"keypair": {"name": "tempest-keypair-1836484499", "type": "x509"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:06.621134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:06.628602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:06.648951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.processutils [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpr9rz9wbh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpr9rz9wbh/temp.key -subj /CN=ef5a0962d38f4d61892e43bc98232cbb -extensions v3_req_client {{(pid=127594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 03 03:57:07.012281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.processutils [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpr9rz9wbh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpr9rz9wbh/temp.key -subj /CN=ef5a0962d38f4d61892e43bc98232cbb -extensions v3_req_client" returned: 0 in 0.356s {{(pid=127594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 03 03:57:07.012281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.processutils [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpr9rz9wbh/temp.key -password pass: {{(pid=127594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 03 03:57:07.090715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.processutils [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpr9rz9wbh/temp.key -password pass:" returned: 0 in 0.078s {{(pid=127594) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 03 03:57:07.186988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:07.191784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:07.195896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:07.196972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:07.197469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:07.198190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:07.198776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:07.199187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:07.233751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:07.252973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Getting quotas for user ef5a0962d38f4d61892e43bc98232cbb and project 254e63038775496ca7c70022deb804f0. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:07.301174 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-acce1700-c869-429a-b902-653c5e42bb96 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.709903 Nov 03 03:57:07.314371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 799/1547] 10.222.0.30 () {62 vars in 1198 bytes} [Thu Nov 3 03:57:06 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 723 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:57:07.332183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9f3016b-d4c1-4161-84b3-494e9d8d59e1 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f90fd5e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:07.347197 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c9f3016b-d4c1-4161-84b3-494e9d8d59e1 tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-1836484499" status: 200 len: 1534 microversion: 2.2 time: 0.029628 Nov 03 03:57:07.355941 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 800/1548] 10.222.0.30 () {60 vars in 1258 bytes} [Thu Nov 3 03:57:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1836484499 => generated 1534 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:07.368066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-54139ef1-d944-4a40-ac3c-22d0684442aa tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f922eee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:07.373508 n-d-854653-7 devstack@n-api.service[127594]: WARNING oslo_db.sqlalchemy.utils [None req-54139ef1-d944-4a40-ac3c-22d0684442aa tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 03 03:57:07.395470 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-54139ef1-d944-4a40-ac3c-22d0684442aa tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.034208 Nov 03 03:57:07.403929 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 801/1549] 10.222.0.30 () {60 vars in 1177 bytes} [Thu Nov 3 03:57:07 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:07.410605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:07.411534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:07.419897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:07.420434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:07.420891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:07.421732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:07.422386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:07.422984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:07.494596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:07.510191 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-385bfaff-e289-445f-9264-207357b0eb43 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.324857 Nov 03 03:57:07.511073 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 749/1550] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:07 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:07.518188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a34b8d96-ed82-42b7-b600-49ce0de4a90f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] Calling method '.version_select at 0x7ff7f95a91f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:07.658907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a34b8d96-ed82-42b7-b600-49ce0de4a90f tempest-KeyPairsV22TestJSON-1506674047 tempest-KeyPairsV22TestJSON-1506674047-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836484499" status: 204 len: 0 microversion: 2.2 time: 0.144162 Nov 03 03:57:07.662020 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 750/1551] 10.222.0.30 () {60 vars in 1261 bytes} [Thu Nov 3 03:57:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836484499 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:07.670573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:07.671339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:07.681392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:07.683933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:07.689958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:07.689958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:07.689958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:07.689958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:07.689958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:07.844603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:07.855564 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c114c82b-e6a0-445d-8ef4-0a5f8400f6dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.449368 Nov 03 03:57:07.858150 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 802/1552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:07 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:08.097275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:08.107426 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-533782ac-cfd2-423e-8342-53df1072ac08 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.445978 Nov 03 03:57:08.111905 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 751/1553] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:07 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:08.545785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:08.546831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:08.578544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:08.585464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:08.591264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:08.594812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:08.599017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:08.603511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:08.880891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:08.881607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:08.896891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:08.906938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:08.906938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:08.906938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:08.906938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:08.906938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:09.050633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:09.061291 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33a6e696-a665-4ad7-a499-729760d67a88 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.522106 Nov 03 03:57:09.074703 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 803/1554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:08 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:09.134269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:09.136039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:09.145475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:09.146764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:09.147932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:09.149396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:09.150094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:09.150695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:09.588016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:09.599428 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-033d328d-272b-431b-8759-369f7f966244 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1314 microversion: 2.1 time: 0.722428 Nov 03 03:57:09.599681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:09.603087 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 752/1555] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:08 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:09.625921 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad5fe7a5-ca0b-4e7f-8f80-0c2ee5f4354a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.496867 Nov 03 03:57:09.627008 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 804/1556] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:09 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:10.087959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:10.093239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:10.095628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:10.096126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:10.096574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:10.097327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:10.097787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:10.098219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:10.252388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:10.264109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a1a3d51-8284-4dbf-9863-ba7b0ec9708c tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.180655 Nov 03 03:57:10.265093 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 753/1557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:10 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:10.636518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:10.637833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:10.652411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:10.654937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:10.659714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:10.660474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:10.661558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:10.665433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:10.668093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:10.668757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:10.671801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:10.677837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:10.678309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:10.679129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:10.679607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:10.680041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:10.763718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:11.247523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:11.260839 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0103f1f-aa54-46b1-a818-41bc89546fee tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.614402 Nov 03 03:57:11.263929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:11.264852 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 754/1558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:10 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:57:11.272996 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-32efcbc8-0093-4d60-b6c7-a75a5257397d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1500 microversion: 2.1 time: 0.650635 Nov 03 03:57:11.278156 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 805/1559] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:10 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1500 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:11.302867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:11.303481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:11.304024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:11.304161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:11.318851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:11.325257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:11.325871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:11.326335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:11.326506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:11.327081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:11.327309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:11.327539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:11.327974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:11.328730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:11.329431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:11.330041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:11.672695 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05373e92-eb17-4723-9cc1-3da697c78f8b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.372890 Nov 03 03:57:11.673675 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 806/1560] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:11 2022] POST /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:57:11.686498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:11.687236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:11.718858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:11.719648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:11.720281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:11.721233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:11.721866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:11.722622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:11.830779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:11.846293 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d182c606-cfee-48a4-b59f-e40203ee2863 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.546606 Nov 03 03:57:11.861044 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 755/1561] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:11 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:12.189233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:12.202706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad66575e-a9ef-432b-a74e-849bc6f1b590 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1505 microversion: 2.1 time: 0.524337 Nov 03 03:57:12.203666 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 807/1562] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:11 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:12.291863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:12.292748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:12.304382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:12.307854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:12.308664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:12.309508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:12.312722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:12.313943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:12.488682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] Calling method '.version_select at 0x7ff7f972a820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:12.505671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:12.506171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:12.506620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:12.509663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:12.514131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:12.514131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:12.546383 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e1935d8-49b5-4220-9b59-0070a1919c3c tempest-AbsoluteLimitsTestJSON-1951324236 tempest-AbsoluteLimitsTestJSON-1951324236-project] 10.222.0.30 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.343590 Nov 03 03:57:12.570724 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 756/1563] 10.222.0.30 () {58 vars in 1122 bytes} [Thu Nov 3 03:57:12 2022] GET /compute/v2.1/limits => generated 511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:12.875874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:12.876555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:12.886710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:12.887220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:12.887657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:12.893678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:12.895459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:12.895913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:12.969870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:12.984658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0b6aa25-ea46-40ef-a397-6f83dda33f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.696317 Nov 03 03:57:12.991313 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 808/1564] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:12 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:57:13.241168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:13.242113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:13.257795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:13.259819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:13.260481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:13.278445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:13.279905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:13.281170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:13.282436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:13.311577 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-49edee1f-a568-4929-accb-d143a40a8a10 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.430216 Nov 03 03:57:13.315392 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 757/1565] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:12 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:13.338301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-683021281", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "2752c8c3-e485-420b-a57b-73b9e6895e51"}], "security_groups": [{"name": "tempest-securitygroup--18603916"}], "key_name": "tempest-keypair-1018292931", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:13.622453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] validate_networks() for [('2752c8c3-e485-420b-a57b-73b9e6895e51', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:57:13.962473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:13.974395 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a83cf4d2-7e38-40e2-94fc-f98a9ef619d8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1485 microversion: 2.1 time: 0.748067 Nov 03 03:57:13.976675 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 809/1566] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:13 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1485 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:14.001766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:14.002368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:14.010903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:14.015823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.016620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.017425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.018495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.019139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.019753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.063948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:57:14.453300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:57:14.453810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:57:14.454341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:57:14.454849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:57:14.455393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:57:14.477163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.478795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.488088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.489814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.490695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.493232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.498996 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9d7ed8e6-3d72-4c54-a334-35fc9785149c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 204 len: 0 microversion: 2.1 time: 0.500809 Nov 03 03:57:14.499684 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 810/1567] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:57:13 2022] DELETE /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:14.506665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:14.507470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:14.516921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:14.521819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.524448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.525759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for user 7ebbc13908db44e88853d5c14c8e2102 and project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:14.526513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.527396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.530968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.535526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.545958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:57:14.548315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:57:14.732426 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-306e2681-299a-431f-9d2b-9d620092121a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 1.415625 Nov 03 03:57:14.733104 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 758/1568] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 03:57:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 03:57:14.746814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:14.754218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:14.776796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.777334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.777781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.778488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.783090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.783090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.784199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:14.812067 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-053ed9a4-6029-4135-898d-f1f45c5fce26 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.310241 Nov 03 03:57:14.814898 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 811/1569] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:14 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:14.828543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:14.830511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:14.849539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.850356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.851354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:14.852413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:14.855656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:14.857852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:15.291126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:15.315657 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a49011a4-7d14-4b55-b25e-7dd9246033f1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.573325 Nov 03 03:57:15.319892 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 759/1570] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:14 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:15.343510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d3766a9-bc23-43de-a2a7-eadad2b34643 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:15.343510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d3766a9-bc23-43de-a2a7-eadad2b34643 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:15.421695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:15.424619 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92611ac3-a3a8-4bdf-a6f8-b7eceb71efca tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1491 microversion: 2.1 time: 0.607934 Nov 03 03:57:15.441621 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 812/1571] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:14 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1491 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:15.516470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d3766a9-bc23-43de-a2a7-eadad2b34643 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:15.528935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d3766a9-bc23-43de-a2a7-eadad2b34643 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:15.530427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d3766a9-bc23-43de-a2a7-eadad2b34643 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:15.534237 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d3766a9-bc23-43de-a2a7-eadad2b34643 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1285 microversion: 2.25 time: 0.207818 Nov 03 03:57:15.539155 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 760/1572] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:15 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:15.608328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e935a92-b9be-4b18-83e9-9e7002044c22 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Action: 'create', calling method: .version_select at 0x7ff7f90fbee0>, body: {"keypair": {"name": "tempest-keypair-2101536118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjtM5iKFmZYQpmDihgzu0H0sk7W3vlUlbM5yoXsCblKP4fpgg40czH5oNfCdeS4Un9YjrpvfJZX2OylziG395JjxG6FLRFsuxmGWXEC4L+GwiPqTESHtXMO/yGE5dkV5g=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:15.630428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6d25428f-2a40-4ab9-85a2-3073ae69cbcb req-5f5bc316-fd91-4a30-8ff2-1df912814a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b39feb3-5f40-46b0-85f8-b17042ace49f", "name": "network-vif-plugged", "status": "completed", "tag": "e5434394-729e-48d4-90d4-8a47f965e59e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:15.665992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5e935a92-b9be-4b18-83e9-9e7002044c22 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Getting quotas for project 443306a268084a118f8f88b6a85220bb. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:15.670264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6d25428f-2a40-4ab9-85a2-3073ae69cbcb req-5f5bc316-fd91-4a30-8ff2-1df912814a4e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:15.677161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6d25428f-2a40-4ab9-85a2-3073ae69cbcb req-5f5bc316-fd91-4a30-8ff2-1df912814a4e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:15.677161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6d25428f-2a40-4ab9-85a2-3073ae69cbcb req-5f5bc316-fd91-4a30-8ff2-1df912814a4e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:15.684897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5e935a92-b9be-4b18-83e9-9e7002044c22 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Getting quotas for user d19de6967f614510ab082f1a005a9b09 and project 443306a268084a118f8f88b6a85220bb. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:15.700408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6d25428f-2a40-4ab9-85a2-3073ae69cbcb req-5f5bc316-fd91-4a30-8ff2-1df912814a4e service nova] Creating event network-vif-plugged:e5434394-729e-48d4-90d4-8a47f965e59e for instance 7b39feb3-5f40-46b0-85f8-b17042ace49f on n-h1-854653-7 Nov 03 03:57:15.718001 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6d25428f-2a40-4ab9-85a2-3073ae69cbcb req-5f5bc316-fd91-4a30-8ff2-1df912814a4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092773 Nov 03 03:57:15.720757 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 761/1573] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:57:15.829574 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e935a92-b9be-4b18-83e9-9e7002044c22 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.225873 Nov 03 03:57:15.836186 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 813/1574] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 03:57:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 03:57:15.841427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:15.842230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:15.848943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:15.856758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:15.861956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:15.862925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:15.865903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:15.865903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:16.354265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:16.355107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:16.381421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:16.382918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:16.384687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:16.391307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:16.391820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:16.392281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:16.654652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:16.663357 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-46d692c0-aaf2-482f-88e9-d33b5b0866d3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1323 microversion: 2.1 time: 0.827254 Nov 03 03:57:16.663975 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 762/1575] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:15 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1323 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:16.676560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:16.681767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:16.694002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:16.694503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:16.694945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:16.710481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:16.711312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:16.711962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:17.113292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:17.134130 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-639329c4-b6bc-4844-b37e-b035be355179 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.788641 Nov 03 03:57:17.143841 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 814/1576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:16 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:17.163985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:17.170887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:17.209652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:17.213182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:17.213669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:17.215893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:17.218667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:17.219192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:17.777687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:17.790878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:17.792643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:17.800097 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c24de9f-cbc7-4e93-8f37-8595ae15999a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1281 microversion: 2.25 time: 0.655053 Nov 03 03:57:17.802851 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 815/1577] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:17 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1281 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:17.821657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:17.822646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:17.843157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:17.846388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:17.847279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:17.848270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:17.852487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:17.853248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:17.977171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:17.990631 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-703ef4a7-0154-4a52-8b87-08e7537d61e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1491 microversion: 2.1 time: 1.318899 Nov 03 03:57:18.013443 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 763/1578] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:16 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1491 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:18.177342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:18.178162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:18.186777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:18.187572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:18.188012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:18.188731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:18.189210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:18.189807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:18.413660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:18.428296 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36084733-fb51-4530-84e3-0f8385714b7e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 200 len: 1518 microversion: 2.1 time: 0.623674 Nov 03 03:57:18.429233 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 816/1579] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:17 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 1518 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:18.560688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:18.582586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-003d2595-87ba-4907-8869-c6031956f527 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.401331 Nov 03 03:57:18.582586 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 764/1580] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:18 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:57:18.582586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'action', calling method: .version_select at 0x7ff7fb948e50>, body: {"addFloatingIp": {"address": "172.25.8.22"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:18.583357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:18.603105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:18.603878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:18.604704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:18.605708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:18.608191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:18.608913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:18.624602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-185f99af-e4fe-4fa0-91ff-925bc3672c54 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Action: 'create', calling method: .version_select at 0x7ff7f9088ca0>, body: {"keypair": {"name": "tempest-keypair-1207748112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFTvEkVx94lFWIO1vWXnsr4XifuezNa9qQ96vs9c5zOHonFU4gI16eex8UEnpklMfXvD6tMmzwtNz8U4Ua03hIF0ApnQG0aHzOSiKkRLQyGEL66u5Q6XLVdRk7LBg1xNw=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:18.655352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:57:18.656508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquired lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:57:18.667642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=49 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:18.671936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-185f99af-e4fe-4fa0-91ff-925bc3672c54 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Getting quotas for project f5cc47f0d35441a6a4df71a38f8eafc4. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:18.679425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-185f99af-e4fe-4fa0-91ff-925bc3672c54 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Getting quotas for user b95768d61a4e40f89aec9d956a4a7d18 and project f5cc47f0d35441a6a4df71a38f8eafc4. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:18.877296 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-185f99af-e4fe-4fa0-91ff-925bc3672c54 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446917 Nov 03 03:57:18.882872 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 817/1581] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 03:57:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:18.896260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:18.897982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:18.909252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:18.910051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:18.910691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:18.911600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:18.912225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:18.912856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:19.127463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:19.137626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:19.139462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:19.142070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-70b0dce0-14bd-4fdd-8221-55614efa33e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1345 microversion: 2.25 time: 0.255964 Nov 03 03:57:19.144485 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 818/1582] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:18 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1345 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:19.155158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:19.156243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:19.167532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:19.168281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:19.168902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:19.169924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:19.170655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:19.171299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:19.354906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:19.385131 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23ab033a-f6b1-4aff-a0ea-370b08a42007 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1449 microversion: 2.1 time: 0.238028 Nov 03 03:57:19.386526 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 819/1583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:19 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1449 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:19.402889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a6d84ab7-d3b0-4207-82db-e03672b35515 req-4db05663-4f2f-4314-997e-f0f71697189d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac", "name": "network-vif-deleted", "tag": "2bc27388-07a0-4e9f-8c2c-4a2ad6f8e220"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:19.419554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6d84ab7-d3b0-4207-82db-e03672b35515 req-4db05663-4f2f-4314-997e-f0f71697189d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:19.420889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6d84ab7-d3b0-4207-82db-e03672b35515 req-4db05663-4f2f-4314-997e-f0f71697189d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:19.421923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6d84ab7-d3b0-4207-82db-e03672b35515 req-4db05663-4f2f-4314-997e-f0f71697189d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:19.436318 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a6d84ab7-d3b0-4207-82db-e03672b35515 req-4db05663-4f2f-4314-997e-f0f71697189d service nova] Creating event network-vif-deleted:2bc27388-07a0-4e9f-8c2c-4a2ad6f8e220 for instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac on n-h1-854653-7 Nov 03 03:57:19.447488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a6d84ab7-d3b0-4207-82db-e03672b35515 req-4db05663-4f2f-4314-997e-f0f71697189d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057607 Nov 03 03:57:19.448146 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 820/1584] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:19.600082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:19.600807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:19.614095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:19.620351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:19.620351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:19.623966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:19.624943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:19.625831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:20.040867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:20.058535 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40310d06-4170-4f3f-b8cd-83a6a5eb266a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.463571 Nov 03 03:57:20.074022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 821/1585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:19 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:57:20.170719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:20.171353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:20.187748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:20.212582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:20.212582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:20.212582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:20.212582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:20.212582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:20.279310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:20.670402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:20.689039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:20.692110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:20.695282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99c19a5d-dbf4-4c99-940b-e7d739dd19fc tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1409 microversion: 2.25 time: 0.528959 Nov 03 03:57:20.705509 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 822/1586] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:20 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1409 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:57:20.722888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:20.723850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:20.737946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:20.738559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:20.739050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:20.740915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:20.741882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:20.744070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:20.802111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:20.804313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:20.805006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:20.805812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lazy-loading 'fault' on Instance uuid bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:57:20.946371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:20.959837 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c3fccb4-6610-46cb-b449-2581c904c38e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 200 len: 1304 microversion: 2.1 time: 0.254025 Nov 03 03:57:20.978637 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 823/1587] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:20 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 1304 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:21.088110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:21.089673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:21.097467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:21.097963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:21.100346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:21.103920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:21.109848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:21.110827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:21.239373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Building network info cache for instance {{(pid=127593) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:57:21.411365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:21.421956 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abc557b0-be65-479e-8877-28c3f84122d5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.340614 Nov 03 03:57:21.436075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 824/1588] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:21 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:57:21.495025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4c055808-a874-4581-b019-bd861e3852c7 req-4955de98-4af3-4202-b224-a8c6e7faf95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabcad71-c1df-46e2-ac26-6e32ad072279", "tag": "b5dcbf93-99c7-4090-acd4-0c6607cfd984"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:21.518753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c055808-a874-4581-b019-bd861e3852c7 req-4955de98-4af3-4202-b224-a8c6e7faf95b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:21.519554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c055808-a874-4581-b019-bd861e3852c7 req-4955de98-4af3-4202-b224-a8c6e7faf95b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:21.520814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c055808-a874-4581-b019-bd861e3852c7 req-4955de98-4af3-4202-b224-a8c6e7faf95b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:21.538869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4c055808-a874-4581-b019-bd861e3852c7 req-4955de98-4af3-4202-b224-a8c6e7faf95b service nova] Creating event network-changed:b5dcbf93-99c7-4090-acd4-0c6607cfd984 for instance dabcad71-c1df-46e2-ac26-6e32ad072279 on n-h2-854653-7 Nov 03 03:57:21.545522 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4c055808-a874-4581-b019-bd861e3852c7 req-4955de98-4af3-4202-b224-a8c6e7faf95b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056539 Nov 03 03:57:21.546830 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 825/1589] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:57:21.730132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:21.732012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:21.747528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:21.748257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:21.748894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:21.752651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:21.753394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:21.754006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:22.048466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:22.058182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:22.068454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:22.070197 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08f28e6c-35dc-47eb-a988-f710a9d2b2e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1409 microversion: 2.25 time: 0.344916 Nov 03 03:57:22.071162 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 826/1590] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:21 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1409 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:57:22.083441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:22.084842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:22.101274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:22.103338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:22.103964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:22.105724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:22.107574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:22.108587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:22.147843 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac HTTP/1.1 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac'} Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:22.154367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:57:22.160559 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:22.160559 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:22.160559 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:22.160559 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:57:22.160559 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:57:22.160559 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 03:57:22.160559 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:57:22.167020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:57:22.171457 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3adefa5f-cf1a-444f-872d-748b2e17c052 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 404 len: 111 microversion: 2.1 time: 0.099019 Nov 03 03:57:22.172284 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 827/1591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:22 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:57:22.385265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2013814555", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "25261195-157d-4c7b-8cfb-4fb3b385217e"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:22.471664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] validate_networks() for [('25261195-157d-4c7b-8cfb-4fb3b385217e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:57:23.684734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Updating instance_info_cache with network_info: [{"id": "b5dcbf93-99c7-4090-acd4-0c6607cfd984", "address": "fa:16:3e:0f:3f:a4", "network": {"id": "104b7573-1057-4ee0-9f14-0c79e9b07517", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-699465872-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69c5a88467bb4b5ca79bfb7562dbf79b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5dcbf93-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127593) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:57:23.756287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:57:23.757558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:57:23.758861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:57:23.759858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:57:23.760516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:57:23.768635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Releasing lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:57:23.768635 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15e43710-944f-4c5c-9cc6-1d8fbd75fdd4 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action" status: 202 len: 0 microversion: 2.1 time: 5.189829 Nov 03 03:57:23.768635 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 765/1592] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:18 2022] POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action => generated 0 bytes in 5191 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 03:57:23.773252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:23.774330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:23.774483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:23.775413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:23.776082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:23.777400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:23.778346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:23.779011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:23.784754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:23.785524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:23.786155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:23.787046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:23.787675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:23.788268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:23.802341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:23.815808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for user baa7ebbbe2c14c82b5a07fef33cc214a and project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:23.860113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:57:23.860113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:57:23.980854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:23.991582 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2048848-7069-44df-bd87-d5b32615c8b7 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.223942 Nov 03 03:57:24.009341 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 766/1593] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:23 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:24.015764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-284194539", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "04b3e38a-7053-4081-bdcb-fd228f978533"}, {"port": "10aaf744-8389-4a5f-bbf5-24d2b6985728", "tag": "port-1"}, {"port": "6c1d02ee-1303-4e41-b729-563e50f0984f", "tag": "port-2"}, {"uuid": "19a6e1e2-58cc-4288-8c5e-472db18e6880", "tag": "net-1"}, {"uuid": "19a6e1e2-58cc-4288-8c5e-472db18e6880"}, {"uuid": "44ec91a5-da5b-4a8d-9959-840a8cf51232", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "44ec91a5-da5b-4a8d-9959-840a8cf51232", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "aacf38ed-938a-404d-8fcb-63b0839bbd0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d233a96e-d3bf-4df5-8b73-bfb0566665e7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "08076445-6770-456a-a2fe-618b1617426e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--613263432"}], "key_name": "tempest-keypair-2101536118", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:24.053194 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-365d30e0-02c9-42ec-9693-33b6d1ad0388 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.672832 Nov 03 03:57:24.064221 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 828/1594] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:57:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:57:24.069354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:24.069984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:24.114417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:24.118567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:24.120675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:24.121697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:24.124590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:24.125535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:24.171408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] validate_networks() for [('04b3e38a-7053-4081-bdcb-fd228f978533', None, None, None, None, None), (None, None, '10aaf744-8389-4a5f-bbf5-24d2b6985728', None, None, None), (None, None, '6c1d02ee-1303-4e41-b729-563e50f0984f', None, None, None), ('19a6e1e2-58cc-4288-8c5e-472db18e6880', None, None, None, None, None), ('19a6e1e2-58cc-4288-8c5e-472db18e6880', None, None, None, None, None), ('44ec91a5-da5b-4a8d-9959-840a8cf51232', '10.2.2.100', None, None, None, None), ('44ec91a5-da5b-4a8d-9959-840a8cf51232', '10.2.2.200', None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:57:24.438489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:24.455889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:24.457851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:24.459139 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6563ad08-c369-4535-8394-2407ef6200f6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1409 microversion: 2.25 time: 0.393750 Nov 03 03:57:24.478109 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 829/1595] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:24 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:24.486382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-52c6fbdc-812e-4c94-8b08-c2ee7ed4ebc3 req-e9a799d6-fe1b-4566-a3b3-39582342a0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed94eeeb-28e0-4472-8d19-c980456ffa0f", "tag": "936b3ab5-5256-4926-b068-f44770180c56"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:24.496619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-52c6fbdc-812e-4c94-8b08-c2ee7ed4ebc3 req-e9a799d6-fe1b-4566-a3b3-39582342a0c4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:24.497235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-52c6fbdc-812e-4c94-8b08-c2ee7ed4ebc3 req-e9a799d6-fe1b-4566-a3b3-39582342a0c4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:24.498453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-52c6fbdc-812e-4c94-8b08-c2ee7ed4ebc3 req-e9a799d6-fe1b-4566-a3b3-39582342a0c4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:24.505791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:24.512536 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-52c6fbdc-812e-4c94-8b08-c2ee7ed4ebc3 req-e9a799d6-fe1b-4566-a3b3-39582342a0c4 service nova] Creating event network-changed:936b3ab5-5256-4926-b068-f44770180c56 for instance ed94eeeb-28e0-4472-8d19-c980456ffa0f on n-h1-854653-7 Nov 03 03:57:24.518325 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-52c6fbdc-812e-4c94-8b08-c2ee7ed4ebc3 req-e9a799d6-fe1b-4566-a3b3-39582342a0c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038607 Nov 03 03:57:24.519412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 830/1596] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:24.527386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.22"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:24.530938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:24.538412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:24.539271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:24.539817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:24.540664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:24.541265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:24.541801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:24.579664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "refresh_cache-7b39feb3-5f40-46b0-85f8-b17042ace49f" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:57:24.580365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquired lock "refresh_cache-7b39feb3-5f40-46b0-85f8-b17042ace49f" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:57:25.519492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=25 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:28.215127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.neutron [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] re-assign floating IP 172.25.8.22 from instance dabcad71-c1df-46e2-ac26-6e32ad072279 Nov 03 03:57:28.341440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Building network info cache for instance {{(pid=127594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:57:28.705326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:57:28.706680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:57:28.707457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:57:28.708183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:57:28.708769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:57:28.736412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:28.737431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:28.738056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:28.742799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:28.743401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:28.744183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:28.824734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Getting quotas for project 443306a268084a118f8f88b6a85220bb. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:28.842271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Getting quotas for user d19de6967f614510ab082f1a005a9b09 and project 443306a268084a118f8f88b6a85220bb. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:29.271748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:57:29.281302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='aacf38ed-938a-404d-8fcb-63b0839bbd0f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d233a96e-d3bf-4df5-8b73-bfb0566665e7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08076445-6770-456a-a2fe-618b1617426e',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:57:29.315619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Updating instance_info_cache with network_info: [{"id": "b5dcbf93-99c7-4090-acd4-0c6607cfd984", "address": "fa:16:3e:0f:3f:a4", "network": {"id": "104b7573-1057-4ee0-9f14-0c79e9b07517", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-699465872-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69c5a88467bb4b5ca79bfb7562dbf79b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5dcbf93-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:57:29.409390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Building network info cache for instance {{(pid=127594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:57:30.860362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-17077a69-5831-4896-a9f0-2ec377ba401c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.849681 Nov 03 03:57:30.869846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 767/1597] 10.222.0.30 () {62 vars in 1189 bytes} [Thu Nov 3 03:57:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 6860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 03:57:30.877885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:30.880402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:30.902570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:30.903081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:30.903535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:30.905960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:30.906461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:30.906977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:30.960217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:31.062754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Updating instance_info_cache with network_info: [{"id": "e5434394-729e-48d4-90d4-8a47f965e59e", "address": "fa:16:3e:bd:bd:1d", "network": {"id": "104b7573-1057-4ee0-9f14-0c79e9b07517", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-699465872-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69c5a88467bb4b5ca79bfb7562dbf79b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape5434394-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:57:31.104878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.116262 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c1d3cc0-e2e5-4543-9932-d0a2c6d803b2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1273 microversion: 2.1 time: 0.244876 Nov 03 03:57:31.120145 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 768/1598] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:30 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:31.181961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Releasing lock "refresh_cache-7b39feb3-5f40-46b0-85f8-b17042ace49f" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:57:31.183191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e11f222-ebc7-4932-97ab-67e17bb4012e tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f/action" status: 202 len: 0 microversion: 2.1 time: 6.662344 Nov 03 03:57:31.183903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 831/1599] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:24 2022] POST /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f/action => generated 0 bytes in 6664 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 03:57:31.191019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:31.192169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:31.217097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:31.224955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:31.226096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:31.228061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:31.234313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:31.241131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:31.394670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:31.395606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:31.412966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:31.420053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:31.420653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:31.427723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:31.428085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:31.428550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:31.582613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.608494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.608494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.629372 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd0e802e-5bc0-455e-94e6-53d106857af8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1409 microversion: 2.25 time: 0.440324 Nov 03 03:57:31.631315 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 832/1600] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:31 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:31.656674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e5ebcd8e-ed16-42dc-8794-36d5a2a92a3a req-4743ed90-3678-4771-adc8-bae2310788e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabcad71-c1df-46e2-ac26-6e32ad072279", "tag": "b5dcbf93-99c7-4090-acd4-0c6607cfd984"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:31.727368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e5ebcd8e-ed16-42dc-8794-36d5a2a92a3a req-4743ed90-3678-4771-adc8-bae2310788e4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:31.728648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e5ebcd8e-ed16-42dc-8794-36d5a2a92a3a req-4743ed90-3678-4771-adc8-bae2310788e4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:31.729139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e5ebcd8e-ed16-42dc-8794-36d5a2a92a3a req-4743ed90-3678-4771-adc8-bae2310788e4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:31.783453 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e5ebcd8e-ed16-42dc-8794-36d5a2a92a3a req-4743ed90-3678-4771-adc8-bae2310788e4 service nova] Creating event network-changed:b5dcbf93-99c7-4090-acd4-0c6607cfd984 for instance dabcad71-c1df-46e2-ac26-6e32ad072279 on n-h2-854653-7 Nov 03 03:57:31.801448 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e5ebcd8e-ed16-42dc-8794-36d5a2a92a3a req-4743ed90-3678-4771-adc8-bae2310788e4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163638 Nov 03 03:57:31.801448 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 833/1601] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:31.808151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e3a0c7c-da2d-4235-b6ae-01731b003724 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:31.812539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e3a0c7c-da2d-4235-b6ae-01731b003724 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:31.929184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.966052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e3a0c7c-da2d-4235-b6ae-01731b003724 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.970268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ba7e18d-3cc1-46ec-9880-93a965ef381a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.851426 Nov 03 03:57:31.972785 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 769/1602] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:31 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:31.978879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.22"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:31.990849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e3a0c7c-da2d-4235-b6ae-01731b003724 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.998657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e3a0c7c-da2d-4235-b6ae-01731b003724 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:31.999887 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e3a0c7c-da2d-4235-b6ae-01731b003724 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1285 microversion: 2.32 time: 0.198823 Nov 03 03:57:32.001227 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 834/1603] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:31 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:32.015913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-304834132", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f004922e-d064-49aa-9c71-6a282c3fe25b"}], "block_device_mapping_v2": [{"uuid": "dae175af-6265-4034-bc78-14969f889d75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:32.144776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] validate_networks() for [('f004922e-d064-49aa-9c71-6a282c3fe25b', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:57:32.490482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:32.499911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:32.500433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:32.501970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:32.502712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:32.503754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:32.505251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:33.261341 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] HTTP exception thrown: Floating IP 172.25.8.22 is not associated with instance dabcad71-c1df-46e2-ac26-6e32ad072279. Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Request method failure captured: Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action HTTP/1.1 Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 48 Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzvgf3Isik4oH_Sex04frMNCYESYheGYSWxWi13ZArTMaLdrYFi30l5PNy64JApEL0v7iSocWoOyGpYltj0OxW1eUYxviNAFX_2ncNLchI89XYh57A17AR67yTOVGfKu00kYGuYpJbZG9M2XJ-GwyFgFkccm6ScVotwaBw7vhwM5gSc Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_69c5a88467bb4b5ca79bfb7562dbf79b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/69c5a88467bb4b5ca79bfb7562dbf79b"}]}] Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 71097a5704904531909e6adfdbbae98a Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: {"removeFloatingIp": {"address": "172.25.8.22"}} Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: exception: Floating IP 172.25.8.22 is not associated with instance dabcad71-c1df-46e2-ac26-6e32ad072279. Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'dabcad71-c1df-46e2-ac26-6e32ad072279', 'body': {'removeFloatingIp': {'address': '172.25.8.22'}}} Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.8.22 is not associated with instance dabcad71-c1df-46e2-ac26-6e32ad072279. Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.8.22 is not associated with instance dabcad71-c1df-46e2-ac26-6e32ad072279. Nov 03 03:57:33.267021 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:33.274520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Returning 409 to user: Floating IP 172.25.8.22 is not associated with instance dabcad71-c1df-46e2-ac26-6e32ad072279. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:57:33.275531 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-289c7f36-c5d9-48e2-baa0-3f6ca4f1b716 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action" status: 409 len: 145 microversion: 2.1 time: 1.301383 Nov 03 03:57:33.276573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 770/1604] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:31 2022] POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action => generated 145 bytes in 1303 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:57:33.283625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-fefbc66f-538d-4100-a60a-dee838c1c0c7 req-b1347da0-3b6b-42dd-9e15-9524a115a85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed94eeeb-28e0-4472-8d19-c980456ffa0f", "name": "network-vif-plugged", "status": "completed", "tag": "936b3ab5-5256-4926-b068-f44770180c56"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:33.297301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fefbc66f-538d-4100-a60a-dee838c1c0c7 req-b1347da0-3b6b-42dd-9e15-9524a115a85a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:33.297988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fefbc66f-538d-4100-a60a-dee838c1c0c7 req-b1347da0-3b6b-42dd-9e15-9524a115a85a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:33.299429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fefbc66f-538d-4100-a60a-dee838c1c0c7 req-b1347da0-3b6b-42dd-9e15-9524a115a85a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:33.317208 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-fefbc66f-538d-4100-a60a-dee838c1c0c7 req-b1347da0-3b6b-42dd-9e15-9524a115a85a service nova] Creating event network-vif-plugged:936b3ab5-5256-4926-b068-f44770180c56 for instance ed94eeeb-28e0-4472-8d19-c980456ffa0f on n-h1-854653-7 Nov 03 03:57:33.324490 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-fefbc66f-538d-4100-a60a-dee838c1c0c7 req-b1347da0-3b6b-42dd-9e15-9524a115a85a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046178 Nov 03 03:57:33.325823 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 771/1605] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:33.332037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:33.333046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:33.346111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:33.346863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:33.348481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:33.349638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:33.350284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:33.350941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:33.631046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:57:33.631516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:57:33.633264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:57:33.633781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:57:33.634211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:57:33.656719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:33.657261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:33.657711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:33.665802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:33.666309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:33.671987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:33.713642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:33.716130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:33.722581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Getting quotas for user c4a4d4a61500400faf673aa67ff8be39 and project 71461e876c80455aa1875086a2ec4f49. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:33.803369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:57:33.805876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dae175af-6265-4034-bc78-14969f889d75',volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:57:33.862678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:33.876663 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0045b45f-b7f2-4352-a779-a1ab949c5b6a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1315 microversion: 2.1 time: 0.548970 Nov 03 03:57:33.885883 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 772/1606] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:33 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:33.896771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:33.898053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:33.905274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:33.906081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:33.906716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:33.908174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:33.908826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:33.909469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:34.201804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:34.214562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:34.223273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:34.224460 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e7a78106-df14-4246-9173-36f9cc410be3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1409 microversion: 2.25 time: 0.337324 Nov 03 03:57:34.225057 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 773/1607] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:33 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:34.252813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:34.253613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:34.261206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:34.263097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:34.264244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:34.264990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:34.265666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:34.266382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:34.333815 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a7146a4-9829-4654-b8e9-a9f44c348f2c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.331474 Nov 03 03:57:34.341314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 835/1608] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:57:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:57:34.341314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:34.342169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:34.352377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:34.353350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:34.354032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:34.354935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:34.355655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:34.356265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:34.542866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:34.560113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:34.564971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:34.568330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87d062d4-69dc-40b9-a99c-5ca044feb605 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1575 microversion: 2.32 time: 0.231665 Nov 03 03:57:34.581983 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 836/1609] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:34 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:34.591078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.22"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:34.616604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:34.626258 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f4c89f5-d912-42f5-831d-632b6f7687d1 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.400120 Nov 03 03:57:34.633464 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 774/1610] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:34 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:34.739772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1897433746", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "8b1a0df9-1430-4d75-808f-0eea0b4a725f"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:34.822874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:34.828910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:34.829643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:34.830270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:34.831410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:34.832045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:34.834047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:34.847432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] validate_networks() for [('8b1a0df9-1430-4d75-808f-0eea0b4a725f', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:57:35.343718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "refresh_cache-7b39feb3-5f40-46b0-85f8-b17042ace49f" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:57:35.343718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquired lock "refresh_cache-7b39feb3-5f40-46b0-85f8-b17042ace49f" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:57:36.284280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:57:36.285463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:57:36.286765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:57:36.290737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:57:36.291498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:57:36.307063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.308665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.309484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:36.310555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.311270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.312102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:36.350377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Getting quotas for project 9c4c175083ac4fe59f2b706bbab5465b. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:57:36.356994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Getting quotas for user 448b231b25c244a6a331d0b87966cceb and project 9c4c175083ac4fe59f2b706bbab5465b. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:57:36.390954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:57:36.393850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:57:36.431736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:36.593881 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b991b1fe-f7a8-40f1-bad0-85f5a1e2c73c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.952385 Nov 03 03:57:36.601650 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 775/1611] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:57:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:57:36.618928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-dea83548-fed0-4f5d-b174-091dac365498 req-b8b881f3-6f7d-4be7-8b86-d2e1b184d097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328fceff-bafd-4b2a-a220-f1f9d57deb42", "tag": "5b7b0984-1390-4bb9-b7a9-feef1a456443"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:36.638405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dea83548-fed0-4f5d-b174-091dac365498 req-b8b881f3-6f7d-4be7-8b86-d2e1b184d097 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.643375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dea83548-fed0-4f5d-b174-091dac365498 req-b8b881f3-6f7d-4be7-8b86-d2e1b184d097 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.643375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dea83548-fed0-4f5d-b174-091dac365498 req-b8b881f3-6f7d-4be7-8b86-d2e1b184d097 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:36.655337 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-dea83548-fed0-4f5d-b174-091dac365498 req-b8b881f3-6f7d-4be7-8b86-d2e1b184d097 service nova] Creating event network-changed:5b7b0984-1390-4bb9-b7a9-feef1a456443 for instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 on n-h1-854653-7 Nov 03 03:57:36.664905 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-dea83548-fed0-4f5d-b174-091dac365498 req-b8b881f3-6f7d-4be7-8b86-d2e1b184d097 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061177 Nov 03 03:57:36.666299 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 776/1612] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:36.674079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b0aaaef9-64e3-4937-a6c9-fe50ec1843b7 req-6832cb5b-70e3-4d8b-8f3b-d2a9992c152b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b39feb3-5f40-46b0-85f8-b17042ace49f", "tag": "e5434394-729e-48d4-90d4-8a47f965e59e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:36.685887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b0aaaef9-64e3-4937-a6c9-fe50ec1843b7 req-6832cb5b-70e3-4d8b-8f3b-d2a9992c152b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.687331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b0aaaef9-64e3-4937-a6c9-fe50ec1843b7 req-6832cb5b-70e3-4d8b-8f3b-d2a9992c152b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.688027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b0aaaef9-64e3-4937-a6c9-fe50ec1843b7 req-6832cb5b-70e3-4d8b-8f3b-d2a9992c152b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:36.702251 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b0aaaef9-64e3-4937-a6c9-fe50ec1843b7 req-6832cb5b-70e3-4d8b-8f3b-d2a9992c152b service nova] Creating event network-changed:e5434394-729e-48d4-90d4-8a47f965e59e for instance 7b39feb3-5f40-46b0-85f8-b17042ace49f on n-h1-854653-7 Nov 03 03:57:36.708972 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b0aaaef9-64e3-4937-a6c9-fe50ec1843b7 req-6832cb5b-70e3-4d8b-8f3b-d2a9992c152b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040928 Nov 03 03:57:36.709914 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 777/1613] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:36.719081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:36.720192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:36.727821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.728697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.730844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:36.730844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.731317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.732055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:36.880110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:36.890700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df6ab4cc-fd8d-4fc7-98ab-0f7690bb0d23 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1150 microversion: 2.1 time: 0.179228 Nov 03 03:57:36.891285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 778/1614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:36 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1150 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:36.911298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:36.919181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:36.926584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.930120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.934572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:36.939390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:36.940053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:36.942711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:37.272993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:37.281434 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87e4ec13-33d7-4fad-8498-73b3c70811e1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1315 microversion: 2.1 time: 0.388572 Nov 03 03:57:37.281679 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 779/1615] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:36 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:37.286302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:37.287589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:37.295546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:37.296689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:37.297427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:37.298396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:37.299087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:37.299757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:37.610354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Building network info cache for instance {{(pid=127594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:57:37.631084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:37.647684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:37.652780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:37.661372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1669adbb-0ccd-46d1-9248-a363d8deffc4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1605 microversion: 2.25 time: 0.371891 Nov 03 03:57:37.661372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 780/1616] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:37 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1605 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:37.676424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:37.678548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:37.694610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:37.696948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:37.697538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:37.699527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:37.700482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:37.702302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:37.996147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:38.012344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:38.013888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:38.015074 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-732195c8-4620-456b-9259-b3cebdd9ad0c tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1593 microversion: 2.32 time: 0.359155 Nov 03 03:57:38.020208 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 781/1617] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:37 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1593 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:38.028973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:38.031773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:38.062058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.062566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.063015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:38.063749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.064211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.064646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:38.476431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:38.495838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70198373-b055-422b-bd04-90f43fa9083b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1476 microversion: 2.1 time: 0.474456 Nov 03 03:57:38.497179 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 782/1618] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:38 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1476 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:38.502040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:38.502874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:38.515563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.516951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.516951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:38.523650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.524104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.524536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:38.644819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:38.656233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70789a7c-fa44-4cf2-8937-96a7be33014b tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1229 microversion: 2.1 time: 0.157680 Nov 03 03:57:38.658192 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 783/1619] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:38 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:38.674139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:38.674690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:38.686903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.687446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.687895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:38.688764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.689260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.689698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:38.936833 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c9030ac-4108-492c-ad50-a7891ab87b7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.277507 Nov 03 03:57:38.949310 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 784/1620] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 03:57:38 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:57:38.963391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:38.967943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:38.971712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.972423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.973120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:38.974020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:38.974859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:38.975461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:39.571219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:39.579859 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d71bba5f-6d03-413c-862a-8925e21c8491 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1150 microversion: 2.1 time: 0.629317 Nov 03 03:57:39.598493 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 785/1621] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:38 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1150 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:39.598493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:39.598493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:39.612491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:39.613118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:39.613634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:39.614368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:39.614835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:39.615273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:40.385685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Updating instance_info_cache with network_info: [{"id": "e5434394-729e-48d4-90d4-8a47f965e59e", "address": "fa:16:3e:bd:bd:1d", "network": {"id": "104b7573-1057-4ee0-9f14-0c79e9b07517", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-699465872-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69c5a88467bb4b5ca79bfb7562dbf79b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape5434394-72", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:57:40.495226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Releasing lock "refresh_cache-7b39feb3-5f40-46b0-85f8-b17042ace49f" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:57:40.496878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82f8bce1-df58-461d-b07d-2461bc8a8a17 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f/action" status: 202 len: 0 microversion: 2.1 time: 5.924215 Nov 03 03:57:40.497889 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 837/1622] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:34 2022] POST /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f/action => generated 0 bytes in 5926 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 03:57:40.503178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-868faee4-426a-4398-8b22-c0bf8abf9ac9 req-70c3af80-b8cc-4871-bba9-fc9faa37b6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b39feb3-5f40-46b0-85f8-b17042ace49f", "tag": "e5434394-729e-48d4-90d4-8a47f965e59e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:40.525114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-868faee4-426a-4398-8b22-c0bf8abf9ac9 req-70c3af80-b8cc-4871-bba9-fc9faa37b6f8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:40.526977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-868faee4-426a-4398-8b22-c0bf8abf9ac9 req-70c3af80-b8cc-4871-bba9-fc9faa37b6f8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:40.528906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-868faee4-426a-4398-8b22-c0bf8abf9ac9 req-70c3af80-b8cc-4871-bba9-fc9faa37b6f8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:40.563439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-868faee4-426a-4398-8b22-c0bf8abf9ac9 req-70c3af80-b8cc-4871-bba9-fc9faa37b6f8 service nova] Creating event network-changed:e5434394-729e-48d4-90d4-8a47f965e59e for instance 7b39feb3-5f40-46b0-85f8-b17042ace49f on n-h1-854653-7 Nov 03 03:57:40.581392 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-868faee4-426a-4398-8b22-c0bf8abf9ac9 req-70c3af80-b8cc-4871-bba9-fc9faa37b6f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076942 Nov 03 03:57:40.588714 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 838/1623] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:40.607618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:40.611916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:40.627566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:40.631412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:40.636204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:40.638226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:40.639746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:40.641110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:41.163443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:41.181820 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c13efdaa-da4a-4762-a17e-82c6df7ed0c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1315 microversion: 2.1 time: 1.592108 Nov 03 03:57:41.184185 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 786/1624] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:39 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1315 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:41.208122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:41.211420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:41.224261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:41.255431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:41.255981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:41.258768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:41.260996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:41.260996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:41.270120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:41.271265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:41.273905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:41.276042 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0bc2ebdf-b0bb-4430-9925-822e440d54ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1593 microversion: 2.32 time: 0.681465 Nov 03 03:57:41.299365 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 839/1625] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:40 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1593 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:41.314624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:41.319837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:41.348796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:41.348796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:41.348796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:41.348796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:41.348796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:41.348796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:41.723170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:41.732812 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb6737ea-944d-42bf-bc73-b13b7f8305b3 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1283 microversion: 2.1 time: 0.432120 Nov 03 03:57:41.737314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 840/1626] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:41 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1283 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:41.755055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:41.755055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:41.768690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:41.770670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:41.772559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:41.774379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:41.775717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:41.777842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:41.790188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:41.841592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:57:42.286391 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04a096e3-0511-4d7e-b064-0ef7aa614bb3 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 204 len: 0 microversion: 2.1 time: 0.545811 Nov 03 03:57:42.286990 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 841/1627] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:57:41 2022] DELETE /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:42.298481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:42.300614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:42.319147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:42.322779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:42.322779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:42.322779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:42.322779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:42.322779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:42.442112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:42.460899 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24eeb8f1-6e10-4310-99aa-4a281b82506b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1475 microversion: 2.1 time: 1.274056 Nov 03 03:57:42.465309 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 787/1628] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:41 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1475 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:42.473621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:42.476849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:42.486188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:42.487060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:42.487751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:42.488695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:42.489404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:42.490065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:42.508656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:42.555372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:42.573797 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3888fa16-6661-4b31-a9db-237bcc647ba6 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1168 microversion: 2.1 time: 0.279672 Nov 03 03:57:42.574405 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 842/1629] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:42 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1168 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:42.583677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.22"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:42.586336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:42.619127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:42.619954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:42.620683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:42.621765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:42.622429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:42.623362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:42.679020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:57:42.679625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquired lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:57:43.183182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:43.200014 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e78658e-646f-4dd8-b750-aed22dc33393 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1315 microversion: 2.1 time: 0.731440 Nov 03 03:57:43.206467 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 788/1630] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:42 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:43.209520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:43.213307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:43.224747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:43.227338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:43.229096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:43.230245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:43.231826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:43.233503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:43.687498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:43.731991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=17 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:44.075516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:44.090292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:44.098712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:44.102422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20aa7b4d-210e-45d4-a6f6-558fdb71646f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1660 microversion: 2.32 time: 0.895391 Nov 03 03:57:44.109907 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 789/1631] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:43 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1660 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:44.126643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:44.138154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:44.161700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:44.161700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:44.161700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:44.161700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:44.161700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:44.164310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:45.188139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:45.202053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a7bd507-a411-4aa4-bd94-8bf57c29bc13 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1325 microversion: 2.1 time: 1.089720 Nov 03 03:57:45.208203 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 790/1632] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:44 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1325 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:45.213878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-562e3ad4-eda1-4329-afb3-ef2d0bc3f028 req-008108c5-99b4-44e3-bc6f-e2d094c35ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "name": "network-vif-unplugged", "status": "completed", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:45.244930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-562e3ad4-eda1-4329-afb3-ef2d0bc3f028 req-008108c5-99b4-44e3-bc6f-e2d094c35ee3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:45.245814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-562e3ad4-eda1-4329-afb3-ef2d0bc3f028 req-008108c5-99b4-44e3-bc6f-e2d094c35ee3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:45.246442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-562e3ad4-eda1-4329-afb3-ef2d0bc3f028 req-008108c5-99b4-44e3-bc6f-e2d094c35ee3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:45.276436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-562e3ad4-eda1-4329-afb3-ef2d0bc3f028 req-008108c5-99b4-44e3-bc6f-e2d094c35ee3 service nova] Creating event network-vif-unplugged:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h1-854653-7 Nov 03 03:57:45.292156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-562e3ad4-eda1-4329-afb3-ef2d0bc3f028 req-008108c5-99b4-44e3-bc6f-e2d094c35ee3 service nova] Instance 6f7995a8-c618-447c-b285-ab5235a00517 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:57:45.315923 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-562e3ad4-eda1-4329-afb3-ef2d0bc3f028 req-008108c5-99b4-44e3-bc6f-e2d094c35ee3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106020 Nov 03 03:57:45.320787 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 791/1633] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:45.344595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-01d3dae8-0ce1-47bf-8892-3b4039229c40 req-4ed17efb-6645-4ff0-987c-5cd5aa18f22c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed94eeeb-28e0-4472-8d19-c980456ffa0f", "tag": "936b3ab5-5256-4926-b068-f44770180c56"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:45.363670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-01d3dae8-0ce1-47bf-8892-3b4039229c40 req-4ed17efb-6645-4ff0-987c-5cd5aa18f22c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:45.364196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-01d3dae8-0ce1-47bf-8892-3b4039229c40 req-4ed17efb-6645-4ff0-987c-5cd5aa18f22c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:45.364788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-01d3dae8-0ce1-47bf-8892-3b4039229c40 req-4ed17efb-6645-4ff0-987c-5cd5aa18f22c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:45.402021 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-01d3dae8-0ce1-47bf-8892-3b4039229c40 req-4ed17efb-6645-4ff0-987c-5cd5aa18f22c service nova] Creating event network-changed:936b3ab5-5256-4926-b068-f44770180c56 for instance ed94eeeb-28e0-4472-8d19-c980456ffa0f on n-h1-854653-7 Nov 03 03:57:45.419695 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-01d3dae8-0ce1-47bf-8892-3b4039229c40 req-4ed17efb-6645-4ff0-987c-5cd5aa18f22c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094442 Nov 03 03:57:45.421481 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 792/1634] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:45.442140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:45.442879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:45.461435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:45.462209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:45.462818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:45.463733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:45.467515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:45.468154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:46.337258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:46.387686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=12 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:46.455191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:46.469407 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9ccd927-c24a-402f-888f-16e849e7a5be tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1475 microversion: 2.1 time: 1.037683 Nov 03 03:57:46.471969 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 793/1635] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:45 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1475 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:46.481409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:46.482173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:46.499799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:46.500769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:46.501715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:46.503116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:46.504140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:46.505219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:48.153461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:48.170659 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ca17047-a28b-46cf-857f-f24d44f9c8b2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1210 microversion: 2.1 time: 1.698261 Nov 03 03:57:48.190455 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 794/1636] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:46 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1210 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:48.199414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:48.203497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:48.217492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:48.218455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:48.219201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:48.224699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:48.226652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:48.232146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:48.948443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:48.956951 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-695c34b2-ac49-4f25-8304-0d4cc48492be tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1315 microversion: 2.1 time: 0.764879 Nov 03 03:57:48.969157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 795/1637] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:48 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:48.974384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9a1b862f-4708-466e-b30d-e30ca306eab0 req-12f0f117-2b4a-4a66-89f2-a4bf05a092ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fceff-bafd-4b2a-a220-f1f9d57deb42", "name": "network-vif-plugged", "status": "completed", "tag": "5b7b0984-1390-4bb9-b7a9-feef1a456443"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:48.984501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9a1b862f-4708-466e-b30d-e30ca306eab0 req-12f0f117-2b4a-4a66-89f2-a4bf05a092ad service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:48.985295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9a1b862f-4708-466e-b30d-e30ca306eab0 req-12f0f117-2b4a-4a66-89f2-a4bf05a092ad service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:48.986186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9a1b862f-4708-466e-b30d-e30ca306eab0 req-12f0f117-2b4a-4a66-89f2-a4bf05a092ad service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:49.000201 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9a1b862f-4708-466e-b30d-e30ca306eab0 req-12f0f117-2b4a-4a66-89f2-a4bf05a092ad service nova] Creating event network-vif-plugged:5b7b0984-1390-4bb9-b7a9-feef1a456443 for instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 on n-h1-854653-7 Nov 03 03:57:49.005896 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9a1b862f-4708-466e-b30d-e30ca306eab0 req-12f0f117-2b4a-4a66-89f2-a4bf05a092ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035080 Nov 03 03:57:49.008041 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 796/1638] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:49.014358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:49.015954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:49.023247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:49.024047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:49.025481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:49.026593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:49.027487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:49.028132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:49.094585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Building network info cache for instance {{(pid=127594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:57:50.114549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:50.133522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:50.135677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:50.137402 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5f3f635e-9ff1-42a8-8b83-89cffb3cc796 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1706 microversion: 2.32 time: 1.128052 Nov 03 03:57:50.157459 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 797/1639] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:49 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1706 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:50.165888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:50.168501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:50.182969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:50.183741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:50.184653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:50.185674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:50.186437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:50.187386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:50.743093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:50.760625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2734d537-f1d0-450a-80ef-18e6519df24c tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1325 microversion: 2.1 time: 0.600167 Nov 03 03:57:50.762162 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 798/1640] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:50 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:50.769546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:50.771229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:50.788345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:50.788976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:50.789650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:50.790969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:50.791449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:50.791894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:51.148970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:51.166017 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c50c0feb-5335-432a-803b-54ee9416ebab tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1475 microversion: 2.1 time: 0.402480 Nov 03 03:57:51.168974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Updating instance_info_cache with network_info: [{"id": "b5dcbf93-99c7-4090-acd4-0c6607cfd984", "address": "fa:16:3e:0f:3f:a4", "network": {"id": "104b7573-1057-4ee0-9f14-0c79e9b07517", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-699465872-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69c5a88467bb4b5ca79bfb7562dbf79b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5dcbf93-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:57:51.178834 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 799/1641] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:50 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1475 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:51.184953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5a78d6d5-705c-460b-9a93-4d4651f33b7a req-888ea992-b63a-438b-aa5c-8c19e306c93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:51.196956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a78d6d5-705c-460b-9a93-4d4651f33b7a req-888ea992-b63a-438b-aa5c-8c19e306c93e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:51.197611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a78d6d5-705c-460b-9a93-4d4651f33b7a req-888ea992-b63a-438b-aa5c-8c19e306c93e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:51.198265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a78d6d5-705c-460b-9a93-4d4651f33b7a req-888ea992-b63a-438b-aa5c-8c19e306c93e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:51.212957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5a78d6d5-705c-460b-9a93-4d4651f33b7a req-888ea992-b63a-438b-aa5c-8c19e306c93e service nova] Creating event network-changed:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h1-854653-7 Nov 03 03:57:51.220393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-5a78d6d5-705c-460b-9a93-4d4651f33b7a req-888ea992-b63a-438b-aa5c-8c19e306c93e service nova] Instance 6f7995a8-c618-447c-b285-ab5235a00517 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:57:51.253094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5a78d6d5-705c-460b-9a93-4d4651f33b7a req-888ea992-b63a-438b-aa5c-8c19e306c93e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070765 Nov 03 03:57:51.255615 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 800/1642] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:51.280282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0a5e243b-39cb-4001-86cb-d7cee46d3f2d req-023391a3-d85f-4d8d-989b-fd8d588814d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b39feb3-5f40-46b0-85f8-b17042ace49f", "name": "network-vif-deleted", "tag": "e5434394-729e-48d4-90d4-8a47f965e59e"}, {"name": "network-changed", "server_uuid": "0a8c4d29-a887-422d-95ec-dee0f364a67c", "tag": "03e3e515-f7e3-44f7-bed2-3a61ee3886ab"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:51.307080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0a5e243b-39cb-4001-86cb-d7cee46d3f2d req-023391a3-d85f-4d8d-989b-fd8d588814d4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:51.309908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Releasing lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:57:51.311028 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f4cbf15a-efe1-4f0a-8732-536b36f47a9f tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action" status: 202 len: 0 microversion: 2.1 time: 8.735431 Nov 03 03:57:51.311880 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 843/1643] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:42 2022] POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action => generated 0 bytes in 8737 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 03:57:51.317666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:51.318922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:51.320292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0a5e243b-39cb-4001-86cb-d7cee46d3f2d req-023391a3-d85f-4d8d-989b-fd8d588814d4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:51.323813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0a5e243b-39cb-4001-86cb-d7cee46d3f2d req-023391a3-d85f-4d8d-989b-fd8d588814d4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:51.346755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:51.356115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:51.356963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:51.358646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:51.359750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:51.364526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:51.379114 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0a5e243b-39cb-4001-86cb-d7cee46d3f2d req-023391a3-d85f-4d8d-989b-fd8d588814d4 service nova] Creating event network-vif-deleted:e5434394-729e-48d4-90d4-8a47f965e59e for instance 7b39feb3-5f40-46b0-85f8-b17042ace49f on n-h1-854653-7 Nov 03 03:57:51.382741 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0a5e243b-39cb-4001-86cb-d7cee46d3f2d req-023391a3-d85f-4d8d-989b-fd8d588814d4 service nova] Creating event network-changed:03e3e515-f7e3-44f7-bed2-3a61ee3886ab for instance 0a8c4d29-a887-422d-95ec-dee0f364a67c on n-h2-854653-7 Nov 03 03:57:51.422336 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0a5e243b-39cb-4001-86cb-d7cee46d3f2d req-023391a3-d85f-4d8d-989b-fd8d588814d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.160570 Nov 03 03:57:51.426613 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 801/1644] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:51.455115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:51.456142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:51.483461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:51.483993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:51.484441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:51.485231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:51.489895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:51.490356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:52.068796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:52.081592 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9e59398-7074-41f9-b7b2-d8f70c9cd30a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1210 microversion: 2.1 time: 0.767325 Nov 03 03:57:52.083869 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 844/1645] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:51 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1210 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:52.093861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:52.094550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:52.102841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:52.103585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:52.105797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:52.107476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:52.108170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:52.109289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:52.151969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:52.165395 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9baa2a2-c10f-4ef4-9b83-2241d65de222 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1315 microversion: 2.1 time: 0.734956 Nov 03 03:57:52.167457 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 802/1646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:51 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:52.173828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a345f54-a16c-4489-9164-ca49a892827a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '.version_select at 0x7ff7f9d1b4c0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:52.501150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:52.523050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:52.529605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:52.530932 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-55c4cd0e-6921-4498-bb8d-c146a13e8ce1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1752 microversion: 2.32 time: 0.444081 Nov 03 03:57:52.532054 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 845/1647] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:52 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1752 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:52.551140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:52.551140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:52.566875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:52.572463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:52.572463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:52.572463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:52.572463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:52.573341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:52.597999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a345f54-a16c-4489-9164-ca49a892827a tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/ab34f727-c86b-431f-b518-1547f6997a29" status: 200 len: 183 microversion: 2.1 time: 0.429196 Nov 03 03:57:52.599315 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 803/1648] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:57:52 2022] GET /compute/v2.1/os-floating-ips/ab34f727-c86b-431f-b518-1547f6997a29 => generated 183 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:52.604637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:52.605626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:52.619868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:52.620673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:52.623976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:52.623976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:52.623976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:52.623976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:52.884416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:52.893262 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3b833cd6-8dfa-45e1-9843-b995f9b9ee89 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1325 microversion: 2.1 time: 0.359479 Nov 03 03:57:52.916180 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 846/1649] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:52 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:52.921178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.22"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:53.047637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:53.056845 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-db2b2f96-8bf7-49ec-a310-8d7e421e1b15 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1473 microversion: 2.1 time: 0.456264 Nov 03 03:57:53.067726 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 804/1650] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:52 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1473 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:53.082889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-243627d9-f1e6-4ecb-a575-f86c10684b39 req-d8bd04ef-3dc2-4a33-b9be-c177c8afcae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c4d29-a887-422d-95ec-dee0f364a67c", "name": "network-vif-plugged", "status": "completed", "tag": "03e3e515-f7e3-44f7-bed2-3a61ee3886ab"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:53.094523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-243627d9-f1e6-4ecb-a575-f86c10684b39 req-d8bd04ef-3dc2-4a33-b9be-c177c8afcae4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:53.095368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-243627d9-f1e6-4ecb-a575-f86c10684b39 req-d8bd04ef-3dc2-4a33-b9be-c177c8afcae4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:53.096055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-243627d9-f1e6-4ecb-a575-f86c10684b39 req-d8bd04ef-3dc2-4a33-b9be-c177c8afcae4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:53.117993 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-243627d9-f1e6-4ecb-a575-f86c10684b39 req-d8bd04ef-3dc2-4a33-b9be-c177c8afcae4 service nova] Creating event network-vif-plugged:03e3e515-f7e3-44f7-bed2-3a61ee3886ab for instance 0a8c4d29-a887-422d-95ec-dee0f364a67c on n-h2-854653-7 Nov 03 03:57:53.138941 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-243627d9-f1e6-4ecb-a575-f86c10684b39 req-d8bd04ef-3dc2-4a33-b9be-c177c8afcae4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063117 Nov 03 03:57:53.139779 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 805/1651] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:53.144933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:53.145835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:53.159435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:53.159597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:53.159597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:53.159597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:53.159597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:53.160287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:53.160424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:53.163031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:53.163633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:53.164121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:53.164852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:53.165349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:53.165788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:53.536084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:53.546699 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-99b1c18e-68c4-450b-b640-20713c770638 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1210 microversion: 2.1 time: 0.405582 Nov 03 03:57:53.557695 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 806/1652] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:53 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1210 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:53.569056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:53.569950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:53.576855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:53.577750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:53.578378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:53.579325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:53.579950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:53.580699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:53.611587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 03:57:53.612578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquired lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 03:57:54.226171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:54.235199 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df38c51b-8a76-4550-8443-c46cdc90e3af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1502 microversion: 2.1 time: 0.676112 Nov 03 03:57:54.236178 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 807/1653] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:53 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1502 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:54.242700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d8a45509-a95a-4a7a-bb59-7d17de16a0f9 req-765e897f-82f0-4a2d-8114-b53f077a37a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabcad71-c1df-46e2-ac26-6e32ad072279", "tag": "b5dcbf93-99c7-4090-acd4-0c6607cfd984"}, {"name": "network-changed", "server_uuid": "90ed965a-8dc9-4615-a8bd-dc2436ecd483", "tag": "d9698e41-18ac-4728-88d7-fdd2f72e075d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:54.254683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8a45509-a95a-4a7a-bb59-7d17de16a0f9 req-765e897f-82f0-4a2d-8114-b53f077a37a1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:54.255247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8a45509-a95a-4a7a-bb59-7d17de16a0f9 req-765e897f-82f0-4a2d-8114-b53f077a37a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:54.255883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8a45509-a95a-4a7a-bb59-7d17de16a0f9 req-765e897f-82f0-4a2d-8114-b53f077a37a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:54.272955 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d8a45509-a95a-4a7a-bb59-7d17de16a0f9 req-765e897f-82f0-4a2d-8114-b53f077a37a1 service nova] Creating event network-changed:b5dcbf93-99c7-4090-acd4-0c6607cfd984 for instance dabcad71-c1df-46e2-ac26-6e32ad072279 on n-h2-854653-7 Nov 03 03:57:54.272955 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d8a45509-a95a-4a7a-bb59-7d17de16a0f9 req-765e897f-82f0-4a2d-8114-b53f077a37a1 service nova] Creating event network-changed:d9698e41-18ac-4728-88d7-fdd2f72e075d for instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 on n-h1-854653-7 Nov 03 03:57:54.281617 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d8a45509-a95a-4a7a-bb59-7d17de16a0f9 req-765e897f-82f0-4a2d-8114-b53f077a37a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043971 Nov 03 03:57:54.283135 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 808/1654] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:54.302447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:54.304020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:54.314010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:54.314718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:54.320250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:54.320250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:54.320250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:54.320843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:55.253188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:55.260621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:57:55.268340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:55.269829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:55.271183 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da290abf-cded-46a0-8a31-9b4382f5c1fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1752 microversion: 2.32 time: 0.985829 Nov 03 03:57:55.271756 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 809/1655] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:54 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1752 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:55.276286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:55.281610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:55.304230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:55.305037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:55.305682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:55.306893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:55.307602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:55.308855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:55.953210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:55.964789 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7bac2f0-74d4-45de-a023-6dd1c2ae3895 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1522 microversion: 2.1 time: 0.691842 Nov 03 03:57:55.966432 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 810/1656] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:55 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1522 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:55.973468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:55.974605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:55.982905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:55.983825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:55.984513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:55.985823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:55.986831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:55.987619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:56.385829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:56.391670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Building network info cache for instance {{(pid=127594) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 03:57:56.417443 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a4d6167f-3807-45eb-8899-c64f380386c5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1470 microversion: 2.1 time: 0.449522 Nov 03 03:57:56.435185 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 811/1657] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:55 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1470 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:56.444883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:56.446581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:56.453290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:56.454217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:56.454952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:56.456160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:56.459748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:56.460586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:56.503225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lazy-loading 'flavor' on Instance uuid 328fceff-bafd-4b2a-a220-f1f9d57deb42 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:57:57.134518 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e63bda2c-0c34-4332-9f04-867a8f123dbb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42/action" status: 202 len: 0 microversion: 2.1 time: 0.696483 Nov 03 03:57:57.141462 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 812/1658] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:56 2022] POST /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:57:57.153663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:57.155012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:57.166716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:57.167215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:57.167651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:57.168369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:57.168836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:57.169288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:57.489476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:57.505576 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-246ca057-6fe2-4414-9e23-5e6a7168f73e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.358412 Nov 03 03:57:57.521488 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 813/1659] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:57 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:57.526588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:57.527767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:57.535071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:57.535782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:57.536324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:57.537221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:57.537973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:57.538496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:57.568553 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] HTTP exception thrown: Instance is not a member of specified network Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Request method failure captured: Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c/ips/invalid HTTP/1.1 Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzwtrQQhRzDaf40Z5konRFMbqmXTE1iZ43x4A-jNxue8Kyd4ajbOhS4Yn13mIOG4C7twg33AVDnM9Sd7M86A8fI63jDKtYBcUDyCHXxoz5XxwEi9Q-Xeli-PVOKaAufsu4hUaEzF72x9KfLikBOduIV17yEZyOB8EFM7M0uZwIzOJhs Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 9c4c175083ac4fe59f2b706bbab5465b Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c4c175083ac4fe59f2b706bbab5465b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9c4c175083ac4fe59f2b706bbab5465b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c4c175083ac4fe59f2b706bbab5465b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9c4c175083ac4fe59f2b706bbab5465b"}]}] Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 9c4c175083ac4fe59f2b706bbab5465b Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerAddressesNegativeTestJSON-1724889602-project Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 448b231b25c244a6a331d0b87966cceb Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1724889602-project Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance is not a member of specified network Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '0a8c4d29-a887-422d-95ec-dee0f364a67c', 'id': 'invalid'} Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Nov 03 03:57:57.574702 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:57.579359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Returning 404 to user: Instance is not a member of specified network {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:57:57.579359 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39c3f128-853f-4a83-bee2-7f8f36a6c90e tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.061503 Nov 03 03:57:57.579717 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 814/1660] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:57:57 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c/ips/invalid => generated 91 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:57:57.586325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:57.586977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:57.593083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:57.594191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:57.594191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:57.595138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:57.596239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:57.596380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.122688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:58.136218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:58.138258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:58.139859 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e7120c3f-777c-4e26-bcbc-28d900681ed0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1798 microversion: 2.32 time: 0.558748 Nov 03 03:57:58.142708 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 815/1661] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:57 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1798 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:58.156970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a57bdfee-867c-4aca-9d16-cf892465d088 req-ecbf7172-6d2e-410b-84c2-855a4aa0e1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabcad71-c1df-46e2-ac26-6e32ad072279", "tag": "b5dcbf93-99c7-4090-acd4-0c6607cfd984"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:58.170495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a57bdfee-867c-4aca-9d16-cf892465d088 req-ecbf7172-6d2e-410b-84c2-855a4aa0e1fc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.170963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a57bdfee-867c-4aca-9d16-cf892465d088 req-ecbf7172-6d2e-410b-84c2-855a4aa0e1fc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.171415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a57bdfee-867c-4aca-9d16-cf892465d088 req-ecbf7172-6d2e-410b-84c2-855a4aa0e1fc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.187096 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a57bdfee-867c-4aca-9d16-cf892465d088 req-ecbf7172-6d2e-410b-84c2-855a4aa0e1fc service nova] Creating event network-changed:b5dcbf93-99c7-4090-acd4-0c6607cfd984 for instance dabcad71-c1df-46e2-ac26-6e32ad072279 on n-h2-854653-7 Nov 03 03:57:58.192176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a57bdfee-867c-4aca-9d16-cf892465d088 req-ecbf7172-6d2e-410b-84c2-855a4aa0e1fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047999 Nov 03 03:57:58.193390 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 816/1662] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:58.211134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:58.211134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:58.216392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.216625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.217937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.218953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.219456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.219886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.421710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Updating instance_info_cache with network_info: [{"id": "b5dcbf93-99c7-4090-acd4-0c6607cfd984", "address": "fa:16:3e:0f:3f:a4", "network": {"id": "104b7573-1057-4ee0-9f14-0c79e9b07517", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-699465872-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "69c5a88467bb4b5ca79bfb7562dbf79b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5dcbf93-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:57:58.543504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Releasing lock "refresh_cache-dabcad71-c1df-46e2-ac26-6e32ad072279" {{(pid=127594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 03:57:58.544964 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fd1b5832-f0d1-497f-9013-72bb8a0d7ad8 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action" status: 202 len: 0 microversion: 2.1 time: 5.627760 Nov 03 03:57:58.551735 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 847/1663] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:52 2022] POST /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279/action => generated 0 bytes in 5635 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 03:57:58.557709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:58.559062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:58.565956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.566792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.567487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.568501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.570075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.571165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.750050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca3f0bbc-05ba-42b3-969e-f8a2433744bd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "POST /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517/action" status: 202 len: 0 microversion: 2.1 time: 0.552493 Nov 03 03:57:58.765859 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 817/1664] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:57:58 2022] POST /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:57:58.774003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7559de96-492c-4f2b-8a42-776d48c7fc9f tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:58.774816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7559de96-492c-4f2b-8a42-776d48c7fc9f tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Failed to fetch instance by id 999 {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 03 03:57:58.775607 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7559de96-492c-4f2b-8a42-776d48c7fc9f tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] HTTP exception thrown: Instance 999 could not be found. Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7559de96-492c-4f2b-8a42-776d48c7fc9f tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Request method failure captured: Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzwtrQQhRzDaf40Z5konRFMbqmXTE1iZ43x4A-jNxue8Kyd4ajbOhS4Yn13mIOG4C7twg33AVDnM9Sd7M86A8fI63jDKtYBcUDyCHXxoz5XxwEi9Q-Xeli-PVOKaAufsu4hUaEzF72x9KfLikBOduIV17yEZyOB8EFM7M0uZwIzOJhs Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 9c4c175083ac4fe59f2b706bbab5465b Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c4c175083ac4fe59f2b706bbab5465b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9c4c175083ac4fe59f2b706bbab5465b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c4c175083ac4fe59f2b706bbab5465b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9c4c175083ac4fe59f2b706bbab5465b"}]}] Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 9c4c175083ac4fe59f2b706bbab5465b Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerAddressesNegativeTestJSON-1724889602-project Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 448b231b25c244a6a331d0b87966cceb Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1724889602-project Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 999 could not be found. Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '999'} Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 03 03:57:58.778018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.796138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7559de96-492c-4f2b-8a42-776d48c7fc9f tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Returning 404 to user: Instance 999 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:57:58.796138 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7559de96-492c-4f2b-8a42-776d48c7fc9f tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016307 Nov 03 03:57:58.796138 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 818/1665] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:57:58 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:57:58.803064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b8fa518a-a439-48a9-9e94-0cc670eb11c8 req-3e0229c1-e320-4075-98e3-3296746e10f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "name": "network-vif-plugged", "status": "completed", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:57:58.818977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b8fa518a-a439-48a9-9e94-0cc670eb11c8 req-3e0229c1-e320-4075-98e3-3296746e10f4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.820040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b8fa518a-a439-48a9-9e94-0cc670eb11c8 req-3e0229c1-e320-4075-98e3-3296746e10f4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.820737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b8fa518a-a439-48a9-9e94-0cc670eb11c8 req-3e0229c1-e320-4075-98e3-3296746e10f4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.844598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:58.846653 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b8fa518a-a439-48a9-9e94-0cc670eb11c8 req-3e0229c1-e320-4075-98e3-3296746e10f4 service nova] Creating event network-vif-plugged:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h1-854653-7 Nov 03 03:57:58.856409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-b8fa518a-a439-48a9-9e94-0cc670eb11c8 req-3e0229c1-e320-4075-98e3-3296746e10f4 service nova] Instance 6f7995a8-c618-447c-b285-ab5235a00517 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:57:58.865487 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-660c5969-8091-46a8-b96b-82048e552c8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.312307 Nov 03 03:57:58.873084 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 848/1666] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:58 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:58.887209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:58.887852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:58.894241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.895269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.895604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.896497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.897195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.897828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.907306 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b8fa518a-a439-48a9-9e94-0cc670eb11c8 req-3e0229c1-e320-4075-98e3-3296746e10f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111316 Nov 03 03:57:58.907992 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 819/1667] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:57:58.920434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:58.921831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:58.929851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.930348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.931562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.932408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.933209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.933652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.950109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] HTTP exception thrown: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Request method failure captured: Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f HTTP/1.1 Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzvgf3Isik4oH_Sex04frMNCYESYheGYSWxWi13ZArTMaLdrYFi30l5PNy64JApEL0v7iSocWoOyGpYltj0OxW1eUYxviNAFX_2ncNLchI89XYh57A17AR67yTOVGfKu00kYGuYpJbZG9M2XJ-GwyFgFkccm6ScVotwaBw7vhwM5gSc Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_69c5a88467bb4b5ca79bfb7562dbf79b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/69c5a88467bb4b5ca79bfb7562dbf79b"}]}] Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 71097a5704904531909e6adfdbbae98a Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7b39feb3-5f40-46b0-85f8-b17042ace49f'} Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:57:58.951937 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Returning 404 to user: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-792eb0b2-be2f-4103-a7c9-4195fd04a867 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 404 len: 111 microversion: 2.1 time: 0.043702 Nov 03 03:57:58.957594 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 820/1668] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:57:58 2022] DELETE /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:57:58.961224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:58.961770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:58.968576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.969130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.969584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:58.970310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:58.970901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:58.971362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.287275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:59.300645 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fea9291b-819a-41e0-bc63-9bf0740902a4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.426159 Nov 03 03:57:59.304687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:59.313970 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c05c1b2-f997-4215-b02d-3ae17e54cd06 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.357480 Nov 03 03:57:59.321625 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 849/1669] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:58 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:59.327409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:59.328176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:59.330348 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 821/1670] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:58 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:57:59.337563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.338985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.339431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:59.340500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: 7b39feb3-5f40-46b0-85f8-b17042ace49f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:59.341937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.343677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.344405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.345144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.347874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.348019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.348441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.351301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.351769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.352406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.372961 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] HTTP exception thrown: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Request method failure captured: Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f HTTP/1.1 Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzvgf3Isik4oH_Sex04frMNCYESYheGYSWxWi13ZArTMaLdrYFi30l5PNy64JApEL0v7iSocWoOyGpYltj0OxW1eUYxviNAFX_2ncNLchI89XYh57A17AR67yTOVGfKu00kYGuYpJbZG9M2XJ-GwyFgFkccm6ScVotwaBw7vhwM5gSc Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_69c5a88467bb4b5ca79bfb7562dbf79b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/69c5a88467bb4b5ca79bfb7562dbf79b"}]}] Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 71097a5704904531909e6adfdbbae98a Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7b39feb3-5f40-46b0-85f8-b17042ace49f'} Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:59.374991 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Returning 404 to user: Instance 7b39feb3-5f40-46b0-85f8-b17042ace49f could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64d76621-eb23-47eb-a4b9-154128e29905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f" status: 404 len: 111 microversion: 2.1 time: 0.045154 Nov 03 03:57:59.381396 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 822/1671] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:59 2022] GET /compute/v2.1/servers/7b39feb3-5f40-46b0-85f8-b17042ace49f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:57:59.385075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:59.385075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:59.391548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.392132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.392571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.394778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.394908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.395859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.414939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:57:59.723502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:59.736259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:59.737725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:57:59.741432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e20a3bf4-7c0d-41b8-8567-d6de208e711e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1844 microversion: 2.32 time: 0.360271 Nov 03 03:57:59.744332 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 823/1672] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:57:59 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1844 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:57:59.751996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d7c2e3d-f4c2-42b1-b309-2a37bd074467 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '.version_select at 0x7ff7f9cf65e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:59.856824 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a7633b5-e92b-48fd-93b1-f94dcd568ae6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 204 len: 0 microversion: 2.1 time: 0.533285 Nov 03 03:57:59.857577 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 850/1673] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:57:59 2022] DELETE /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:57:59.867356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:57:59.868325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:57:59.875636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.875804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.876382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:57:59.877145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:57:59.877598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:57:59.878227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:00.300758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:00.309525 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1a359ac7-82d0-4741-a820-6f1e0cf23491 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1528 microversion: 2.1 time: 0.447176 Nov 03 03:58:00.310938 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 851/1674] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:57:59 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1528 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:00.317262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:00.321972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:00.326597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:00.327291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:00.327926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:00.328804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:00.329661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:00.330419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:00.963530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:00.966751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:00.993566 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0a1bc88-817c-45f2-bdb3-eb9f5a29ad84 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.663862 Nov 03 03:58:00.993566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 852/1675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:00 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:00.993566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:00.993566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:01.003542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:01.006931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:01.006931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:01.006931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:01.006931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:01.009419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:01.323100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:01.335049 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ada39a95-8817-4f2e-85b2-8042b3f3bc4c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.356824 Nov 03 03:58:01.336094 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 853/1676] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:00 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:01.344505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:01.347642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:01.359218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:01.360036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:01.366717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:01.366717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:01.366717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:01.366717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:01.672434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:01.680978 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f59aacb6-60d2-4bc2-b440-904da18c6606 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.343419 Nov 03 03:58:01.681949 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 854/1677] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:01 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:01.701918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e175931f-2fce-4c2c-a48e-c74d1d33d78a req-1be64d48-0116-4c98-842e-365a366e7d00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "6d00f3d5-ad14-49f4-b158-233065bddcf8"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:01.712661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e175931f-2fce-4c2c-a48e-c74d1d33d78a req-1be64d48-0116-4c98-842e-365a366e7d00 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:01.718035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e175931f-2fce-4c2c-a48e-c74d1d33d78a req-1be64d48-0116-4c98-842e-365a366e7d00 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:01.718035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e175931f-2fce-4c2c-a48e-c74d1d33d78a req-1be64d48-0116-4c98-842e-365a366e7d00 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:01.726769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e175931f-2fce-4c2c-a48e-c74d1d33d78a req-1be64d48-0116-4c98-842e-365a366e7d00 service nova] Creating event network-changed:6d00f3d5-ad14-49f4-b158-233065bddcf8 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:58:01.732596 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e175931f-2fce-4c2c-a48e-c74d1d33d78a req-1be64d48-0116-4c98-842e-365a366e7d00 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034447 Nov 03 03:58:01.734179 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 855/1678] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:01.740156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:01.741502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:01.748486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:01.749085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:01.749820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:01.750380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:01.751205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:01.751523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.119282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:02.135407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:02.139605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:02.140359 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2af2ab6-31e1-4afd-b81f-25ccd9409dc6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1844 microversion: 2.32 time: 0.404977 Nov 03 03:58:02.143821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 856/1679] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:01 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1844 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:02.153233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:02.154182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:02.160865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.161769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.162533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.165246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.166050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.166713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.269781 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d7c2e3d-f4c2-42b1-b309-2a37bd074467 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/ab34f727-c86b-431f-b518-1547f6997a29" status: 202 len: 0 microversion: 2.1 time: 2.521142 Nov 03 03:58:02.271448 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 824/1680] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:57:59 2022] DELETE /compute/v2.1/os-floating-ips/ab34f727-c86b-431f-b518-1547f6997a29 => generated 0 bytes in 2524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:58:02.274155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:02.277623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:02.278553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:02.284692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5515ec1f-ff4f-437a-bcf0-e59995fa330d tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1486 microversion: 2.1 time: 0.139547 Nov 03 03:58:02.285168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.285722 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 857/1681] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:02 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1486 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:02.286289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.286994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.287993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.289277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.289962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.291923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f1e8b3f3-055e-4463-bb51-0571ac708798 req-6853e2fd-8b0b-43d7-9f42-5bb89c9d1f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a8c4d29-a887-422d-95ec-dee0f364a67c", "name": "network-vif-deleted", "tag": "03e3e515-f7e3-44f7-bed2-3a61ee3886ab"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:02.304069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f1e8b3f3-055e-4463-bb51-0571ac708798 req-6853e2fd-8b0b-43d7-9f42-5bb89c9d1f4e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.304766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f1e8b3f3-055e-4463-bb51-0571ac708798 req-6853e2fd-8b0b-43d7-9f42-5bb89c9d1f4e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.305401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f1e8b3f3-055e-4463-bb51-0571ac708798 req-6853e2fd-8b0b-43d7-9f42-5bb89c9d1f4e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.320826 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f1e8b3f3-055e-4463-bb51-0571ac708798 req-6853e2fd-8b0b-43d7-9f42-5bb89c9d1f4e service nova] Creating event network-vif-deleted:03e3e515-f7e3-44f7-bed2-3a61ee3886ab for instance 0a8c4d29-a887-422d-95ec-dee0f364a67c on n-h2-854653-7 Nov 03 03:58:02.328027 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f1e8b3f3-055e-4463-bb51-0571ac708798 req-6853e2fd-8b0b-43d7-9f42-5bb89c9d1f4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040405 Nov 03 03:58:02.332900 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 858/1682] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:02.351075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:02.360249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:02.370042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.375351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.376090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.377111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.377781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.378533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.413443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:58:02.533716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:02.545373 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a4861d8f-93fd-4d31-838b-2f30ddfd05ad tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.272588 Nov 03 03:58:02.554729 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 825/1683] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:02 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:02.560458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:02.562424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:02.571497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:02.573577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.574342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.575020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.576124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.577055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.577766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.808423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:02.819204 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da242827-b68a-46d3-a16c-d1146448123b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.262633 Nov 03 03:58:02.820148 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 826/1684] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:02 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:02.825853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:02.826479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:02.838081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.838591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.839038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.839752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.840214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.840650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.862288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:02.875478 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fcb3814a-bcaf-4b08-b1a9-f3c0085beab7 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 204 len: 0 microversion: 2.1 time: 0.515152 Nov 03 03:58:02.875478 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 859/1685] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:58:02 2022] DELETE /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:58:02.883298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:02.884247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:02.890448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.891060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.891608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:02.892421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:02.892986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:02.893542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.076329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:03.083715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:03.086257 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc4e424e-6e9f-4000-a01c-0d7b7dd06230 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.264878 Nov 03 03:58:03.086836 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 827/1686] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:02 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:03.092525 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f9a86a5-7572-4b34-896a-e6d805dc9f16 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1525 microversion: 2.1 time: 0.213497 Nov 03 03:58:03.093306 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 860/1687] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:02 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1525 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:03.175208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:03.175854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:03.183510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.184007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.184451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.185609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.186077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.186511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.313522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:03.314208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:03.321138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.321702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.322297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.323248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.323719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.324100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.366234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.367122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.367652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.368176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lazy-loading 'fault' on Instance uuid 0a8c4d29-a887-422d-95ec-dee0f364a67c {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:58:03.402583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:03.421810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:03.424178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:03.424691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:03.426641 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61911a7b-a6bf-4533-ba07-bbb187b09a6a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1865 microversion: 2.32 time: 0.255534 Nov 03 03:58:03.429487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 828/1688] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:03 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1865 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:03.441464 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45f534ca-542a-4f36-9a84-64cdf749f4d6 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1315 microversion: 2.1 time: 0.132210 Nov 03 03:58:03.442060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 861/1689] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:03 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1315 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:03.583237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:03.583237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:03.586805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.587422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.587922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.588690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.590008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.590420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.742423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:03.750331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7046a8c8-4f24-468b-bca9-1f9b9b6f5cf6 req-662f92db-9213-4e86-a137-e19140b78838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "10aaf744-8389-4a5f-bbf5-24d2b6985728"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:03.752982 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7c647f85-62d6-4da6-87a4-1fd18be1216c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.178029 Nov 03 03:58:03.755407 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 829/1690] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:03 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:03.776726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7046a8c8-4f24-468b-bca9-1f9b9b6f5cf6 req-662f92db-9213-4e86-a137-e19140b78838 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.777284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7046a8c8-4f24-468b-bca9-1f9b9b6f5cf6 req-662f92db-9213-4e86-a137-e19140b78838 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.777778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7046a8c8-4f24-468b-bca9-1f9b9b6f5cf6 req-662f92db-9213-4e86-a137-e19140b78838 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.793784 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7046a8c8-4f24-468b-bca9-1f9b9b6f5cf6 req-662f92db-9213-4e86-a137-e19140b78838 service nova] Creating event network-changed:10aaf744-8389-4a5f-bbf5-24d2b6985728 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:58:03.799753 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7046a8c8-4f24-468b-bca9-1f9b9b6f5cf6 req-662f92db-9213-4e86-a137-e19140b78838 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054178 Nov 03 03:58:03.800796 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 862/1691] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:58:03.843827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:03.844583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:03.852308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.852999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.857412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:03.857412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:03.857412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:03.857412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.052684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:04.075891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-162d9825-25fa-4195-8831-1b7c47bc79ff tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.223413 Nov 03 03:58:04.075891 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 830/1692] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:03 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:04.110290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:04.112209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:04.118459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:04.119624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:04.128625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.129318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.129755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.130672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.131717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.132235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.134625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.135149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.137823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.137823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.137823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.137823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.476601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:04.484138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:04.484771 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-99032fbc-7f96-4735-a896-6b9b2a32930c tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1525 microversion: 2.1 time: 0.372325 Nov 03 03:58:04.485872 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 831/1693] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:04 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1525 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:04.497301 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-091e9b7d-8d39-4b35-b76b-ae4f09e0de57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.388375 Nov 03 03:58:04.507290 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 863/1694] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:04 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:04.507967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:04.508815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:04.515096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.515673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.516176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.516635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:04.517030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.517687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.517813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:04.518110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.523968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.527266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.527266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.527266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.527266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.527266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.560678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.561211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.561669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.562132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lazy-loading 'fault' on Instance uuid 0a8c4d29-a887-422d-95ec-dee0f364a67c {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:58:04.645972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '448b231b25c244a6a331d0b87966cceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c4c175083ac4fe59f2b706bbab5465b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:04.654878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42a81141-a1e9-4707-8ed1-4b3f0402b1c9 tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 200 len: 1315 microversion: 2.1 time: 0.145697 Nov 03 03:58:04.655112 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 864/1695] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:04 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:04.760688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:04.771497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:04.773665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:04.775503 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fc364608-9f0b-4aa9-aa59-2254834ed7ee tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1865 microversion: 2.32 time: 0.276888 Nov 03 03:58:04.776268 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 832/1696] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:04 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1865 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:04.780005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:04.780958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:04.788082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.788848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.789901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.790850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:04.791576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:04.792361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:04.919250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1304750764", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a4b97e4a-e8fa-4ae5-bc9c-9c418fd5af7c"}], "security_groups": [{"name": "tempest-securitygroup--1321721987"}], "key_name": "tempest-keypair-1207748112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "8c33a608-42f5-43c3-a71f-80fc38b6c62d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:05.092174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:05.101506 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cdca91ea-d91f-4234-a2a0-9ed46b84821a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.325426 Nov 03 03:58:05.103786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 865/1697] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:04 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:05.109646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:05.110276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:05.112551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:05.117215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] validate_networks() for [('a4b97e4a-e8fa-4ae5-bc9c-9c418fd5af7c', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:58:05.134919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:05.135726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:05.136345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:05.137269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:05.137963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:05.138565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:05.469411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:05.480150 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-841d38bc-6cd7-41da-9b68-79b55046147b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.375185 Nov 03 03:58:05.481351 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 866/1698] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:05 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:05.491515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-83455a29-ce1e-46b6-830e-ae6d05cfd195 req-6f08aeac-8466-4748-ace5-db39a4198feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabcad71-c1df-46e2-ac26-6e32ad072279", "name": "network-vif-deleted", "tag": "b5dcbf93-99c7-4090-acd4-0c6607cfd984"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:05.510645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-83455a29-ce1e-46b6-830e-ae6d05cfd195 req-6f08aeac-8466-4748-ace5-db39a4198feb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:05.511430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-83455a29-ce1e-46b6-830e-ae6d05cfd195 req-6f08aeac-8466-4748-ace5-db39a4198feb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:05.512047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-83455a29-ce1e-46b6-830e-ae6d05cfd195 req-6f08aeac-8466-4748-ace5-db39a4198feb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:05.527770 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-83455a29-ce1e-46b6-830e-ae6d05cfd195 req-6f08aeac-8466-4748-ace5-db39a4198feb service nova] Creating event network-vif-deleted:b5dcbf93-99c7-4090-acd4-0c6607cfd984 for instance dabcad71-c1df-46e2-ac26-6e32ad072279 on n-h2-854653-7 Nov 03 03:58:05.534364 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-83455a29-ce1e-46b6-830e-ae6d05cfd195 req-6f08aeac-8466-4748-ace5-db39a4198feb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051561 Nov 03 03:58:05.535283 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 867/1699] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:05.542525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:05.544325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:05.561346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:05.562000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:05.567643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:05.567643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:05.567643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:05.567643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:05.693724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:05.702835 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c0c18a77-cebe-49e9-8e25-ffffd232c905 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1483 microversion: 2.1 time: 0.166172 Nov 03 03:58:05.704348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 868/1700] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:05 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1483 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:05.709745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:05.712237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:05.724061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:05.726793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:05.727719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:05.732228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:05.732996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:05.735086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.010701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Getting quotas for project f5cc47f0d35441a6a4df71a38f8eafc4. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:58:06.016345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Getting quotas for user b95768d61a4e40f89aec9d956a4a7d18 and project f5cc47f0d35441a6a4df71a38f8eafc4. Resources: dict_keys(['metadata_items']) {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:58:06.032972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:58:06.033852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:58:06.034514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:58:06.035125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:58:06.035718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:58:06.046505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.047001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.047449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.048229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.048772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.049159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.099188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Getting quotas for project f5cc47f0d35441a6a4df71a38f8eafc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:58:06.100537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:06.108145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:06.109194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Getting quotas for user b95768d61a4e40f89aec9d956a4a7d18 and project f5cc47f0d35441a6a4df71a38f8eafc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:58:06.109328 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8aa00c3b-08e6-48d4-8531-22a77fc1c744 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.403358 Nov 03 03:58:06.109798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 869/1701] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:05 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:06.118283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:06.119120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] [instance: 0a8c4d29-a887-422d-95ec-dee0f364a67c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:06.125407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.126119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.126736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.127663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.128284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.128887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.145767 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] HTTP exception thrown: Instance 0a8c4d29-a887-422d-95ec-dee0f364a67c could not be found. Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Request method failure captured: Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c HTTP/1.1 Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzwtrQQhRzDaf40Z5konRFMbqmXTE1iZ43x4A-jNxue8Kyd4ajbOhS4Yn13mIOG4C7twg33AVDnM9Sd7M86A8fI63jDKtYBcUDyCHXxoz5XxwEi9Q-Xeli-PVOKaAufsu4hUaEzF72x9KfLikBOduIV17yEZyOB8EFM7M0uZwIzOJhs Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 9c4c175083ac4fe59f2b706bbab5465b Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c4c175083ac4fe59f2b706bbab5465b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9c4c175083ac4fe59f2b706bbab5465b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c4c175083ac4fe59f2b706bbab5465b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9c4c175083ac4fe59f2b706bbab5465b"}]}] Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 9c4c175083ac4fe59f2b706bbab5465b Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1724889602 Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerAddressesNegativeTestJSON-1724889602-project Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 448b231b25c244a6a331d0b87966cceb Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1724889602-project Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0a8c4d29-a887-422d-95ec-dee0f364a67c could not be found. Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0a8c4d29-a887-422d-95ec-dee0f364a67c'} Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a8c4d29-a887-422d-95ec-dee0f364a67c could not be found. Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a8c4d29-a887-422d-95ec-dee0f364a67c could not be found. Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:06.148110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a8c4d29-a887-422d-95ec-dee0f364a67c could not be found. Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] Returning 404 to user: Instance 0a8c4d29-a887-422d-95ec-dee0f364a67c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b023d5b7-aeda-49d1-844c-3f29611afbeb tempest-ServerAddressesNegativeTestJSON-1724889602 tempest-ServerAddressesNegativeTestJSON-1724889602-project] 10.222.0.30 "GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c" status: 404 len: 111 microversion: 2.1 time: 0.035156 Nov 03 03:58:06.153155 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 870/1702] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:06 2022] GET /compute/v2.1/servers/0a8c4d29-a887-422d-95ec-dee0f364a67c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:06.155973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:06.155973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:06.161421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.162894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.164720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.164720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.165126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.165729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.229376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:58:06.231635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c33a608-42f5-43c3-a71f-80fc38b6c62d',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:58:06.471128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:06.480614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:06.482130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:06.483325 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0ae3cf5-f93b-475b-bb9b-40db0debc884 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.332331 Nov 03 03:58:06.491419 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 871/1703] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:06 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:06.496282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cb22788f-7b74-49d4-bf46-f17315d6dbe5 req-c868cb9e-2f97-4fef-a8b4-99919bc710a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "6c1d02ee-1303-4e41-b729-563e50f0984f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:06.519374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cb22788f-7b74-49d4-bf46-f17315d6dbe5 req-c868cb9e-2f97-4fef-a8b4-99919bc710a2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.520494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cb22788f-7b74-49d4-bf46-f17315d6dbe5 req-c868cb9e-2f97-4fef-a8b4-99919bc710a2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.523013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cb22788f-7b74-49d4-bf46-f17315d6dbe5 req-c868cb9e-2f97-4fef-a8b4-99919bc710a2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.539278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cb22788f-7b74-49d4-bf46-f17315d6dbe5 req-c868cb9e-2f97-4fef-a8b4-99919bc710a2 service nova] Creating event network-changed:6c1d02ee-1303-4e41-b729-563e50f0984f for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:58:06.546745 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cb22788f-7b74-49d4-bf46-f17315d6dbe5 req-c868cb9e-2f97-4fef-a8b4-99919bc710a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053571 Nov 03 03:58:06.548044 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 872/1704] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:06.555132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:06.557537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:06.570471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.571636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.572605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.573600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.574714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.575391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.778914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ec6e210-5d14-4961-8175-a77a9d5c130f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.872966 Nov 03 03:58:06.780335 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 833/1705] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:58:04 2022] POST /compute/v2.1/servers => generated 407 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:58:06.785470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:06.786646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:06.794402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.795448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.796304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.797534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.798247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.798919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.852503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:06.864438 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf2b669d-7e5c-4a6e-9d79-95799f73b83c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.314505 Nov 03 03:58:06.867880 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 873/1706] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:06 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:06.875135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:06.878027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:06.888624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.891135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.891135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.891135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.891135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.891679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.924774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:06.925531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:06.926150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:06.927024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lazy-loading 'fault' on Instance uuid dabcad71-c1df-46e2-ac26-6e32ad072279 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:58:07.023090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71097a5704904531909e6adfdbbae98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69c5a88467bb4b5ca79bfb7562dbf79b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:07.034206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-598d2988-0253-4612-82a0-6428f4c898cc tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 200 len: 1314 microversion: 2.1 time: 0.165128 Nov 03 03:58:07.034795 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 874/1707] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:06 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:07.056193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c01b670-39d7-406b-aa75-59c07f29bda9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:07.072677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c01b670-39d7-406b-aa75-59c07f29bda9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:07.158486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c01b670-39d7-406b-aa75-59c07f29bda9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:07.171046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c01b670-39d7-406b-aa75-59c07f29bda9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1122 microversion: 2.1 time: 0.119684 Nov 03 03:58:07.171638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 875/1708] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:07 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1122 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:07.176598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:07.179338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:07.190357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.190856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.198500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:07.198500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.198500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.198500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:07.204692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:07.216053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-576ad1d2-7cb8-4699-aaac-8fd09a921290 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.433605 Nov 03 03:58:07.216973 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 834/1709] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:06 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:07.368211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:07.384255 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a1efe37-244b-41f8-829d-1a863038e3c4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.211175 Nov 03 03:58:07.385973 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 876/1710] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:07 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:07.520728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:07.522473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:07.530959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.531764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.532554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:07.533598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.534232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.534833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:07.554843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "name": "network-vif-unplugged", "status": "completed", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}, {"name": "network-changed", "server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:07.565496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.566267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.566877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:07.581693 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] Creating event network-vif-unplugged:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h2-854653-7 Nov 03 03:58:07.582467 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] Creating event network-changed:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h2-854653-7 Nov 03 03:58:07.589288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] Instance 6f7995a8-c618-447c-b285-ab5235a00517 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 03:58:07.604504 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-910a4837-43a5-4b22-94d7-372c85df7225 req-ab1fd7da-60ee-4a17-a2a0-b29b9bb872e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053065 Nov 03 03:58:07.605469 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 877/1711] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:58:07.744706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8dbd9bfa-2cc0-45de-8a87-69199ccb1096 req-0d8d5f6b-63d9-470c-9cfa-b17396f2325a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ed965a-8dc9-4615-a8bd-dc2436ecd483", "name": "network-vif-plugged", "status": "completed", "tag": "d9698e41-18ac-4728-88d7-fdd2f72e075d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:07.756620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dbd9bfa-2cc0-45de-8a87-69199ccb1096 req-0d8d5f6b-63d9-470c-9cfa-b17396f2325a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.763671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dbd9bfa-2cc0-45de-8a87-69199ccb1096 req-0d8d5f6b-63d9-470c-9cfa-b17396f2325a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.763671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dbd9bfa-2cc0-45de-8a87-69199ccb1096 req-0d8d5f6b-63d9-470c-9cfa-b17396f2325a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:07.772349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8dbd9bfa-2cc0-45de-8a87-69199ccb1096 req-0d8d5f6b-63d9-470c-9cfa-b17396f2325a service nova] Creating event network-vif-plugged:d9698e41-18ac-4728-88d7-fdd2f72e075d for instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 on n-h1-854653-7 Nov 03 03:58:07.778186 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8dbd9bfa-2cc0-45de-8a87-69199ccb1096 req-0d8d5f6b-63d9-470c-9cfa-b17396f2325a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037631 Nov 03 03:58:07.779594 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 878/1712] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:58:07.891423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:07.892409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:07.911736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.913138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.913790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:07.921189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:07.922095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:07.923755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.444635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:08.456472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:08.458631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:08.460353 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2609b8f-d2e8-4cfc-be01-5658e542c1df tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.945723 Nov 03 03:58:08.475285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 835/1713] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:07 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:08.485162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:08.496424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:08.496707 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68d0c967-c8a3-4a87-9cf3-1b83d58e1ff9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.611787 Nov 03 03:58:08.503488 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 879/1714] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:07 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:08.510085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:08.510939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:08.513924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] [instance: dabcad71-c1df-46e2-ac26-6e32ad072279] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:08.521315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.524905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.524905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.524905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.525515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.526160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.527481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.530149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.530621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.531390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.531858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.532295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.548954 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] HTTP exception thrown: Instance dabcad71-c1df-46e2-ac26-6e32ad072279 could not be found. Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Request method failure captured: Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 HTTP/1.1 Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzvgf3Isik4oH_Sex04frMNCYESYheGYSWxWi13ZArTMaLdrYFi30l5PNy64JApEL0v7iSocWoOyGpYltj0OxW1eUYxviNAFX_2ncNLchI89XYh57A17AR67yTOVGfKu00kYGuYpJbZG9M2XJ-GwyFgFkccm6ScVotwaBw7vhwM5gSc Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_69c5a88467bb4b5ca79bfb7562dbf79b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69c5a88467bb4b5ca79bfb7562dbf79b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/69c5a88467bb4b5ca79bfb7562dbf79b"}]}] Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 69c5a88467bb4b5ca79bfb7562dbf79b Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1041324171 Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 71097a5704904531909e6adfdbbae98a Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1041324171-project Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance dabcad71-c1df-46e2-ac26-6e32ad072279 could not be found. Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'dabcad71-c1df-46e2-ac26-6e32ad072279'} Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dabcad71-c1df-46e2-ac26-6e32ad072279 could not be found. Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dabcad71-c1df-46e2-ac26-6e32ad072279 could not be found. Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:08.551574 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dabcad71-c1df-46e2-ac26-6e32ad072279 could not be found. Nov 03 03:58:08.556959 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:08.559742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] Returning 404 to user: Instance dabcad71-c1df-46e2-ac26-6e32ad072279 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:08.560818 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-103625af-2192-4c70-aee9-49ac4ec24cd1 tempest-FloatingIPsAssociationTestJSON-1041324171 tempest-FloatingIPsAssociationTestJSON-1041324171-project] 10.222.0.30 "GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279" status: 404 len: 111 microversion: 2.1 time: 0.071751 Nov 03 03:58:08.563953 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 836/1715] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:08 2022] GET /compute/v2.1/servers/dabcad71-c1df-46e2-ac26-6e32ad072279 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:08.569509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:08.570370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:08.577973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.578847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.579367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.580237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.580789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.581606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.667137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:08.688710 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab36e406-0941-41a2-94f7-9d52ffeb4167 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1164 microversion: 2.1 time: 0.183784 Nov 03 03:58:08.703624 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 880/1716] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:08 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1164 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:08.711531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:08.713515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:08.725114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.725701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.726154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.726884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.727349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:08.727784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:08.942526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:08.955112 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-637d2d81-8477-4f98-9201-e9ea06c32816 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.389785 Nov 03 03:58:08.957111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 837/1717] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:08 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:08.980209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-933b6858-b877-40e2-a641-8644e55bdc2a req-e0888139-7a91-4ee7-9b1b-9f4ae71262fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "2455d1ec-cb1c-4e26-afd2-8b73f9399820"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:08.998634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-933b6858-b877-40e2-a641-8644e55bdc2a req-e0888139-7a91-4ee7-9b1b-9f4ae71262fb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:08.999861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-933b6858-b877-40e2-a641-8644e55bdc2a req-e0888139-7a91-4ee7-9b1b-9f4ae71262fb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:09.000476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-933b6858-b877-40e2-a641-8644e55bdc2a req-e0888139-7a91-4ee7-9b1b-9f4ae71262fb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:09.015826 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-933b6858-b877-40e2-a641-8644e55bdc2a req-e0888139-7a91-4ee7-9b1b-9f4ae71262fb service nova] Creating event network-changed:2455d1ec-cb1c-4e26-afd2-8b73f9399820 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:58:09.022987 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-933b6858-b877-40e2-a641-8644e55bdc2a req-e0888139-7a91-4ee7-9b1b-9f4ae71262fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064350 Nov 03 03:58:09.024136 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 838/1718] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:09.053344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:09.061690 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ec932e8-a1d2-4a81-a171-2dec9e48ad01 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.356451 Nov 03 03:58:09.062902 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 881/1719] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:08 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:09.497769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:09.503547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:09.511184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:09.511682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:09.512665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:09.517879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:09.518374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:09.518815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:09.520280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:09.520921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:09.529302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:09.529803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:09.530253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:09.530982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:09.531446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:09.531880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:09.905089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:09.919988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:09.930394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:09.932787 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d3f01237-4fcb-4ba1-8f02-49247a1c8b7e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.444051 Nov 03 03:58:09.934273 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 839/1720] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:09 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:09.950801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:09.951639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:09.965962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:09.966470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:09.966918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:09.975206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:09.975963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:09.976585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:10.085817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:10.097505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e4a3dae3-4056-438c-9b60-ae1a54772e6b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.581385 Nov 03 03:58:10.098417 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 882/1721] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:09 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:10.112967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:10.115900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:10.128949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:10.129494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:10.129942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:10.131096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:10.131368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:10.131558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:10.159173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:10.170290 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cdafd7d7-b6e9-4390-8a06-f14d13dc598c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1220 microversion: 2.1 time: 0.234622 Nov 03 03:58:10.170935 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 840/1722] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:09 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1220 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:10.187650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:10.188590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:10.195342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:10.196076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:10.209861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:10.210931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:10.211589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:10.212200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:10.591850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:10.601178 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28e0585b-e817-45c9-a049-971396d4bdeb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1198 microversion: 2.1 time: 0.501523 Nov 03 03:58:10.605303 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 883/1723] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:10 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1198 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:10.624331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:10.636053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a39dfdf4-b21b-45c1-9e46-c515ec7e4fbd tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1469 microversion: 2.1 time: 0.461819 Nov 03 03:58:10.643882 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 841/1724] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:10 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:10.964138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:10.965146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:10.971422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:10.971919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:10.972371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:10.973335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:10.973997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:10.975238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.059337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-072178d2-f22c-4aa2-93d1-4d84bdb156de req-fc5f6c90-9674-4a6a-b76d-f96f0255e5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:11.074880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-072178d2-f22c-4aa2-93d1-4d84bdb156de req-fc5f6c90-9674-4a6a-b76d-f96f0255e5d0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.075361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-072178d2-f22c-4aa2-93d1-4d84bdb156de req-fc5f6c90-9674-4a6a-b76d-f96f0255e5d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.075791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-072178d2-f22c-4aa2-93d1-4d84bdb156de req-fc5f6c90-9674-4a6a-b76d-f96f0255e5d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.087506 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-072178d2-f22c-4aa2-93d1-4d84bdb156de req-fc5f6c90-9674-4a6a-b76d-f96f0255e5d0 service nova] Creating event network-changed:3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:58:11.092702 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-072178d2-f22c-4aa2-93d1-4d84bdb156de req-fc5f6c90-9674-4a6a-b76d-f96f0255e5d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039723 Nov 03 03:58:11.093880 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 842/1725] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:58:11.126941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:11.130827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:11.141607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.142534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.144004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.150516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.151014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.151610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.388195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:11.421950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:11.424256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:11.426915 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45f30d41-c909-46fa-9d5e-34e20ec6eead tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.466749 Nov 03 03:58:11.427811 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 884/1726] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:10 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:11.435315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:11.436181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:11.467254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.467254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.467683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:11.472298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.473340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.474195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.476605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.478379 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40056852-39d8-4f33-85c6-ca61634b212c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.359597 Nov 03 03:58:11.479560 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 843/1727] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:11 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:11.577418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:11.591208 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-809e97d7-1b66-4e72-ac65-727b6ac3f8bc tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1238 microversion: 2.1 time: 0.161940 Nov 03 03:58:11.594782 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 885/1728] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:11 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1238 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:11.628059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:11.628668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:11.644640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.645163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.645607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.647095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.647564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.647989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.664560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:11.669852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:11.675647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.676626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.677259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.678186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:11.678852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:11.679456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:11.898454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:11.915533 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3519fdae-c849-4037-b46a-bf2b18233f3c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1381 microversion: 2.1 time: 0.291625 Nov 03 03:58:11.920799 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 844/1729] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:11 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1381 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:11.925754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:11.934617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-df328e8f-1847-4967-8e3c-bb5a805cdc4e tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1462 microversion: 2.1 time: 0.274647 Nov 03 03:58:11.935195 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 886/1730] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:11 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1462 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:12.100227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:12.101164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:12.108454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.109298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.110085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.114421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.114421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.114421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.152788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:12.153438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:12.163944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.164822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.165848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.166797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.167419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.168404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.335736 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e953b401-dc32-4c8b-80cd-3b2fd5a5098c tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1532 microversion: 2.1 time: 0.392818 Nov 03 03:58:12.349242 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 845/1731] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:11 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1532 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:12.359737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:12.360370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:12.372530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.373055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.373715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.374445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.374903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.375333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.400968 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5159d999-90eb-4fbe-a368-0f81fa26c3aa tempest-MigrationsAdminTest-211642071 tempest-MigrationsAdminTest-211642071-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1613 microversion: 2.1 time: 0.446953 Nov 03 03:58:12.413645 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 887/1732] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:11 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1613 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:12.433879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:12.434406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:12.446083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.446495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.446936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.452384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.453087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.453827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.499783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:58:12.567375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:12.570037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:12.574749 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ca62da9-3276-4920-9939-2bf8c99ede14 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1532 microversion: 2.1 time: 0.218764 Nov 03 03:58:12.585168 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 846/1733] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:12 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1532 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:12.585168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:12.585168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:12.589043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.589043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.589043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.589043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.589554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.589869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.829493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:12.840322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:12.842406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:12.844172 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5e744600-195d-4046-bd3b-565578e56e98 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.267834 Nov 03 03:58:12.845034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 847/1734] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:12 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:12.850057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:12.850990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:12.859317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.860932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.861269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.862231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.862980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.863705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.880095 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-494d3875-035f-4845-9eb9-e6bb642f6c0b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 204 len: 0 microversion: 2.1 time: 0.449487 Nov 03 03:58:12.881804 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 888/1735] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:58:12 2022] DELETE /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:58:12.888192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:12.892238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.904939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.905605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.906561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:12.914703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:12.918084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:12.988174 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2da1696a-ce02-4c51-b519-d762a96efae9 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104437 Nov 03 03:58:12.991948 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 889/1736] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 03:58:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:12.996979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:13.002473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:13.020933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.024811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.026619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.027504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.028899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.032658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.147344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:13.159974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:13.173559 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c75e044-1378-4107-90ef-3b9b3ddfae47 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1238 microversion: 2.1 time: 0.180190 Nov 03 03:58:13.177309 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 890/1737] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:12 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:13.178298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14408b63-952e-4b09-9eb4-431b575242f7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.329810 Nov 03 03:58:13.180146 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 848/1738] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:12 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:13.184853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:13.188506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854653-7", "block_migration": false, "disk_over_commit": false}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:13.189392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:13.194078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:13.201693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.202189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.202631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.203349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.203805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.205671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.207302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.207796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.208237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.209210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.209678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.210104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.236455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lazy-loading 'flavor' on Instance uuid 90ed965a-8dc9-4615-a8bd-dc2436ecd483 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:58:13.250657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Going to try to live migrate instance to n-h2-854653-7 {{(pid=127593) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:58:13.354849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:13.364072 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-46ce2af1-ac08-478a-91c6-19b710c630d8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1468 microversion: 2.1 time: 0.184324 Nov 03 03:58:13.376522 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 891/1739] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:13 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:13.376522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-64a7c728-6112-49c2-b6b2-5daf251a66da req-5d5f13a9-d8a4-4b58-83e3-5ea0e4486d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "name": "network-vif-plugged", "status": "completed", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:13.381146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-64a7c728-6112-49c2-b6b2-5daf251a66da req-5d5f13a9-d8a4-4b58-83e3-5ea0e4486d20 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.381829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-64a7c728-6112-49c2-b6b2-5daf251a66da req-5d5f13a9-d8a4-4b58-83e3-5ea0e4486d20 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.382371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-64a7c728-6112-49c2-b6b2-5daf251a66da req-5d5f13a9-d8a4-4b58-83e3-5ea0e4486d20 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.400083 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-64a7c728-6112-49c2-b6b2-5daf251a66da req-5d5f13a9-d8a4-4b58-83e3-5ea0e4486d20 service nova] Creating event network-vif-plugged:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h2-854653-7 Nov 03 03:58:13.406008 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-64a7c728-6112-49c2-b6b2-5daf251a66da req-5d5f13a9-d8a4-4b58-83e3-5ea0e4486d20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038933 Nov 03 03:58:13.410673 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 892/1740] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:13.859451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b61251b2-f921-4a47-99c2-903a30f00d77 req-f090f564-3a79-4ef1-a580-afefb035bcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "9b0a115d-5a93-4669-bac8-1ceb99cf533d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:13.888925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b61251b2-f921-4a47-99c2-903a30f00d77 req-f090f564-3a79-4ef1-a580-afefb035bcb2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.894192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b61251b2-f921-4a47-99c2-903a30f00d77 req-f090f564-3a79-4ef1-a580-afefb035bcb2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.894947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b61251b2-f921-4a47-99c2-903a30f00d77 req-f090f564-3a79-4ef1-a580-afefb035bcb2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.922104 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b61251b2-f921-4a47-99c2-903a30f00d77 req-f090f564-3a79-4ef1-a580-afefb035bcb2 service nova] Creating event network-changed:9b0a115d-5a93-4669-bac8-1ceb99cf533d for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:58:13.931129 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b61251b2-f921-4a47-99c2-903a30f00d77 req-f090f564-3a79-4ef1-a580-afefb035bcb2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076136 Nov 03 03:58:13.931752 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 893/1741] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:13.947526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:13.948510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:13.957885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.958382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.958884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:13.959603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:13.960276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:13.960715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:14.302134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:14.315952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:14.315952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:14.316915 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3ad9e36b-f9a0-4714-8098-7fd1063ce615 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.382435 Nov 03 03:58:14.318098 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 894/1742] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:13 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:14.327963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:14.328849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:14.342901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:14.345074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:14.345854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:14.346841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:14.347631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:14.348719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:14.634715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:14.651054 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8d87f3b-09db-486a-bffd-8809a1a13f8d tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1306 microversion: 2.1 time: 0.331664 Nov 03 03:58:14.651974 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 895/1743] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:14 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1306 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:14.657027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:14.657873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:14.679051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:14.679550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:14.680002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:14.680727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:14.681222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:14.681658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:14.916344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:14.929002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1d549e5b-7193-42a9-8bc4-10910e3195ac tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.275704 Nov 03 03:58:14.930158 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 896/1744] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:14 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:14.946511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:14.954729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:14.966755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:14.969649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:14.970295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:14.973718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:14.974450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:14.975622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:15.256909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:15.267160 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2ca2a298-6b0b-4d53-a06c-aae0f20d25d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 200 len: 1468 microversion: 2.1 time: 0.335724 Nov 03 03:58:15.268009 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 897/1745] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:14 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:15.346334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:15.346756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:15.363014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:15.363527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:15.363975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:15.364708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:15.365769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:15.366211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:15.736183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:15.760260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:15.762195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:15.769800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6716a18e-3947-459b-abec-aee7d6c29611 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.427456 Nov 03 03:58:15.799795 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 898/1746] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:15 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:58:15.818371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7a18b02a-25db-42e2-9f3c-e5b2f11eb413 req-c9ff0806-db13-413f-aff5-5039855d65cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7995a8-c618-447c-b285-ab5235a00517", "name": "network-vif-deleted", "tag": "0f49bad8-5f60-4ac7-9077-3bdedbce3828"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:15.862107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a18b02a-25db-42e2-9f3c-e5b2f11eb413 req-c9ff0806-db13-413f-aff5-5039855d65cb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:15.862834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a18b02a-25db-42e2-9f3c-e5b2f11eb413 req-c9ff0806-db13-413f-aff5-5039855d65cb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:15.863586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a18b02a-25db-42e2-9f3c-e5b2f11eb413 req-c9ff0806-db13-413f-aff5-5039855d65cb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:15.878565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7a18b02a-25db-42e2-9f3c-e5b2f11eb413 req-c9ff0806-db13-413f-aff5-5039855d65cb service nova] Creating event network-vif-deleted:0f49bad8-5f60-4ac7-9077-3bdedbce3828 for instance 6f7995a8-c618-447c-b285-ab5235a00517 on n-h2-854653-7 Nov 03 03:58:15.895036 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7a18b02a-25db-42e2-9f3c-e5b2f11eb413 req-c9ff0806-db13-413f-aff5-5039855d65cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091045 Nov 03 03:58:15.907373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 899/1747] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:15.924696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:15.929946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:15.934586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:15.935456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:15.936166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:15.937709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:15.938358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:15.939051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:16.059947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:16.121847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:16.733262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:16.743440 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d817ea1d-9dc4-4bd3-8114-311be2346887 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1306 microversion: 2.1 time: 0.834512 Nov 03 03:58:16.744077 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 900/1748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:15 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1306 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:16.751996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:16.759515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:16.770807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:16.776098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:16.780415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:16.780415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:16.780415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:16.780415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.010933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:17.021670 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10ae37cf-198f-4389-9435-dbab8786f546 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.274577 Nov 03 03:58:17.023306 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 901/1749] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:16 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:17.029108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:17.030119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 6f7995a8-c618-447c-b285-ab5235a00517] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:17.038438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.039367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.040214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.041278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.041934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.042618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.065642 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] HTTP exception thrown: Instance 6f7995a8-c618-447c-b285-ab5235a00517 could not be found. Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Request method failure captured: Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 HTTP/1.1 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzr2Vv9XN6yHCm1aespaBthOdgpdBq7N4g1gUalIdvFrSY5iF44OR_kRsdpMFdproBBmKoGAaIiE3fYVGJaPRD7-dpQ-LGkl6PmJd_27x-1wwy0qZtCazTBMQcRXilUzA3TRQFc5hj_SpvZjRg_KONpzwzKJUnVIRFFoCW_uvklUfRE Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68cd41e9643b443b81b22489194213c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68cd41e9643b443b81b22489194213c7"}]}] Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 74ac442756f54baa8b70bb302b35b95c Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 6f7995a8-c618-447c-b285-ab5235a00517 could not be found. Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '6f7995a8-c618-447c-b285-ab5235a00517'} Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f7995a8-c618-447c-b285-ab5235a00517 could not be found. Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f7995a8-c618-447c-b285-ab5235a00517 could not be found. Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:17.068279 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f7995a8-c618-447c-b285-ab5235a00517 could not be found. Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Returning 404 to user: Instance 6f7995a8-c618-447c-b285-ab5235a00517 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98058042-5856-4e0b-939f-9fc59181f57a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517" status: 404 len: 111 microversion: 2.1 time: 0.045175 Nov 03 03:58:17.073564 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 902/1750] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:17 2022] GET /compute/v2.1/servers/6f7995a8-c618-447c-b285-ab5235a00517 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:17.079926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:17.080615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:17.088449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.088962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.089444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.090840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.091503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.091951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.177543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:17.346701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:17.357571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:17.359128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:17.360836 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0f7ad7b-2f53-4d1a-89cd-4086b0cb14a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.288495 Nov 03 03:58:17.361987 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 903/1751] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:17 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:17.366836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:17.367609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:17.374356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.375157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.375856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.376811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.377526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.378185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.407920 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8183dfe1-aa80-4c76-ac75-4e143b6c7a02 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483/action" status: 202 len: 0 microversion: 2.1 time: 4.226532 Nov 03 03:58:17.412684 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 849/1752] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:58:13 2022] POST /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483/action => generated 0 bytes in 4232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:58:17.417706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:17.418405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:17.421757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:58:17.433552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.434050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.437686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.437686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.437686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.437686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.607191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:17.616228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1813df04-6712-473c-844b-aded1d099e14 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.202283 Nov 03 03:58:17.621305 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 850/1753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:17 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:17.773186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:17.774120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:17.790137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.790746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.791300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.792163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.792671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.794079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.804477 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a2413bd-becc-4afa-b87c-ca1a2fd6832a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 204 len: 0 microversion: 2.1 time: 0.440880 Nov 03 03:58:17.812602 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 904/1754] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:58:17 2022] DELETE /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:58:17.815596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:17.818611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:17.830413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.833156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.834969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:17.835717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:17.836185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:17.837117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.037247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:18.046773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-944bdda4-79bd-49d4-9bff-50dfff921928 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1306 microversion: 2.1 time: 0.279242 Nov 03 03:58:18.048005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 851/1755] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:17 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1306 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:18.053415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:18.054498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:18.061099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:18.061911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:18.062614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.063555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:18.064239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:18.065457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.086613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:18.097191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-88d7b657-78d4-4f6e-8618-ae4721066092 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1533 microversion: 2.1 time: 0.285845 Nov 03 03:58:18.097882 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 905/1756] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:17 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1533 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:18.227010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:18.238152 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aecf70f2-3dac-4fa6-8b70-90c3c319b8c6 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.188878 Nov 03 03:58:18.240835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 852/1757] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:18 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:18.391503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:18.392204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:18.399090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:18.399593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:18.400037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.400843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:18.401394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:18.401835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.406392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:18.417982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1f15e9f7-5c8d-444c-8645-90f1deb82d5e req-087c1c47-8152-4301-9b3c-36fd702cc0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87397ac1-d176-430d-b8ee-56755d8beca3", "tag": "7b3c2b66-95e4-4ca5-9750-e62618eca2a6"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:18.428929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1f15e9f7-5c8d-444c-8645-90f1deb82d5e req-087c1c47-8152-4301-9b3c-36fd702cc0c7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:18.430082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1f15e9f7-5c8d-444c-8645-90f1deb82d5e req-087c1c47-8152-4301-9b3c-36fd702cc0c7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:18.430516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1f15e9f7-5c8d-444c-8645-90f1deb82d5e req-087c1c47-8152-4301-9b3c-36fd702cc0c7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.442300 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1f15e9f7-5c8d-444c-8645-90f1deb82d5e req-087c1c47-8152-4301-9b3c-36fd702cc0c7 service nova] Creating event network-changed:7b3c2b66-95e4-4ca5-9750-e62618eca2a6 for instance 87397ac1-d176-430d-b8ee-56755d8beca3 on n-h2-854653-7 Nov 03 03:58:18.448803 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1f15e9f7-5c8d-444c-8645-90f1deb82d5e req-087c1c47-8152-4301-9b3c-36fd702cc0c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037434 Nov 03 03:58:18.449939 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 853/1758] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:18.634098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:18.641820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:18.642663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:18.647637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:18.649523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:18.650464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:18.650599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:18.651055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.651328 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2009f12-0694-4fe8-84c7-854f970a622e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.264171 Nov 03 03:58:18.651931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:18.652516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:18.665030 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 906/1759] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:18 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:18.665254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:18.807702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:18.816840 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12af85dd-5770-41d2-b400-37e6a491e5c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.179154 Nov 03 03:58:18.817286 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 854/1760] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:18 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:19.070255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:19.070805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:19.073429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:19.078508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.078997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.079448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:19.080152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.080612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.081079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:19.119651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:19.120281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:19.134856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.135373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.137319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:19.137319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.137319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.137646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:19.532882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:19.542206 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-628e8823-402b-4c07-8b3e-68c452957954 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1533 microversion: 2.1 time: 0.426296 Nov 03 03:58:19.546672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:19.557606 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 855/1761] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:19 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1533 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:19.557606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:19.557606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:19.563344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.564304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.564979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:19.565952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.566650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.567204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:19.619831 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e0fd5b6-633c-44e3-a816-7572135ce4a9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1306 microversion: 2.1 time: 0.553950 Nov 03 03:58:19.621074 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 907/1762] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:19 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1306 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:19.686877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:19.688829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:19.703397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.703901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.704478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:19.705643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:19.706195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:19.706589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.087470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:20.104387 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-301ac118-2d8c-4230-b701-18c30dc00f7c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.555059 Nov 03 03:58:20.105474 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 856/1763] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:19 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:20.112490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:20.113897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:20.121421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:20.122217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:20.123363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.124713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:20.125563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:20.126200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.269959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:20.282883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:20.284761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:20.286176 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45249e40-e469-4dff-9d93-dc2c586e2de6 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.607582 Nov 03 03:58:20.301739 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 908/1764] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:19 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:58:20.441790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:20.456243 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9467ef49-0b91-43df-95cb-5e9062a4fbde tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.346666 Nov 03 03:58:20.457107 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 857/1765] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:20 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:20.470175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a02e510e-8ec9-4b3a-be5d-dec2879e0661 req-332ac065-4dc0-4224-86da-bad810ffc31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "606a7cb9-b94b-4ddc-8269-c39b0f27ee7d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:20.504697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a02e510e-8ec9-4b3a-be5d-dec2879e0661 req-332ac065-4dc0-4224-86da-bad810ffc31f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:20.506427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a02e510e-8ec9-4b3a-be5d-dec2879e0661 req-332ac065-4dc0-4224-86da-bad810ffc31f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:20.507163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a02e510e-8ec9-4b3a-be5d-dec2879e0661 req-332ac065-4dc0-4224-86da-bad810ffc31f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.528191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a02e510e-8ec9-4b3a-be5d-dec2879e0661 req-332ac065-4dc0-4224-86da-bad810ffc31f service nova] Creating event network-changed:606a7cb9-b94b-4ddc-8269-c39b0f27ee7d for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:58:20.538678 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a02e510e-8ec9-4b3a-be5d-dec2879e0661 req-332ac065-4dc0-4224-86da-bad810ffc31f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073332 Nov 03 03:58:20.539295 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 909/1766] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:58:20.580199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:20.581003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:20.590777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:20.591476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:20.592005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.592822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:20.593432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:20.593949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.650320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:20.651966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:20.669156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:20.672860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:20.673933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.674938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:20.675648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:20.677072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:20.943423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:20.952505 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37e75a8b-0959-4bb5-81d7-6e26cc036da2 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1533 microversion: 2.1 time: 0.380865 Nov 03 03:58:20.953684 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 858/1767] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:20 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1533 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:21.004790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:21.014294 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f5d968a3-2015-4895-a52f-de918e4226fa tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.370241 Nov 03 03:58:21.029086 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 910/1768] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:20 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:21.132314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:21.138884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:21.145530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.150770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.151568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:21.152576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.155447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.156191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:21.319496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:21.320645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:21.335122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.336621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.337104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:21.341661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.342188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.343950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:21.398139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:21.409590 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83c3dc07-b91b-4c21-888b-97e82cbbbc21 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.285182 Nov 03 03:58:21.414415 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 859/1769] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:21 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:21.485876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:21.487376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:21.495434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.496314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.497060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:21.498085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.499512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.500184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:21.781208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:21.840328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:21.853546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:21.864004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3ca2da8e-2587-40a8-985a-662391df3ee1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.541438 Nov 03 03:58:21.881734 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 911/1770] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:21 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:21.881847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:21.883693 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-852d5962-9782-4ee5-91b8-e2943c1d325e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.402319 Nov 03 03:58:21.884922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 860/1771] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:21 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:21.979272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:21.989952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:21.989952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.989952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.990692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:21.991814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:21.992286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:21.993050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.041999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:22.042869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:22.061713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.062412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.063042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.063927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.064522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.065081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.170895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:22.185646 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2193d24c-651d-410e-b890-b57838442cf5 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 200 len: 1363 microversion: 2.1 time: 0.211534 Nov 03 03:58:22.187181 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 912/1772] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:21 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:22.438766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:22.440454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:22.464418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.466824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.468296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.470152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.471257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.472621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.551440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:22.565457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-436045b1-3ec6-4c11-9c9e-ec6ab143604b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.529213 Nov 03 03:58:22.585932 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 861/1773] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:22 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:22.592863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-11993bad-ce4d-4d1f-9788-0301490edbbd req-bcc7ed56-be72-4584-a6bc-ea7290edb28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b033176-fb9d-429b-a068-6e8914bdc171", "name": "network-vif-deleted", "tag": "bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:22.606868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-11993bad-ce4d-4d1f-9788-0301490edbbd req-bcc7ed56-be72-4584-a6bc-ea7290edb28b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.607716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-11993bad-ce4d-4d1f-9788-0301490edbbd req-bcc7ed56-be72-4584-a6bc-ea7290edb28b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.609744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-11993bad-ce4d-4d1f-9788-0301490edbbd req-bcc7ed56-be72-4584-a6bc-ea7290edb28b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.615484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:22.626539 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-11993bad-ce4d-4d1f-9788-0301490edbbd req-bcc7ed56-be72-4584-a6bc-ea7290edb28b service nova] Creating event network-vif-deleted:bbcc0fa3-bba1-4501-b4ce-d8d6fa431db9 for instance 2b033176-fb9d-429b-a068-6e8914bdc171 on n-h2-854653-7 Nov 03 03:58:22.632102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-11993bad-ce4d-4d1f-9788-0301490edbbd req-bcc7ed56-be72-4584-a6bc-ea7290edb28b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044613 Nov 03 03:58:22.633454 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 862/1774] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:22.741241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:22.753514 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b134162-a2e2-4e63-ab9b-bca7a3a6f7da tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.319010 Nov 03 03:58:22.754945 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 913/1775] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:22 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:22.897301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:22.899280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:22.922622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:22.930244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:22.936257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.939430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.939818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:22.943775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.944820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.945975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.948130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.949038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.949818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.950500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:22.951379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:22.954452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:22.955173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:22.956030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:23.396015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:23.407296 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42bc9342-fb48-463f-a2cd-8d26d055d5c9 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.488336 Nov 03 03:58:23.408202 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 914/1776] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:22 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:23.421698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:23.427792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 2b033176-fb9d-429b-a068-6e8914bdc171] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:23.435924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:23.436420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:23.436856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:23.437790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:23.438256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:23.438685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:23.462789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:23.476357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:23.478633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:23.480846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] HTTP exception thrown: Instance 2b033176-fb9d-429b-a068-6e8914bdc171 could not be found. Nov 03 03:58:23.481563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-46656cc4-fb0f-4e67-93b6-ea181fa942fa tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.589373 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Request method failure captured: Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 HTTP/1.1 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzr2Vv9XN6yHCm1aespaBthOdgpdBq7N4g1gUalIdvFrSY5iF44OR_kRsdpMFdproBBmKoGAaIiE3fYVGJaPRD7-dpQ-LGkl6PmJd_27x-1wwy0qZtCazTBMQcRXilUzA3TRQFc5hj_SpvZjRg_KONpzwzKJUnVIRFFoCW_uvklUfRE Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68cd41e9643b443b81b22489194213c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68cd41e9643b443b81b22489194213c7"}]}] Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 74ac442756f54baa8b70bb302b35b95c Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 2b033176-fb9d-429b-a068-6e8914bdc171 could not be found. Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '2b033176-fb9d-429b-a068-6e8914bdc171'} Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b033176-fb9d-429b-a068-6e8914bdc171 could not be found. Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b033176-fb9d-429b-a068-6e8914bdc171 could not be found. Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:23.497415 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b033176-fb9d-429b-a068-6e8914bdc171 could not be found. Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Returning 404 to user: Instance 2b033176-fb9d-429b-a068-6e8914bdc171 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3ddea77f-d4b9-4526-9e24-2362806d1291 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171" status: 404 len: 111 microversion: 2.1 time: 0.073251 Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 915/1777] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:23 2022] GET /compute/v2.1/servers/2b033176-fb9d-429b-a068-6e8914bdc171 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:23.511476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-580a82d0-3eea-4590-8e6d-57bcf34ce4d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '.version_select at 0x7ff7f9861af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:23.513431 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 863/1778] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:22 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:23.589927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:23.591230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:23.601471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:23.602863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:23.603318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:23.605260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:23.605746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:23.608741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:23.612625 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-580a82d0-3eea-4590-8e6d-57bcf34ce4d3 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134022048" status: 202 len: 0 microversion: 2.1 time: 0.118693 Nov 03 03:58:23.613240 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 916/1779] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 03:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1134022048 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 03:58:23.780487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:23.781226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:23.799012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:23.799517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:23.799962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:23.800683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:23.801218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:23.801624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:24.424624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:24.441241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bd05201d-e137-4144-8289-893a30d77453 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.853349 Nov 03 03:58:24.443750 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 864/1780] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:23 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:24.459086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:24.460090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:24.468835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:24.471909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:24.473570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:24.476348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:24.477140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:24.478410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:24.558985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:24.575702 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e2d0f74f-ff83-4268-a3fc-b6545d2a50dd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1508 microversion: 2.1 time: 0.797200 Nov 03 03:58:24.580309 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 917/1781] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:23 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1508 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:24.620092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:24.624554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:24.646741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:24.647241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:24.650516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:24.653414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:24.655106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:24.658772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:25.061911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:25.075270 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a077b7f-17fb-4b8e-b76f-969e785328d5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.629683 Nov 03 03:58:25.076671 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 865/1782] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:24 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:25.180360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:25.193994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:25.195800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:25.197380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8bc3884d-dbbc-4f6b-b9de-1ccef6021a0a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.593794 Nov 03 03:58:25.198209 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 918/1783] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:24 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:25.464530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:25.465261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:25.482478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:25.482998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:25.483458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:25.484203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:25.484747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:25.485237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:25.610139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:25.612111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:25.641833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:25.643188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:25.644531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:25.647965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:25.648718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:25.649869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.168016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:26.181427 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-945d976d-1708-434e-b21c-2f32f494b381 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.720900 Nov 03 03:58:26.183781 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 866/1784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:25 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:26.203273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:26.204428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:26.205348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:26.216125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.216982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.217722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.220430 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20cff119-9ea3-4d21-8e5d-f849702aeffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1529 microversion: 2.1 time: 0.615981 Nov 03 03:58:26.223436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.225175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.225889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.233715 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 919/1785] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:25 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1529 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:26.245168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:26.246062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:26.252602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.253334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.253946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.254833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.255491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.256090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.279697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:58:26.659827 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1a8b704-82e9-4a5c-800b-2e05463d22c9 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "DELETE /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 204 len: 0 microversion: 2.1 time: 0.474486 Nov 03 03:58:26.662864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 867/1786] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:58:26 2022] DELETE /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:58:26.663705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:26.671834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:26.673719 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c761df5-5edd-4595-8ecb-7b4b1d48693f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.438836 Nov 03 03:58:26.675486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:26.678658 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 920/1787] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:26 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:26.696486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:26.697736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:26.704410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.705198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.706390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.707284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.707909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.709087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.709307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.710007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.710526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:26.711399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:26.711937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:26.712557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:27.126117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:27.136980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a3104dd-3239-4785-a62f-71bebb694393 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1467 microversion: 2.1 time: 0.453867 Nov 03 03:58:27.152729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:27.153798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 921/1788] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:26 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1467 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:27.163873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:27.165610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:27.167164 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d270f7af-248f-4649-a31b-a1fe86981c65 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.502132 Nov 03 03:58:27.168497 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 868/1789] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:26 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:27.207781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:27.208758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:27.216592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:27.217480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:27.218410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:27.219792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:27.220484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:27.221179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:27.249514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:27.251523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:27.264343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:27.266168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:27.266168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:27.267817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:27.269999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:27.271102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:27.553053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:27.563439 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-45aa685d-343a-4476-9ed3-868e3331f81d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1529 microversion: 2.1 time: 0.318238 Nov 03 03:58:27.564039 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 869/1790] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:27 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1529 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:27.607201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:27.630000 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2df99ed9-6a79-4264-821e-cde90223a2da tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.425965 Nov 03 03:58:27.645447 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 922/1791] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:27 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:27.701443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:27.702071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:27.711368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:27.711873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:27.712320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:27.718049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:27.718714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:27.719170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:28.162520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:28.163784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:28.171159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:28.171965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:28.172649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:28.173641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:28.174279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:28.174907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:28.464454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:28.472938 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d98a5ac5-9383-4a0a-901f-5501ef32e68b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.775368 Nov 03 03:58:28.485438 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 870/1792] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:27 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:28.495156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:28.496081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:28.503162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:28.503992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:28.504628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:28.506132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:28.506769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:28.507377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:28.940611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:28.947939 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78ba8578-cca9-42bd-a7e6-e2904ff38947 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1467 microversion: 2.1 time: 0.789506 Nov 03 03:58:28.964269 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 923/1793] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:28 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1467 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:28.965988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:28.966609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:28.984928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:28.985965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:28.986553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:28.987434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:28.988066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:28.988496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:29.422954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:29.447801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:29.453693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:29.457186 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-285ec5f5-25d2-4129-a361-f335d138d59f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.968553 Nov 03 03:58:29.457186 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 871/1794] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:28 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:29.462717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:29.463733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:29.472804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:29.474614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:29.475274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:29.477199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:29.477363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:29.478506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:29.479189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:29.486455 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ddcc897b-5399-4405-bab6-c0d7158d08af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1529 microversion: 2.1 time: 0.524185 Nov 03 03:58:29.492598 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 924/1795] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:28 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1529 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:29.500476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:29.507129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:29.518013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:29.518514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:29.518956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:29.519680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:29.520140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:29.521172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:29.524241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:30.195946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:30.207649 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6e99996-5692-469d-9d50-2e3d830dd7f2 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.750492 Nov 03 03:58:30.210087 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 872/1796] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:29 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:30.228044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:30.228642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:30.246582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:30.248712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:30.258731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:30.260313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:30.262952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:30.265400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:30.582018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:30.591539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95880fe3-89de-4c87-9510-24bfe5ae70f5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 1.096312 Nov 03 03:58:30.600497 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 925/1797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:29 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:30.609214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:30.616195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:30.629520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:30.630562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:30.631139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:30.631726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:30.632186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:30.646914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:30.863613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:30.879224 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d10b8e33-a19f-4b9c-9a32-106252c27b62 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1467 microversion: 2.1 time: 0.664201 Nov 03 03:58:30.879416 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 873/1798] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:30 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1467 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:30.891767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:30.892946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:30.911024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:30.915722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:30.916214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:30.922043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:30.928075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:30.928523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:31.920919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:31.940543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:31.942699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:31.959896 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75df2092-9818-47d0-98c6-1869fd485aa0 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 1.357754 Nov 03 03:58:31.960496 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 926/1799] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:30 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:32.008312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:32.016673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:32.034403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:32.045858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:32.046354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:32.046796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:32.057613 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c281807d-9a93-4d73-b842-b7a7d322bf9e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 1.166473 Nov 03 03:58:32.058304 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 874/1800] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:30 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:32.066382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:32.066918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:32.067908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:32.086171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b11e183f-bfcf-41c9-ab92-a2b5aec8b3a8 req-f939378b-fc83-40b2-ab97-01073d2041ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fceff-bafd-4b2a-a220-f1f9d57deb42", "name": "network-vif-plugged", "status": "completed", "tag": "5b7b0984-1390-4bb9-b7a9-feef1a456443"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:32.112201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b11e183f-bfcf-41c9-ab92-a2b5aec8b3a8 req-f939378b-fc83-40b2-ab97-01073d2041ae service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:32.114458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b11e183f-bfcf-41c9-ab92-a2b5aec8b3a8 req-f939378b-fc83-40b2-ab97-01073d2041ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:32.115078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b11e183f-bfcf-41c9-ab92-a2b5aec8b3a8 req-f939378b-fc83-40b2-ab97-01073d2041ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:32.147848 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b11e183f-bfcf-41c9-ab92-a2b5aec8b3a8 req-f939378b-fc83-40b2-ab97-01073d2041ae service nova] Creating event network-vif-plugged:5b7b0984-1390-4bb9-b7a9-feef1a456443 for instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 on n-h1-854653-7 Nov 03 03:58:32.163503 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b11e183f-bfcf-41c9-ab92-a2b5aec8b3a8 req-f939378b-fc83-40b2-ab97-01073d2041ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099971 Nov 03 03:58:32.167393 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 875/1801] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:32.195708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:32.209832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:32.235946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:32.237381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:32.239986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:32.243239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:32.245193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:32.247634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:32.902049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:32.922326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ca2066ff-3429-4dfc-ae6f-51502f0fb35a tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.960316 Nov 03 03:58:32.923566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 927/1802] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:31 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:32.960401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6991e7f9-c047-492f-b3fa-b1b7131e8dbb req-afe9b8d5-ddaa-4b78-8855-2430a99961a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a6e84a-57a6-4788-9864-9263e9f2e08d", "name": "network-vif-deleted", "tag": "78c74cd3-8416-43d4-86d6-a1a41c25566e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:32.964944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:32.974371 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-883ada16-9642-4672-b3aa-23b4fa95c7e2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.804208 Nov 03 03:58:32.975554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 876/1803] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:32 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:32.984557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:32.985217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:33.008883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6991e7f9-c047-492f-b3fa-b1b7131e8dbb req-afe9b8d5-ddaa-4b78-8855-2430a99961a8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.011208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6991e7f9-c047-492f-b3fa-b1b7131e8dbb req-afe9b8d5-ddaa-4b78-8855-2430a99961a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.012513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6991e7f9-c047-492f-b3fa-b1b7131e8dbb req-afe9b8d5-ddaa-4b78-8855-2430a99961a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.012984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.013943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.014584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.015604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.017643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.018266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.042227 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6991e7f9-c047-492f-b3fa-b1b7131e8dbb req-afe9b8d5-ddaa-4b78-8855-2430a99961a8 service nova] Creating event network-vif-deleted:78c74cd3-8416-43d4-86d6-a1a41c25566e for instance 05a6e84a-57a6-4788-9864-9263e9f2e08d on n-h1-854653-7 Nov 03 03:58:33.058876 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6991e7f9-c047-492f-b3fa-b1b7131e8dbb req-afe9b8d5-ddaa-4b78-8855-2430a99961a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134666 Nov 03 03:58:33.062666 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 928/1804] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:33.079869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:33.080424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:33.101546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.102046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.102498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.103212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.103669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.104102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.125570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.126791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.127262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.135206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lazy-loading 'fault' on Instance uuid 05a6e84a-57a6-4788-9864-9263e9f2e08d {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:58:33.237505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:33.243025 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11b3718e-dc22-4816-b7cf-7e5b7f936a57 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 200 len: 1302 microversion: 2.1 time: 0.265624 Nov 03 03:58:33.248908 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 877/1805] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:32 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 1302 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:33.259011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:33.266183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:33.276736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.278761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.279339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.284334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.285587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.286817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.335349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:33.667830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:33.684182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:33.685650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:33.696337 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-be794717-c3d1-4d2c-a905-ab6dc7fb29a2 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.632181 Nov 03 03:58:33.697659 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 929/1806] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:33 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:33.750761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:33.768109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38a5e0eb-89d4-46de-b5aa-0672a22e4021 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 0.509996 Nov 03 03:58:33.769522 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 878/1807] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:33 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:33.949931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:33.950561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:33.963645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.964149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.964588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.965340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:33.965803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:33.966297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:33.999861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:34.000487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:34.015763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:34.016257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:34.026405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:34.030130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:34.030803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:34.032458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:34.835247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:34.845433 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-df38748f-e208-49b0-8f3f-818393db4ea6 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1294 microversion: 2.1 time: 0.899753 Nov 03 03:58:34.862440 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 930/1808] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:33 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1294 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:34.868014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3b52503b-1cdd-4f9c-8144-fe25f5f968fd req-633e13d3-5697-4d0d-ab81-752399401795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87397ac1-d176-430d-b8ee-56755d8beca3", "name": "network-vif-plugged", "status": "completed", "tag": "7b3c2b66-95e4-4ca5-9750-e62618eca2a6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:34.912330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3b52503b-1cdd-4f9c-8144-fe25f5f968fd req-633e13d3-5697-4d0d-ab81-752399401795 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:34.913206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3b52503b-1cdd-4f9c-8144-fe25f5f968fd req-633e13d3-5697-4d0d-ab81-752399401795 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:34.913827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3b52503b-1cdd-4f9c-8144-fe25f5f968fd req-633e13d3-5697-4d0d-ab81-752399401795 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:34.920377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:34.929920 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d24707c3-8141-463c-bd1c-b67f87177a8b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.933964 Nov 03 03:58:34.931268 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3b52503b-1cdd-4f9c-8144-fe25f5f968fd req-633e13d3-5697-4d0d-ab81-752399401795 service nova] Creating event network-vif-plugged:7b3c2b66-95e4-4ca5-9750-e62618eca2a6 for instance 87397ac1-d176-430d-b8ee-56755d8beca3 on n-h2-854653-7 Nov 03 03:58:34.935647 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 879/1809] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:33 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:34.939105 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3b52503b-1cdd-4f9c-8144-fe25f5f968fd req-633e13d3-5697-4d0d-ab81-752399401795 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075263 Nov 03 03:58:34.940301 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 931/1810] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:34.941051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:34.956772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:34.958928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:34.962468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 05a6e84a-57a6-4788-9864-9263e9f2e08d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:34.971969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:34.972895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:34.974162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:34.975143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:34.975840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:34.976519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:34.979644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:34.982593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:34.983239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:34.989738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:34.990435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:34.997707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:35.028072 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] HTTP exception thrown: Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d could not be found. Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Request method failure captured: Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d HTTP/1.1 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzr2Vv9XN6yHCm1aespaBthOdgpdBq7N4g1gUalIdvFrSY5iF44OR_kRsdpMFdproBBmKoGAaIiE3fYVGJaPRD7-dpQ-LGkl6PmJd_27x-1wwy0qZtCazTBMQcRXilUzA3TRQFc5hj_SpvZjRg_KONpzwzKJUnVIRFFoCW_uvklUfRE Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68cd41e9643b443b81b22489194213c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68cd41e9643b443b81b22489194213c7"}]}] Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 74ac442756f54baa8b70bb302b35b95c Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d could not be found. Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '05a6e84a-57a6-4788-9864-9263e9f2e08d'} Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d could not be found. Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d could not be found. Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:35.040491 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:35.045748 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:35.045748 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:35.045748 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:35.045748 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:35.045748 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:35.045748 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d could not be found. Nov 03 03:58:35.045748 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:35.047134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Returning 404 to user: Instance 05a6e84a-57a6-4788-9864-9263e9f2e08d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:35.050158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-084a21a8-959a-44f9-813e-06efe802aef4 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d" status: 404 len: 111 microversion: 2.1 time: 0.112946 Nov 03 03:58:35.052470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 880/1811] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:34 2022] GET /compute/v2.1/servers/05a6e84a-57a6-4788-9864-9263e9f2e08d => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:35.064294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:35.070481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:35.092087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:35.095251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:35.097370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:35.113099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:35.113821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:35.116969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:35.730950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:35.749149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:35.751001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:35.754988 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c253002-b76b-4cfd-9d13-922c444ca428 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.812803 Nov 03 03:58:35.758120 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 932/1812] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:34 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:35.769588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:35.770503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:35.784932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:35.786488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:35.787984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:35.791705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:35.792566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:35.793175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:35.793581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:35.821616 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04bc471b-bbc4-4150-a12f-5a7f0c9dd0af tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 0.758762 Nov 03 03:58:35.822361 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 881/1813] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:35 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:35.860125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:58:36.204160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bba38303-068a-41b1-ba9b-55bfac03e58c tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Action: 'create', calling method: .version_select at 0x7ff7f92e4dc0>, body: {"pool": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:36.580482 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-edc54994-ae1c-49c2-a655-44f0ece5d5f8 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 204 len: 0 microversion: 2.1 time: 0.820733 Nov 03 03:58:36.585995 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 933/1814] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:58:35 2022] DELETE /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 0 bytes in 823 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:58:36.737184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1471363611", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:36.858778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] validate_networks() for [('a7bcc526-54ff-467b-af8a-dcb5382ba079', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:58:38.349897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:58:38.349897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:58:38.349897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:58:38.349897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:58:38.349897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:58:38.368303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:38.369615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:38.370485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:38.372832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:38.372832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:38.372832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:38.396125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Getting quotas for project 639550f5bd124c76ac1344d804632929. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:58:38.403798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Getting quotas for user b0617b26463e4602902a3c5f27c8b891 and project 639550f5bd124c76ac1344d804632929. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:58:38.419607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:58:38.422620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:58:38.621148 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8f1c469-59aa-4895-b479-c8a36674ca43 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.037988 Nov 03 03:58:38.633792 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 934/1815] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:58:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:58:38.661687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:38.672661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:38.706218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:38.711784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:38.712411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:38.717519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:38.719719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:38.729262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:39.280915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:39.289803 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef116b7a-80b6-485f-9113-f9ef0fee84e9 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1484 microversion: 2.1 time: 0.651256 Nov 03 03:58:39.290569 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 935/1816] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:38 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1484 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:39.300700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:39.301362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:39.313519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:39.314220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:39.314672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:39.315564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:39.316031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:39.316725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:39.784559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:39.799055 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27273e12-4772-4796-a7ee-d6898256b53d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.503978 Nov 03 03:58:39.803767 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 936/1817] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:39 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:39.813447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:39.814467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:39.830321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:39.833720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:39.834935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:39.837360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:39.842423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:39.843239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:40.030357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:40.064660 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b287377c-6067-43ad-93d3-de35b17e2582 tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1427 microversion: 2.1 time: 0.259341 Nov 03 03:58:40.070281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 937/1818] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:39 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1427 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:40.079959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:40.081712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:40.108606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:40.124937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:40.127156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:40.129297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:40.130240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:40.130882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:40.665579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:40.683888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:40.690837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:40.697713 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-373be4e3-f85e-4ba5-92ba-224162471d33 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.625554 Nov 03 03:58:40.701343 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 938/1819] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:40 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:40.719008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1df85be7-c38e-4494-9d30-9d56c9efc821 req-db114e5a-a88f-43b3-8a53-9bbcdfb4de1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ed965a-8dc9-4615-a8bd-dc2436ecd483", "name": "network-vif-unplugged", "status": "completed", "tag": "d9698e41-18ac-4728-88d7-fdd2f72e075d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:40.751996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1df85be7-c38e-4494-9d30-9d56c9efc821 req-db114e5a-a88f-43b3-8a53-9bbcdfb4de1c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:40.756977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1df85be7-c38e-4494-9d30-9d56c9efc821 req-db114e5a-a88f-43b3-8a53-9bbcdfb4de1c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:40.756977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1df85be7-c38e-4494-9d30-9d56c9efc821 req-db114e5a-a88f-43b3-8a53-9bbcdfb4de1c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:40.774269 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1df85be7-c38e-4494-9d30-9d56c9efc821 req-db114e5a-a88f-43b3-8a53-9bbcdfb4de1c service nova] Creating event network-vif-unplugged:d9698e41-18ac-4728-88d7-fdd2f72e075d for instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 on n-h1-854653-7 Nov 03 03:58:40.781275 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1df85be7-c38e-4494-9d30-9d56c9efc821 req-db114e5a-a88f-43b3-8a53-9bbcdfb4de1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070886 Nov 03 03:58:40.785042 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 939/1820] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:40.791791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:40.793364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:40.814301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:40.814301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:40.814301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:40.814301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:40.814301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:40.815412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.100700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:41.108665 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7048fe00-158f-4e9d-9dfc-7ee80dc945ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 0.324633 Nov 03 03:58:41.109269 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 940/1821] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:40 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:41.130577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:41.131324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:41.137772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.138269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.138936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.139654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.140395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.141260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.275977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:41.285328 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7fb9d9e9-83bd-46b7-9112-9a70e2b296a1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1228 microversion: 2.1 time: 0.158992 Nov 03 03:58:41.289247 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 941/1822] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:41 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1228 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:41.293234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:41.293750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:41.300258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.300746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.301939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.302715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.303430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.303836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.450731 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9a01aea-c56c-4279-8c05-17bcb62758c8 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163620 Nov 03 03:58:41.451904 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 942/1823] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 03:58:41 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:41.457840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:41.474045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:41.500517 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bba38303-068a-41b1-ba9b-55bfac03e58c tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.676018 Nov 03 03:58:41.501770 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 882/1824] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 03:58:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:41.501915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.502463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.503254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.507437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:41.508251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:41.518397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.519015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.519481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.523231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:41.525389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.526097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.526319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.527245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.530863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.531622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.605227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:41.605860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:41.606372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:41.606916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lazy-loading 'fault' on Instance uuid 5eb3fa88-5c7b-4b15-ac0b-347c3353070f {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:58:41.679646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74ac442756f54baa8b70bb302b35b95c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68cd41e9643b443b81b22489194213c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:41.691573 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7dc432b8-f4ba-4f09-9feb-3598cff1524b tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 200 len: 1303 microversion: 2.1 time: 0.188560 Nov 03 03:58:41.699598 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 883/1825] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:41 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:41.721667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50bc1991-b754-4260-981c-07a6f6d7bc99 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Calling method '.version_select at 0x7ff7fd658ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:42.023986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:42.038313 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-168858ca-f59b-463a-9c3a-de9741f24b85 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.585228 Nov 03 03:58:42.049194 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 943/1826] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:41 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:42.064084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:42.068593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:42.082654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:42.083199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:42.083659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:42.084409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:42.085672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:42.097443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:42.196911 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50bc1991-b754-4260-981c-07a6f6d7bc99 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/def82ca9-8083-4c0b-9a9f-e841dc77f01a" status: 200 len: 142 microversion: 2.1 time: 0.494353 Nov 03 03:58:42.203134 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 884/1827] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:58:41 2022] GET /compute/v2.1/os-floating-ips/def82ca9-8083-4c0b-9a9f-e841dc77f01a => generated 142 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:42.216394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:42.217346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:42.244948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:42.247379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:42.249848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:42.251586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:42.252744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:42.255450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:42.690141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:42.713007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:42.714847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:42.731454 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a87532d4-49fc-4f1e-99f2-03ebef5530f3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.679467 Nov 03 03:58:42.733742 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 944/1828] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:42 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:42.747219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23e8455f-987f-40eb-9a28-819a580fcf65 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Calling method '.version_select at 0x7ff7f94544c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:43.706922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:43.721114 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b389a191-50b6-4910-b1d5-e0e9ac62ff73 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 1.515142 Nov 03 03:58:43.722400 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 885/1829] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:42 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:43.730991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:43.743901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:43.747238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:43.747745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:43.748445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:43.751165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:43.751833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:43.752475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.009820 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23e8455f-987f-40eb-9a28-819a580fcf65 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.274935 Nov 03 03:58:44.010461 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 945/1830] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 03:58:42 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:44.015441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:44.016321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] [instance: 5eb3fa88-5c7b-4b15-ac0b-347c3353070f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:44.039359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.040247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.040893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.041960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:44.045316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.046947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.048640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.060182 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a313182-99b4-4970-aab5-4512909f711a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1284 microversion: 2.1 time: 0.334679 Nov 03 03:58:44.060981 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 886/1831] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:43 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:44.081436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d179b39b-0fea-4b50-936a-24fe1dd29765 req-86d1d701-c911-4ae3-8d9d-7def5a5237ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ed965a-8dc9-4615-a8bd-dc2436ecd483", "tag": "d9698e41-18ac-4728-88d7-fdd2f72e075d"}, {"server_uuid": "5eb3fa88-5c7b-4b15-ac0b-347c3353070f", "name": "network-vif-deleted", "tag": "6e412a17-821b-446c-a74e-78bc6a61268d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:44.085400 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] HTTP exception thrown: Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f could not be found. Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Request method failure captured: Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f HTTP/1.1 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzr2Vv9XN6yHCm1aespaBthOdgpdBq7N4g1gUalIdvFrSY5iF44OR_kRsdpMFdproBBmKoGAaIiE3fYVGJaPRD7-dpQ-LGkl6PmJd_27x-1wwy0qZtCazTBMQcRXilUzA3TRQFc5hj_SpvZjRg_KONpzwzKJUnVIRFFoCW_uvklUfRE Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_68cd41e9643b443b81b22489194213c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/68cd41e9643b443b81b22489194213c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/68cd41e9643b443b81b22489194213c7"}]}] Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 68cd41e9643b443b81b22489194213c7 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-MigrationsAdminTest-1178028668 Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 74ac442756f54baa8b70bb302b35b95c Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-MigrationsAdminTest-1178028668-project Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f could not be found. Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5eb3fa88-5c7b-4b15-ac0b-347c3353070f'} Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f could not be found. Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f could not be found. Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:44.087765 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:44.093776 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:44.093776 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:44.093776 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:44.093776 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:44.093776 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:44.093776 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f could not be found. Nov 03 03:58:44.093776 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:58:44.095597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] Returning 404 to user: Instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:44.096672 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c09b4d09-31a5-4e68-8c0e-8ea9f4c8f66a tempest-MigrationsAdminTest-1178028668 tempest-MigrationsAdminTest-1178028668-project] 10.222.0.30 "GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f" status: 404 len: 111 microversion: 2.1 time: 0.085274 Nov 03 03:58:44.100958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d179b39b-0fea-4b50-936a-24fe1dd29765 req-86d1d701-c911-4ae3-8d9d-7def5a5237ce service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.101602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d179b39b-0fea-4b50-936a-24fe1dd29765 req-86d1d701-c911-4ae3-8d9d-7def5a5237ce service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.102101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d179b39b-0fea-4b50-936a-24fe1dd29765 req-86d1d701-c911-4ae3-8d9d-7def5a5237ce service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.108446 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 946/1832] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:44 2022] GET /compute/v2.1/servers/5eb3fa88-5c7b-4b15-ac0b-347c3353070f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:44.124810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:44.128387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:44.134696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:44.144530 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d179b39b-0fea-4b50-936a-24fe1dd29765 req-86d1d701-c911-4ae3-8d9d-7def5a5237ce service nova] Creating event network-changed:d9698e41-18ac-4728-88d7-fdd2f72e075d for instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 on n-h1-854653-7 Nov 03 03:58:44.147599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.151557 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d179b39b-0fea-4b50-936a-24fe1dd29765 req-86d1d701-c911-4ae3-8d9d-7def5a5237ce service nova] Creating event network-vif-deleted:6e412a17-821b-446c-a74e-78bc6a61268d for instance 5eb3fa88-5c7b-4b15-ac0b-347c3353070f on n-h1-854653-7 Nov 03 03:58:44.152196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.156284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.157396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.158091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.158857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.186632 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d179b39b-0fea-4b50-936a-24fe1dd29765 req-86d1d701-c911-4ae3-8d9d-7def5a5237ce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.123921 Nov 03 03:58:44.188161 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 887/1833] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:44.196582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:44.198401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:44.214561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.216456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.218349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.220218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.220916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.221639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.729383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:44.744146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:44.754032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:44.759055 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9d799185-25ad-467b-b087-69de76544c92 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.569214 Nov 03 03:58:44.769034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 888/1834] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:44 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:44.774478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50ad25df-1561-4edb-81cf-1b610be3d630 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Calling method '.version_select at 0x7ff7fd4cb3a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:44.848919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:44.862289 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80bdd5d2-e307-4d1e-b455-b49f8315dc71 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.745335 Nov 03 03:58:44.864079 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 947/1835] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:44 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:44.874250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:44.878277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:44.891885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.892614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.893565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:44.894631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:44.895656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:44.898734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:45.513729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:45.525650 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d860b8e-848e-4190-9d11-02c8c2a709e3 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1484 microversion: 2.1 time: 0.652148 Nov 03 03:58:45.526568 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 948/1836] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:44 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1484 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:45.532476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-32390f63-b3c4-4afb-80ed-0470902e71a5 req-1c9824db-4a9c-4015-a762-d2ca84aac639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87397ac1-d176-430d-b8ee-56755d8beca3", "tag": "7b3c2b66-95e4-4ca5-9750-e62618eca2a6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:45.587227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-32390f63-b3c4-4afb-80ed-0470902e71a5 req-1c9824db-4a9c-4015-a762-d2ca84aac639 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:45.588140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-32390f63-b3c4-4afb-80ed-0470902e71a5 req-1c9824db-4a9c-4015-a762-d2ca84aac639 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:45.590819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-32390f63-b3c4-4afb-80ed-0470902e71a5 req-1c9824db-4a9c-4015-a762-d2ca84aac639 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:45.641288 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-32390f63-b3c4-4afb-80ed-0470902e71a5 req-1c9824db-4a9c-4015-a762-d2ca84aac639 service nova] Creating event network-changed:7b3c2b66-95e4-4ca5-9750-e62618eca2a6 for instance 87397ac1-d176-430d-b8ee-56755d8beca3 on n-h2-854653-7 Nov 03 03:58:45.662541 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-32390f63-b3c4-4afb-80ed-0470902e71a5 req-1c9824db-4a9c-4015-a762-d2ca84aac639 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133488 Nov 03 03:58:45.670839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 949/1837] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:45.682862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:45.696047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:45.727324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:45.728439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:45.729551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:45.735101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:45.736291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:45.737099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:46.716780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:46.716780 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-282f8da0-d697-436e-958a-65254de17982 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 1.030511 Nov 03 03:58:46.716780 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 950/1838] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:45 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:46.716780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:46.716780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:46.722141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:46.722978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:46.723342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:46.724742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:46.724742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:46.725066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:46.902118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:46.918582 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c274f824-9825-423a-a31b-56b76a69bcc1 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1282 microversion: 2.1 time: 0.210294 Nov 03 03:58:46.919200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 951/1839] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:46 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:46.926757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:46.927630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:46.933977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:46.934710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:46.935157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:46.935870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:46.936332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:46.936791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:48.075380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:48.092782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:48.100633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:48.114874 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7165061f-4134-4c76-8d81-3f72d229841f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 1.181761 Nov 03 03:58:48.115768 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 952/1840] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:46 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:48.147908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:48.150621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:48.164930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:48.165376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:48.169152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:48.170134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:48.174233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:48.178753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:48.388353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:48.414269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:48.776045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:48.785740 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10f088ee-a3bc-456e-965a-5ce539b9f75c tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.666926 Nov 03 03:58:48.786372 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 953/1841] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:48 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:48.791176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:48.792037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:48.800725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:48.801636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:48.802380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:48.806078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:48.809406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:48.810272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:48.882352 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50ad25df-1561-4edb-81cf-1b610be3d630 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/def82ca9-8083-4c0b-9a9f-e841dc77f01a" status: 202 len: 0 microversion: 2.1 time: 4.109791 Nov 03 03:58:48.888589 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 889/1842] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:58:44 2022] DELETE /compute/v2.1/os-floating-ips/def82ca9-8083-4c0b-9a9f-e841dc77f01a => generated 0 bytes in 4117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:58:48.893076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:48.893887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:48.911032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:48.914211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:48.914961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:48.918002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:48.919777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:48.920279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:49.424889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:49.434907 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48a5bf49-e044-4e59-9df8-ef965f7b150f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 0.647215 Nov 03 03:58:49.444416 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 954/1843] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:48 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:49.453601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef93c705-7cd0-4b9c-b547-0ed2281c998f tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Action: 'create', calling method: .version_select at 0x7ff7f94ef820>, body: {"pool": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:49.531593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:49.541253 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2608155-0908-45e0-9514-0d56ff9d8a9a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.652069 Nov 03 03:58:49.558517 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 890/1844] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:48 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:49.567278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:49.568326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:49.575141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:49.576371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:49.576695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:49.577972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:49.578702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:49.579362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:50.024966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:50.036660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:50.043933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:50.061199 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0eada7a6-0cdd-4f8e-8545-022b5ddf26a3 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.486438 Nov 03 03:58:50.061199 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 891/1845] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:49 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:50.061199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:50.061199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:50.096381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:50.099223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:50.101069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:50.102201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:50.103881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:50.110062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:50.575300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:50.586262 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2dbf34af-f25d-48ae-a1a2-92c7268def5a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1391 microversion: 2.1 time: 0.537824 Nov 03 03:58:50.589302 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 892/1846] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:50 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1391 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:50.600108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:50.600108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:50.606621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:50.607398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:50.608182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:50.609128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:50.609984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:50.610956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:51.081612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:51.091792 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e8417e5a-262d-49b5-8618-ede4ab7a39a3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 0.501012 Nov 03 03:58:51.096960 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 893/1847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:50 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:51.097626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:51.098423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:51.105192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:51.105928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:51.106601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:51.107509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:51.108145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:51.108738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:52.046973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:52.062660 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30956746-a348-48c5-9852-341a4e82bd28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.968975 Nov 03 03:58:52.081435 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 894/1848] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:51 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:52.374259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30bbd57a-c014-4a96-92e2-48e00a359fef tempest-NetworksTest-1825381531 tempest-NetworksTest-1825381531-project-admin] Calling method '.version_select at 0x7ff7fd52c5e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:52.953756 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30bbd57a-c014-4a96-92e2-48e00a359fef tempest-NetworksTest-1825381531 tempest-NetworksTest-1825381531-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 10127 microversion: 2.1 time: 0.869794 Nov 03 03:58:52.954894 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 895/1849] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:58:52 2022] GET /compute/v2.1/os-networks => generated 10127 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:58:52.966787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:52.968433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:52.988365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:52.988959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:52.989633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:52.991672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:52.992484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:52.997174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:53.585969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:53.599890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:53.602432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:53.603726 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2959ae70-416d-4e89-9326-0bac94783e7b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.647847 Nov 03 03:58:53.604655 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 896/1850] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:52 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:53.609585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:53.610969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:53.618585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:53.619642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:53.620643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:53.621666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:53.622643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:53.623295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:53.899201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:53.907457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-59bf651f-6a51-47e6-9200-23dfad32f6d1 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1381 microversion: 2.1 time: 0.301575 Nov 03 03:58:53.908272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 897/1851] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:53 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1381 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:53.913212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-52d34d99-615d-49d1-a275-e1b9c38e9701 req-ece376fd-69e3-4ca1-87a3-b15a6439f0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84138b04-4841-4c50-9bc2-a91875d34567", "tag": "91904e83-d2ff-4f69-bd5c-521bdb26fce3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:53.923027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52d34d99-615d-49d1-a275-e1b9c38e9701 req-ece376fd-69e3-4ca1-87a3-b15a6439f0b2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:53.923505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52d34d99-615d-49d1-a275-e1b9c38e9701 req-ece376fd-69e3-4ca1-87a3-b15a6439f0b2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:53.923934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52d34d99-615d-49d1-a275-e1b9c38e9701 req-ece376fd-69e3-4ca1-87a3-b15a6439f0b2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:53.936255 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-52d34d99-615d-49d1-a275-e1b9c38e9701 req-ece376fd-69e3-4ca1-87a3-b15a6439f0b2 service nova] Creating event network-changed:91904e83-d2ff-4f69-bd5c-521bdb26fce3 for instance 84138b04-4841-4c50-9bc2-a91875d34567 on n-h1-854653-7 Nov 03 03:58:53.940930 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-52d34d99-615d-49d1-a275-e1b9c38e9701 req-ece376fd-69e3-4ca1-87a3-b15a6439f0b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 Nov 03 03:58:53.944528 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 898/1852] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:53.946564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:53.947265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:53.953392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:53.953879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:53.954322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:53.955042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:53.955502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:53.955930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:54.134670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:54.142464 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87f5f675-23ae-4b49-b266-0f5c8a4b9392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1524 microversion: 2.1 time: 0.199795 Nov 03 03:58:54.143230 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 899/1853] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:53 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1524 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:54.147861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ef3ce50-16af-48ce-8ca2-f96304fd0328 tempest-NetworksTest-1825381531 tempest-NetworksTest-1825381531-project-admin] Calling method '.version_select at 0x7ff7f9bcf040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:54.350048 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ef3ce50-16af-48ce-8ca2-f96304fd0328 tempest-NetworksTest-1825381531 tempest-NetworksTest-1825381531-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks/6d2ab465-64b6-4819-b014-15c6774f2465" status: 200 len: 652 microversion: 2.1 time: 0.205943 Nov 03 03:58:54.350866 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 900/1854] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 03:58:54 2022] GET /compute/v2.1/os-networks/6d2ab465-64b6-4819-b014-15c6774f2465 => generated 652 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:54.355387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:54.356012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:54.358279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:54.363249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:54.363815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:54.366930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:54.366930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:54.366930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:54.366930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:54.383159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:54.407542 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef93c705-7cd0-4b9c-b547-0ed2281c998f tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.961914 Nov 03 03:58:54.415504 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 955/1855] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 03:58:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:54.415504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f13866b4-fdeb-4436-b8f8-e28947b72274 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '.version_select at 0x7ff7f8f61dc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:54.418445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13866b4-fdeb-4436-b8f8-e28947b72274 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:54.418946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13866b4-fdeb-4436-b8f8-e28947b72274 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:54.419399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f13866b4-fdeb-4436-b8f8-e28947b72274 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:54.430043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f13866b4-fdeb-4436-b8f8-e28947b72274 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.020298 Nov 03 03:58:54.436571 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 956/1856] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 03:58:54 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:54.443234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b6f911d-0b85-4005-b4b1-bd7078c18bb6 tempest-NetworksTest-1825381531 tempest-NetworksTest-1825381531-project-admin] Calling method '.version_select at 0x7ff7f95dbaf0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:54.882025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:54.890587 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba7d9cf8-f667-4d7e-93db-b3f8728fa0ab tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.538561 Nov 03 03:58:54.891641 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 901/1857] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:54 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:54.895832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07d08142-270a-402a-8d75-0896ba0a9948 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Calling method '.version_select at 0x7ff7fd66c5e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:54.901330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b6f911d-0b85-4005-b4b1-bd7078c18bb6 tempest-NetworksTest-1825381531 tempest-NetworksTest-1825381531-project-admin] 10.222.0.30 "GET /compute/v2.1/os-networks" status: 200 len: 10127 microversion: 2.1 time: 0.463493 Nov 03 03:58:54.901968 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 957/1858] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:58:54 2022] GET /compute/v2.1/os-networks => generated 10127 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:58:54.906955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:54.911332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:54.919457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:54.920021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:54.920640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:54.921431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:54.921901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:54.922364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.157778 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6a4d637-b2ab-4a05-9e11-8b2cccd31302 tempest-LiveMigrationTest-1050778048 tempest-LiveMigrationTest-1050778048-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1532 microversion: 2.1 time: 0.254527 Nov 03 03:58:55.158363 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 958/1859] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:54 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1532 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:55.163482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:55.164162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:55.170136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.170677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.171229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.171933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.172387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.172996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.454234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:58:55.471239 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd4ea2bd-f9c9-4d22-b7f9-984ec011d4b6 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 2342 microversion: 2.25 time: 0.311817 Nov 03 03:58:55.472432 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 959/1860] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:55 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 2342 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:55.477946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:55.479146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:55.486738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.487671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.488962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.490066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.491024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.491777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.768578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:55.774898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:55.776702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:55.777979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53719bcc-5974-4ca7-be5e-51ba3f1b597b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.304404 Nov 03 03:58:55.778756 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 960/1861] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:55 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:55.783455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:55.784125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:55.790772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.791561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.792263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.793226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.793911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.795456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.971063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:55.979311 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1094671-a452-4430-9f07-b05fd13d622b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1506 microversion: 2.1 time: 0.199132 Nov 03 03:58:55.979886 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 961/1862] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:55 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:55.985800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:55.986301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:55.994301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.994859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.995325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:55.996119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:55.996637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:55.997084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.023764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:58:56.036472 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07d08142-270a-402a-8d75-0896ba0a9948 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad" status: 202 len: 0 microversion: 2.1 time: 1.144079 Nov 03 03:58:56.037090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 902/1863] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:58:54 2022] DELETE /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad => generated 0 bytes in 1145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:58:56.043410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:56.047336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.051945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.051945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.051945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.051945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.051945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.075479 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1bd9642-3326-4cad-8120-8de9b70b803e tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037328 Nov 03 03:58:56.076098 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 903/1864] 10.222.0.30 () {60 vars in 1217 bytes} [Thu Nov 3 03:58:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:58:56.087641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:56.088275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:56.094501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.095010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.095422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.096681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.097335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.103272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.174893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:58:56.246246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:56.254749 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4da9fac8-e090-4e43-b071-33ff44d3431a tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.177667 Nov 03 03:58:56.255319 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 904/1865] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:56 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:56.259808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-35b0a150-ed3f-43bd-be0a-d9c06c88c47d tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Calling method '.version_select at 0x7ff7fd66c9d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:56.310823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-35b0a150-ed3f-43bd-be0a-d9c06c88c47d tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 54f30eeb-3f91-47ee-a04d-1b820d61d7ad could not be found", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 03:58:56.311595 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-35b0a150-ed3f-43bd-be0a-d9c06c88c47d tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] HTTP exception thrown: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-35b0a150-ed3f-43bd-be0a-d9c06c88c47d tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Request method failure captured: Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad HTTP/1.1 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzxra500vYf8KQFmh2sZTwc7iIMnp2_wFXQJZrg4j9ZHcf8jmudVzpB1YQQNow1S84cMafcCYNZZDXT7Wg7YqOEyqpR-NbDrYW1SRBfn7qHgggloTAc3O8SuUIQfqbZZ0BKm52arAQ7d8COuLpi6qmsEzu_7DxzNkpOq1DTBNiwiyS4 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: f0852ce957df4490b824c3aa4a555ad1 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsTestJSON-664970575 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0852ce957df4490b824c3aa4a555ad1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f0852ce957df4490b824c3aa4a555ad1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0852ce957df4490b824c3aa4a555ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f0852ce957df4490b824c3aa4a555ad1"}]}] Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsTestJSON-664970575 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: f0852ce957df4490b824c3aa4a555ad1 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsTestJSON-664970575 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsTestJSON-664970575-project Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: bc58d1afd2ad43278cc98287d8d6004c Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsTestJSON-664970575-project Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: exception: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '54f30eeb-3f91-47ee-a04d-1b820d61d7ad'} Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 54f30eeb-3f91-47ee-a04d-1b820d61d7ad could not be found Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e85b556-54b4-4800-8d79-666d003f8573'] Nov 03 03:58:56.314501 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad. Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-35b0a150-ed3f-43bd-be0a-d9c06c88c47d tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Returning 404 to user: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-35b0a150-ed3f-43bd-be0a-d9c06c88c47d tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad" status: 404 len: 111 microversion: 2.1 time: 0.060933 Nov 03 03:58:56.320062 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 905/1866] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 03:58:56 2022] GET /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:56.328924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9c8f1dc-6ce3-4f17-bb60-4df636cdcf38 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Calling method '.version_select at 0x7ff7f90f9f70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:56.371641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-c9c8f1dc-6ce3-4f17-bb60-4df636cdcf38 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 54f30eeb-3f91-47ee-a04d-1b820d61d7ad could not be found", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 03:58:56.372352 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-c9c8f1dc-6ce3-4f17-bb60-4df636cdcf38 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] HTTP exception thrown: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9c8f1dc-6ce3-4f17-bb60-4df636cdcf38 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Request method failure captured: Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad HTTP/1.1 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzxra500vYf8KQFmh2sZTwc7iIMnp2_wFXQJZrg4j9ZHcf8jmudVzpB1YQQNow1S84cMafcCYNZZDXT7Wg7YqOEyqpR-NbDrYW1SRBfn7qHgggloTAc3O8SuUIQfqbZZ0BKm52arAQ7d8COuLpi6qmsEzu_7DxzNkpOq1DTBNiwiyS4 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: f0852ce957df4490b824c3aa4a555ad1 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPsTestJSON-664970575 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0852ce957df4490b824c3aa4a555ad1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f0852ce957df4490b824c3aa4a555ad1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0852ce957df4490b824c3aa4a555ad1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f0852ce957df4490b824c3aa4a555ad1"}]}] Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPsTestJSON-664970575 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: f0852ce957df4490b824c3aa4a555ad1 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPsTestJSON-664970575 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPsTestJSON-664970575-project Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: bc58d1afd2ad43278cc98287d8d6004c Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPsTestJSON-664970575-project Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: exception: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '54f30eeb-3f91-47ee-a04d-1b820d61d7ad'} Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 54f30eeb-3f91-47ee-a04d-1b820d61d7ad could not be found Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58dd719e-df6e-436d-9faf-862fcf9c5f52'] Nov 03 03:58:56.374930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad. Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9c8f1dc-6ce3-4f17-bb60-4df636cdcf38 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] Returning 404 to user: Floating IP not found for ID 54f30eeb-3f91-47ee-a04d-1b820d61d7ad {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c9c8f1dc-6ce3-4f17-bb60-4df636cdcf38 tempest-FloatingIPsTestJSON-664970575 tempest-FloatingIPsTestJSON-664970575-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad" status: 404 len: 111 microversion: 2.1 time: 0.052408 Nov 03 03:58:56.380928 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 906/1867] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:58:56 2022] DELETE /compute/v2.1/os-floating-ips/54f30eeb-3f91-47ee-a04d-1b820d61d7ad => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:58:56.438605 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1123c27e-4b43-48d9-b2b7-f27aa43bd462 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "DELETE /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 204 len: 0 microversion: 2.1 time: 0.457304 Nov 03 03:58:56.440035 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 962/1868] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:58:55 2022] DELETE /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:58:56.449259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:56.450122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:56.459042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.459549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.459995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.460713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.461205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.461646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.615368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:56.623631 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac137428-5eab-4a47-99bf-0bb621f18f8a tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1387 microversion: 2.1 time: 0.178458 Nov 03 03:58:56.624573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 907/1869] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:56 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1387 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:56.809436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:56.810336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:56.849302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.849302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.849302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:56.849302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:56.849302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:56.849302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:57.010440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:57.012631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:57.026107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:57.026723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:57.027919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:57.028975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:57.029667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:57.031070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:57.388292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:57.398693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:57.400167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:57.401358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-349c718e-2190-4f2b-a4c3-83ed23ef8fe7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.600573 Nov 03 03:58:57.401913 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 963/1870] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:56 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:57.420884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:57.421791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:57.427995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:57.428799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:57.429449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:57.430765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:57.431395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:57.432071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:57.603025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:57.612733 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6e7d233-1770-4d36-b547-77d1321895ea tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1506 microversion: 2.1 time: 0.609891 Nov 03 03:58:57.629078 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 908/1871] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:57 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1506 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:57.647793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:57.649043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:57.657900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:57.658426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:57.659894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:57.661284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:57.661949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:57.662543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:58.228685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:58.252812 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2342585c-c0e8-4da0-afd1-f9f5ad9b81ee tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.842082 Nov 03 03:58:58.270189 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 964/1872] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:57 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:58.428946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:58.429563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:58.437962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:58.442629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:58.442629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:58.442629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:58.442629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:58.444737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:58.453189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:58.472791 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f75ebd5-722a-4448-a32c-2821440d23e8 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1387 microversion: 2.1 time: 0.829308 Nov 03 03:58:58.476777 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 909/1873] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:57 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1387 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:58.636490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:58.638192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:58.650553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:58.659520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:58.659520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:58.659520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:58.659520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:58.659520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:58.934700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:58.953719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:58.953719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:58.953719 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dcc4e7f0-c7bd-4a41-a811-0302bfb50e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.528507 Nov 03 03:58:58.953719 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 965/1874] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:58 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:58:58.967793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:58.974045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-06615cc3-4456-43a8-aa16-2e6aab042e9f req-e7db4377-30ee-4270-b532-5f8862d3de43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fceff-bafd-4b2a-a220-f1f9d57deb42", "name": "network-vif-unplugged", "status": "completed", "tag": "5b7b0984-1390-4bb9-b7a9-feef1a456443"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:58.976480 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ca98e99-b168-4051-ac2c-e0ac38a57bf7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1506 microversion: 2.1 time: 0.344491 Nov 03 03:58:58.980068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 910/1875] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:58 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:58.993270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-06615cc3-4456-43a8-aa16-2e6aab042e9f req-e7db4377-30ee-4270-b532-5f8862d3de43 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:58.993270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-06615cc3-4456-43a8-aa16-2e6aab042e9f req-e7db4377-30ee-4270-b532-5f8862d3de43 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:58.993270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-06615cc3-4456-43a8-aa16-2e6aab042e9f req-e7db4377-30ee-4270-b532-5f8862d3de43 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.015802 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-06615cc3-4456-43a8-aa16-2e6aab042e9f req-e7db4377-30ee-4270-b532-5f8862d3de43 service nova] Creating event network-vif-unplugged:5b7b0984-1390-4bb9-b7a9-feef1a456443 for instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 on n-h1-854653-7 Nov 03 03:58:59.026215 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-06615cc3-4456-43a8-aa16-2e6aab042e9f req-e7db4377-30ee-4270-b532-5f8862d3de43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071855 Nov 03 03:58:59.026816 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 966/1876] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:58:59.050095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f824fcc4-961a-400d-b0af-b3bbae3e759c", "device": "/dev/xvdb"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:59.053226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:59.061174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.062164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.063067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.064558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.065310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.066723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.179057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4724903c-d3ac-44a1-a9a8-f0643c3ad575 req-f1e0d6da-472a-47f9-8d7b-f117aa5ca4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ed965a-8dc9-4615-a8bd-dc2436ecd483", "name": "network-vif-deleted", "tag": "d9698e41-18ac-4728-88d7-fdd2f72e075d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:58:59.195495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4724903c-d3ac-44a1-a9a8-f0643c3ad575 req-f1e0d6da-472a-47f9-8d7b-f117aa5ca4d0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.196251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4724903c-d3ac-44a1-a9a8-f0643c3ad575 req-f1e0d6da-472a-47f9-8d7b-f117aa5ca4d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.196940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4724903c-d3ac-44a1-a9a8-f0643c3ad575 req-f1e0d6da-472a-47f9-8d7b-f117aa5ca4d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.212993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4724903c-d3ac-44a1-a9a8-f0643c3ad575 req-f1e0d6da-472a-47f9-8d7b-f117aa5ca4d0 service nova] Creating event network-vif-deleted:d9698e41-18ac-4728-88d7-fdd2f72e075d for instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 on n-h2-854653-7 Nov 03 03:58:59.221536 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4724903c-d3ac-44a1-a9a8-f0643c3ad575 req-f1e0d6da-472a-47f9-8d7b-f117aa5ca4d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049996 Nov 03 03:58:59.222690 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 967/1877] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:58:59.277651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:59.278561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:59.288168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.288948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.289584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.290385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.290903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.291335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.472215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:59.481725 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc1c329b-6cba-476b-b79c-5a0a14184b12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.208938 Nov 03 03:58:59.493463 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 968/1878] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:59 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:58:59.501383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:59.502060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:59.522146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.522571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.523019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.523814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.524388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.524924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.647101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:58:59.662196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4eeb0b5a-759b-440d-a292-6c7feb4429d4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1183 microversion: 2.1 time: 0.162549 Nov 03 03:58:59.682286 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 969/1879] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:58:59 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:58:59.982979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:58:59.983618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:58:59.991639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.992367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:58:59.992827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:58:59.993570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:58:59.994100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:00.005742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:00.499169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:00.527268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:00.529319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:00.535918 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-716cb607-58c6-4b40-b1e6-11d02d502968 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.551598 Nov 03 03:59:00.541087 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 970/1880] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:58:59 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:00.549987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:00.554509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:00.578493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:00.581157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:00.581157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:00.581157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:00.589532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:00.590517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:00.668794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9f3bb26-49ad-4b71-bbe3-fbf72edaa98a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "POST /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.625955 Nov 03 03:59:00.669853 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 911/1881] 10.222.0.30 () {62 vars in 1364 bytes} [Thu Nov 3 03:58:59 2022] POST /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 194 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:59:00.707309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:00.711452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:00.743229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:00.745365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:00.745824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:00.748648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:00.749930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:00.750435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:01.443775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:01.452652 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fee0cf05-7c33-4e6c-8208-7090eaadbf85 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 200 len: 1509 microversion: 2.1 time: 0.910405 Nov 03 03:59:01.457187 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 971/1882] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:00 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 1509 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:01.466094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:01.466850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:01.467672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:01.474044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:01.474767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:01.475421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:01.476312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:01.476949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:01.477575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:01.478227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4e5aea4-5786-4ce6-b64b-1d917c8e32fa tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.806290 Nov 03 03:59:01.478909 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 912/1883] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:00 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:01.631219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:01.645059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-109c5978-1de5-4ee6-b3bf-5db3af285b8f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1183 microversion: 2.1 time: 0.186645 Nov 03 03:59:01.649781 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 972/1884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:01 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:01.660022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1e3b1d98-196d-41cb-b513-36cdbe2a767d req-c8d9c7f1-cd84-48bb-b4a3-7c14e8d978b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-plugged", "status": "completed", "tag": "6c1d02ee-1303-4e41-b729-563e50f0984f"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-plugged", "status": "completed", "tag": "6d00f3d5-ad14-49f4-b158-233065bddcf8"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:01.674367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1e3b1d98-196d-41cb-b513-36cdbe2a767d req-c8d9c7f1-cd84-48bb-b4a3-7c14e8d978b7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:01.675107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1e3b1d98-196d-41cb-b513-36cdbe2a767d req-c8d9c7f1-cd84-48bb-b4a3-7c14e8d978b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:01.678069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1e3b1d98-196d-41cb-b513-36cdbe2a767d req-c8d9c7f1-cd84-48bb-b4a3-7c14e8d978b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:01.693380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1e3b1d98-196d-41cb-b513-36cdbe2a767d req-c8d9c7f1-cd84-48bb-b4a3-7c14e8d978b7 service nova] Creating event network-vif-plugged:6c1d02ee-1303-4e41-b729-563e50f0984f for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:01.694369 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1e3b1d98-196d-41cb-b513-36cdbe2a767d req-c8d9c7f1-cd84-48bb-b4a3-7c14e8d978b7 service nova] Creating event network-vif-plugged:6d00f3d5-ad14-49f4-b158-233065bddcf8 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:01.701156 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1e3b1d98-196d-41cb-b513-36cdbe2a767d req-c8d9c7f1-cd84-48bb-b4a3-7c14e8d978b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049910 Nov 03 03:59:01.702453 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 973/1885] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:01.710344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:01.712578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:01.720075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:01.720875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:01.723328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:01.725354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:01.726082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:01.726765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:01.764358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:59:01.772878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Working on deleting snapshot e8122cdf-1436-448b-9a7e-17e2722b3f63 from shelved instance... Nov 03 03:59:01.794777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1503359217", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:01.860448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:59:02.321219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:59:02.321675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:59:02.322248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:59:02.322543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:59:02.323159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:59:02.334401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:02.335152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:02.335596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:02.336321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:02.336984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:02.337442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:02.356272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Getting quotas for project 69350185d62a4cf48dae399af40bf70d. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:59:02.362111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Getting quotas for user e116c8b3b3d447e7b0a19ef304c28d84 and project 69350185d62a4cf48dae399af40bf70d. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:59:02.379034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:59:02.379034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:59:02.567466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10808e1c-28ce-4449-85c3-2cb9abe508c7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084808 Nov 03 03:59:02.591661 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 913/1886] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:59:02.613733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:02.617788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:02.629640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:02.630513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:02.631212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:02.637665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:02.637665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:02.637665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:02.991675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:03.006020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:03.008107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:03.009722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad3a190b-d999-4445-b833-694c6e43b5ed tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.418012 Nov 03 03:59:03.010821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 914/1887] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:02 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:03.016703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:03.017563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:03.024814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:03.025758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:03.026589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:03.027815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:03.028557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:03.029249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:03.235131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:03.260822 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e635ac96-298c-48b5-a54c-fee6489bb714 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.248612 Nov 03 03:59:03.261462 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 915/1888] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:03 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:03.266610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2b3862e-5511-457e-8a99-075a49191b83 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:03.267236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d2b3862e-5511-457e-8a99-075a49191b83 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:03.353829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d2b3862e-5511-457e-8a99-075a49191b83 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:03.364020 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2b3862e-5511-457e-8a99-075a49191b83 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1223 microversion: 2.1 time: 0.101490 Nov 03 03:59:03.365108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 916/1889] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:03 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:03.373212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:03.374197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:03.381883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:03.383585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:03.384360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:03.385732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:03.386451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:03.387863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:03.471326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:03.482063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-453e773b-f7bb-46fe-90e2-aa77a68e22c0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1183 microversion: 2.1 time: 0.115137 Nov 03 03:59:03.482946 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 917/1890] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:03 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:03.637599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Doing local delete in cell 464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=127594) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 03 03:59:03.639077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:03.639887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:03.640791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:03.641586 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 03 03:59:03.646785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] deallocate_for_instance() {{(pid=127594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 03 03:59:03.889946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-plugged", "status": "completed", "tag": "2455d1ec-cb1c-4e26-afd2-8b73f9399820"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-plugged", "status": "completed", "tag": "10aaf744-8389-4a5f-bbf5-24d2b6985728"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-plugged", "status": "completed", "tag": "3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad"}, {"server_uuid": "84138b04-4841-4c50-9bc2-a91875d34567", "name": "network-vif-plugged", "status": "completed", "tag": "91904e83-d2ff-4f69-bd5c-521bdb26fce3"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-plugged", "status": "completed", "tag": "9b0a115d-5a93-4669-bac8-1ceb99cf533d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:03.944015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:03.944321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:03.944867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:03.976340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Creating event network-vif-plugged:2455d1ec-cb1c-4e26-afd2-8b73f9399820 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:03.976945 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Creating event network-vif-plugged:10aaf744-8389-4a5f-bbf5-24d2b6985728 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:03.977651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Creating event network-vif-plugged:3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:03.979036 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Creating event network-vif-plugged:91904e83-d2ff-4f69-bd5c-521bdb26fce3 for instance 84138b04-4841-4c50-9bc2-a91875d34567 on n-h1-854653-7 Nov 03 03:59:03.979562 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] Creating event network-vif-plugged:9b0a115d-5a93-4669-bac8-1ceb99cf533d for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:03.992802 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d50ebacb-cee2-4485-b00b-b05562dce9d3 req-157ff07d-3d57-4afa-ab14-c3a21839ebd1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.108400 Nov 03 03:59:03.994774 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 918/1891] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:04.044601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:04.055758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:04.088639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.089252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.092061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.092061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.092061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.092061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.434400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:04.446081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:04.447888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:04.449369 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ab1effb-f239-4093-9e48-c19acffb0e42 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.417089 Nov 03 03:59:04.465313 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 919/1892] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:04 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:04.473115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:04.474828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:04.481478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.482401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.483133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.484078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.484650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.485315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.631224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:04.640781 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da9b7abb-1f52-49bb-8634-9f0ebbeaab33 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.174073 Nov 03 03:59:04.641731 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 920/1893] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:04 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:04.647663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:04.648594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:04.656527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.658513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.658513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.665168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.667219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.667952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.810789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:04.818891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a3a688c-fd38-4653-b2ce-ea46405089d5 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1227 microversion: 2.1 time: 0.175907 Nov 03 03:59:04.819476 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 921/1894] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:04 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1227 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:04.824464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:04.825327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:04.831659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.832390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.832838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.833583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.834048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.834521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.849333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Updating instance_info_cache with network_info: [] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 03:59:04.907903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:04.911162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:04.921066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3df9177d-882d-41ce-aa2c-4928e8c91081 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1183 microversion: 2.1 time: 0.100267 Nov 03 03:59:04.921745 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 922/1895] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:04 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:04.927928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2f817627-6869-49a3-aabf-51d61673b018 req-f6f1f69f-69ca-49b1-8eae-0a91342566cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fceff-bafd-4b2a-a220-f1f9d57deb42", "name": "network-vif-deleted", "tag": "5b7b0984-1390-4bb9-b7a9-feef1a456443"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:04.941751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2f817627-6869-49a3-aabf-51d61673b018 req-f6f1f69f-69ca-49b1-8eae-0a91342566cb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:04.945741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2f817627-6869-49a3-aabf-51d61673b018 req-f6f1f69f-69ca-49b1-8eae-0a91342566cb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:04.945741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2f817627-6869-49a3-aabf-51d61673b018 req-f6f1f69f-69ca-49b1-8eae-0a91342566cb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:04.955820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_external_events [req-2f817627-6869-49a3-aabf-51d61673b018 req-f6f1f69f-69ca-49b1-8eae-0a91342566cb service nova] Unable to find a host for instance 328fceff-bafd-4b2a-a220-f1f9d57deb42. Dropping event network-vif-deleted {{(pid=127593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 03 03:59:04.956814 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2f817627-6869-49a3-aabf-51d61673b018 req-f6f1f69f-69ca-49b1-8eae-0a91342566cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.033820 Nov 03 03:59:04.957514 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 923/1896] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 03 03:59:05.441749 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f905a7e-b74a-47ea-8396-dbe02bb5bad3 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] 10.222.0.30 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.153455 Nov 03 03:59:05.442952 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 924/1897] 10.222.0.30 () {58 vars in 1128 bytes} [Thu Nov 3 03:59:05 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 03 03:59:05.453250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0eaf76b5-8672-4e56-9b06-e9616926bf24 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Calling method '.version_select at 0x7ff7f90f9e50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:05.477226 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-0eaf76b5-8672-4e56-9b06-e9616926bf24 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] HTTP exception thrown: Image not found. Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0eaf76b5-8672-4e56-9b06-e9616926bf24 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Request method failure captured: Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyJW1u6LBatS6uaFFZx-3pH56aJkKexqIpJFqFsWRhmgXyntmjKyKGynHgydlPQHLEXDwPH3nrClcxA-FQVRD9sgOq8k_Av96KDbj38eWkz5N67qPxuZB3uud0Kz9GX42JZ8lNEV1qUgSlxvr6GeDe2SVnzRHksvUdq4SrUvxOB2xQ Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37cf667983934becabc5939beea0556a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37cf667983934becabc5939beea0556a"}]}] Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c47f4d155a6b4b3d80b0432e85b08a1d Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '-1'} Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.479181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0eaf76b5-8672-4e56-9b06-e9616926bf24 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:05.485358 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0eaf76b5-8672-4e56-9b06-e9616926bf24 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] 10.222.0.30 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.034247 Nov 03 03:59:05.488445 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 925/1898] 10.222.0.30 () {58 vars in 1134 bytes} [Thu Nov 3 03:59:05 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 03 03:59:05.494771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:05.495477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:05.504092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:05.504806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:05.505270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:05.505978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:05.506431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:05.506857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:05.692707 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2dcbeaef-6b90-4e11-a5c7-34255f1ad51b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 204 len: 0 microversion: 2.1 time: 3.988386 Nov 03 03:59:05.693372 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 974/1899] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:01 2022] DELETE /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 0 bytes in 3990 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:59:05.699317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-faf21ebf-d81d-4ba1-a708-bf847666ba3f tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Calling method '.version_select at 0x7ff7f8f611f0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:05.732214 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-faf21ebf-d81d-4ba1-a708-bf847666ba3f tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] HTTP exception thrown: Image not found. Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-faf21ebf-d81d-4ba1-a708-bf847666ba3f tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Request method failure captured: Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/images/33226c21-2125-4bb2-8b6e-f7e541b76adj HTTP/1.1 Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyJW1u6LBatS6uaFFZx-3pH56aJkKexqIpJFqFsWRhmgXyntmjKyKGynHgydlPQHLEXDwPH3nrClcxA-FQVRD9sgOq8k_Av96KDbj38eWkz5N67qPxuZB3uud0Kz9GX42JZ8lNEV1qUgSlxvr6GeDe2SVnzRHksvUdq4SrUvxOB2xQ Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37cf667983934becabc5939beea0556a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37cf667983934becabc5939beea0556a"}]}] Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c47f4d155a6b4b3d80b0432e85b08a1d Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '33226c21-2125-4bb2-8b6e-f7e541b76adj'} Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 33226c21-2125-4bb2-8b6e-f7e541b76adj to delete Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33226c21-2125-4bb2-8b6e-f7e541b76adj could not be found. Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.734532 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-faf21ebf-d81d-4ba1-a708-bf847666ba3f tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-faf21ebf-d81d-4ba1-a708-bf847666ba3f tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] 10.222.0.30 "DELETE /compute/v2.1/images/33226c21-2125-4bb2-8b6e-f7e541b76adj" status: 404 len: 62 microversion: 2.1 time: 0.041623 Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 975/1900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:05 2022] DELETE /compute/v2.1/images/33226c21-2125-4bb2-8b6e-f7e541b76adj => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:05.748501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:05.757199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:05.757662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:05.758331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:05.759954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:05.760580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:05.773590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:05.792620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:05.893637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:05.906731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:05.910436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:05.912474 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90f18d7b-ae5d-48e6-a69c-888de4a58f44 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.424030 Nov 03 03:59:05.913527 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 926/1901] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:05 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:05.934041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:05.937576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:05.951943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:05.953498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:05.953960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:05.954677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:05.955302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:05.955902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:05.971171 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 HTTP/1.1 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '328fceff-bafd-4b2a-a220-f1f9d57deb42'} Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:05.973439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.978814 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:05.978814 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:05.978814 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:05.978814 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:05.978814 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:05.978814 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 03:59:05.978814 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:05.980357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:05.981482 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23863f12-dcbe-4cdd-9e2a-276717c9b677 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 404 len: 111 microversion: 2.1 time: 0.066741 Nov 03 03:59:05.982363 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 927/1902] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:05 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:06.004520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ec79f6e-a634-49db-a012-f8ec2b72e114 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Calling method '.version_select at 0x7ff7f90f9820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:06.024764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-0ec79f6e-a634-49db-a012-f8ec2b72e114 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] HTTP exception thrown: Image not found. Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ec79f6e-a634-49db-a012-f8ec2b72e114 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Request method failure captured: Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/1a7d5799-69f5-454f-be30-c4af520920a91 HTTP/1.1 Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyJW1u6LBatS6uaFFZx-3pH56aJkKexqIpJFqFsWRhmgXyntmjKyKGynHgydlPQHLEXDwPH3nrClcxA-FQVRD9sgOq8k_Av96KDbj38eWkz5N67qPxuZB3uud0Kz9GX42JZ8lNEV1qUgSlxvr6GeDe2SVnzRHksvUdq4SrUvxOB2xQ Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37cf667983934becabc5939beea0556a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37cf667983934becabc5939beea0556a"}]}] Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c47f4d155a6b4b3d80b0432e85b08a1d Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1a7d5799-69f5-454f-be30-c4af520920a91'} Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1a7d5799-69f5-454f-be30-c4af520920a91 to delete Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a7d5799-69f5-454f-be30-c4af520920a91 could not be found. Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.027428 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:59:06.034610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.036241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:06.036795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ec79f6e-a634-49db-a012-f8ec2b72e114 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:06.036795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ec79f6e-a634-49db-a012-f8ec2b72e114 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] 10.222.0.30 "DELETE /compute/v2.1/images/1a7d5799-69f5-454f-be30-c4af520920a91" status: 404 len: 62 microversion: 2.1 time: 0.040090 Nov 03 03:59:06.036795 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 928/1903] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:05 2022] DELETE /compute/v2.1/images/1a7d5799-69f5-454f-be30-c4af520920a91 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:59:06.042383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:06.043241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:06.043566 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a96a036-8ad5-419d-9881-8b67d25e4780 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1324 microversion: 2.1 time: 0.304535 Nov 03 03:59:06.049839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 976/1904] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:05 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:06.070213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.070716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.071362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:06.072088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.072547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.073212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:06.075467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:06.078804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:06.104459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.106740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.106740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:06.108072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.109148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.110103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:06.150991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:06.162908 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f1f44a6-4e7d-448b-943a-c7cb25af063c tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1275 microversion: 2.1 time: 0.124449 Nov 03 03:59:06.163491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 929/1905] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:06 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:06.177201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a87a87d6-6ff0-4f00-a364-4469f83e6358 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Calling method '.version_select at 0x7ff7f91e6e50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:06.189879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.191233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.196294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:06.196842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lazy-loading 'fault' on Instance uuid 90ed965a-8dc9-4615-a8bd-dc2436ecd483 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:06.213281 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a87a87d6-6ff0-4f00-a364-4469f83e6358 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] HTTP exception thrown: Image not found. Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a87a87d6-6ff0-4f00-a364-4469f83e6358 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Request method failure captured: Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/tempest-invalid-1380430785 HTTP/1.1 Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyJW1u6LBatS6uaFFZx-3pH56aJkKexqIpJFqFsWRhmgXyntmjKyKGynHgydlPQHLEXDwPH3nrClcxA-FQVRD9sgOq8k_Av96KDbj38eWkz5N67qPxuZB3uud0Kz9GX42JZ8lNEV1qUgSlxvr6GeDe2SVnzRHksvUdq4SrUvxOB2xQ Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37cf667983934becabc5939beea0556a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37cf667983934becabc5939beea0556a"}]}] Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c47f4d155a6b4b3d80b0432e85b08a1d Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'tempest-invalid-1380430785'} Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1380430785 to delete Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1380430785 could not be found. Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.225395 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a87a87d6-6ff0-4f00-a364-4469f83e6358 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:06.235400 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a87a87d6-6ff0-4f00-a364-4469f83e6358 tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] 10.222.0.30 "DELETE /compute/v2.1/images/tempest-invalid-1380430785" status: 404 len: 62 microversion: 2.1 time: 0.069544 Nov 03 03:59:06.241945 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 930/1906] 10.222.0.30 () {58 vars in 1206 bytes} [Thu Nov 3 03:59:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1380430785 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:59:06.247115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-662566ad-6167-45ec-bccb-f0e4cd14a6a1 req-c0e0ae12-474f-4c6c-9df0-5bc16f01eac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-plugged", "status": "completed", "tag": "606a7cb9-b94b-4ddc-8269-c39b0f27ee7d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:06.262225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-662566ad-6167-45ec-bccb-f0e4cd14a6a1 req-c0e0ae12-474f-4c6c-9df0-5bc16f01eac6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.262776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-662566ad-6167-45ec-bccb-f0e4cd14a6a1 req-c0e0ae12-474f-4c6c-9df0-5bc16f01eac6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.263222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-662566ad-6167-45ec-bccb-f0e4cd14a6a1 req-c0e0ae12-474f-4c6c-9df0-5bc16f01eac6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:06.269920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:06.276855 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-662566ad-6167-45ec-bccb-f0e4cd14a6a1 req-c0e0ae12-474f-4c6c-9df0-5bc16f01eac6 service nova] Creating event network-vif-plugged:606a7cb9-b94b-4ddc-8269-c39b0f27ee7d for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:06.280117 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-70e790e8-23cd-464b-bb2d-e642cdec1a1f tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 200 len: 1188 microversion: 2.1 time: 0.226374 Nov 03 03:59:06.290807 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 977/1907] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:06 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 1188 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:06.301776 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-662566ad-6167-45ec-bccb-f0e4cd14a6a1 req-c0e0ae12-474f-4c6c-9df0-5bc16f01eac6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040937 Nov 03 03:59:06.301776 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 931/1908] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:06.302150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1554649040", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "25261195-157d-4c7b-8cfb-4fb3b385217e"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:06.302268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52c3a5cc-c5ff-4c95-ac8d-fe899a80c8ab tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Calling method '.version_select at 0x7ff7fd66cee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:06.334363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-52c3a5cc-c5ff-4c95-ac8d-fe899a80c8ab tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] HTTP exception thrown: Image not found. Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52c3a5cc-c5ff-4c95-ac8d-fe899a80c8ab tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Request method failure captured: Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/a56dd74e-8cf2-46b7-a9d7-189491720934 HTTP/1.1 Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyJW1u6LBatS6uaFFZx-3pH56aJkKexqIpJFqFsWRhmgXyntmjKyKGynHgydlPQHLEXDwPH3nrClcxA-FQVRD9sgOq8k_Av96KDbj38eWkz5N67qPxuZB3uud0Kz9GX42JZ8lNEV1qUgSlxvr6GeDe2SVnzRHksvUdq4SrUvxOB2xQ Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37cf667983934becabc5939beea0556a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37cf667983934becabc5939beea0556a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37cf667983934becabc5939beea0556a"}]}] Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 37cf667983934becabc5939beea0556a Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43549925 Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c47f4d155a6b4b3d80b0432e85b08a1d Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43549925-project Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a56dd74e-8cf2-46b7-a9d7-189491720934'} Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a56dd74e-8cf2-46b7-a9d7-189491720934 to delete Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a56dd74e-8cf2-46b7-a9d7-189491720934 could not be found. Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.336319 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52c3a5cc-c5ff-4c95-ac8d-fe899a80c8ab tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52c3a5cc-c5ff-4c95-ac8d-fe899a80c8ab tempest-ImagesDeleteNegativeTestJSON-43549925 tempest-ImagesDeleteNegativeTestJSON-43549925-project] 10.222.0.30 "DELETE /compute/v2.1/images/a56dd74e-8cf2-46b7-a9d7-189491720934" status: 404 len: 62 microversion: 2.1 time: 0.051577 Nov 03 03:59:06.341867 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 932/1909] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:06 2022] DELETE /compute/v2.1/images/a56dd74e-8cf2-46b7-a9d7-189491720934 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:59:06.386080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] validate_networks() for [('25261195-157d-4c7b-8cfb-4fb3b385217e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:59:06.949496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:06.951056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:06.960932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.961738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.962959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:06.964793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:06.965897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:06.966572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.306648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:07.325054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:07.327865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:07.329464 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-03a9ac09-a2fc-4308-9fe0-f806dc8eefea tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.384264 Nov 03 03:59:07.332411 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 933/1910] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:06 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:07.341135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:07.342058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:07.349764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.350560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.351230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.352324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.352588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:59:07.353228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:59:07.353510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:59:07.353926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:59:07.354349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:59:07.354833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.355493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.369596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.370078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.370528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.371270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.371733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.372165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.410069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:59:07.417509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for user baa7ebbbe2c14c82b5a07fef33cc214a and project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:59:07.436972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:59:07.439944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:59:07.540056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:07.548125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a4f2781-5cae-4bd7-ad28-05c1b97d4011 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1521 microversion: 2.1 time: 0.214360 Nov 03 03:59:07.548931 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 934/1911] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:07 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:07.553834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:07.554562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:07.560763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.562120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.562120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.562823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.563391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.564085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.640816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8495df9-cb54-4a26-9297-99d8f54c3724 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355648 Nov 03 03:59:07.648955 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 978/1912] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:59:07.655168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:07.690330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:07.691089 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82758c1c-2170-496f-a3ed-aa4272dd8131 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1281 microversion: 2.1 time: 0.137893 Nov 03 03:59:07.692860 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 935/1913] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:07 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:07.697929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 90ed965a-8dc9-4615-a8bd-dc2436ecd483] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:07.714309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7d2f136-275a-4992-98c3-cc6893f2efc3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:07.717486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7d2f136-275a-4992-98c3-cc6893f2efc3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:07.727367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.734139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.734139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.734139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:07.734139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:07.734139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:07.754892 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] HTTP exception thrown: Instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 could not be found. Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Request method failure captured: Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 HTTP/1.1 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrHdvDIjMdlWK5cAuUDZJ9XaZqbPBi42CDNyRhePEddUHQkDrR-I22WcWXdVtS3JqTvg8Obk3xeWyXzb5-OXmo7X9cNuaHJnyNd9pYZ4nuEKENLG_ew7fH8g9aQi4jjetfhGFzi_L05Z67oV--mmERQw3MZq5kf49qg642e5Hh-NG4 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_71461e876c80455aa1875086a2ec4f49", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/71461e876c80455aa1875086a2ec4f49"}]}] Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c4a4d4a61500400faf673aa67ff8be39 Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 could not be found. Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '90ed965a-8dc9-4615-a8bd-dc2436ecd483'} Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 could not be found. Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 could not be found. Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.757707 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 could not be found. Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Returning 404 to user: Instance 90ed965a-8dc9-4615-a8bd-dc2436ecd483 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b43f5be-af5e-465b-8e53-d7c81470d8f4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483" status: 404 len: 111 microversion: 2.1 time: 0.114460 Nov 03 03:59:07.770989 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 979/1914] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:07 2022] GET /compute/v2.1/servers/90ed965a-8dc9-4615-a8bd-dc2436ecd483 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:07.785284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d49a17c-f57c-444d-91f2-a8dcbc5ec830 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1069249273", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d49a17c-f57c-444d-91f2-a8dcbc5ec830 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 243 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1069249273", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1069249273', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'a7bcc526-54ff-467b-af8a-dcb5382ba079'}]}}} Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'': 'data1'} Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:07.789932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d49a17c-f57c-444d-91f2-a8dcbc5ec830 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:07.796056 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d49a17c-f57c-444d-91f2-a8dcbc5ec830 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.012015 Nov 03 03:59:07.804003 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 980/1915] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:07 2022] POST /compute/v2.1/servers => generated 175 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 03 03:59:07.810177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9eade1c3-c8a0-49d5-aa32-c2286c707c28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:07.810935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9eade1c3-c8a0-49d5-aa32-c2286c707c28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 7258c15d-0acd-49ad-8b45-96c62fab026f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:07.819029 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9eade1c3-c8a0-49d5-aa32-c2286c707c28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] HTTP exception thrown: Instance 7258c15d-0acd-49ad-8b45-96c62fab026f could not be found. Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9eade1c3-c8a0-49d5-aa32-c2286c707c28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/7258c15d-0acd-49ad-8b45-96c62fab026f/metadata HTTP/1.1 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 7258c15d-0acd-49ad-8b45-96c62fab026f could not be found. Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': '7258c15d-0acd-49ad-8b45-96c62fab026f'} Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7258c15d-0acd-49ad-8b45-96c62fab026f could not be found. Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7258c15d-0acd-49ad-8b45-96c62fab026f could not be found. Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.824010 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.830447 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:07.830447 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:07.830447 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7258c15d-0acd-49ad-8b45-96c62fab026f could not be found. Nov 03 03:59:07.830447 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.833159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9eade1c3-c8a0-49d5-aa32-c2286c707c28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 404 to user: Instance 7258c15d-0acd-49ad-8b45-96c62fab026f could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:07.834325 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9eade1c3-c8a0-49d5-aa32-c2286c707c28 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/7258c15d-0acd-49ad-8b45-96c62fab026f/metadata" status: 404 len: 111 microversion: 2.1 time: 0.029120 Nov 03 03:59:07.847798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 981/1916] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 03:59:07 2022] GET /compute/v2.1/servers/7258c15d-0acd-49ad-8b45-96c62fab026f/metadata => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:07.850596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f7d2f136-275a-4992-98c3-cc6893f2efc3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:07.863746 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7d2f136-275a-4992-98c3-cc6893f2efc3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1215 microversion: 2.1 time: 0.167377 Nov 03 03:59:07.865877 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 936/1917] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:07 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:07.948486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccb03371-636e-4a06-b13d-3cd8eb51db12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2045323287", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccb03371-636e-4a06-b13d-3cd8eb51db12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 499 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2045323287", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2045323287', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a7bcc526-54ff-467b-af8a-dcb5382ba079'}]}}} Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:59:07.957632 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:07.962437 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:07.969218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccb03371-636e-4a06-b13d-3cd8eb51db12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:07.969717 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ccb03371-636e-4a06-b13d-3cd8eb51db12 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.023256 Nov 03 03:59:07.980111 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 982/1918] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:07 2022] POST /compute/v2.1/servers => generated 687 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:59:08.040278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-662a033a-b0c3-4dcd-9e57-dc30db8cb9e7 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-951806491", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-662a033a-b0c3-4dcd-9e57-dc30db8cb9e7 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 499 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-951806491", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-951806491', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a7bcc526-54ff-467b-af8a-dcb5382ba079'}]}}} Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:59:08.048489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-662a033a-b0c3-4dcd-9e57-dc30db8cb9e7 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-662a033a-b0c3-4dcd-9e57-dc30db8cb9e7 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010739 Nov 03 03:59:08.052606 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 937/1919] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:08 2022] POST /compute/v2.1/servers => generated 689 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:59:08.120520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4f2b9f7-6ab5-4aed-bd37-2b9cf02d8d3d tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-568968508", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4f2b9f7-6ab5-4aed-bd37-2b9cf02d8d3d tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 753 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-568968508", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-568968508', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a7bcc526-54ff-467b-af8a-dcb5382ba079'}]}}} Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:08.141103 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:08.150484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:08.154073 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.154073 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.154073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4f2b9f7-6ab5-4aed-bd37-2b9cf02d8d3d tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:08.154073 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d4f2b9f7-6ab5-4aed-bd37-2b9cf02d8d3d tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.031875 Nov 03 03:59:08.154073 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 983/1920] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:08 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 03 03:59:08.296883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b46e2d80-9d48-45a0-8a35-6aec077d7606 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-879450075", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b46e2d80-9d48-45a0-8a35-6aec077d7606 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 1265 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-879450075", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "a7bcc526-54ff-467b-af8a-dcb5382ba079"}]}} Nov 03 03:59:08.302430 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-879450075', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'a7bcc526-54ff-467b-af8a-dcb5382ba079'}]}}} Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.305248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:08.306910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:08.309293 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:08.309293 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.313660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b46e2d80-9d48-45a0-8a35-6aec077d7606 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:08.314882 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b46e2d80-9d48-45a0-8a35-6aec077d7606 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.024892 Nov 03 03:59:08.317938 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 938/1921] 10.222.0.30 () {60 vars in 1148 bytes} [Thu Nov 3 03:59:08 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Nov 03 03:59:08.333727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e678abf1-6ae8-4f18-8efb-e06d88078c36 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:08.334289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e678abf1-6ae8-4f18-8efb-e06d88078c36 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:08.348550 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-e678abf1-6ae8-4f18-8efb-e06d88078c36 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] HTTP exception thrown: Instance f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4 could not be found. Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e678abf1-6ae8-4f18-8efb-e06d88078c36 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4/metadata/test2 HTTP/1.1 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4 could not be found. Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': 'f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4', 'id': 'test2'} Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4 could not be found. Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4 could not be found. Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:08.353886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:08.369563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:08.369563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:08.369563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4 could not be found. Nov 03 03:59:08.369563 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:08.369563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e678abf1-6ae8-4f18-8efb-e06d88078c36 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 404 to user: Instance f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:08.369563 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e678abf1-6ae8-4f18-8efb-e06d88078c36 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.029958 Nov 03 03:59:08.369563 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 984/1922] 10.222.0.30 () {58 vars in 1281 bytes} [Thu Nov 3 03:59:08 2022] GET /compute/v2.1/servers/f87a8bd8-7a69-4fe9-8ee9-7b2f1b6efce4/metadata/test2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:08.381447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:08.382141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:08.386290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:08.387576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:08.401214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:08.402128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:08.402754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:08.402893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:08.403345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:08.403795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:08.404374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:08.404624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:08.405114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:08.405544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:08.406199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:08.406682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:08.466134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:59:08.813234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:08.837131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:08.838662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:08.839826 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94df778a-7d11-4d7f-8685-1824bdde483e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1874 microversion: 2.32 time: 0.481592 Nov 03 03:59:08.840534 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 939/1923] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:08 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1874 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:08.846056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:08.847491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:08.854715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:08.856008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:08.856776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:08.858648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:08.859347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:08.860118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:08.923998 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b8ce097-5cb3-43ec-b482-a9b4bfef9a05 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "DELETE /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 204 len: 0 microversion: 2.1 time: 0.554482 Nov 03 03:59:08.927903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 985/1924] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:08 2022] DELETE /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:59:08.930660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30757946-d1a2-4073-90cd-c2a1f80635ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:08.931524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-30757946-d1a2-4073-90cd-c2a1f80635ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:08.933576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:09.048733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-30757946-d1a2-4073-90cd-c2a1f80635ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:09.055747 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30757946-d1a2-4073-90cd-c2a1f80635ba tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1215 microversion: 2.1 time: 0.129952 Nov 03 03:59:09.067755 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 986/1925] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:08 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:09.067755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:09.067755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:09.071950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:09.071950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:09.071950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:09.071950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:09.071950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:09.072430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:09.296826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:09.313958 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf7658c8-051c-4f6a-893e-51a8a62ca7c3 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.471587 Nov 03 03:59:09.316247 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 940/1926] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:08 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:09.369251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:09.384062 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d247a4d-2ed1-48c6-a264-402ae50cc4c5 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1527 microversion: 2.1 time: 0.323492 Nov 03 03:59:09.384062 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 987/1927] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:09 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1527 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:09.868984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:09.869627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:09.879099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:09.879606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:09.880030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:09.880740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:09.881230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:09.881721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:10.082940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:10.084092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:10.095496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:10.096245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:10.097836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:10.099424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:10.100282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:10.101266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:10.226914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:10.240804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:10.252920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:10.254551 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73e48ea3-7f0b-4754-92e1-64288bd0b8ad tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2826 microversion: 2.32 time: 0.389509 Nov 03 03:59:10.258374 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 941/1928] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:09 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2826 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:10.276603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d60c2bfe-96a9-4256-af5f-44e9f02f929e req-8c59566d-5366-42d5-8b26-c6f56ef01603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ad7bd7-7664-4a21-a481-9766d7be69f1", "tag": "81007eef-a217-41b5-87a5-caff3ee14c9f"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:10.285233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:10.288399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d60c2bfe-96a9-4256-af5f-44e9f02f929e req-8c59566d-5366-42d5-8b26-c6f56ef01603 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:10.289035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d60c2bfe-96a9-4256-af5f-44e9f02f929e req-8c59566d-5366-42d5-8b26-c6f56ef01603 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:10.290263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d60c2bfe-96a9-4256-af5f-44e9f02f929e req-8c59566d-5366-42d5-8b26-c6f56ef01603 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:10.301384 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-377085ec-c1f5-4436-8fdb-e91f7f9b28bd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1211 microversion: 2.1 time: 0.225724 Nov 03 03:59:10.312983 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d60c2bfe-96a9-4256-af5f-44e9f02f929e req-8c59566d-5366-42d5-8b26-c6f56ef01603 service nova] Creating event network-changed:81007eef-a217-41b5-87a5-caff3ee14c9f for instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 on n-h1-854653-7 Nov 03 03:59:10.322776 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d60c2bfe-96a9-4256-af5f-44e9f02f929e req-8c59566d-5366-42d5-8b26-c6f56ef01603 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060681 Nov 03 03:59:10.323603 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 942/1929] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:10.328676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:10.343002 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 988/1930] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:10 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1211 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:10.349064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:10.349467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:10.356296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:10.369095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:10.369907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:10.370523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:10.371426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:10.372433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:10.373058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:10.376214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:10.379453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:10.380152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:10.382385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:10.382972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:10.388046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:11.012631 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-868df90f-05c8-4d1f-9e61-5e26799eec1b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.687705 Nov 03 03:59:11.025110 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 943/1931] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 03:59:10 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa/os-interface => generated 1831 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:11.030403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:11.031130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:11.043286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:11.049392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:11.050037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:11.050876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:11.051423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:11.051949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:12.217325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:12.229965 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c34c4aa-6889-4990-a1a0-7b8aed2a5320 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 1.882063 Nov 03 03:59:12.231359 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 989/1932] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:10 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:12.242581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:12.243252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:12.269102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:12.269662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:12.270116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:12.270851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:12.271442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:12.271879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:12.333602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:12.347594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:12.351311 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3311a38e-9040-456b-8f2f-ecde33dd1a1b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1527 microversion: 2.1 time: 1.325087 Nov 03 03:59:12.356086 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 944/1933] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:11 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1527 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:12.820101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:12.828822 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac222e0f-353d-4536-8373-1480790175c9 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1273 microversion: 2.1 time: 0.596153 Nov 03 03:59:12.848140 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 990/1934] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:12 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1273 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:13.260707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:13.261526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:13.272822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:13.273621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:13.274137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:13.275257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:13.276185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:13.277212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:13.381365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:13.382774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:13.396713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:13.398065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:13.399718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:13.400641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:13.404977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:13.405677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:13.693830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:13.718795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3c9fb286-95e9-4d23-9f9e-db2d54f6029d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.459550 Nov 03 03:59:13.727101 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 945/1935] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:13 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:13.861500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:13.862242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:13.872258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:13.875676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:13.876456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:13.881395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:13.882211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:13.883271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:14.088643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:14.097963 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93a383cc-ba18-4d6a-8efe-8e792d3475b3 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1273 microversion: 2.1 time: 0.241959 Nov 03 03:59:14.098897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 946/1936] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:13 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:14.181617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:14.189899 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7cc69bc-205f-4b86-b752-5e70fbfcf53b tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1527 microversion: 2.1 time: 0.813665 Nov 03 03:59:14.201381 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 991/1937] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:13 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1527 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:14.401756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ee92fa3c-f5b6-43b5-93a1-d24f783be0d6 req-d1f59535-91e6-449e-ae89-33d086a69a28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84138b04-4841-4c50-9bc2-a91875d34567", "name": "network-vif-deleted", "tag": "91904e83-d2ff-4f69-bd5c-521bdb26fce3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:14.428832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ee92fa3c-f5b6-43b5-93a1-d24f783be0d6 req-d1f59535-91e6-449e-ae89-33d086a69a28 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:14.430008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ee92fa3c-f5b6-43b5-93a1-d24f783be0d6 req-d1f59535-91e6-449e-ae89-33d086a69a28 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:14.432508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ee92fa3c-f5b6-43b5-93a1-d24f783be0d6 req-d1f59535-91e6-449e-ae89-33d086a69a28 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:14.465789 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ee92fa3c-f5b6-43b5-93a1-d24f783be0d6 req-d1f59535-91e6-449e-ae89-33d086a69a28 service nova] Creating event network-vif-deleted:91904e83-d2ff-4f69-bd5c-521bdb26fce3 for instance 84138b04-4841-4c50-9bc2-a91875d34567 on n-h1-854653-7 Nov 03 03:59:14.483579 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ee92fa3c-f5b6-43b5-93a1-d24f783be0d6 req-d1f59535-91e6-449e-ae89-33d086a69a28 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089284 Nov 03 03:59:14.484867 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 947/1938] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:14.750710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:14.751960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:14.763343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:14.765778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:14.766680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:14.768168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:14.770206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:14.774712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:14.803787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:14.804673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:14.830659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:14.830659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:14.830659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:14.830659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:14.830659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:14.832340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:14.895961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:59:15.264642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:15.280845 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb64eead-ebe3-4e50-85f1-103f7945b32e tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.534327 Nov 03 03:59:15.287475 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 992/1939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:14 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:15.304969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:15.318131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:15.323047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:15.345253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:15.350390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:15.354257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:15.355600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:15.356527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:15.358591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:15.405150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9b96761-5de9-4fa2-971c-d728407bccb5 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 204 len: 0 microversion: 2.1 time: 0.605891 Nov 03 03:59:15.406274 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 948/1940] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:14 2022] DELETE /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:59:15.413181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:15.424381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:15.468042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:15.470744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:15.473963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:15.479427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:15.482781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:15.485877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:15.517138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:15.620794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:15.625643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:15.632760 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0698c834-e68a-412b-8416-fe62e5241bd2 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1273 microversion: 2.1 time: 0.341451 Nov 03 03:59:15.633388 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 993/1941] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:15 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1273 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:15.659586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:15.659983 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42139696-5d6d-44e1-8fe6-648f62f420f3 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1485 microversion: 2.1 time: 0.249517 Nov 03 03:59:15.660227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:15.663242 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 949/1942] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:15 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1485 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:15.710357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:15.710877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:15.711349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:15.712097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:15.712565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:15.712996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:16.160995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:16.170878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73086262-cad0-4c1b-8240-927d13bd92b7 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1666 microversion: 2.1 time: 0.530980 Nov 03 03:59:16.172555 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 994/1943] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:15 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1666 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:16.316643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:16.317947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:16.329228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:16.330002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:16.330625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:16.332822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:16.332822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:16.333565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:16.662311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:16.662311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:16.682159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:16.683185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:16.684105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:16.686359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:16.687790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:16.688551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:17.235183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:17.244616 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b4a47b3-7d9e-4f98-8489-7dc4d7dc74e7 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.932641 Nov 03 03:59:17.245236 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 950/1944] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:16 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:17.286619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:17.287236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:17.302248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:17.305457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:17.306115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:17.307060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:17.307716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:17.308408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:17.386524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:17.387730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:17.388372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:17.390280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lazy-loading 'fault' on Instance uuid 84138b04-4841-4c50-9bc2-a91875d34567 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:17.394209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:17.507346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0617b26463e4602902a3c5f27c8b891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639550f5bd124c76ac1344d804632929', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:17.523366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0e25aef-8582-4173-9c9a-354e863959f4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 200 len: 1314 microversion: 2.1 time: 0.251060 Nov 03 03:59:17.542165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:17.547204 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 951/1945] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:17 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:17.558423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-bd8a374c-500a-47bd-bd3c-e4f100293cb3 req-a1928d52-7256-4c72-b4e4-bf6096018d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "tag": "6d00f3d5-ad14-49f4-b158-233065bddcf8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:17.561862 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab881514-9755-43dc-967a-fa39092c409b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1315 microversion: 2.1 time: 0.904293 Nov 03 03:59:17.562452 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 995/1946] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:16 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:17.568910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:17.570090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:17.572129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bd8a374c-500a-47bd-bd3c-e4f100293cb3 req-a1928d52-7256-4c72-b4e4-bf6096018d59 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:17.572617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bd8a374c-500a-47bd-bd3c-e4f100293cb3 req-a1928d52-7256-4c72-b4e4-bf6096018d59 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:17.573078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bd8a374c-500a-47bd-bd3c-e4f100293cb3 req-a1928d52-7256-4c72-b4e4-bf6096018d59 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:17.582712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:17.583508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:17.584290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:17.585822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:17.586524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:17.587200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:17.604184 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-bd8a374c-500a-47bd-bd3c-e4f100293cb3 req-a1928d52-7256-4c72-b4e4-bf6096018d59 service nova] Creating event network-changed:6d00f3d5-ad14-49f4-b158-233065bddcf8 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 03:59:17.632243 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-bd8a374c-500a-47bd-bd3c-e4f100293cb3 req-a1928d52-7256-4c72-b4e4-bf6096018d59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076751 Nov 03 03:59:17.634794 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 952/1947] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:18.017379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:18.027538 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c7851ab-7ef1-49cf-915f-15eb9915bdda tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1666 microversion: 2.1 time: 0.463638 Nov 03 03:59:18.029749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 996/1948] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:17 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1666 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:18.280264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:18.311981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:18.328510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:18.377885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:18.378494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:18.381947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:18.384713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:18.387287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:18.388819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:18.552913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:18.554327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] [instance: 84138b04-4841-4c50-9bc2-a91875d34567] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:18.563528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:18.564934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:18.565702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:18.567252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:18.567977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:18.568674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:18.593300 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] HTTP exception thrown: Instance 84138b04-4841-4c50-9bc2-a91875d34567 could not be found. Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Request method failure captured: Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 HTTP/1.1 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzxrKEo_xLaQT3HkNr7su2GMqbgHw56MaIah1505qlV3ON50BJax55xYgVTudeFHTbPl6pI0cAM8tMC4nwPoN0aDmyaVRjfpMWk2R-GbLBFAvVOiPBmAUMo4e2SGG5N35m9SSaIJ8n_xQFpM2q6sCt65Sdl-KczT6WZZfQfa0BPy3BU Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_639550f5bd124c76ac1344d804632929", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/639550f5bd124c76ac1344d804632929"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/639550f5bd124c76ac1344d804632929"}]}] Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 639550f5bd124c76ac1344d804632929 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2129915223 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b0617b26463e4602902a3c5f27c8b891 Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2129915223-project Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 84138b04-4841-4c50-9bc2-a91875d34567 could not be found. Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '84138b04-4841-4c50-9bc2-a91875d34567'} Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84138b04-4841-4c50-9bc2-a91875d34567 could not be found. Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84138b04-4841-4c50-9bc2-a91875d34567 could not be found. Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:18.596154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84138b04-4841-4c50-9bc2-a91875d34567 could not be found. Nov 03 03:59:18.608042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:18.611806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] Returning 404 to user: Instance 84138b04-4841-4c50-9bc2-a91875d34567 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:18.618940 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cda787c3-ef1c-4f69-99bc-6df7041e14e4 tempest-ServerMetadataNegativeTestJSON-2129915223 tempest-ServerMetadataNegativeTestJSON-2129915223-project] 10.222.0.30 "GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567" status: 404 len: 111 microversion: 2.1 time: 0.065767 Nov 03 03:59:18.618940 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 997/1949] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:18 2022] GET /compute/v2.1/servers/84138b04-4841-4c50-9bc2-a91875d34567 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:18.625313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:18.626100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:18.632557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:18.633195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:18.633739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:18.634544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:18.635624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:18.636543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:18.850788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:18.928204 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-95d98e30-d49b-473c-9fde-73cd576be016 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.641579 Nov 03 03:59:18.930077 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 953/1950] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:18 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:19.044971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:19.047693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:19.053486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:19.054381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:19.057914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:19.062765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72ab315c-e0dc-41b4-afd7-5f3bda2b0f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1315 microversion: 2.1 time: 0.441438 Nov 03 03:59:19.063342 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 998/1951] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:18 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:19.076699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:19.077720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:19.078140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:19.078863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:19.079328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:19.079823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:19.207038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:19.219654 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb43a9ec-6773-452e-b4f6-256ab17f8d3e tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1598 microversion: 2.1 time: 0.170066 Nov 03 03:59:19.220269 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 954/1952] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:19 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:19.708474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-aec33e2a-f43b-4be7-bbdc-9272b791e636 req-4ff549d7-1dd1-4155-a3c9-4eeb5eda2b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f90a0c21-607b-4f27-b2f5-f06fa4cbe765", "tag": "72e45d4f-14cf-441b-9bb3-22466436c570"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:19.743676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-aec33e2a-f43b-4be7-bbdc-9272b791e636 req-4ff549d7-1dd1-4155-a3c9-4eeb5eda2b58 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:19.744158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-aec33e2a-f43b-4be7-bbdc-9272b791e636 req-4ff549d7-1dd1-4155-a3c9-4eeb5eda2b58 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:19.744644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-aec33e2a-f43b-4be7-bbdc-9272b791e636 req-4ff549d7-1dd1-4155-a3c9-4eeb5eda2b58 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:19.767339 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-aec33e2a-f43b-4be7-bbdc-9272b791e636 req-4ff549d7-1dd1-4155-a3c9-4eeb5eda2b58 service nova] Creating event network-changed:72e45d4f-14cf-441b-9bb3-22466436c570 for instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 on n-h2-854653-7 Nov 03 03:59:19.784932 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-aec33e2a-f43b-4be7-bbdc-9272b791e636 req-4ff549d7-1dd1-4155-a3c9-4eeb5eda2b58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086941 Nov 03 03:59:19.788378 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 999/1953] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:19.952356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:19.956286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:19.976286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:19.978421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:19.979650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:19.992110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:19.993038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:19.993703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:20.111345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:20.114422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:20.128723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:20.129593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:20.130299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:20.131362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:20.132133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:20.132915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:20.273393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:20.299233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ed8e02b-3e8d-4cc8-8b07-0363e2abf6ab tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.350976 Nov 03 03:59:20.304807 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 955/1954] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:19 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:20.322128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:20.322842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:20.339160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:20.339660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:20.342277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:20.345195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:20.345934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:20.347857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:20.386301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:20.396231 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-677ce397-6098-488f-acc3-95bc20cea93e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1315 microversion: 2.1 time: 0.310733 Nov 03 03:59:20.396818 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1000/1955] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:20 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:20.455364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:20.458459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:20.459297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:20.461996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lazy-loading 'fault' on Instance uuid 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:20.568079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:20.582120 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-016944f4-6218-47e4-8c8d-6d41b7cd16c2 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 200 len: 1324 microversion: 2.1 time: 0.280871 Nov 03 03:59:20.594498 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 956/1956] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:20 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 1324 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:20.777577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-332866578", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "5b8fe51f-9af2-47f9-8ae4-cb9d7cbdd61a"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:20.855939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] validate_networks() for [('5b8fe51f-9af2-47f9-8ae4-cb9d7cbdd61a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:59:21.281412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-37501968-d225-4d10-a721-676c93cae2af req-200a0559-7803-49c7-90c5-15e15be4a9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ad7bd7-7664-4a21-a481-9766d7be69f1", "name": "network-vif-plugged", "status": "completed", "tag": "81007eef-a217-41b5-87a5-caff3ee14c9f"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:21.303324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-37501968-d225-4d10-a721-676c93cae2af req-200a0559-7803-49c7-90c5-15e15be4a9b5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.303812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-37501968-d225-4d10-a721-676c93cae2af req-200a0559-7803-49c7-90c5-15e15be4a9b5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.304248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-37501968-d225-4d10-a721-676c93cae2af req-200a0559-7803-49c7-90c5-15e15be4a9b5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.326775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-37501968-d225-4d10-a721-676c93cae2af req-200a0559-7803-49c7-90c5-15e15be4a9b5 service nova] Creating event network-vif-plugged:81007eef-a217-41b5-87a5-caff3ee14c9f for instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 on n-h1-854653-7 Nov 03 03:59:21.331969 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-37501968-d225-4d10-a721-676c93cae2af req-200a0559-7803-49c7-90c5-15e15be4a9b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058327 Nov 03 03:59:21.333593 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 957/1957] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:59:21.340495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:21.352501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:21.374390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.374892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.375331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.382103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.384176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.385938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.468998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:59:21.469826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:59:21.470256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:59:21.470687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:59:21.471631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:59:21.491239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.491746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.492198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.495551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.496286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.504752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.538090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for project 0c64c3da724e48709d5f073189b61fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:59:21.544486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for user c25b2e8e63e54fada80ba039c1be2501 and project 0c64c3da724e48709d5f073189b61fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:59:21.567889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:59:21.575935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:59:21.701709 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aad47871-1023-4c56-8a43-92a344c44190 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169502 Nov 03 03:59:21.703192 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1001/1958] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:59:21.711028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:21.712247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:21.723440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.725717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.727104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.727994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.728613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.728905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:21.729332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.760578 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6824e622-ea48-4557-8ddf-b938931dd21b tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.425024 Nov 03 03:59:21.762090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 958/1959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:21 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:21.772737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:21.779458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:21.798573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.800629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.801564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.803332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:21.804939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:21.805673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:21.859190 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] HTTP exception thrown: Instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 could not be found. Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Request method failure captured: Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 HTTP/1.1 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzrHdvDIjMdlWK5cAuUDZJ9XaZqbPBi42CDNyRhePEddUHQkDrR-I22WcWXdVtS3JqTvg8Obk3xeWyXzb5-OXmo7X9cNuaHJnyNd9pYZ4nuEKENLG_ew7fH8g9aQi4jjetfhGFzi_L05Z67oV--mmERQw3MZq5kf49qg642e5Hh-NG4 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_71461e876c80455aa1875086a2ec4f49", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/71461e876c80455aa1875086a2ec4f49"}]}] Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c4a4d4a61500400faf673aa67ff8be39 Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 could not be found. Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '64ddb0bd-101b-4c9e-92fa-76855b9e6ec9'} Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 could not be found. Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 could not be found. Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:21.865160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:21.870891 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:21.870891 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:21.870891 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:21.870891 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:21.870891 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:21.870891 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 could not be found. Nov 03 03:59:21.870891 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:21.872772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Returning 404 to user: Instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:21.874439 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a01a7e1e-ac3e-4629-bed2-5e39474900f3 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9" status: 404 len: 111 microversion: 2.1 time: 0.111144 Nov 03 03:59:21.876065 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 959/1960] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:21 2022] GET /compute/v2.1/servers/64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:21.888684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-56825e4a-8309-4c63-8907-e6c6495b1151 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:21.888684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-56825e4a-8309-4c63-8907-e6c6495b1151 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:22.095677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-56825e4a-8309-4c63-8907-e6c6495b1151 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:22.115033 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-56825e4a-8309-4c63-8907-e6c6495b1151 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1224 microversion: 2.1 time: 0.236360 Nov 03 03:59:22.123356 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 960/1961] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:21 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1224 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:22.131427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6fc4f322-7aa3-464c-a655-8a47267fa084 req-5077681b-e65f-4a67-9f52-24773587b03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ddb0bd-101b-4c9e-92fa-76855b9e6ec9", "name": "network-vif-deleted", "tag": "1b137398-13a0-4268-8495-d732181a2eb9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:22.160061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:22.168091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6fc4f322-7aa3-464c-a655-8a47267fa084 req-5077681b-e65f-4a67-9f52-24773587b03a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:22.172171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6fc4f322-7aa3-464c-a655-8a47267fa084 req-5077681b-e65f-4a67-9f52-24773587b03a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:22.172171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6fc4f322-7aa3-464c-a655-8a47267fa084 req-5077681b-e65f-4a67-9f52-24773587b03a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:22.172612 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28ec18fc-dcd5-4d41-8c1a-7e7a8c5a3bd7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1315 microversion: 2.1 time: 0.467258 Nov 03 03:59:22.176032 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1002/1962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:21 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:22.188951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60ef24ca-30bd-4c9a-8089-d34f919688df tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '.version_select at 0x7ff7fd62cd30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:22.198256 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6fc4f322-7aa3-464c-a655-8a47267fa084 req-5077681b-e65f-4a67-9f52-24773587b03a service nova] Creating event network-vif-deleted:1b137398-13a0-4268-8495-d732181a2eb9 for instance 64ddb0bd-101b-4c9e-92fa-76855b9e6ec9 on n-h1-854653-7 Nov 03 03:59:22.213722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6fc4f322-7aa3-464c-a655-8a47267fa084 req-5077681b-e65f-4a67-9f52-24773587b03a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091362 Nov 03 03:59:22.218778 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 961/1963] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:22.320713 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60ef24ca-30bd-4c9a-8089-d34f919688df tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644447059" status: 202 len: 0 microversion: 2.1 time: 0.143345 Nov 03 03:59:22.322677 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1003/1964] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 03:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644447059 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:59:22.557289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:22.558361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:22.582898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:22.583412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:22.584190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:22.584654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:22.585190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:22.585636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:22.789302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:22.790095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:22.804870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:22.804870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:22.805581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:22.806471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:22.810876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:22.811468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:23.642278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:23.694588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:23.695125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11de10e8-89ae-4426-8e52-34b082f1ea08 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 2420 microversion: 2.25 time: 1.126806 Nov 03 03:59:23.695125 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 962/1965] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:22 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 2420 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:23.695442 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12099144-e413-496e-b280-89883acd0b22 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1323 microversion: 2.1 time: 0.897347 Nov 03 03:59:23.695442 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1004/1966] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:22 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:23.695442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:23.695442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:23.706344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd7810a6-cd75-4b70-bb06-687b11bc73b4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:23.706642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd7810a6-cd75-4b70-bb06-687b11bc73b4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:23.720243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:23.720941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:23.728027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:23.730884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:23.731547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:23.732529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:23.850556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dd7810a6-cd75-4b70-bb06-687b11bc73b4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:23.862358 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd7810a6-cd75-4b70-bb06-687b11bc73b4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1224 microversion: 2.1 time: 0.182004 Nov 03 03:59:23.863238 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 963/1967] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:23 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:23.871788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854653-7", "block_migration": "auto"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:23.880288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:23.898196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:23.900544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:23.900544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:23.900544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:23.904511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:23.905259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:23.936447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'flavor' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:23.951540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Going to try to live migrate instance to n-h2-854653-7 {{(pid=127593) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 03:59:24.047736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:24.055751 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b5e39ad-44f2-4d7f-aa76-9639a5d106b1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1315 microversion: 2.1 time: 0.370468 Nov 03 03:59:24.070176 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1005/1968] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:23 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:24.480971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:24.486041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:24.492741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:24.500710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:24.500710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:24.500710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:24.500710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:24.500710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:24.535287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:59:24.985138 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d54b558-8ecf-4b5b-b92b-3a18b929f954 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 204 len: 0 microversion: 2.1 time: 0.507822 Nov 03 03:59:24.997445 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1006/1969] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:24 2022] DELETE /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 03:59:25.007694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:25.009355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:25.017688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:25.018810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:25.019390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:25.020375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:25.021437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:25.022467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:25.254632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:25.262822 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e6573c52-095b-4c9c-8b28-bea684d9a6a1 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1472 microversion: 2.1 time: 0.263835 Nov 03 03:59:25.263399 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1007/1970] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:24 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:25.268336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:25.269518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:25.276431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:25.276924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:25.277460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:25.278127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:25.278649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:25.279084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:25.442830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:25.476405 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b6db848-b48d-4c48-be43-e57a8477436d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1284 microversion: 2.1 time: 0.209694 Nov 03 03:59:25.478281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1008/1971] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:25 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1284 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:25.489307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:25.491738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:25.518391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:25.521278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:25.526027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:25.529336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:25.529860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:25.530395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.062428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:26.075968 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e3b79da6-4436-4b59-a242-2136129f7c67 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1485 microversion: 2.1 time: 0.595583 Nov 03 03:59:26.094958 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1009/1972] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:25 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1485 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:26.102492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:26.103462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:26.115749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.116642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.117229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.118110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.118720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.119244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.596663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:26.618020 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02db8cd0-c1bd-4364-9783-8d275322a89d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1315 microversion: 2.1 time: 0.521279 Nov 03 03:59:26.619166 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1010/1973] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:26 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:26.627875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:26.629308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:26.638310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.638989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.639545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.640785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.641751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.642603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.704284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Request method failure captured: Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1/diagnostics HTTP/1.1 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyDEO1PvAV7Jz6b9L9UmMYxlG6queuCQ-xo2GW3ySWP3zt5I1uRGN_I9ZUdEWxd_ja9Y0Mexd6MxBBhpupFa9_0l-YNbr7esW6goiKCmu_F0Mqk1CxEearbZVTT8SJCEDYcgo60EUQwhzXOvxGO6U16h11OhAMfiqIgm67IZKhFAtY Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 69350185d62a4cf48dae399af40bf70d Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1559992304 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69350185d62a4cf48dae399af40bf70d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_69350185d62a4cf48dae399af40bf70d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69350185d62a4cf48dae399af40bf70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/69350185d62a4cf48dae399af40bf70d"}]}] Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1559992304 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 69350185d62a4cf48dae399af40bf70d Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1559992304 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerDiagnosticsNegativeTest-1559992304-project Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: e116c8b3b3d447e7b0a19ef304c28d84 Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1559992304-project Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': '62ad7bd7-7664-4a21-a481-9766d7be69f1'} Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:26.726896 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:26.733227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:26.733227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:26.733227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:59:26.733227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:59:26.733227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 03 03:59:26.733227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:26.737720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:26.739265 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-24be2114-7fb2-474b-94db-b28c821b45ca tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.118149 Nov 03 03:59:26.739965 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1011/1974] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 03:59:26 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1/diagnostics => generated 117 bytes in 120 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:26.754944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d9c7eb30-1107-42e8-ad6b-4f59c4c5fe57 req-439143a3-01d0-4107-b7ea-9e3848957b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90a0c21-607b-4f27-b2f5-f06fa4cbe765", "name": "network-vif-plugged", "status": "completed", "tag": "72e45d4f-14cf-441b-9bb3-22466436c570"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:26.762084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d9c7eb30-1107-42e8-ad6b-4f59c4c5fe57 req-439143a3-01d0-4107-b7ea-9e3848957b97 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.762688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d9c7eb30-1107-42e8-ad6b-4f59c4c5fe57 req-439143a3-01d0-4107-b7ea-9e3848957b97 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.763045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d9c7eb30-1107-42e8-ad6b-4f59c4c5fe57 req-439143a3-01d0-4107-b7ea-9e3848957b97 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.776330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d9c7eb30-1107-42e8-ad6b-4f59c4c5fe57 req-439143a3-01d0-4107-b7ea-9e3848957b97 service nova] Creating event network-vif-plugged:72e45d4f-14cf-441b-9bb3-22466436c570 for instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 on n-h2-854653-7 Nov 03 03:59:26.781856 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d9c7eb30-1107-42e8-ad6b-4f59c4c5fe57 req-439143a3-01d0-4107-b7ea-9e3848957b97 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035632 Nov 03 03:59:26.783184 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1012/1975] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:26.791726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-65074675-39c3-45e8-b273-eea6caf5be13 req-c983658d-abdc-411b-ba80-bda4a9585b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b75530a-26ef-44c1-99d3-5ff30f3ae5cf", "name": "network-vif-deleted", "tag": "92280416-ffea-4aae-a135-b4d7c67670b1"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:26.803301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-65074675-39c3-45e8-b273-eea6caf5be13 req-c983658d-abdc-411b-ba80-bda4a9585b42 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.804196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-65074675-39c3-45e8-b273-eea6caf5be13 req-c983658d-abdc-411b-ba80-bda4a9585b42 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.804861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-65074675-39c3-45e8-b273-eea6caf5be13 req-c983658d-abdc-411b-ba80-bda4a9585b42 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.820076 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-65074675-39c3-45e8-b273-eea6caf5be13 req-c983658d-abdc-411b-ba80-bda4a9585b42 service nova] Creating event network-vif-deleted:92280416-ffea-4aae-a135-b4d7c67670b1 for instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf on n-h2-854653-7 Nov 03 03:59:26.825475 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-65074675-39c3-45e8-b273-eea6caf5be13 req-c983658d-abdc-411b-ba80-bda4a9585b42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040039 Nov 03 03:59:26.830979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1013/1976] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:26.837049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:26.838050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:26.852759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.852759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.852759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:26.852759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:26.852759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:26.852759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.033293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:27.043678 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-995e4406-0048-47fe-af0a-765af1c26b6a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1282 microversion: 2.1 time: 0.210688 Nov 03 03:59:27.044412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1014/1977] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:26 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1282 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:27.049098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:27.049567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:27.056208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.056921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.057391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.058116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.058743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.059177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.085252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:59:27.570639 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-101c2205-7129-4e6d-a1a3-8f9cd3f0d22d tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "DELETE /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 204 len: 0 microversion: 2.1 time: 0.524863 Nov 03 03:59:27.573842 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1015/1978] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:27 2022] DELETE /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:59:27.581597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:27.582311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:27.588818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.589406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.589923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.590646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.591112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.591542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.594587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:27.635563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.635563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.635563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.636040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lazy-loading 'fault' on Instance uuid 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:27.683558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:27.692849 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e8ec81d-1e8b-43e4-9daf-46a5ba608a0b tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 200 len: 1301 microversion: 2.1 time: 0.116450 Nov 03 03:59:27.699357 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1016/1979] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:27 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 1301 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:27.699357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:27.699357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:27.704583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.705031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.705545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.706255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.706734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.707142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.713937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-853cee44-8fba-411b-9a3e-ad511e89113b tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/action" status: 202 len: 0 microversion: 2.25 time: 3.847959 Nov 03 03:59:27.716543 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 964/1980] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 03:59:23 2022] POST /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/action => generated 0 bytes in 3852 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:59:27.729394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:27.730521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:27.742622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.742622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.742622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.744406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.745209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.746213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.934538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:27.944846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6da3da2b-3adb-4997-916e-4488f8ba9d21 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1478 microversion: 2.1 time: 0.250296 Nov 03 03:59:27.948919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:27.956385 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-75ed5bc3-e5ea-44ff-bfed-b48cb59aab7f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1315 microversion: 2.1 time: 0.238416 Nov 03 03:59:27.957111 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1017/1981] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:27 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1478 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:27.975176 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 965/1982] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:27 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:27.978327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:27.979041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:27.985774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.987328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.988018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:27.988793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:27.989500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:27.990249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:28.071361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:28.072998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:28.079877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:28.080559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:28.081067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:28.081990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:28.083016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:28.083516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:28.173316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:28.183062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:28.184820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:28.186185 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0cf098bf-92bc-410e-bd15-07f33cc199a7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.227698 Nov 03 03:59:28.186828 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1018/1983] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:27 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:28.257632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:28.267021 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca22ee6b-b7f3-4703-a389-b93bad154970 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.199749 Nov 03 03:59:28.268005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 966/1984] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:28 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:28.718700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:28.718700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:28.724099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:28.724916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:28.725609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:28.727318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:28.728000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:28.728645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:28.745062 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] HTTP exception thrown: Instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf could not be found. Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Request method failure captured: Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf HTTP/1.1 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrHdvDIjMdlWK5cAuUDZJ9XaZqbPBi42CDNyRhePEddUHQkDrR-I22WcWXdVtS3JqTvg8Obk3xeWyXzb5-OXmo7X9cNuaHJnyNd9pYZ4nuEKENLG_ew7fH8g9aQi4jjetfhGFzi_L05Z67oV--mmERQw3MZq5kf49qg642e5Hh-NG4 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_71461e876c80455aa1875086a2ec4f49", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/71461e876c80455aa1875086a2ec4f49"}]}] Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c4a4d4a61500400faf673aa67ff8be39 Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf could not be found. Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '3b75530a-26ef-44c1-99d3-5ff30f3ae5cf'} Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf could not be found. Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf could not be found. Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:28.747012 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf could not be found. Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Returning 404 to user: Instance 3b75530a-26ef-44c1-99d3-5ff30f3ae5cf could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-26c25158-58f8-4bfc-9fd8-057f6ef541cb tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf" status: 404 len: 111 microversion: 2.1 time: 0.040733 Nov 03 03:59:28.757417 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1019/1985] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:28 2022] GET /compute/v2.1/servers/3b75530a-26ef-44c1-99d3-5ff30f3ae5cf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:28.763200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:28.763704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:28.778907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:28.779436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:28.779890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:28.780638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:28.781145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:28.786241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:28.828623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:59:28.833679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:28.980911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:28.981439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:28.984027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:29.002892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:29.008101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:29.010110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:29.011333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:29.012614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:29.014435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:29.243797 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f0ac2b3-052a-4041-97ca-50a06776ec17 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 204 len: 0 microversion: 2.1 time: 0.484353 Nov 03 03:59:29.244462 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 967/1986] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:28 2022] DELETE /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:59:29.250446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:29.251902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:29.262563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:29.262563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:29.262563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:29.264206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:29.264971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:29.265456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:29.311923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:29.321354 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6866e658-8644-49f0-b219-5ba615b553e0 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1478 microversion: 2.1 time: 0.344665 Nov 03 03:59:29.322829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1020/1987] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:28 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1478 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:29.327694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:29.328812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:29.337554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:29.338296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:29.343085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:29.343085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:29.343085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:29.343085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.043333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:30.054750 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7ffb41f-8d31-4066-844d-7f21719f2a97 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1502 microversion: 2.1 time: 0.808646 Nov 03 03:59:30.055711 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 968/1988] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:29 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1502 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:30.062982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:30.063924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:30.071383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.074517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.074517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.074517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.074517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.074517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.124123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:30.148227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:30.149878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:30.151527 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e73eba1b-91e2-4794-afac-889250f7bebe tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.827563 Nov 03 03:59:30.153516 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1021/1989] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:29 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:30.158347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:30.159258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:30.171699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.173574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.175932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.179530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.181766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.182434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.560807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:30.571196 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d900a7de-1d21-43aa-8f07-85050f9c526d tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1498 microversion: 2.1 time: 0.513184 Nov 03 03:59:30.571653 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 969/1990] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:30 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1498 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:30.593298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a279e588-dfc5-43e4-9942-280dd9b4f990 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:30.601357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a279e588-dfc5-43e4-9942-280dd9b4f990 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.602152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a279e588-dfc5-43e4-9942-280dd9b4f990 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.604492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a279e588-dfc5-43e4-9942-280dd9b4f990 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.682553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a279e588-dfc5-43e4-9942-280dd9b4f990 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Going to try to stop instance {{(pid=127593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 03:59:30.692587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:30.709947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f4a3f2de-d38f-4821-8cb8-2ce6b159b401 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.555080 Nov 03 03:59:30.710852 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1022/1991] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:30 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:30.715642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:30.716257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:30.732653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.733493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.741984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.741984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.741984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.741984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.844438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:30.856686 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48aa0e03-1e80-4041-ba13-b9493e8d996a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1436 microversion: 2.1 time: 0.144635 Nov 03 03:59:30.859085 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1023/1992] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:30 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1436 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:30.919270 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a279e588-dfc5-43e4-9942-280dd9b4f990 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765/action" status: 202 len: 0 microversion: 2.1 time: 0.335815 Nov 03 03:59:30.920022 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 970/1993] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:59:30 2022] POST /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 03:59:30.928565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:30.929238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:30.935736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.936436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.937237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.938168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:30.938666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:30.939348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:30.983712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b23d68a3-ac45-4c3d-8264-7e8944da8963 req-a965a9f4-1ad4-4aea-8ec8-74b1a509db33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e28a87c-e822-45ba-891c-c932a261bc97", "tag": "bc32fcde-9e7e-4482-b4a2-28e142e0633c"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:31.004294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b23d68a3-ac45-4c3d-8264-7e8944da8963 req-a965a9f4-1ad4-4aea-8ec8-74b1a509db33 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:31.006459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b23d68a3-ac45-4c3d-8264-7e8944da8963 req-a965a9f4-1ad4-4aea-8ec8-74b1a509db33 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:31.008766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b23d68a3-ac45-4c3d-8264-7e8944da8963 req-a965a9f4-1ad4-4aea-8ec8-74b1a509db33 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:31.029445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b23d68a3-ac45-4c3d-8264-7e8944da8963 req-a965a9f4-1ad4-4aea-8ec8-74b1a509db33 service nova] Creating event network-changed:bc32fcde-9e7e-4482-b4a2-28e142e0633c for instance 7e28a87c-e822-45ba-891c-c932a261bc97 on n-h1-854653-7 Nov 03 03:59:31.036178 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b23d68a3-ac45-4c3d-8264-7e8944da8963 req-a965a9f4-1ad4-4aea-8ec8-74b1a509db33 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057242 Nov 03 03:59:31.037296 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 971/1994] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:59:31.183738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:31.185512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:31.195586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:31.201881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:31.202826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:31.204873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:31.206734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:31.208239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:31.478015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:31.500844 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd313514-7936-44e4-9b3c-4fa233c18428 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.573364 Nov 03 03:59:31.503871 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1024/1995] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:30 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:31.595340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:31.597512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:31.598133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:31.599956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:31.600620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:31.609619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:31.611366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:31.613913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:31.620451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:31.622247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:31.623274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:31.626153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:31.627110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:31.647311 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-21e6c809-89bd-4a2a-ad4d-104090445e74 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.465385 Nov 03 03:59:31.649685 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 972/1996] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:31 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:31.738881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:31.740556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:31.780412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:31.784628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:31.800746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:31.801761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:31.806198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:31.806819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.117950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:32.138734 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3e44b816-b3c0-4d0f-aa9b-930abd09f9b0 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1456 microversion: 2.1 time: 0.544949 Nov 03 03:59:32.140941 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1025/1997] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:31 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1456 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:32.162164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:32.163183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:32.172026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:32.173303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:32.174437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.175433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:32.176112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:32.176812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.196440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:32.208908 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d600fbfa-15a7-4697-98f8-5fbb564f1aaf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.477410 Nov 03 03:59:32.212601 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 973/1998] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:31 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:32.216771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:32.217550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:32.218265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.218953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lazy-loading 'fault' on Instance uuid 62ad7bd7-7664-4a21-a481-9766d7be69f1 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:32.299845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e116c8b3b3d447e7b0a19ef304c28d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69350185d62a4cf48dae399af40bf70d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:32.310747 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d15208d-d241-47de-a3d9-49021f8814c4 tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 200 len: 1313 microversion: 2.1 time: 0.167957 Nov 03 03:59:32.311339 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1026/1999] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:32 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:32.527980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:32.528882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:32.538128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:32.542338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:32.543963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.546392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:32.547140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:32.549127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.678741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:32.682330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:32.686712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:32.687517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:32.688201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.689230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:32.690463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:32.691143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:32.896479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:32.912630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:32.912630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:32.918841 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a9dfd830-7224-4033-bfa3-d3d9085ff3e9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.239706 Nov 03 03:59:32.919847 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1027/2000] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:32 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:32.998872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:33.008029 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-13d4771b-2947-4d9c-a656-179e489ba8c1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.484338 Nov 03 03:59:33.032563 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 974/2001] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:32 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:33.100428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8c760bc7-dea2-4ba4-ba9e-b47f8d409ba1 req-24a39729-714a-4c18-b095-92c725f0fd3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ad7bd7-7664-4a21-a481-9766d7be69f1", "name": "network-vif-deleted", "tag": "81007eef-a217-41b5-87a5-caff3ee14c9f"}, {"server_uuid": "fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e", "name": "network-vif-deleted", "tag": "d1831cce-663d-4321-9dbf-b189e71623a7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:33.116482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8c760bc7-dea2-4ba4-ba9e-b47f8d409ba1 req-24a39729-714a-4c18-b095-92c725f0fd3d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.117284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8c760bc7-dea2-4ba4-ba9e-b47f8d409ba1 req-24a39729-714a-4c18-b095-92c725f0fd3d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.121297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8c760bc7-dea2-4ba4-ba9e-b47f8d409ba1 req-24a39729-714a-4c18-b095-92c725f0fd3d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.158712 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8c760bc7-dea2-4ba4-ba9e-b47f8d409ba1 req-24a39729-714a-4c18-b095-92c725f0fd3d service nova] Creating event network-vif-deleted:81007eef-a217-41b5-87a5-caff3ee14c9f for instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 on n-h1-854653-7 Nov 03 03:59:33.158712 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8c760bc7-dea2-4ba4-ba9e-b47f8d409ba1 req-24a39729-714a-4c18-b095-92c725f0fd3d service nova] Creating event network-vif-deleted:d1831cce-663d-4321-9dbf-b189e71623a7 for instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e on n-h2-854653-7 Nov 03 03:59:33.166365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:33.169139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:33.172432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8c760bc7-dea2-4ba4-ba9e-b47f8d409ba1 req-24a39729-714a-4c18-b095-92c725f0fd3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076967 Nov 03 03:59:33.180508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.181638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1028/2002] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:59:33.184602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.185694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.186460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.186929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.194489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.237224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:33.238257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:33.257802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.260727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.263293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.265578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.266311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.267056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.270891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.271517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.272328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.273636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lazy-loading 'fault' on Instance uuid fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 03:59:33.363486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4a4d4a61500400faf673aa67ff8be39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71461e876c80455aa1875086a2ec4f49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:33.374686 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7fb5dcdb-a80a-426b-89ba-0e07f7ec3ac4 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 200 len: 1300 microversion: 2.1 time: 0.211229 Nov 03 03:59:33.376257 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 975/2003] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:33 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 1300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:33.384098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:33.390439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] [instance: 62ad7bd7-7664-4a21-a481-9766d7be69f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:33.405148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.405658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.406798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.407535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.408297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.409548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.427768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] HTTP exception thrown: Instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 could not be found. Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Request method failure captured: Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 HTTP/1.1 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyDEO1PvAV7Jz6b9L9UmMYxlG6queuCQ-xo2GW3ySWP3zt5I1uRGN_I9ZUdEWxd_ja9Y0Mexd6MxBBhpupFa9_0l-YNbr7esW6goiKCmu_F0Mqk1CxEearbZVTT8SJCEDYcgo60EUQwhzXOvxGO6U16h11OhAMfiqIgm67IZKhFAtY Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 69350185d62a4cf48dae399af40bf70d Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1559992304 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69350185d62a4cf48dae399af40bf70d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_69350185d62a4cf48dae399af40bf70d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/69350185d62a4cf48dae399af40bf70d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/69350185d62a4cf48dae399af40bf70d"}]}] Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1559992304 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 69350185d62a4cf48dae399af40bf70d Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1559992304 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerDiagnosticsNegativeTest-1559992304-project Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: e116c8b3b3d447e7b0a19ef304c28d84 Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1559992304-project Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 could not be found. Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '62ad7bd7-7664-4a21-a481-9766d7be69f1'} Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 could not be found. Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 could not be found. Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:33.430538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 could not be found. Nov 03 03:59:33.435168 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:33.437622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] Returning 404 to user: Instance 62ad7bd7-7664-4a21-a481-9766d7be69f1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:33.439366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d7f37af-6a4f-4106-8d7a-ff49c822635a tempest-ServerDiagnosticsNegativeTest-1559992304 tempest-ServerDiagnosticsNegativeTest-1559992304-project] 10.222.0.30 "GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1" status: 404 len: 111 microversion: 2.1 time: 0.060502 Nov 03 03:59:33.441361 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 976/2004] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:33 2022] GET /compute/v2.1/servers/62ad7bd7-7664-4a21-a481-9766d7be69f1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:33.490059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:33.504381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-173afe2c-7df0-4f2a-84f4-6ab2a5e7f93a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.274037 Nov 03 03:59:33.506270 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1029/2005] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:33 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:33.950272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:33.960439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:33.964543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:33.974474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.974975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.976607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:33.977395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:33.979350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:33.981858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:34.037524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:34.038228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:34.052828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:34.053505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:34.055463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:34.056331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:34.058617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:34.059658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:34.304314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:34.319810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:34.324878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:34.332482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:34.341741 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01e1bd70-2b9e-4725-89ef-478470ce9f5a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.309602 Nov 03 03:59:34.342902 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1030/2006] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:34 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:34.343506 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ecaf51f-9ecc-488a-a385-9ed737bc02e4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.396130 Nov 03 03:59:34.348290 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 977/2007] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:33 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:34.402872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:34.404284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] [instance: fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:34.411756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:34.412787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:34.413851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:34.415014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:34.415710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:34.416359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:34.444667 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] HTTP exception thrown: Instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e could not be found. Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Request method failure captured: Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e HTTP/1.1 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzrHdvDIjMdlWK5cAuUDZJ9XaZqbPBi42CDNyRhePEddUHQkDrR-I22WcWXdVtS3JqTvg8Obk3xeWyXzb5-OXmo7X9cNuaHJnyNd9pYZ4nuEKENLG_ew7fH8g9aQi4jjetfhGFzi_L05Z67oV--mmERQw3MZq5kf49qg642e5Hh-NG4 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_71461e876c80455aa1875086a2ec4f49", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/71461e876c80455aa1875086a2ec4f49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/71461e876c80455aa1875086a2ec4f49"}]}] Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 71461e876c80455aa1875086a2ec4f49 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveMigrationTest-1823814461 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c4a4d4a61500400faf673aa67ff8be39 Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveMigrationTest-1823814461-project Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e could not be found. Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e'} Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e could not be found. Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e could not be found. Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:34.447101 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e could not be found. Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] Returning 404 to user: Instance fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:34.458669 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04490771-087c-47a2-bf23-cc3706e4e909 tempest-LiveMigrationTest-1823814461 tempest-LiveMigrationTest-1823814461-project] 10.222.0.30 "GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e" status: 404 len: 111 microversion: 2.1 time: 0.052918 Nov 03 03:59:34.474465 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1031/2008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:34 2022] GET /compute/v2.1/servers/fe651cac-1d49-4e3d-80e2-fdcfa3d30c8e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:34.531254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:34.532025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:34.540035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:34.540537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:34.540978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:34.541859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:34.542176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:34.542607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:35.016461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:35.027711 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf0a2468-53a6-4e3f-a41e-e09054dcff8a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.502238 Nov 03 03:59:35.029429 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 978/2009] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:34 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:35.383002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:35.383644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:35.388552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:35.390150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:35.392025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:35.392525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:35.398674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:35.401981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:35.402724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:35.404845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:35.405067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:35.405744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:35.407886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:35.409210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:35.411593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:35.412557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:35.919031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:35.940835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:35.950045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:35.950045 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69e3bcd5-be54-4326-8fcf-8fe102331e5f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.571859 Nov 03 03:59:35.960265 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1032/2010] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:35 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:36.022900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:36.036937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-811cb16d-b801-4a94-a8d2-29aba6004ada tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.652004 Nov 03 03:59:36.038362 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 979/2011] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:35 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:36.054714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:36.055342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:36.068935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:36.069464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:36.076308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:36.076308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:36.076308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:36.076308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:36.426416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:36.438656 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9c1b7aeb-fd5c-4bb0-9633-d0a2d33c1f36 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.388158 Nov 03 03:59:36.441103 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1033/2012] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:36 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:36.979339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:36.980782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:36.992364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:37.002727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:37.003838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:37.004922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:37.005719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:37.006687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:37.063967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:37.065342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:37.083620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:37.093920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:37.095682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:37.104073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:37.106209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:37.107521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:37.115239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:37.493865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:37.521111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:37.524915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:37.531722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64f6de65-3c97-47e9-914b-46d023885bde tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.554407 Nov 03 03:59:37.545926 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 980/2013] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:36 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:37.557776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:37.558746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:37.566048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:37.567638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:37.568335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:37.568963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:37.569786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:37.570411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:37.571103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:37.583030 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f98c6810-1013-41e0-995a-8f5a673c5392 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.519710 Nov 03 03:59:37.583869 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1034/2014] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:37 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:37.806083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:37.815328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c3333c5b-d534-4371-a0db-03c7c407b516 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.267901 Nov 03 03:59:37.826580 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 981/2015] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:37 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:38.592112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:38.600814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:38.610848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:38.612716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:38.620055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:38.622085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:38.622085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:38.622479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:38.623248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:38.623911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:38.632151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:38.632657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:38.636059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:38.636879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:38.637400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:38.640893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:39.188698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:39.200378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:39.203432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:39.204671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b55f02e-9e28-4596-a25a-04994b800aa4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.645736 Nov 03 03:59:39.211566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1035/2016] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:38 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:39.220862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:39.222018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:39.249500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:39.249977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:39.250430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:39.251164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:39.255787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:39.256325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:39.393629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:39.400736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:39.412063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-76384052-a0cc-4a31-a98d-72b7b879418c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.800303 Nov 03 03:59:39.425158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 982/2017] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:38 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:39.436951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-96fdedb7-fa82-4038-a2d5-f5469946b54b req-a79bfd37-dfac-4bb6-b10d-89155b541e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e28a87c-e822-45ba-891c-c932a261bc97", "name": "network-vif-plugged", "status": "completed", "tag": "bc32fcde-9e7e-4482-b4a2-28e142e0633c"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:39.461063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-96fdedb7-fa82-4038-a2d5-f5469946b54b req-a79bfd37-dfac-4bb6-b10d-89155b541e96 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:39.462221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-96fdedb7-fa82-4038-a2d5-f5469946b54b req-a79bfd37-dfac-4bb6-b10d-89155b541e96 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:39.464754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-96fdedb7-fa82-4038-a2d5-f5469946b54b req-a79bfd37-dfac-4bb6-b10d-89155b541e96 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:39.491618 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-96fdedb7-fa82-4038-a2d5-f5469946b54b req-a79bfd37-dfac-4bb6-b10d-89155b541e96 service nova] Creating event network-vif-plugged:bc32fcde-9e7e-4482-b4a2-28e142e0633c for instance 7e28a87c-e822-45ba-891c-c932a261bc97 on n-h1-854653-7 Nov 03 03:59:39.502978 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-96fdedb7-fa82-4038-a2d5-f5469946b54b req-a79bfd37-dfac-4bb6-b10d-89155b541e96 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073383 Nov 03 03:59:39.505522 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 983/2018] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:39.884735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-222387144", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1f101308-9db8-4b30-b5f1-954d8d42482e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:39.948794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:39.960135 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd793eb2-802f-40db-94c6-4fc1749ee200 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.749068 Nov 03 03:59:39.963193 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1036/2019] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:39 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:39.978377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:59:40.240744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:40.241447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:40.249583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.250368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.251917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.252921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.253573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.254176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.620170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:40.629464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:40.631269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:40.632562 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2cd458a7-8e67-4b2f-a64b-202b0deb9d57 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.396658 Nov 03 03:59:40.633483 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1037/2020] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:40 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:40.787013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:40.793719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.793719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.793719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.793719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.793719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.793719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.810074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:59:40.810799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:59:40.811485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:59:40.811897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:59:40.812502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:59:40.820140 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0262f01e-99b2-408b-96e2-f5845caf861d tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.169882 Nov 03 03:59:40.821050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1038/2021] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:59:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:40.823048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.823715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.824329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.825367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.826017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.826171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:40.826747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:40.826996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.836279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.839694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.839694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.839694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:40.839694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:40.839694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:40.852231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:59:40.862756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:59:40.875572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:40.880110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:59:40.882567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:59:41.086630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:41.091909 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae0c2fbb-57e1-4823-9304-a2f85202d7a2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444241 Nov 03 03:59:41.094175 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 984/2022] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:59:41.100281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.103103 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0187d99f-ffed-4311-947a-76d59f326cb1 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.280509 Nov 03 03:59:41.103659 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1039/2023] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:40 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:41.105600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.106243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.106742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.107951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.108471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.109274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.118721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.119367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:41.125851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.126337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.126828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.128188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.128652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.129105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.162976 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-036be428-47c0-4446-853d-32b4212d1a8e tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.067227 Nov 03 03:59:41.165200 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 985/2024] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:41.170076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-429e64e9-9886-469d-9317-6536a0c84edd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.171018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-429e64e9-9886-469d-9317-6536a0c84edd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:41.248426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-429e64e9-9886-469d-9317-6536a0c84edd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:41.259030 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-429e64e9-9886-469d-9317-6536a0c84edd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1192 microversion: 2.1 time: 0.091387 Nov 03 03:59:41.259030 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 986/2025] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:41.283744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.301196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.301752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.303632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.305481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.307874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.311647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.347325 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc646b2b-cd1c-47cf-9c92-702c23c3e7ec tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.087088 Nov 03 03:59:41.348484 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 987/2026] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:41.376150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.389732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.389732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.389732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.389732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.390456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:41.390598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.391142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.422485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3be1ee12-55a7-489c-aac9-fe95456d09ef tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-854653-7&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.059897 Nov 03 03:59:41.424457 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 988/2027] 10.222.0.30 () {58 vars in 1194 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/os-services?host=n-d-854653-7&binary=xxx => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:59:41.432882 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-141897c1-c2f1-4232-8327-7babf7511069 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1324 microversion: 2.1 time: 0.326194 Nov 03 03:59:41.436245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.441421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.442189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.444502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.444502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.444502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.444502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.446643 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1040/2028] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:41.477230 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2b7effe-f527-4cd1-8d2c-61682752aa3a tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.044758 Nov 03 03:59:41.478535 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 989/2029] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:41.494338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.498781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.499496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.500111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.501075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.501691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.502899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.529431 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17e7868f-2577-4a23-a0c9-d7c0e354babe tempest-ServicesAdminNegativeTestJSON-1908422057 tempest-ServicesAdminNegativeTestJSON-1908422057-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.039496 Nov 03 03:59:41.530485 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1041/2030] 10.222.0.30 () {58 vars in 1198 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 03:59:41.663723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.664384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:41.672136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.672975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.675182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.675923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fa33c31-5717-49be-806d-298286c6c02e tempest-ServicesAdminNegativeTestJSON-1280350637 tempest-ServicesAdminNegativeTestJSON-1280350637-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:41.676503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:41.677367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:41.678034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:41.679305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2fa33c31-5717-49be-806d-298286c6c02e tempest-ServicesAdminNegativeTestJSON-1280350637 tempest-ServicesAdminNegativeTestJSON-1280350637-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ee8e34a10ae0464c826851d64fb0fa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe77f994c7cf4fa2b0c66c346c611aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fa33c31-5717-49be-806d-298286c6c02e tempest-ServicesAdminNegativeTestJSON-1280350637 tempest-ServicesAdminNegativeTestJSON-1280350637-project] Request method failure captured: Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyqKRfy7OBiXwTzQa25f3F4XTVxDaQ59fbjjQ1o0uIub9UFl5HRG4xmJxWs_lp5zsuxSxKCA9_Wr2eGxMEjOLYJsce7iP3R7EMk5CfZYOYBDHN2Vu5BsqSaogA5RWNhSvcEvcHXonMmmZfAm26gnvdAk-6KLjTNy6NNTIi5qHk0MLc Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: fe77f994c7cf4fa2b0c66c346c611aa6 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1280350637 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe77f994c7cf4fa2b0c66c346c611aa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe77f994c7cf4fa2b0c66c346c611aa6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe77f994c7cf4fa2b0c66c346c611aa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe77f994c7cf4fa2b0c66c346c611aa6"}]}] Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1280350637 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: fe77f994c7cf4fa2b0c66c346c611aa6 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1280350637 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServicesAdminNegativeTestJSON-1280350637-project Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ee8e34a10ae0464c826851d64fb0fa22 Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1280350637-project Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: action_args: {} Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 03 03:59:41.686094 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fa33c31-5717-49be-806d-298286c6c02e tempest-ServicesAdminNegativeTestJSON-1280350637 tempest-ServicesAdminNegativeTestJSON-1280350637-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2fa33c31-5717-49be-806d-298286c6c02e tempest-ServicesAdminNegativeTestJSON-1280350637 tempest-ServicesAdminNegativeTestJSON-1280350637-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.147154 Nov 03 03:59:41.690828 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 990/2031] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 149 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 03:59:41.844377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:41.855815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:41.857530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:41.858700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3ef0db9b-75eb-44d6-9e48-3f23bca9d3e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.199277 Nov 03 03:59:41.859630 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1042/2032] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:41 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:42.128530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:42.129216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:42.137596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.138144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.138596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.139320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.139785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.140219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.515251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-55f46778-fcae-4355-96f1-0db02d0a200f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:42.515251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55f46778-fcae-4355-96f1-0db02d0a200f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:42.527459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:42.527459 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d596930-5375-4cd6-aa6f-1be3f8b418bb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.203899 Nov 03 03:59:42.527459 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 991/2033] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:42 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:42.528950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-55f46778-fcae-4355-96f1-0db02d0a200f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:42.528950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-55f46778-fcae-4355-96f1-0db02d0a200f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1192 microversion: 2.1 time: 0.112251 Nov 03 03:59:42.528950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1043/2034] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:42 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.529698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.695760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:42.703638 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-76812c85-826b-49eb-9b6f-f763420db6d9 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.244090 Nov 03 03:59:42.704331 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 992/2035] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:42 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:42.728755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:42.730081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:42.738040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.738535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.738984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.739696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.740178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.740600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.886878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:42.888222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:42.905943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.907102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.907816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.909361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:42.910451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:42.911251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:42.941896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:42.954584 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85d6819e-43e9-446e-bdc4-4f55c032e348 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.230531 Nov 03 03:59:42.956735 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1044/2036] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:42 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:42.993076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85156e68-5493-4ef1-8ed8-67ce7b3073f0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-743106768", "metadata": {"": ""}}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85156e68-5493-4ef1-8ed8-67ce7b3073f0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action HTTP/1.1 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 106 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-743106768", "metadata": {"": ""}}} Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7e28a87c-e822-45ba-891c-c932a261bc97', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-743106768', 'metadata': {'': ''}}}} Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'': ''} Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:43.006696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85156e68-5493-4ef1-8ed8-67ce7b3073f0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:43.010355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85156e68-5493-4ef1-8ed8-67ce7b3073f0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action" status: 400 len: 170 microversion: 2.1 time: 0.029310 Nov 03 03:59:43.019433 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1045/2037] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Nov 3 03:59:42 2022] POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action => generated 170 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 03 03:59:43.031385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:43.032031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:43.044930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.045564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.047167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.048847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.049806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.052130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.192907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:43.211213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:43.212687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:43.213907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9e1f4b86-94d3-4c86-85cc-19e9d7bba51c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.331586 Nov 03 03:59:43.214837 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 993/2038] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:42 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:43.384779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:43.387220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:43.397619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.398440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.398997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.400351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.400919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.401473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.417971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:43.435684 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e1c37e2-a0a1-4a00-bf26-15c71a20c096 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.414651 Nov 03 03:59:43.436623 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1046/2039] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:43 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:43.443185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:43.444379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:43.453190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.454335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.455119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.456365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.456828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.457352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.609642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:43.617234 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1eac1e3-4a89-489a-a78e-9066f7bbdbf4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1196 microversion: 2.1 time: 0.178843 Nov 03 03:59:43.630620 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1047/2040] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:43 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1196 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:43.655184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:43.655675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:43.666950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:43.668940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.670255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.671865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.672739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:43.674847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:43.678530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:43.680444 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a39e8b74-5da0-4b24-9b12-edc02fc4025a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.326796 Nov 03 03:59:43.681675 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 994/2041] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:43 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:43.921645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:43.932715 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-753eac99-b851-4fc1-a7e7-eff100f9ffc5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.300726 Nov 03 03:59:43.933709 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1048/2042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:43 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:43.974025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a92d168a-e420-4bad-ac96-bcf81d916b9c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-38323372", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a92d168a-e420-4bad-ac96-bcf81d916b9c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action HTTP/1.1 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 617 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-38323372", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7e28a87c-e822-45ba-891c-c932a261bc97', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-38323372', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:43.993885 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Nov 03 03:59:43.996784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:43.999919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a92d168a-e420-4bad-ac96-bcf81d916b9c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:44.002181 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a92d168a-e420-4bad-ac96-bcf81d916b9c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action" status: 400 len: 938 microversion: 2.1 time: 0.037019 Nov 03 03:59:44.004980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 995/2043] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Nov 3 03:59:43 2022] POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action => generated 938 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:59:44.030193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:44.030193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:44.036985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.037513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.037961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.038691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.039155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.039591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.237697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:44.246898 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f5ff6fe-f609-48ae-bc22-018729ea8135 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.229730 Nov 03 03:59:44.247495 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1049/2044] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:44 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:44.252173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:44.254235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:44.262283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.262916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.263767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.264741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.265355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.266195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.280891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:44.281952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:44.299991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.304153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.304618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.305406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.306265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.308684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.508130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:44.533736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:44.539367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:44.543980 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0746313e-c24d-4d97-ab6c-929e68c8e152 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.302886 Nov 03 03:59:44.544772 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 996/2045] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:44 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:44.569233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:44.581832 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-453fae63-21a9-40c9-a60d-b74b4d155af4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.308340 Nov 03 03:59:44.582503 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1050/2046] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:44 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:44.611380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ae1188c-4add-42e6-9ada-711703593709 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ae1188c-4add-42e6-9ada-711703593709 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action HTTP/1.1 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 285 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7e28a87c-e822-45ba-891c-c932a261bc97', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['createImage']: Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:44.615921 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ae1188c-4add-42e6-9ada-711703593709 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:44.618841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ae1188c-4add-42e6-9ada-711703593709 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action" status: 400 len: 619 microversion: 2.1 time: 0.011118 Nov 03 03:59:44.621155 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 997/2047] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Nov 3 03:59:44 2022] POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 03:59:44.629231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:44.630033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:44.647574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:44.649161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:44.653724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.654404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.655102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.655979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.656588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.657261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.665334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.666063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.667085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.668363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.669920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.670522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.808211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:44.817922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b93e1dec-e164-4c71-9eea-d633d392e336 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1244 microversion: 2.1 time: 0.177769 Nov 03 03:59:44.818506 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 998/2048] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:44 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1244 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:44.840737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:44.842989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:44.851860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.852265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.852720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:44.853481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:44.853949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:44.854417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:45.159612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:45.175488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5a3144c0-aba3-4e9a-9f59-609deee19737 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.550853 Nov 03 03:59:45.176820 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1051/2049] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:44 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:45.204206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:45.204845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:45.216246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:45.216756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:45.217265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:45.231080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:45.232255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:45.232867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:45.418757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:45.433921 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-58f9c06e-6b3d-487a-a99e-6bee35d37b76 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.608158 Nov 03 03:59:45.434505 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 999/2050] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:44 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:45.578655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:45.579376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:45.594744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:45.598200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:45.600154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:45.602089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:45.606044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:45.611158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:45.901375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:45.931826 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-040a9eab-a419-4dca-a53c-fb80f1f31c15 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.730819 Nov 03 03:59:45.934787 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1052/2051] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:45 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:45.957373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:45.960613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:45.982904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:45.983571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:45.985390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:45.988147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:45.988824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:45.990448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:46.203208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:46.213949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d0f8687-a130-431a-a530-20602057e4ba tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1250 microversion: 2.1 time: 0.277899 Nov 03 03:59:46.234730 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1053/2052] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:45 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1250 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:46.240390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-782095586"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:46.243089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:46.249584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:46.250486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:46.251242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:46.252732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:46.253450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:46.254090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:46.278881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:46.341564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:46.373630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:46.375233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:46.376516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b80b774-7f0e-4a5a-ab78-cbe31e161621 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.807768 Nov 03 03:59:46.405224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1000/2053] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:45 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:46.462493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:46.463124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:46.473395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:46.482327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:46.483049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:46.484018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:46.484656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:46.485257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:46.898295 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-081c731d-9d89-4fd3-9ae2-55130b61fb67 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action" status: 202 len: 0 microversion: 2.1 time: 0.661556 Nov 03 03:59:46.905226 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1054/2054] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:59:46 2022] POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 03:59:46.911343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b7da986d-0b87-4cf9-a3e4-30d55a8a832b req-9e92ae9b-443b-4af6-81c7-d074a65b8fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed94eeeb-28e0-4472-8d19-c980456ffa0f", "name": "network-vif-unplugged", "status": "completed", "tag": "936b3ab5-5256-4926-b068-f44770180c56"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:46.932587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b7da986d-0b87-4cf9-a3e4-30d55a8a832b req-9e92ae9b-443b-4af6-81c7-d074a65b8fba service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:46.932587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b7da986d-0b87-4cf9-a3e4-30d55a8a832b req-9e92ae9b-443b-4af6-81c7-d074a65b8fba service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:46.932587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b7da986d-0b87-4cf9-a3e4-30d55a8a832b req-9e92ae9b-443b-4af6-81c7-d074a65b8fba service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:46.947875 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b7da986d-0b87-4cf9-a3e4-30d55a8a832b req-9e92ae9b-443b-4af6-81c7-d074a65b8fba service nova] Creating event network-vif-unplugged:936b3ab5-5256-4926-b068-f44770180c56 for instance ed94eeeb-28e0-4472-8d19-c980456ffa0f on n-h1-854653-7 Nov 03 03:59:46.953878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b7da986d-0b87-4cf9-a3e4-30d55a8a832b req-9e92ae9b-443b-4af6-81c7-d074a65b8fba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046828 Nov 03 03:59:46.955651 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1055/2055] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:46.961393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-963131891"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:46.963861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:46.971405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:46.971959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:46.972760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:46.973688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:46.974160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:46.974595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:47.056424 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Cannot 'createImage' instance 7e28a87c-e822-45ba-891c-c932a261bc97 while it is in task_state image_snapshot_pending Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action HTTP/1.1 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 84 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-963131891"}} Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: exception: Cannot 'createImage' instance 7e28a87c-e822-45ba-891c-c932a261bc97 while it is in task_state image_snapshot_pending Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7e28a87c-e822-45ba-891c-c932a261bc97', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-963131891'}}} Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 03:59:47.064399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 7e28a87c-e822-45ba-891c-c932a261bc97 while it is in task_state image_snapshot_pending Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 7e28a87c-e822-45ba-891c-c932a261bc97 while it is in task_state image_snapshot_pending Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 409 to user: Cannot 'createImage' instance 7e28a87c-e822-45ba-891c-c932a261bc97 while it is in task_state image_snapshot_pending {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 03:59:47.067960 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99f23482-e0d6-4d96-9cc5-83cc81418b1b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action" status: 409 len: 167 microversion: 2.1 time: 0.109131 Nov 03 03:59:47.071676 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1056/2056] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 03:59:46 2022] POST /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97/action => generated 167 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 03:59:47.077683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7d727fb-1c68-4f72-8924-ecdb098474fd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '.version_select at 0x7ff7fd597550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:47.250748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:47.264586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4bb644a3-466b-44e1-a0f8-d3d90bd1f835 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.809658 Nov 03 03:59:47.266209 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1001/2057] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:46 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:47.278498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:47.280194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:47.294551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:47.296619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:47.297589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:47.302468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:47.302468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:47.302468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:47.449603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:47.459674 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14cd4791-818c-42b1-84de-5ee5cc79be9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1250 microversion: 2.1 time: 0.192007 Nov 03 03:59:47.470007 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1002/2058] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:47 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1250 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:47.483117 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7d727fb-1c68-4f72-8924-ecdb098474fd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/images/6de7cf50-299c-486c-b179-da4a926bd4bc" status: 204 len: 0 microversion: 2.1 time: 0.410006 Nov 03 03:59:47.487606 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1057/2059] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:47 2022] DELETE /compute/v2.1/images/6de7cf50-299c-486c-b179-da4a926bd4bc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:59:47.494200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:47.495134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:47.498766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:47.500418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:47.503500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:47.504836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:47.505525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:47.506484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:47.507161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:47.507807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:47.511335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:47.511853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:47.512297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:47.513413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:47.513873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:47.514300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:47.900564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:47.912133 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-271ccca3-5ab5-4aff-b9b7-990ae7706a35 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1533 microversion: 2.1 time: 0.422923 Nov 03 03:59:47.930049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:47.930250 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1058/2060] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:47 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1533 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:47.941628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:47.945557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:47.947024 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d86c7a0-d3dc-4ff0-9867-0bd41458f0ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.468023 Nov 03 03:59:47.950759 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1003/2061] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:47 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:48.298500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:48.300253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:48.308025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:48.308793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:48.309856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:48.310782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:48.311420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:48.313565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:48.485225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:48.486606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:48.500529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:48.501050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:48.501503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:48.502635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:48.503105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:48.503539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:48.655638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:48.665803 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-342174bf-d374-404a-8933-74e898371bce tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.376235 Nov 03 03:59:48.677891 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1059/2062] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:48 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:48.811167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:48.823613 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55812b11-5f2a-4fd2-9f5d-dbfa7edb2728 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.342387 Nov 03 03:59:48.825116 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1004/2063] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:48 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:48.944743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:48.946796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:48.961317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:48.963843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:48.963843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:48.963843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:48.966106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:48.967263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:48.982645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:48.989005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:49.000655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:49.006372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:49.007067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:49.007807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:49.009904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:49.016472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:49.373901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:49.384023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:49.385622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:49.386980 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e40f466-736f-4bae-908c-c49bbd873595 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.414402 Nov 03 03:59:49.387338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:49.388837 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1005/2064] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:48 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:49.412053 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6999c739-2aab-4897-891f-c646029ca34f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1533 microversion: 2.1 time: 0.472026 Nov 03 03:59:49.413138 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1060/2065] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:48 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1533 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:49.416460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8fcc92b2-e246-4590-bb92-6f70f32353a2 req-39fe3557-7686-4f10-a849-4d1513d07ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed94eeeb-28e0-4472-8d19-c980456ffa0f", "tag": "936b3ab5-5256-4926-b068-f44770180c56"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:49.424185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8fcc92b2-e246-4590-bb92-6f70f32353a2 req-39fe3557-7686-4f10-a849-4d1513d07ec0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:49.424746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8fcc92b2-e246-4590-bb92-6f70f32353a2 req-39fe3557-7686-4f10-a849-4d1513d07ec0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:49.425273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8fcc92b2-e246-4590-bb92-6f70f32353a2 req-39fe3557-7686-4f10-a849-4d1513d07ec0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:49.438878 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8fcc92b2-e246-4590-bb92-6f70f32353a2 req-39fe3557-7686-4f10-a849-4d1513d07ec0 service nova] Creating event network-changed:936b3ab5-5256-4926-b068-f44770180c56 for instance ed94eeeb-28e0-4472-8d19-c980456ffa0f on n-h1-854653-7 Nov 03 03:59:49.445813 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8fcc92b2-e246-4590-bb92-6f70f32353a2 req-39fe3557-7686-4f10-a849-4d1513d07ec0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042747 Nov 03 03:59:49.450224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1006/2066] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:49.690336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:49.690993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:49.697137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:49.697634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:49.698079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:49.698795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:49.699258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:49.699691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:49.848991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:49.849708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:49.858335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:49.859247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:49.863100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:49.863100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:49.863303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:49.863629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:50.073247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:50.081359 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8734f7ef-8384-4892-932e-db37192b423f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.396103 Nov 03 03:59:50.082162 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1061/2067] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:49 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:50.086831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f09a1c3-8cf5-4f33-816d-0b003f61f2c6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5da160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:50.136598 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f09a1c3-8cf5-4f33-816d-0b003f61f2c6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/775aa719-69ea-4fbe-94ef-37e07c3bef14" status: 200 len: 662 microversion: 2.1 time: 0.053073 Nov 03 03:59:50.137068 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1062/2068] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:59:50 2022] GET /compute/v2.1/images/775aa719-69ea-4fbe-94ef-37e07c3bef14 => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:50.154144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e3fb92b8-3780-4804-8de8-1382c4f5ecfc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd597790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:50.199505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e3fb92b8-3780-4804-8de8-1382c4f5ecfc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/775aa719-69ea-4fbe-94ef-37e07c3bef14" status: 200 len: 662 microversion: 2.1 time: 0.050938 Nov 03 03:59:50.200060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1063/2069] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:59:50 2022] GET /compute/v2.1/images/775aa719-69ea-4fbe-94ef-37e07c3bef14 => generated 662 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:59:50.249794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:50.259907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-77a835ed-cee6-45fd-b9c4-c0c3edb4f291 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.415861 Nov 03 03:59:50.260654 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1007/2070] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:49 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:50.439593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:50.440478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:50.447607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:50.448231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:50.449058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:50.449582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:50.450098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:50.451023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:50.457052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:50.647568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:50.648647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:50.656449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:50.657136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:50.657753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:50.658474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:50.659124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:50.659731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:50.717620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:50.725408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d6ecd9f-86a4-4d1b-a553-860dc82accf3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1539 microversion: 2.1 time: 0.289631 Nov 03 03:59:50.725997 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1008/2071] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:50 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1539 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:50.820111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:50.829290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:50.831330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:50.832521 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-797b6ab5-942f-4fcc-a02d-51363f24eba2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.419482 Nov 03 03:59:50.833163 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1064/2072] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:50 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:51.105818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:51.106517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:51.114936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.115429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.115875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.116581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.117071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.117510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.253675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:51.274034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:51.282648 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-740d1227-31f7-4620-907a-81869117d0df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.180946 Nov 03 03:59:51.293066 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1009/2073] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:51 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:51.293232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:51.293232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:51.293232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.293232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.293232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.293948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.294097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.294543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.429347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:51.438236 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad24f372-911c-4c11-a496-734e8aaca30f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.158373 Nov 03 03:59:51.438881 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1065/2074] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:51 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:51.485131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b5f78a0f-8c7a-4663-9910-6e76b94dea1c req-23e91858-8c89-4623-99d0-f225da2b6e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac272146-9a22-4d57-b195-66af7e425fc3", "tag": "0fdca9ea-826d-4f5e-9a2f-8595dd279169"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:51.490994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:51.496302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b5f78a0f-8c7a-4663-9910-6e76b94dea1c req-23e91858-8c89-4623-99d0-f225da2b6e51 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.496794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b5f78a0f-8c7a-4663-9910-6e76b94dea1c req-23e91858-8c89-4623-99d0-f225da2b6e51 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.497248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b5f78a0f-8c7a-4663-9910-6e76b94dea1c req-23e91858-8c89-4623-99d0-f225da2b6e51 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.508205 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b5f78a0f-8c7a-4663-9910-6e76b94dea1c req-23e91858-8c89-4623-99d0-f225da2b6e51 service nova] Creating event network-changed:0fdca9ea-826d-4f5e-9a2f-8595dd279169 for instance ac272146-9a22-4d57-b195-66af7e425fc3 on n-h1-854653-7 Nov 03 03:59:51.513273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b5f78a0f-8c7a-4663-9910-6e76b94dea1c req-23e91858-8c89-4623-99d0-f225da2b6e51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031784 Nov 03 03:59:51.514170 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1010/2075] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:51.749992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:51.750879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:51.753121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:51.758532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.759023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.759459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.760332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.760782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.761587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.858971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:51.860011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:51.867259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.867800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.868234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.868943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:51.869575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:51.870002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:51.907201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:51.916310 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c57fe31d-ebc1-4347-8278-0af4f84809bf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1539 microversion: 2.1 time: 0.170514 Nov 03 03:59:51.919425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1066/2076] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:51 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1539 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:52.018474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:52.039685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:52.039685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:52.039685 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55fc6264-9527-4322-9b9c-e5530af1d58b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.176835 Nov 03 03:59:52.039685 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1011/2077] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:51 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 03:59:52.307975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:52.308597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:52.316577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:52.316954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:52.317421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:52.318128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:52.318587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:52.319019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:52.351215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd2c534f-3a78-40d5-a898-0a96a4bcb895 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4a65e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:52.382753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:52.397752 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd2c534f-3a78-40d5-a898-0a96a4bcb895 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/64d56063-0b45-4b28-a7d0-08a4560f2a57" status: 200 len: 662 microversion: 2.1 time: 0.050464 Nov 03 03:59:52.398358 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1012/2078] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:59:52 2022] GET /compute/v2.1/images/64d56063-0b45-4b28-a7d0-08a4560f2a57 => generated 662 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:59:52.412280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1eed9006-4d42-462e-853d-76956b806b1c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4af160>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:52.461665 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1eed9006-4d42-462e-853d-76956b806b1c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/64d56063-0b45-4b28-a7d0-08a4560f2a57" status: 200 len: 662 microversion: 2.1 time: 0.053060 Nov 03 03:59:52.462439 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1013/2079] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:59:52 2022] GET /compute/v2.1/images/64d56063-0b45-4b28-a7d0-08a4560f2a57 => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:52.463426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:52.467587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:52.468198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:52.471944 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0496d4a3-2a50-4971-8c01-947213d8bc42 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.167815 Nov 03 03:59:52.472533 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1067/2080] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:52 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:52.481860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:52.482712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:52.483464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:52.485066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:52.486671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:52.487724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:52.650537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:52.656389 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dfa5f859-bada-4fc9-ae6a-32cfd512f428 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.192499 Nov 03 03:59:52.670074 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1014/2081] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:52 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:52.670867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6769e76f-f300-4c84-a115-b69129a54b87 req-2dd08135-a1b2-4933-97fd-d42aea5cc37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e28a87c-e822-45ba-891c-c932a261bc97", "name": "network-vif-plugged", "status": "completed", "tag": "bc32fcde-9e7e-4482-b4a2-28e142e0633c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:52.681829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6769e76f-f300-4c84-a115-b69129a54b87 req-2dd08135-a1b2-4933-97fd-d42aea5cc37d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:52.682320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6769e76f-f300-4c84-a115-b69129a54b87 req-2dd08135-a1b2-4933-97fd-d42aea5cc37d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:52.682763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6769e76f-f300-4c84-a115-b69129a54b87 req-2dd08135-a1b2-4933-97fd-d42aea5cc37d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:52.694843 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6769e76f-f300-4c84-a115-b69129a54b87 req-2dd08135-a1b2-4933-97fd-d42aea5cc37d service nova] Creating event network-vif-plugged:bc32fcde-9e7e-4482-b4a2-28e142e0633c for instance 7e28a87c-e822-45ba-891c-c932a261bc97 on n-h1-854653-7 Nov 03 03:59:52.699705 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6769e76f-f300-4c84-a115-b69129a54b87 req-2dd08135-a1b2-4933-97fd-d42aea5cc37d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033124 Nov 03 03:59:52.700477 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1068/2082] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 03:59:52.939890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:52.940582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:52.947405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:52.947969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:52.948476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:52.949221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:52.949678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:52.950106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:53.063458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:53.064237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:53.070599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:53.071275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:53.071914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:53.072625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:53.073264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:53.073847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:53.091878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:53.101948 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2a4c3a9-e279-4434-8520-bf37475871cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1539 microversion: 2.1 time: 0.165808 Nov 03 03:59:53.112179 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1015/2083] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:52 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1539 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:53.233334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:53.242342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:53.243879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:53.245097 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15f3bc35-1e91-489e-8f24-23cf400e087a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.185811 Nov 03 03:59:53.245652 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1069/2084] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:53 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:53.297293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42aac6d1-4491-4502-b64f-b2791d84883a tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] Calling method '.version_select at 0x7ff7fd49ec10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:53.308550 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42aac6d1-4491-4502-b64f-b2791d84883a tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.144981 Nov 03 03:59:53.309128 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1016/2085] 10.222.0.30 () {60 vars in 1226 bytes} [Thu Nov 3 03:59:53 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 03:59:53.320932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c0736ca-3037-434f-af44-e3fc265946da tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] Action: 'update', calling method: .version_select at 0x7ff7fd5d5940>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:53.327047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:53.497216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:53.498976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:53.508633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:53.509153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:53.509950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:53.510675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:53.511131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:53.511563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:54.033410 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c0736ca-3037-434f-af44-e3fc265946da tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.716647 Nov 03 03:59:54.034145 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1070/2086] 10.222.0.30 () {62 vars in 1247 bytes} [Thu Nov 3 03:59:53 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 03:59:54.039749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:54.039749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:54.045724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:54.046162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:54.046605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:54.047552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:54.049451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:54.049451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:54.168087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:54.176402 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84655736-2ea1-40d9-a3a5-f9b0884667fd tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.683466 Nov 03 03:59:54.176979 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1017/2087] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:53 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:54.181404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-327ed1ca-fa30-402c-a9a7-54d10a9aca23 tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] Calling method '.version_select at 0x7ff7fd4a65e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:54.194089 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-327ed1ca-fa30-402c-a9a7-54d10a9aca23 tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.015952 Nov 03 03:59:54.195218 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1018/2088] 10.222.0.30 () {60 vars in 1226 bytes} [Thu Nov 3 03:59:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:59:54.200065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:54.200696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:54.207018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:54.207517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:54.207969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:54.211431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:54.211431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:54.211431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:54.474232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:54.483355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3373fade-0916-4438-aee4-78bfcc82c268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.448078 Nov 03 03:59:54.483947 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1071/2089] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:54 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:54.490155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50305e5b-1b60-4e3c-9c0f-8db26f9bcbc0 tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] Action: 'update', calling method: .version_select at 0x7ff7fd5ff940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:54.581777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:54.590752 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9d38430e-6489-4c2c-816a-a16bcf33c28d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1539 microversion: 2.1 time: 0.394266 Nov 03 03:59:54.591492 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1019/2090] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:54 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1539 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:54.613937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:54.614777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:54.620959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:54.621487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:54.621934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:54.622677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:54.623138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:54.623566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:54.857944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:54.867438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:54.869980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:54.871242 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e43783e4-695d-4bb9-acf5-5c3df2935713 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.264783 Nov 03 03:59:54.871917 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1020/2091] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:54 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:54.876499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd2a0a8d-73c9-42d8-83b8-cbaeb26bc206 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4d95e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:54.933182 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd2a0a8d-73c9-42d8-83b8-cbaeb26bc206 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/29b8015d-2502-45c6-8f3d-7109d4699e81" status: 200 len: 661 microversion: 2.1 time: 0.060121 Nov 03 03:59:54.934055 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1021/2092] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:59:54 2022] GET /compute/v2.1/images/29b8015d-2502-45c6-8f3d-7109d4699e81 => generated 661 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:54.948387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe09d465-2310-4121-a2bf-f48138d08af3 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4223a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:54.995339 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe09d465-2310-4121-a2bf-f48138d08af3 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/29b8015d-2502-45c6-8f3d-7109d4699e81" status: 200 len: 661 microversion: 2.1 time: 0.050876 Nov 03 03:59:54.996031 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1022/2093] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 03:59:54 2022] GET /compute/v2.1/images/29b8015d-2502-45c6-8f3d-7109d4699e81 => generated 661 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:55.113194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-45850097", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:55.169258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:59:55.293743 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50305e5b-1b60-4e3c-9c0f-8db26f9bcbc0 tempest-QuotaClassesAdmin257Test-1032947615 tempest-QuotaClassesAdmin257Test-1032947615-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.808158 Nov 03 03:59:55.301779 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1072/2094] 10.222.0.30 () {62 vars in 1247 bytes} [Thu Nov 3 03:59:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 03:59:55.308578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:55.309641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:55.317282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.319719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.320499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.321421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.322185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.323588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.449500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:59:55.450370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:59:55.451054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:59:55.456044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:59:55.456044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:59:55.462545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.463511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.464192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.466088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.467028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.467685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.489977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Getting quotas for project 405fb920cbb2441d8f3ef5c9749f2ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:59:55.495869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Getting quotas for user ee1303e758764c42a30fbe07e5e5f823 and project 405fb920cbb2441d8f3ef5c9749f2ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:59:55.512299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:59:55.514805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:59:55.529227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:55.536946 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e06aba8d-29e9-495c-8558-3eeb25ecadfb tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.233852 Nov 03 03:59:55.537643 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1073/2095] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:55 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:55.544823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:55.544823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:55.550023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.550529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.550947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.551642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.552451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.552885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.693550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:55.702070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0c08844-50c5-4034-9a48-c460eafe4b65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.163326 Nov 03 03:59:55.703020 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1074/2096] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:55 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:55.707687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:55.708301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:55.714275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.714768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.715209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.716111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.716572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.717167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.835433 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a826613-6ad6-4747-a955-f0ccdc6f51da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726713 Nov 03 03:59:55.856774 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1023/2097] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 03:59:55.888040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:55.890824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:55.899864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1587981069", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:55.900715 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-678bb45b-04a6-4b45-b35a-c4e4b89dba0c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1539 microversion: 2.1 time: 0.196372 Nov 03 03:59:55.901548 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1075/2098] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:55 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1539 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:55.906218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:55.906837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:55.914669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.914867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.915384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.916028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:55.916495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:55.916929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:55.980233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 03:59:56.293940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 03:59:56.294990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 03:59:56.295872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 03:59:56.296309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:56.297222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 03:59:56.297911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 03:59:56.306570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:56.309120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:56.309627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a10f2517-9ced-446c-b7ea-523464bbe8ab tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.407219 Nov 03 03:59:56.310540 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1076/2099] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:55 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:56.311561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:56.312148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:56.313082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:56.313805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:56.314446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:56.314967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:56.335594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Getting quotas for project 405fb920cbb2441d8f3ef5c9749f2ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 03:59:56.338432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 03:59:56.342751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Getting quotas for user ee1303e758764c42a30fbe07e5e5f823 and project 405fb920cbb2441d8f3ef5c9749f2ff0. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 03:59:56.356448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 03:59:56.358992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 03:59:56.560914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b1f7195b-9251-4006-a16f-a5bc8466a95f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666207 Nov 03 03:59:56.570100 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1024/2100] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 03:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 03:59:56.570396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:56.571207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:56.576475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a3906bd-3680-4bca-a2e5-64c24795bccd tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:56.577848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a3906bd-3680-4bca-a2e5-64c24795bccd tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:56.602170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:56.602684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:56.603143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:56.603866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:56.613518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:56.614002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:56.662013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a3906bd-3680-4bca-a2e5-64c24795bccd tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:56.670707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a3906bd-3680-4bca-a2e5-64c24795bccd tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1218 microversion: 2.1 time: 0.098328 Nov 03 03:59:56.671275 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1025/2101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:56 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:56.725829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:56.726361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:56.735004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:56.739072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:56.739679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:56.740724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:56.740852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:56.742305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:56.957337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:56.967554 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-967ae697-62e6-4091-828a-4b609ef08dde tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.410063 Nov 03 03:59:56.987345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1077/2102] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:56 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:56.993918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:56.994799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:57.003466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.004407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.005066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.007007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.007485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.007985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.016731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:57.026775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b806a523-c781-4c35-83fd-c0c3532ca19c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.303967 Nov 03 03:59:57.026775 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1026/2103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:56 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:57.037113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a2bab8b7-93f4-4345-9e91-ee585f3a72e7 req-8c289d08-ab2d-4c3a-aefb-ec7207db39b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac272146-9a22-4d57-b195-66af7e425fc3", "name": "network-vif-plugged", "status": "completed", "tag": "0fdca9ea-826d-4f5e-9a2f-8595dd279169"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 03:59:57.059085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a2bab8b7-93f4-4345-9e91-ee585f3a72e7 req-8c289d08-ab2d-4c3a-aefb-ec7207db39b4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.059576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a2bab8b7-93f4-4345-9e91-ee585f3a72e7 req-8c289d08-ab2d-4c3a-aefb-ec7207db39b4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.063210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a2bab8b7-93f4-4345-9e91-ee585f3a72e7 req-8c289d08-ab2d-4c3a-aefb-ec7207db39b4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.087847 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a2bab8b7-93f4-4345-9e91-ee585f3a72e7 req-8c289d08-ab2d-4c3a-aefb-ec7207db39b4 service nova] Creating event network-vif-plugged:0fdca9ea-826d-4f5e-9a2f-8595dd279169 for instance ac272146-9a22-4d57-b195-66af7e425fc3 on n-h1-854653-7 Nov 03 03:59:57.092762 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a2bab8b7-93f4-4345-9e91-ee585f3a72e7 req-8c289d08-ab2d-4c3a-aefb-ec7207db39b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059406 Nov 03 03:59:57.093789 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1027/2104] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 03:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 03:59:57.313228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:57.323260 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d8a6a2c-6237-4494-b2e4-4e5900142ccc tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1521 microversion: 2.1 time: 0.334517 Nov 03 03:59:57.323964 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1078/2105] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:56 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:57.342460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:57.344150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:57.350474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:57.350974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:57.351612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.352338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.353146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.354068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.354687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.355318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.361927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.362426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.362869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.363583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.364070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.364496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.401667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 03:59:57.502286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:57.511121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:57.512762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:57.514053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-59bd6397-dade-4c14-aa99-557b73934381 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.177595 Nov 03 03:59:57.515118 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1028/2106] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:57 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:57.698257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdfaf0d5-0c94-45f3-b5ba-578f4313a532 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:57.699329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cdfaf0d5-0c94-45f3-b5ba-578f4313a532 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:57.806755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cdfaf0d5-0c94-45f3-b5ba-578f4313a532 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:57.815229 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cdfaf0d5-0c94-45f3-b5ba-578f4313a532 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1218 microversion: 2.1 time: 0.121914 Nov 03 03:59:57.816286 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1029/2107] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:57 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:57.854128 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7fdb9a23-6760-4091-9a7c-6ccabfa1ea45 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 204 len: 0 microversion: 2.1 time: 0.507380 Nov 03 03:59:57.855298 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1079/2108] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 03:59:57 2022] DELETE /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 03:59:57.864132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:57.864762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:57.871376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.872055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.872655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:57.873552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:57.874157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:57.879185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.027871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:58.036621 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a6a0c89-c0d6-4f5d-87d6-5329b6bde49d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1527 microversion: 2.1 time: 0.176930 Nov 03 03:59:58.037240 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1030/2109] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:57 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1527 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:58.059391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:58.060061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:58.066368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.066862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.067309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.068086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.068469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.069245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.287948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:58.296243 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1e1b956-626d-45c3-aaf1-d28420ff67cb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.245618 Nov 03 03:59:58.296818 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1031/2110] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:58 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:58.305864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:58.306608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:58.313500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.314032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.314479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.315270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.315781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.316219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.541782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:58.542784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:58.549382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.549873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.550498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.551651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.552291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.552889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.586884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:58.597002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e8bc85b-5e52-432c-9a14-e0946952d44a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.609102 Nov 03 03:59:58.597835 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1080/2111] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:57 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:58.825339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:58.837292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:58.839632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:58.841216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:58.841418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5281dc42-4863-46e2-bc8c-5b61fcebefa3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.304224 Nov 03 03:59:58.842313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:58.850724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.851572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.852215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.856809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:58.857491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1032/2112] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:58 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 03:59:58.857579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:58.857579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:58.919793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:58.927890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04fcbf2b-a94d-46d7-bd30-ed6fc8a4883e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1214 microversion: 2.1 time: 0.092232 Nov 03 03:59:58.928483 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1081/2113] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:58 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 03:59:59.065597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:59.066243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:59.072315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.073251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.073970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.074900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.075435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.075941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.217489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:59.225307 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8655bb3f-aad4-4ccf-8432-aa7967acc5cf tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1527 microversion: 2.1 time: 0.164515 Nov 03 03:59:59.225880 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1033/2114] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:59 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:59.323171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:59.323935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:59.330319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.331136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.335489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.335489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.335489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.335489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.540489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:59.550539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21ea13db-113b-429b-94f4-6e273d10ae47 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1292 microversion: 2.1 time: 0.233909 Nov 03 03:59:59.551467 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1082/2115] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:59 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1292 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:59.621859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:59.622503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:59.631103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.631617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.632062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.632779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.633289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.633773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.774819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 03:59:59.783206 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2bc1cf1-9ec2-40e3-9649-3d735528818f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.165529 Nov 03 03:59:59.783775 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1034/2116] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:59 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 03:59:59.870710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:59.871473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:59.881068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.882168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.882857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.883962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.884624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.885296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.953392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 03:59:59.953791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 03:59:59.967246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.967822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.975302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.975302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 03:59:59.975302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 03:59:59.975302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 03:59:59.990382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:00.089290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:00.100975 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec291038-a5e6-4650-a349-e73425f62ae1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1270 microversion: 2.1 time: 0.151937 Nov 03 04:00:00.101857 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1035/2117] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 03:59:59 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:00.180263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:00.195157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:00.197685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:00.199502 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a529c0b7-3d5c-48e1-a1eb-112e76024c95 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1812 microversion: 2.25 time: 0.335213 Nov 03 04:00:00.201267 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1083/2118] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 03:59:59 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1812 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:00.251925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:00.259522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:00.270781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:00.273214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:00.274026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:00.274954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:00.275583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:00.279030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:00.579949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:00.581286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:00.633743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:00.637278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:00.639568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:00.642055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:00.648738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:00.651283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:00.666344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:00.678080 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f1c0abd-e31a-45e8-8fd9-4d6601a9567b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1527 microversion: 2.1 time: 0.432207 Nov 03 04:00:00.678897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1036/2119] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:00 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1527 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:00.710374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-f1262069-76f0-424a-9e99-e19abdef38ca req-fc71bbe3-75e0-479f-943e-8fd3ac93b348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e28a87c-e822-45ba-891c-c932a261bc97", "name": "network-vif-unplugged", "status": "completed", "tag": "bc32fcde-9e7e-4482-b4a2-28e142e0633c"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:00.732063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f1262069-76f0-424a-9e99-e19abdef38ca req-fc71bbe3-75e0-479f-943e-8fd3ac93b348 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:00.732553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f1262069-76f0-424a-9e99-e19abdef38ca req-fc71bbe3-75e0-479f-943e-8fd3ac93b348 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:00.733126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f1262069-76f0-424a-9e99-e19abdef38ca req-fc71bbe3-75e0-479f-943e-8fd3ac93b348 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:00.750970 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-f1262069-76f0-424a-9e99-e19abdef38ca req-fc71bbe3-75e0-479f-943e-8fd3ac93b348 service nova] Creating event network-vif-unplugged:bc32fcde-9e7e-4482-b4a2-28e142e0633c for instance 7e28a87c-e822-45ba-891c-c932a261bc97 on n-h1-854653-7 Nov 03 04:00:00.778315 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-f1262069-76f0-424a-9e99-e19abdef38ca req-fc71bbe3-75e0-479f-943e-8fd3ac93b348 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068498 Nov 03 04:00:00.781887 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1037/2120] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:00.808081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:00.809235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:00.837154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:00.837914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:00.838969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:00.843898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:00.845169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:00.846289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:00.938230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:00.950197 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a137a3b-e6a9-4fbc-a647-2c72757dfd7f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1473 microversion: 2.1 time: 0.378675 Nov 03 04:00:00.950733 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1084/2121] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:00 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:01.103438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-298990837", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:01.192604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:00:01.248574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:01.266254 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-366b72c3-6e83-4f86-b613-13d3b8c9ac6f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1512 microversion: 2.1 time: 0.462941 Nov 03 04:00:01.266978 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1038/2122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:00 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:01.272442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:01.276719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:01.286031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:01.286527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:01.286971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:01.287693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:01.288154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:01.288585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.084292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:02.092305 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-78e3c85f-5cc5-4d65-99c5-d9be6cd19bb1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1318 microversion: 2.1 time: 0.824024 Nov 03 04:00:02.093213 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1039/2123] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:01 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:02.098544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:02.099302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:02.105708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.106457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.107144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.108074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.108742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.109468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.435063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:02.446951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:02.448465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:02.449714 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f479716f-0e05-466b-a2f9-f38c607401c4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1802 microversion: 2.25 time: 0.355342 Nov 03 04:00:02.450272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1040/2124] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:02 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1802 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:02.557134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:00:02.557751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:00:02.558299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:00:02.559032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:00:02.559556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:00:02.574823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.576537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.577083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.578035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.578686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.579349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.601998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:02.608210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:02.622888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:00:02.625588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 0cbb3679-8e5d-4dc9-a633-c0723672b1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:00:02.697561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Action: 'update', calling method: .version_select at 0x7ff7fd479f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:02.762469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.762960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.763453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.764435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.765000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.765559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.786390 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-404db80d-00ad-41a6-b6ca-0dbfad820ae6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.687840 Nov 03 04:00:02.787378 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1085/2125] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:00:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:00:02.792085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:02.792700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:02.799503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.799981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.800419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.801463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.802084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.802658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.841311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:02.841792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:02.842236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:02.842684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 7e28a87c-e822-45ba-891c-c932a261bc97 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:02.930526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:02.957101 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-efe51ca3-4d50-4576-8778-51b905773047 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 200 len: 1314 microversion: 2.1 time: 0.163792 Nov 03 04:00:02.970607 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1086/2126] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:02 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:02.990362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4457cba7-011f-4071-b9d0-dc143b490840 req-ba05d80e-9f97-4fcc-a998-e0ee5dea172c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e28a87c-e822-45ba-891c-c932a261bc97", "name": "network-vif-deleted", "tag": "bc32fcde-9e7e-4482-b4a2-28e142e0633c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:02.991255 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc77f620-9eaf-4f54-ae68-93da2a3d8ec5 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a" status: 200 len: 240 microversion: 2.36 time: 0.539491 Nov 03 04:00:02.992121 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1041/2127] 10.222.0.30 () {62 vars in 1303 bytes} [Thu Nov 3 04:00:02 2022] PUT /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a => generated 240 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:03.004713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.007461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:03.010170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4457cba7-011f-4071-b9d0-dc143b490840 req-ba05d80e-9f97-4fcc-a998-e0ee5dea172c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.010972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4457cba7-011f-4071-b9d0-dc143b490840 req-ba05d80e-9f97-4fcc-a998-e0ee5dea172c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.014219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4457cba7-011f-4071-b9d0-dc143b490840 req-ba05d80e-9f97-4fcc-a998-e0ee5dea172c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.027235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.028041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.030142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.031581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.033554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.037534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.040349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4457cba7-011f-4071-b9d0-dc143b490840 req-ba05d80e-9f97-4fcc-a998-e0ee5dea172c service nova] Creating event network-vif-deleted:bc32fcde-9e7e-4482-b4a2-28e142e0633c for instance 7e28a87c-e822-45ba-891c-c932a261bc97 on n-h1-854653-7 Nov 03 04:00:03.047491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4457cba7-011f-4071-b9d0-dc143b490840 req-ba05d80e-9f97-4fcc-a998-e0ee5dea172c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075134 Nov 03 04:00:03.048927 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1087/2128] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:03.056448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.062745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:03.064766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Searching by: {'deleted': False, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:00:03.071243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.072053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.073483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.074669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.075443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.076161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.105565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:00:03.144046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e839c42-b671-408a-a892-ca9e53568abb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.092592 Nov 03 04:00:03.145269 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1088/2129] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:00:03 2022] GET /compute/v2.1/servers => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:03.159793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-541c57f8-4c01-4c58-b978-78e554e22c89 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '.version_select at 0x7ff7f9329550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.167390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c57f8-4c01-4c58-b978-78e554e22c89 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.168168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c57f8-4c01-4c58-b978-78e554e22c89 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.168833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c57f8-4c01-4c58-b978-78e554e22c89 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.179460 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-541c57f8-4c01-4c58-b978-78e554e22c89 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1523 microversion: 2.25 time: 0.032947 Nov 03 04:00:03.180352 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1089/2130] 10.222.0.30 () {60 vars in 1184 bytes} [Thu Nov 3 04:00:03 2022] GET /compute/v2.1/os-migrations => generated 1523 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:03.195338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d7a5f9f-fb48-42ac-a102-73d5d1d0ede4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.196131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d7a5f9f-fb48-42ac-a102-73d5d1d0ede4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 0cbb3679-8e5d-4dc9-a633-c0723672b1f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:03.215156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d7a5f9f-fb48-42ac-a102-73d5d1d0ede4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 0cbb3679-8e5d-4dc9-a633-c0723672b1f0] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:00:03.239593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:UPDATE=15,nova_api:SELECT=80,nova_api:INSERT=5 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:03.311468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:03.321036 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68433d2c-4c85-4d9d-918d-b71352701c65 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1489 microversion: 2.1 time: 0.327479 Nov 03 04:00:03.321735 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1042/2131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:02 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1489 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:03.330797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-304d5532-7716-4dd6-aaf4-19560e1ed8de req-7fde97a7-8144-4813-bb19-cb301237e885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60129a1a-b160-4e7e-a855-dd553c4acf5d", "tag": "08ee2daa-805b-4703-9a93-903066d40144"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:03.342235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-304d5532-7716-4dd6-aaf4-19560e1ed8de req-7fde97a7-8144-4813-bb19-cb301237e885 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.343050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-304d5532-7716-4dd6-aaf4-19560e1ed8de req-7fde97a7-8144-4813-bb19-cb301237e885 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.343634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-304d5532-7716-4dd6-aaf4-19560e1ed8de req-7fde97a7-8144-4813-bb19-cb301237e885 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.376852 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-304d5532-7716-4dd6-aaf4-19560e1ed8de req-7fde97a7-8144-4813-bb19-cb301237e885 service nova] Creating event network-changed:08ee2daa-805b-4703-9a93-903066d40144 for instance 60129a1a-b160-4e7e-a855-dd553c4acf5d on n-h2-854653-7 Nov 03 04:00:03.386687 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-304d5532-7716-4dd6-aaf4-19560e1ed8de req-7fde97a7-8144-4813-bb19-cb301237e885 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063304 Nov 03 04:00:03.388431 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1043/2132] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:03.395720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Calling method '.version_select at 0x7ff7fd479af0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.486934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.487620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.487841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.488580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.489060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.489908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.511195 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b351934e-1180-4211-bf54-16dbcf5990d3 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a/detail" status: 200 len: 672 microversion: 2.36 time: 0.121122 Nov 03 04:00:03.524511 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1044/2133] 10.222.0.30 () {60 vars in 1304 bytes} [Thu Nov 3 04:00:03 2022] GET /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a/detail => generated 672 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:03.524511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.524511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:03.534688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.535231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.535690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.536448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.536998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.537477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.714605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:03.723226 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-193091d3-c7ae-4368-a4d1-c6554a6d76fa tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1318 microversion: 2.1 time: 0.209443 Nov 03 04:00:03.723790 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1045/2134] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:03 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:03.728380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.733619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:03.734488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Searching by: {'deleted': False, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:00:03.740927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.741473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.741909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.742626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.743080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.743504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.760377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.scheduler.client.report [None req-4d7a5f9f-fb48-42ac-a102-73d5d1d0ede4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Deleted allocations for instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 Nov 03 04:00:03.770417 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-4d7a5f9f-fb48-42ac-a102-73d5d1d0ede4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 0cbb3679-8e5d-4dc9-a633-c0723672b1f0] Instance Mapping does not exist while attempting local delete cleanup. Nov 03 04:00:03.771611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d7a5f9f-fb48-42ac-a102-73d5d1d0ede4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0" status: 204 len: 0 microversion: 2.1 time: 0.589846 Nov 03 04:00:03.772464 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1090/2135] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:03 2022] DELETE /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:03.776059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:00:03.794941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:03.817904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:03.824903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.825516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.826827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.827936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:03.839797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.840289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.840730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.841493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:03.841934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:03.842364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:03.998226 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8a1d52e-f157-4d92-810a-694d91fec94b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.273327 Nov 03 04:00:03.998803 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1046/2136] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:00:03 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:04.005720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:04.006309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:04.014085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.014620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.015066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.015846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.016515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.017934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.049456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:00:04.049582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:04.064071 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4baa92e8-6c1c-4c30-8aa3-50b0443dee4c tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 2420 microversion: 2.25 time: 0.285001 Nov 03 04:00:04.064764 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1091/2137] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:03 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 2420 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:04.069596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f67155e6-467a-4df6-b6d9-033efb00cbe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:04.070438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f67155e6-467a-4df6-b6d9-033efb00cbe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 0cbb3679-8e5d-4dc9-a633-c0723672b1f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:04.076645 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f67155e6-467a-4df6-b6d9-033efb00cbe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f67155e6-467a-4df6-b6d9-033efb00cbe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0 HTTP/1.1 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0cbb3679-8e5d-4dc9-a633-c0723672b1f0'} Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:04.078506 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:04.084491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:04.084491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:04.084491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:04.084491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:00:04.084491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.084491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f67155e6-467a-4df6-b6d9-033efb00cbe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:04.084491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f67155e6-467a-4df6-b6d9-033efb00cbe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0" status: 404 len: 111 microversion: 2.1 time: 0.014568 Nov 03 04:00:04.089995 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1092/2138] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:04 2022] GET /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:04.096333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Action: 'update', calling method: .version_select at 0x7ff7fd5b9670>, body: {"quota_set": {"ram": "2048"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:04.167827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.168322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.168764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.169558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.170022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.170483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.204733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.205260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.205755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.206489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.206948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.207399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.217512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:04.347860 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6297b30b-40b1-4883-9aa1-f0116dc2effc tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a?user_id=54dcfe831e54432e9e6b32456e3bcc77" status: 200 len: 240 microversion: 2.36 time: 0.256524 Nov 03 04:00:04.348412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1093/2139] 10.222.0.30 () {62 vars in 1384 bytes} [Thu Nov 3 04:00:04 2022] PUT /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a?user_id=54dcfe831e54432e9e6b32456e3bcc77 => generated 240 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:04.352894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:04.353544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:04.359159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.359647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.360088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.361599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.362054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.364947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.375608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 HTTP/1.1 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7e28a87c-e822-45ba-891c-c932a261bc97'} Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.377796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-999ee417-c418-45b1-9588-d1b478a32751 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 404 len: 111 microversion: 2.1 time: 0.029832 Nov 03 04:00:04.381621 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1094/2140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:04 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:04.383980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a514c77c-dc0c-4816-9d73-439fe5d82536 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:04.391375 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a514c77c-dc0c-4816-9d73-439fe5d82536 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010811 Nov 03 04:00:04.391947 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1095/2141] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:00:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:04.396147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:04.396753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:04.406040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.406528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.406974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.407700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.408155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.408585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.419896 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12ed4e8f-168e-4bcf-8e23-44925ba83955 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 204 len: 0 microversion: 2.1 time: 0.419685 Nov 03 04:00:04.420487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1047/2142] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:03 2022] DELETE /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:04.426869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-832908437", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "1f101308-9db8-4b30-b5f1-954d8d42482e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:04.484869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:00:04.614359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:04.637669 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dfa4d04f-c1b8-4b09-9ef2-f176b6ef00de tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 2420 microversion: 2.25 time: 0.236146 Nov 03 04:00:04.637669 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1096/2143] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:04 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 2420 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:04.637669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47cfd2cb-d583-4543-918d-c6dd5208a1e4 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] Calling method '.version_select at 0x7ff7f94ef280>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:04.717439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-47cfd2cb-d583-4543-918d-c6dd5208a1e4 tempest-QuotasAdminTestV236-819173935 tempest-QuotasAdminTestV236-819173935-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a?user_id=54dcfe831e54432e9e6b32456e3bcc77" status: 200 len: 282 microversion: 2.36 time: 0.086595 Nov 03 04:00:04.721131 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1097/2144] 10.222.0.30 () {60 vars in 1364 bytes} [Thu Nov 3 04:00:04 2022] GET /compute/v2.1/os-quota-sets/d627b6b3584e4b978eac18bc4f22200a?user_id=54dcfe831e54432e9e6b32456e3bcc77 => generated 282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:04.723688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a063350a-d5d8-4349-b812-25b8b3e5c902 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'create', calling method: .version_select at 0x7ff7fd53f8b0>, body: {"keypair": {"name": "tempest-keypair-760121176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4eZ9hdTz2ZQD2s6lZl17atRGPW84fYaL7J8y28Jev0szVlPDpZzSPfI2cT8GtgJ9QCzjXmYf7chRHpCZq2T1oGwKBjaQ5InqAiSKXtC132pBDVFQI/p2Zd0KKPYs8iLA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:04.744576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a063350a-d5d8-4349-b812-25b8b3e5c902 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for project 0c64c3da724e48709d5f073189b61fc4. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:04.752162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a063350a-d5d8-4349-b812-25b8b3e5c902 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for user c25b2e8e63e54fada80ba039c1be2501 and project 0c64c3da724e48709d5f073189b61fc4. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:04.850027 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a063350a-d5d8-4349-b812-25b8b3e5c902 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130073 Nov 03 04:00:04.850658 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1098/2145] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:00:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:04.855686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:04.856396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:04.864075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.864631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.865107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:04.865825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:04.866277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:04.866703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.012882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:00:05.013422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:00:05.015359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:00:05.015359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:00:05.015359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:00:05.025136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.025718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.026232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.027044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.027734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.028232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.047513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:05.054095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:05.068084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:00:05.070689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:00:05.120540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:05.128668 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc7ab39b-dfc9-4e45-bfdf-881959e23668 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1495 microversion: 2.1 time: 0.276686 Nov 03 04:00:05.142473 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1099/2146] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:04 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1495 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:05.142473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:05.142473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:05.142473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.142473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.142933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.143411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.143867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.144421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.245515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lazy-loading 'services' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:05.247416 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4cbf5dd-60af-4ca9-be7b-862cd8049081 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825590 Nov 03 04:00:05.249671 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1048/2147] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:00:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:00:05.261132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:05.263965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:05.272209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:05.278293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.278734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.279173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.280050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.280509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.280937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.465089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:05.476932 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e8b53541-181f-40b1-ac8f-8c3afa96f1f1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1318 microversion: 2.1 time: 0.223994 Nov 03 04:00:05.477809 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1049/2148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:05 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:05.482191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:05.483002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:05.489246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.489744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.490191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.490899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.491362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.491801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.518260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:00:05.618293 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1afd4357-faf7-4c5a-a80a-4e2049e52f29 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments/f824fcc4-961a-400d-b0af-b3bbae3e759c" status: 202 len: 0 microversion: 2.25 time: 0.487125 Nov 03 04:00:05.619145 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1100/2149] 10.222.0.30 () {60 vars in 1457 bytes} [Thu Nov 3 04:00:05 2022] DELETE /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments/f824fcc4-961a-400d-b0af-b3bbae3e759c => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:05.630541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ae761919-ee85-4953-a9c0-be13bbce55ff req-c2c033c7-1127-47f8-bb3f-76a1a7aff482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1547c889-73e4-4a6a-8925-439fba280d99", "tag": "8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:05.644427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ae761919-ee85-4953-a9c0-be13bbce55ff req-c2c033c7-1127-47f8-bb3f-76a1a7aff482 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.645080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ae761919-ee85-4953-a9c0-be13bbce55ff req-c2c033c7-1127-47f8-bb3f-76a1a7aff482 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.645804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ae761919-ee85-4953-a9c0-be13bbce55ff req-c2c033c7-1127-47f8-bb3f-76a1a7aff482 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.658184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ae761919-ee85-4953-a9c0-be13bbce55ff req-c2c033c7-1127-47f8-bb3f-76a1a7aff482 service nova] Creating event network-changed:8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac for instance 1547c889-73e4-4a6a-8925-439fba280d99 on n-h2-854653-7 Nov 03 04:00:05.663688 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ae761919-ee85-4953-a9c0-be13bbce55ff req-c2c033c7-1127-47f8-bb3f-76a1a7aff482 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043060 Nov 03 04:00:05.664689 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1101/2150] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:05.671542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e4bcfdd-683a-4a96-9d14-ac8adcd37464 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:05.672849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e4bcfdd-683a-4a96-9d14-ac8adcd37464 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:05.731119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e4bcfdd-683a-4a96-9d14-ac8adcd37464 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:05.752125 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e4bcfdd-683a-4a96-9d14-ac8adcd37464 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1220 microversion: 2.1 time: 0.085913 Nov 03 04:00:05.764148 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1102/2151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:05 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:05.764148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:05.769538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:05.776020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.776568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.777359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.786710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.786710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.786710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.809536 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c1d3911-1ea2-49eb-8d3e-d82a16b5f4f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.054717 Nov 03 04:00:05.810075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1103/2152] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:05 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:05.927424 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-86ea68e3-f214-4cc0-bd23-2aee6b1eb838 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "DELETE /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 204 len: 0 microversion: 2.1 time: 0.448476 Nov 03 04:00:05.928246 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1050/2153] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:05 2022] DELETE /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:05.936704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:05.937318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:05.944743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.945280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.945727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:05.946435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:05.946928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:05.947359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.105895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:06.115050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b7f0f48-66c3-4daa-a478-308498c3c54b tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1609 microversion: 2.1 time: 0.182266 Nov 03 04:00:06.115675 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1104/2154] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:05 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1609 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:06.154601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:06.155308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:06.164589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.165215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.166151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.167308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.167777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.168371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.186870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:06.318178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:06.326970 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9c6bf4e-b26c-4151-a1d6-c84faa335816 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1495 microversion: 2.1 time: 0.176823 Nov 03 04:00:06.327642 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1051/2155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:06 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1495 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:06.502215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:06.502922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:06.512044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.512554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.513003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.513817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.514219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.514654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.671468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:06.679059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2123c78d-6324-43a4-9282-0030fe6617ea tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1318 microversion: 2.1 time: 0.182174 Nov 03 04:00:06.679613 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1105/2156] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:06 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:06.777583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:06.778192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:06.786041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.786532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.787017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.790557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.790557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.790557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.823168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:06.825954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:06.833133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.833901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.834511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.835441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:06.838552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:06.838552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:06.862376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:06.870863 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85646d6a-f196-4402-b25d-a13e1bf3885a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.051907 Nov 03 04:00:06.871063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d11076cf-0314-4096-a3b3-3dc4c8cabcfa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1224 microversion: 2.1 time: 0.097613 Nov 03 04:00:06.871979 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1052/2157] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:06 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:06.876325 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1106/2158] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:06 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:00:07.138835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:07.139611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:07.145799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.146377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.146967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.147737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.148261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.148840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.300486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:07.308277 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37dc57c1-fffc-4ad3-9f91-88512080e906 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1609 microversion: 2.1 time: 0.173426 Nov 03 04:00:07.308872 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1053/2159] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:07 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1609 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:07.350413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:07.351046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:07.359839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.362171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.362794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.364400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.365123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.365657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.504587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:07.512848 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c0b2fb6-a75e-4616-81a0-f304397b1c23 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1495 microversion: 2.1 time: 0.166311 Nov 03 04:00:07.513544 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1107/2160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:07 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1495 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:07.702128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:07.703098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:07.710081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.710574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.711014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.711717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.712169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.712593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.861143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:07.869338 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6dec1b5-985f-4727-889b-94cda8f1d5a4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1318 microversion: 2.1 time: 0.171016 Nov 03 04:00:07.870248 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1054/2161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:07 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:07.889857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:07.892166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:07.897490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:07.899495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:07.908106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.910457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.910457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.910457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.910457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.910755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.925353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.925869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.926314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.927043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:07.927507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:07.927924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:07.975971 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b5eae3f-5a0a-4cae-a9ed-953501fa6294 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095676 Nov 03 04:00:07.977182 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1108/2162] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:07 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:08.065149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:08.086760 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44db7129-faf3-45a9-ac01-482d37048750 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1280 microversion: 2.1 time: 0.196352 Nov 03 04:00:08.089478 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1055/2163] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:07 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:08.212234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-700c5a07-a9e0-4748-b12d-78d69c208f3f req-895a0220-b1ec-4d51-a91b-6d6efde98997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60129a1a-b160-4e7e-a855-dd553c4acf5d", "name": "network-vif-plugged", "status": "completed", "tag": "08ee2daa-805b-4703-9a93-903066d40144"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:08.232074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-700c5a07-a9e0-4748-b12d-78d69c208f3f req-895a0220-b1ec-4d51-a91b-6d6efde98997 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.232798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-700c5a07-a9e0-4748-b12d-78d69c208f3f req-895a0220-b1ec-4d51-a91b-6d6efde98997 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.233240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-700c5a07-a9e0-4748-b12d-78d69c208f3f req-895a0220-b1ec-4d51-a91b-6d6efde98997 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:08.247179 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-700c5a07-a9e0-4748-b12d-78d69c208f3f req-895a0220-b1ec-4d51-a91b-6d6efde98997 service nova] Creating event network-vif-plugged:08ee2daa-805b-4703-9a93-903066d40144 for instance 60129a1a-b160-4e7e-a855-dd553c4acf5d on n-h2-854653-7 Nov 03 04:00:08.253158 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-700c5a07-a9e0-4748-b12d-78d69c208f3f req-895a0220-b1ec-4d51-a91b-6d6efde98997 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045332 Nov 03 04:00:08.253954 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1109/2164] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:08.323436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1773705577", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:08.343659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:08.344357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:08.360529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.361449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.362216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:08.363018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.363018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.363533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:08.414382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] validate_networks() for [('5b8fe51f-9af2-47f9-8ae4-cb9d7cbdd61a', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:00:08.756351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:08.765609 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c06f949-e0c7-4f11-9de6-abe91e779f64 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1609 microversion: 2.1 time: 0.437426 Nov 03 04:00:08.766044 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1110/2165] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:08 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1609 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:08.771716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e284576d-89be-481e-ab26-f68739c69767 req-35de2bc3-0884-4eb4-8f69-64d94ad19df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f90a0c21-607b-4f27-b2f5-f06fa4cbe765", "name": "network-vif-deleted", "tag": "72e45d4f-14cf-441b-9bb3-22466436c570"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:08.783544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e284576d-89be-481e-ab26-f68739c69767 req-35de2bc3-0884-4eb4-8f69-64d94ad19df8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.784189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e284576d-89be-481e-ab26-f68739c69767 req-35de2bc3-0884-4eb4-8f69-64d94ad19df8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.784791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e284576d-89be-481e-ab26-f68739c69767 req-35de2bc3-0884-4eb4-8f69-64d94ad19df8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:08.797061 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e284576d-89be-481e-ab26-f68739c69767 req-35de2bc3-0884-4eb4-8f69-64d94ad19df8 service nova] Creating event network-vif-deleted:72e45d4f-14cf-441b-9bb3-22466436c570 for instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 on n-h2-854653-7 Nov 03 04:00:08.802438 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e284576d-89be-481e-ab26-f68739c69767 req-35de2bc3-0884-4eb4-8f69-64d94ad19df8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034490 Nov 03 04:00:08.804694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1111/2166] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:08.813917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:08.814844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:08.823140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.823487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.823781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:08.824666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.825210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.825575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:08.954517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:08.963609 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-063c9347-7ba5-4b00-82c7-c7637efbf6c8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1453 microversion: 2.1 time: 0.156073 Nov 03 04:00:08.964596 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1112/2167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:08 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:08.969396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:08.970029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:08.976447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.977320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.977762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:08.978462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:08.978944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:08.979368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.354654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:09.364540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:00:09.365367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:00:09.365474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:00:09.365882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:00:09.366358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:00:09.369105 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ebb64e8-ae6d-447a-87d1-1d331ca1d9dc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1318 microversion: 2.1 time: 0.403164 Nov 03 04:00:09.372153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1113/2168] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:08 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:09.385744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.386336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.387640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.387640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.387965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.388421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.393323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:09.395541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:09.401745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.402238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.405247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.406129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.406530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.407501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.416487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for project 0c64c3da724e48709d5f073189b61fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:09.425080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for user c25b2e8e63e54fada80ba039c1be2501 and project 0c64c3da724e48709d5f073189b61fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:09.466553 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96d39db7-1376-4290-b252-dde6630a6193 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.080242 Nov 03 04:00:09.467638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1114/2169] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:09 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:09.472714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:00:09.475296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:09.476623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:09.484797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:00:09.501363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.501363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.501363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.501363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.501363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.501363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.770228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c69e288-1128-4503-854e-aed77b0012de tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.447393 Nov 03 04:00:09.770228 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1056/2170] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:00:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:00:09.783050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9c79141-e2f2-4b03-bb99-9e65a6b2d8e8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:09.795906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a9c79141-e2f2-4b03-bb99-9e65a6b2d8e8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:09.863991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:09.872791 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e036304f-8efc-4c62-b862-6721faee7268 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.403066 Nov 03 04:00:09.874824 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1115/2171] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:09 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:09.902816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:09.903798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:09.930553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.935269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.936021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.937962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:09.938697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:09.939331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:09.951023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:09.980363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a9c79141-e2f2-4b03-bb99-9e65a6b2d8e8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:10.001637 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9c79141-e2f2-4b03-bb99-9e65a6b2d8e8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1225 microversion: 2.1 time: 0.224383 Nov 03 04:00:10.009113 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1057/2172] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:09 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1225 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:10.037108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:10.038070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:10.051932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.056655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.057407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.060258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.062252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.064923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.130134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.130788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.131273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.132160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lazy-loading 'fault' on Instance uuid f90a0c21-607b-4f27-b2f5-f06fa4cbe765 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:10.267062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:10.278518 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba070e67-e231-4d87-b363-9cf01c2f251c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1305 microversion: 2.1 time: 0.269900 Nov 03 04:00:10.281495 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1058/2173] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:10 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1305 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:10.404784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:10.408960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:10.416130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:10.425635 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21e8db99-bd7a-44b9-88d6-d5cc46b718c0 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1609 microversion: 2.1 time: 0.547465 Nov 03 04:00:10.427250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.429044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.430897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.431388 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1116/2174] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:09 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1609 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:10.435580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.436101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.436694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.487297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:10.490833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:10.509394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.511046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.511506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.513529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.516331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.516966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.573936 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-063d7f4f-84f7-4a05-90a4-a906713be8c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092941 Nov 03 04:00:10.574547 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1117/2175] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:10 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:00:10.827653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:10.839132 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-62a83692-a69b-42bc-a503-3bf77998d927 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1318 microversion: 2.1 time: 0.443798 Nov 03 04:00:10.840902 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1059/2176] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:10 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:10.901090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:10.902076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:10.917951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.919512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.920131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:10.921936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:10.923913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:10.925544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.043232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e6d4bf4-fef8-4580-b18f-c247a3c60602 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:11.044433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e6d4bf4-fef8-4580-b18f-c247a3c60602 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:11.248375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e6d4bf4-fef8-4580-b18f-c247a3c60602 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:11.257890 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e6d4bf4-fef8-4580-b18f-c247a3c60602 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1225 microversion: 2.1 time: 0.229151 Nov 03 04:00:11.261208 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1060/2177] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:11 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1225 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:11.303751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:11.304393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:11.311754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.312251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.312694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.317624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.318390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.318994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.394529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.395317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.395763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.396240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lazy-loading 'fault' on Instance uuid f90a0c21-607b-4f27-b2f5-f06fa4cbe765 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:11.543214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:11.544803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:11.552626 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ba6157b-2254-4319-8656-9ee15dd1e7fe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 200 len: 1305 microversion: 2.1 time: 0.252739 Nov 03 04:00:11.558175 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b01e55ac-5a41-41a4-a11d-128e734c08f0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.659597 Nov 03 04:00:11.559841 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1118/2178] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:10 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:11.560161 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1061/2179] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:11 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 1305 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:11.569384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:11.570990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:11.582447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.582945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.583383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.584089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.584548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.584975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.602490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:11.609258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:11.623371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=97,nova_api:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:11.637165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.640827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.646074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.646074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.648885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.649842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.725777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:11.726288 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af86499c-b86c-4038-bf82-99df2a673b41 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.142990 Nov 03 04:00:11.735322 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1119/2180] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:11 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:11.737518 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c973c561-e2a5-4b21-8026-4601847e62cb tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1541 microversion: 2.1 time: 0.175673 Nov 03 04:00:11.738322 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1062/2181] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:11 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1541 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:11.867631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:11.868560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:11.874645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.876500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.876990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:11.877745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:11.878208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:11.879601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.138050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1072241087", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": "none"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:12.239149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:00:12.239835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:00:12.241105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:00:12.241547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:00:12.252084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:00:12.285529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.286397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.287057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.288073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.288756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.295085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.339465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Getting quotas for project ec186db9a3a14062a468f5f5106f2cec. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:12.361110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Getting quotas for user 718826833702413f9189617cd67107aa and project ec186db9a3a14062a468f5f5106f2cec. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:12.372206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:00:12.375026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:00:12.563164 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2eead2b0-a529-4bf9-b087-1450c0174a5c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.662123 Nov 03 04:00:12.566656 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1063/2182] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:00:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:00:12.580077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-59ce6f75-dc34-4ea8-b14c-cd80925328b7 req-a34796cd-51f3-4dec-b335-7db185d7f12c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59785d6-020a-45d0-ae18-48edbc2fc755", "tag": "91938d23-1465-4b5b-a8f2-318a3f7e1699"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:12.600010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-59ce6f75-dc34-4ea8-b14c-cd80925328b7 req-a34796cd-51f3-4dec-b335-7db185d7f12c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.600844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-59ce6f75-dc34-4ea8-b14c-cd80925328b7 req-a34796cd-51f3-4dec-b335-7db185d7f12c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.601564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-59ce6f75-dc34-4ea8-b14c-cd80925328b7 req-a34796cd-51f3-4dec-b335-7db185d7f12c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.620253 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-59ce6f75-dc34-4ea8-b14c-cd80925328b7 req-a34796cd-51f3-4dec-b335-7db185d7f12c service nova] Creating event network-changed:91938d23-1465-4b5b-a8f2-318a3f7e1699 for instance f59785d6-020a-45d0-ae18-48edbc2fc755 on n-h1-854653-7 Nov 03 04:00:12.627526 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-59ce6f75-dc34-4ea8-b14c-cd80925328b7 req-a34796cd-51f3-4dec-b335-7db185d7f12c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057447 Nov 03 04:00:12.631067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1064/2183] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:12.638818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-dffe185f-208f-4ec4-9a97-9c2291a93255 req-1f493a4a-4848-40f2-baaa-ce2835c659bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87397ac1-d176-430d-b8ee-56755d8beca3", "name": "network-vif-deleted", "tag": "7b3c2b66-95e4-4ca5-9750-e62618eca2a6"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:12.653157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dffe185f-208f-4ec4-9a97-9c2291a93255 req-1f493a4a-4848-40f2-baaa-ce2835c659bb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.654738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dffe185f-208f-4ec4-9a97-9c2291a93255 req-1f493a4a-4848-40f2-baaa-ce2835c659bb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.655327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dffe185f-208f-4ec4-9a97-9c2291a93255 req-1f493a4a-4848-40f2-baaa-ce2835c659bb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.669638 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-dffe185f-208f-4ec4-9a97-9c2291a93255 req-1f493a4a-4848-40f2-baaa-ce2835c659bb service nova] Creating event network-vif-deleted:7b3c2b66-95e4-4ca5-9750-e62618eca2a6 for instance 87397ac1-d176-430d-b8ee-56755d8beca3 on n-h2-854653-7 Nov 03 04:00:12.679704 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-dffe185f-208f-4ec4-9a97-9c2291a93255 req-1f493a4a-4848-40f2-baaa-ce2835c659bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044100 Nov 03 04:00:12.680077 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1065/2184] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:12.687079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:12.687795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:12.695090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.695589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.696030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.696747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.698309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.698905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.824000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:12.839067 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b78a545-e8a4-4928-ac6a-fed3480d9a32 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1468 microversion: 2.1 time: 0.975262 Nov 03 04:00:12.839725 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1120/2185] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:11 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1468 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:12.843894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:12.844320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-036bad1d-f8e9-424c-9c84-eb78c60d601f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:12.847694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-036bad1d-f8e9-424c-9c84-eb78c60d601f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:12.874403 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00ac4869-0f35-444a-9dd9-2ab951f08534 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1277 microversion: 2.1 time: 0.192099 Nov 03 04:00:12.880491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1066/2186] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:12 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:12.893056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:12.897118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:12.916952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.918874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.922131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.923145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:12.923686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:12.927768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:12.979191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-036bad1d-f8e9-424c-9c84-eb78c60d601f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:12.989189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-036bad1d-f8e9-424c-9c84-eb78c60d601f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:12.990872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-036bad1d-f8e9-424c-9c84-eb78c60d601f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:12.998063 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-036bad1d-f8e9-424c-9c84-eb78c60d601f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1454 microversion: 2.91 time: 0.157274 Nov 03 04:00:12.999213 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1121/2187] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:12 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:13.005189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:13.009086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:13.018354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.019049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.019685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.020687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.021370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.022364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.038475 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 HTTP/1.1 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f90a0c21-607b-4f27-b2f5-f06fa4cbe765'} Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:13.040515 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:13.043883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:13.043883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:13.043883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:13.043883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:13.043883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:13.043883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:13.043883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:13.046175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:13.052950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a75a3926-11d4-4bc0-a364-6b7747822230 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 404 len: 111 microversion: 2.1 time: 0.047012 Nov 03 04:00:13.052950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1122/2188] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:12 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:13.069964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:13.072434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:13.081216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.081867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.082448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.083275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.084313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.084847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.153458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bf77265-5df1-44e7-9acf-4b458612b7f4 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099888 Nov 03 04:00:13.161290 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1123/2189] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:13 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:13.165934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:13.168963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:13.180432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.183173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.183860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.187214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.189690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.193393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.335879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:13.355915 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78e7ed2e-8abe-433f-8dd1-d24e03992e8c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1253 microversion: 2.1 time: 0.197633 Nov 03 04:00:13.359423 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1124/2190] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:13 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1253 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:13.363281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:13.367368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:13.388394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.388394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.388394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.389338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.389973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.401749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.407126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:13.429487 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb15e4df-683f-4da0-908a-6f4410ecdb0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.547696 Nov 03 04:00:13.434692 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1067/2191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:12 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:13.444758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-154d2240-8c80-464a-b06a-2cb31ec76968 req-61eeb53b-c452-45dc-958e-8a4ebbf8ffb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1547c889-73e4-4a6a-8925-439fba280d99", "name": "network-vif-plugged", "status": "completed", "tag": "8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:13.461849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-154d2240-8c80-464a-b06a-2cb31ec76968 req-61eeb53b-c452-45dc-958e-8a4ebbf8ffb7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.462595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-154d2240-8c80-464a-b06a-2cb31ec76968 req-61eeb53b-c452-45dc-958e-8a4ebbf8ffb7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.463183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-154d2240-8c80-464a-b06a-2cb31ec76968 req-61eeb53b-c452-45dc-958e-8a4ebbf8ffb7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.476421 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-154d2240-8c80-464a-b06a-2cb31ec76968 req-61eeb53b-c452-45dc-958e-8a4ebbf8ffb7 service nova] Creating event network-vif-plugged:8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac for instance 1547c889-73e4-4a6a-8925-439fba280d99 on n-h2-854653-7 Nov 03 04:00:13.483853 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-154d2240-8c80-464a-b06a-2cb31ec76968 req-61eeb53b-c452-45dc-958e-8a4ebbf8ffb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047140 Nov 03 04:00:13.484677 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1068/2192] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:13.492848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-94242488", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "25261195-157d-4c7b-8cfb-4fb3b385217e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:13.591341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] validate_networks() for [('25261195-157d-4c7b-8cfb-4fb3b385217e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:00:13.867707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:13.875702 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-396e929b-6cd4-41d5-88c6-c213c4334e48 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1316 microversion: 2.1 time: 0.517932 Nov 03 04:00:13.876301 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1125/2193] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:13 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:13.918271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:13.918919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:13.926035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.926534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.926979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:13.927704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:13.928181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:13.928605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.050698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:14.061691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf20d179-16a9-431b-b499-ebf19cdd5eae tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1283 microversion: 2.1 time: 0.147190 Nov 03 04:00:14.063133 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1126/2194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:13 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:14.068175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:14.069227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:14.076782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.077482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.078195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.079129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.080357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.081226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.217567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:14.254307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:14.267007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:14.268710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:14.275007 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4fec3561-90aa-45f4-9803-c091590affcf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1458 microversion: 2.91 time: 0.210700 Nov 03 04:00:14.286726 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1127/2195] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:14 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1458 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:14.292628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:14.296836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:14.305945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.306449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.307275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.307672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.308303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.308721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.345228 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1400480-989c-4ac5-879b-a38bc97938a3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067234 Nov 03 04:00:14.345693 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1128/2196] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:14 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:14.363204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:00:14.363702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:00:14.364440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:00:14.365048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:00:14.365474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:00:14.375973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.376701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.377269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.378205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.378669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.379981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.387656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:14.388611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:14.400023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:14.400711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.401340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.401906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.402902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.403439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.404502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.408189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Getting quotas for user baa7ebbbe2c14c82b5a07fef33cc214a and project 337f8c15ac624e38ba1ad67d77e8f725. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:14.427834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:00:14.431189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:00:14.510749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:14.522793 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f8048c5-ac92-4035-af95-4fa53356819f tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1253 microversion: 2.1 time: 0.140893 Nov 03 04:00:14.523381 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1129/2197] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:14 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1253 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:14.528398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:14.529037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:14.535215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.535722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.536152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.536851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.537334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.537758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.720264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3869d27f-e0f7-4a80-94a8-52efd8ce8d6d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233346 Nov 03 04:00:14.721521 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1069/2198] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:00:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:00:14.734137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c423249b-bfdc-4639-96c8-3f98ae689853 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:14.735029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c423249b-bfdc-4639-96c8-3f98ae689853 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:14.769842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:14.985431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:14.987638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c423249b-bfdc-4639-96c8-3f98ae689853 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:14.988730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e1f69d11-c905-4084-b91c-80e27f80d11a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.340730 Nov 03 04:00:14.988730 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1130/2199] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:14 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:14.989926 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c423249b-bfdc-4639-96c8-3f98ae689853 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1213 microversion: 2.1 time: 0.140119 Nov 03 04:00:14.989926 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1070/2200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:14 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1213 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:14.991053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.091758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:15.092375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:15.097299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:15.105744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.106397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.107288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.108478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.108998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.109485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.112953 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb59c22f-8fe5-4a85-93df-2ddba0a63e23 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1316 microversion: 2.1 time: 0.218462 Nov 03 04:00:15.118230 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1131/2201] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:14 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:15.276160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:15.285145 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2301d70a-4e83-4468-8063-d7906f95736d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.199001 Nov 03 04:00:15.288840 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1071/2202] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:15 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:15.305487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:15.306163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:15.314276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.317405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.317405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.317405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.317405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.317405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.359180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:15.363741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:15.369470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.370042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.370544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.371354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.371812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.372236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.393735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:15.402817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:15.404936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:15.410835 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65ad8221-3dc8-4e90-a47e-46627106554c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1458 microversion: 2.91 time: 0.109625 Nov 03 04:00:15.411952 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1132/2203] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:15 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1458 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:15.426482 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf31151a-0ea7-437d-8a85-0c97b9e13197 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070431 Nov 03 04:00:15.432558 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1072/2204] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:15 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:00:15.545352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:15.546123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:15.552717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.553261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.553708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.554430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:15.554869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:15.555298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:15.618965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:15.628575 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af2008f1-558d-4f72-8d22-4f15b408c29c tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1253 microversion: 2.1 time: 0.087209 Nov 03 04:00:15.629170 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1133/2205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:15 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:15.998210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:15.999608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:16.000131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:16.001600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:16.010769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.012694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.012694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.013861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.015501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.016041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.016223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.016492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.017348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.018016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.018154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.018526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.064907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:16.204427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:16.216219 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10fe92d1-68c4-427a-a39a-51be39f3c197 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1217 microversion: 2.1 time: 0.220105 Nov 03 04:00:16.217123 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1134/2206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:15 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:16.224226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:16.224846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:16.231549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.232047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.232630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.233269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.233679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.236835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.537936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:16.547454 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-376aafef-b112-4353-bb24-a7f3bd58a384 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.554661 Nov 03 04:00:16.561961 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1073/2207] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:15 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:16.567961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:16.571304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:16.574762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.575266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.575707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.576598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.577242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.577677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.595285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:16.634627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:16.641945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-59f02f5a-fe66-4963-83e8-64148a6aab7f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1465 microversion: 2.1 time: 0.422402 Nov 03 04:00:16.642819 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1135/2208] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:16 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1465 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:16.648103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:16.648744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:16.656154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.657456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.663235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.663235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.663235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.663235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.792330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:16.811386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:16.815356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:16.821727 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f7c8a7c-59d1-410c-951e-050eaa6c0b22 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1506 microversion: 2.91 time: 0.177791 Nov 03 04:00:16.822461 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1136/2209] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:16 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:16.828077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:16.836958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:16.853554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.854354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.854914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.857309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.857809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.859062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.909621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72b195e5-6928-4128-9e3d-50665282599e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.086005 Nov 03 04:00:16.916582 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1137/2210] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:00:16 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:16.938609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:16.940377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:16.948819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.948819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.949299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.950104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:16.950646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:16.951152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:16.972583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:17.002712 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1086a65a-c493-40d2-b1cd-d32a60b2ea6b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.421638 Nov 03 04:00:17.002712 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1074/2211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:16 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:17.002712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-118283324"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:17.006174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:17.020624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.024779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.027129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.027129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.027129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.027129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.117885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:17.128242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2dbb4c6-b164-4d34-8282-fcba39f58aea tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1253 microversion: 2.1 time: 0.214088 Nov 03 04:00:17.133807 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1138/2212] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:16 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1253 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:17.241252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:17.242879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:17.254481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.255199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.255903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.256864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.257457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.258173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.390238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:17.417590 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eea6c0b0-1f8d-49d6-9044-69ada3243387 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1209 microversion: 2.1 time: 0.177778 Nov 03 04:00:17.429039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1139/2213] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:17 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1209 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:17.574649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:17.575270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:17.583655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.584157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.584602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.585365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.585826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.586256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.657213 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f239d4d6-7e7e-4eed-bd71-1357a0feb4e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "POST /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99/action" status: 202 len: 0 microversion: 2.1 time: 0.665063 Nov 03 04:00:17.664434 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1075/2214] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:00:16 2022] POST /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:00:17.671569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0b01fc9c-8667-4ebe-9849-c9e4188bb149 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd421ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:17.748363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0b01fc9c-8667-4ebe-9849-c9e4188bb149 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 200 len: 1454 microversion: 2.1 time: 0.075947 Nov 03 04:00:17.748363 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1076/2215] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:17 2022] GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:17.748637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8cf71db9-042e-4765-b126-28123456e4eb req-c34d7133-3f4e-4744-8358-6f7ac8d2c492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f01a566-a0bd-43f8-944f-19c1027b5d02", "tag": "7820cb7c-9957-4620-823d-950195cdadaf"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:17.761556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8cf71db9-042e-4765-b126-28123456e4eb req-c34d7133-3f4e-4744-8358-6f7ac8d2c492 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.762257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8cf71db9-042e-4765-b126-28123456e4eb req-c34d7133-3f4e-4744-8358-6f7ac8d2c492 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.762858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8cf71db9-042e-4765-b126-28123456e4eb req-c34d7133-3f4e-4744-8358-6f7ac8d2c492 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.777994 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8cf71db9-042e-4765-b126-28123456e4eb req-c34d7133-3f4e-4744-8358-6f7ac8d2c492 service nova] Creating event network-changed:7820cb7c-9957-4620-823d-950195cdadaf for instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 on n-h1-854653-7 Nov 03 04:00:17.787024 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8cf71db9-042e-4765-b126-28123456e4eb req-c34d7133-3f4e-4744-8358-6f7ac8d2c492 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042707 Nov 03 04:00:17.788175 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1077/2216] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:17.851458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:17.861817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:17.861817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.861817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.861817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.861817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:17.861817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:17.861817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:17.865106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:17.874208 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bcc7b9ff-e5f4-48ff-a21b-5e9b9e3e9d22 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.304264 Nov 03 04:00:17.874931 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1140/2217] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:17 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:17.980079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:17.990061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:17.991616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:17.998739 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-294ebb36-ea92-4935-8ca5-75a9a5f3237a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1524 microversion: 2.91 time: 0.151413 Nov 03 04:00:17.999272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1078/2218] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:17 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1524 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:00:18.014124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:18.014802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:18.021719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.022213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.022662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:18.023372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.023832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.024267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:18.156289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:18.157567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:18.164702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.167657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.167657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:18.167657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.167657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.167657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:18.288215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:18.296756 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fb753df0-3cf7-469b-9b96-d05d539a6d88 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1253 microversion: 2.1 time: 0.144353 Nov 03 04:00:18.297479 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1079/2219] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:18 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1253 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:18.446207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:18.447854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:18.471406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.472341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.473776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:18.474761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.477122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.478043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:18.731183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:18.733855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:18.745642 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d3886a7-9c1b-4134-ba6f-edd054b3715c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1273 microversion: 2.1 time: 0.303319 Nov 03 04:00:18.746557 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1080/2220] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:18 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:18.758281 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-55b41394-b4cf-4249-97dd-df4e22d4be6d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.736394 Nov 03 04:00:18.758281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1141/2221] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:18 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:18.779028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-62ecbf0e-d37e-48ec-921e-e18a2afc50ce tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd564c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:18.856788 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-62ecbf0e-d37e-48ec-921e-e18a2afc50ce tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 200 len: 1454 microversion: 2.1 time: 0.100251 Nov 03 04:00:18.857781 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1142/2222] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:18 2022] GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:18.898699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:18.899708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:18.906884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.914048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.914048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:18.914048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:18.914048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:18.914048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.010535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ef97e266-fc75-4beb-902c-1bc43cc0fa11 req-a780ce72-ee33-4323-85f5-5b623f0e2abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59785d6-020a-45d0-ae18-48edbc2fc755", "name": "network-vif-plugged", "status": "completed", "tag": "91938d23-1465-4b5b-a8f2-318a3f7e1699"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:19.025424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ef97e266-fc75-4beb-902c-1bc43cc0fa11 req-a780ce72-ee33-4323-85f5-5b623f0e2abf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.026288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ef97e266-fc75-4beb-902c-1bc43cc0fa11 req-a780ce72-ee33-4323-85f5-5b623f0e2abf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.027481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ef97e266-fc75-4beb-902c-1bc43cc0fa11 req-a780ce72-ee33-4323-85f5-5b623f0e2abf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.043691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ef97e266-fc75-4beb-902c-1bc43cc0fa11 req-a780ce72-ee33-4323-85f5-5b623f0e2abf service nova] Creating event network-vif-plugged:91938d23-1465-4b5b-a8f2-318a3f7e1699 for instance f59785d6-020a-45d0-ae18-48edbc2fc755 on n-h1-854653-7 Nov 03 04:00:19.050721 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ef97e266-fc75-4beb-902c-1bc43cc0fa11 req-a780ce72-ee33-4323-85f5-5b623f0e2abf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044450 Nov 03 04:00:19.051963 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1143/2223] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:00:19.058366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:19.059377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:19.069496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.070226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.070871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.072073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.072721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.073373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.091551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:19.103929 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-49410758-5a7d-463b-81bd-d746e1db1ec8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.209745 Nov 03 04:00:19.107751 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1081/2224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:18 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:19.166279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:19.176265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:19.178076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:19.184449 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c51b11b-1f93-4ed3-87b1-eca8f552f5fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1512 microversion: 2.91 time: 0.131190 Nov 03 04:00:19.185049 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1144/2225] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:19 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1512 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:19.320243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:19.321100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:19.328156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.328660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.329134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.330052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.330699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.331308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.399859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:19.408790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-62cbe16f-29de-41ee-b2c0-8bb1a6fac624 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1253 microversion: 2.1 time: 0.093074 Nov 03 04:00:19.409418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1082/2226] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:19 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1253 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:19.772583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:19.773971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:19.781428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.782053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:19.782294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.782732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.783467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.783755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:19.783930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.784568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.790834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.796273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.796273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.796273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:19.796273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:19.796273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:19.906268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:19.916351 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90d18b34-17d3-4c7a-a173-96b315545813 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1283 microversion: 2.1 time: 0.147521 Nov 03 04:00:19.918902 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1145/2227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:19 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1283 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:19.924797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c73f28bf-ec15-426a-96cd-0adeec51539c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f9062700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:19.979384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:19.990928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de180bf5-052b-4553-8c92-be95efd8d71a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.212934 Nov 03 04:00:19.991935 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1083/2228] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:19 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:20.007265 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c73f28bf-ec15-426a-96cd-0adeec51539c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 200 len: 1454 microversion: 2.1 time: 0.082482 Nov 03 04:00:20.007908 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1146/2229] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:19 2022] GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:20.135608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:20.136878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:20.145689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.146669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.147747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:20.148964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.150726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.151878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:20.216268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:20.217171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:20.238180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.240133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.241371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:20.243489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.243972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.247020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:20.350149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:20.358500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:20.362619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:20.368465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36ef632b-2f26-4fb1-8893-b1ab809c6000 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1512 microversion: 2.91 time: 0.156403 Nov 03 04:00:20.369392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1147/2230] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:20 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:00:20.403164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:20.412841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2fa5f557-cf3d-423c-8010-c3d3527dea75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.284203 Nov 03 04:00:20.414159 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1084/2231] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:20 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:20.431945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:20.432732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:20.439331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.439991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.440506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:20.441646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.442503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.443048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:20.515586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:20.527170 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80972a50-129f-4cb5-83cd-89c169167884 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1253 microversion: 2.1 time: 0.098823 Nov 03 04:00:20.528339 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1148/2232] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:20 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1253 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:20.940751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:20.941393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:20.948272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.948967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.949430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:20.950375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:20.951282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:20.951877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.021706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:21.022887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:21.034941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.036023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.036586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.037421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.038088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.038730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.081040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:21.091730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d095ff7b-76eb-44f9-90c2-d7353c1f5578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1283 microversion: 2.1 time: 0.155687 Nov 03 04:00:21.093372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1085/2233] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:20 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1283 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:21.098634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e019e02-bd76-4890-a90a-63e2dcf87359 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f8bc21f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:21.227343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:21.237158 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b41678a1-1e5a-488e-9ab3-95f376b94b9e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.222872 Nov 03 04:00:21.237745 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1149/2234] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:21 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:21.399524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:21.400368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:21.413937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.415596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.416151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.419765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.421261 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7e019e02-bd76-4890-a90a-63e2dcf87359 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 200 len: 1454 microversion: 2.1 time: 0.324397 Nov 03 04:00:21.421740 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1086/2235] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:21 2022] GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 1454 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:21.425626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.427976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.451868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:21.452502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:21.476927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.477518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.477968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.480154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.480655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.481201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.551366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:21.561186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:21.563203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:21.568703 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68b1f653-acad-424e-85f5-997799d894bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1512 microversion: 2.91 time: 0.174245 Nov 03 04:00:21.581042 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1150/2236] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:21 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:21.581042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:21.581042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:21.593761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.595545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.602008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.606076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.608976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.611063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.697727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:21.698486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:21.699697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:21.704474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lazy-loading 'fault' on Instance uuid 87397ac1-d176-430d-b8ee-56755d8beca3 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:21.796885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:21.815756 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a48a3a87-319c-45d5-be94-60266ef29496 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.376271 Nov 03 04:00:21.816559 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1087/2237] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:21 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:21.839563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b95768d61a4e40f89aec9d956a4a7d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc47f0d35441a6a4df71a38f8eafc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:21.850897 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6962b375-bc77-4cb7-b2e9-310386b8c455 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 200 len: 1258 microversion: 2.1 time: 0.273816 Nov 03 04:00:21.863859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1151/2238] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:21 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 1258 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:22.131549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:22.137408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:22.150682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:22.151763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:22.153803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:22.157139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:22.157678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:22.158412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:22.262220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:22.263715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:22.272690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:22.273489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:22.274177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:22.279095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:22.279095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:22.279095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:22.753309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:22.771291 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7c319b2f-ea03-4ca5-b672-8b5f55e7a164 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1313 microversion: 2.1 time: 0.651068 Nov 03 04:00:22.772700 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1088/2239] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:22 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:22.791520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2ab0d6c-79e3-4c16-b6df-92aa7e096132 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd66c9d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:22.841441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:22.852080 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e1968f9-8f9b-420b-b501-92b141fe5d09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.593200 Nov 03 04:00:22.854183 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1152/2240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:22 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:22.879352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-df2b4fc9-306f-45ae-a529-4a8e580ed7e0 req-48e0b3f9-cb9d-4024-a432-429c4259c19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1547c889-73e4-4a6a-8925-439fba280d99", "name": "network-vif-plugged", "status": "completed", "tag": "8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:22.909434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-df2b4fc9-306f-45ae-a529-4a8e580ed7e0 req-48e0b3f9-cb9d-4024-a432-429c4259c19e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:22.911686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-df2b4fc9-306f-45ae-a529-4a8e580ed7e0 req-48e0b3f9-cb9d-4024-a432-429c4259c19e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:22.912621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-df2b4fc9-306f-45ae-a529-4a8e580ed7e0 req-48e0b3f9-cb9d-4024-a432-429c4259c19e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:22.947599 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-df2b4fc9-306f-45ae-a529-4a8e580ed7e0 req-48e0b3f9-cb9d-4024-a432-429c4259c19e service nova] Creating event network-vif-plugged:8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac for instance 1547c889-73e4-4a6a-8925-439fba280d99 on n-h2-854653-7 Nov 03 04:00:22.959190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-df2b4fc9-306f-45ae-a529-4a8e580ed7e0 req-48e0b3f9-cb9d-4024-a432-429c4259c19e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103551 Nov 03 04:00:22.962343 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1153/2241] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:22.979853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:22.981969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:22.996264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=42,nova_cell0:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:23.000628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:23.001380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:23.002065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:23.004647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:23.005595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:23.007169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:23.023541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:23.330932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:23.346102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:23.348096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:23.359244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07a35e79-13b3-48ec-8619-b525f4a1d22a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1533 microversion: 2.91 time: 0.390808 Nov 03 04:00:23.361338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1154/2242] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:22 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1533 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:23.372782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:23.373719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:23.387635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:23.389045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:23.391047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:23.395996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:23.399257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:23.399756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:23.763255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:23.798330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-149c02c2-1ac7-4f11-abfd-9bb680e8ac5a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1320 microversion: 2.1 time: 0.431581 Nov 03 04:00:23.799726 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1155/2243] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:23 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:23.811926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:23.817908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] [instance: 87397ac1-d176-430d-b8ee-56755d8beca3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:23.828374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:23.829401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:23.844961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:23.845876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:23.850311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:23.851586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:23.872999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] HTTP exception thrown: Instance 87397ac1-d176-430d-b8ee-56755d8beca3 could not be found. Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Request method failure captured: Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 HTTP/1.1 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzweY_ZuGnh8VKNg_4LoCr1BdZfePBfHa1hJiNyoz1ri5vL5L7owsSSyDlWGXBmewWxaCnvP0QEcrxKWhnapSflWDTqjKQeuZvh2-aqMfbLd_D4AkrWqczRRWZBEf1mHs8e4WqlOVgC3wt52FzKY2IxSLq6m8932_f81IlO3TH4NOAw Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f5cc47f0d35441a6a4df71a38f8eafc4 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestBootFromVolume-1432378890 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f5cc47f0d35441a6a4df71a38f8eafc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f5cc47f0d35441a6a4df71a38f8eafc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f5cc47f0d35441a6a4df71a38f8eafc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f5cc47f0d35441a6a4df71a38f8eafc4"}]}] Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestBootFromVolume-1432378890 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f5cc47f0d35441a6a4df71a38f8eafc4 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1432378890 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestBootFromVolume-1432378890-project Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b95768d61a4e40f89aec9d956a4a7d18 Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestBootFromVolume-1432378890-project Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 87397ac1-d176-430d-b8ee-56755d8beca3 could not be found. Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '87397ac1-d176-430d-b8ee-56755d8beca3'} Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87397ac1-d176-430d-b8ee-56755d8beca3 could not be found. Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87397ac1-d176-430d-b8ee-56755d8beca3 could not be found. Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:23.875042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:23.879484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:23.879484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:23.879484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:23.879484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:23.879484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:23.879484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87397ac1-d176-430d-b8ee-56755d8beca3 could not be found. Nov 03 04:00:23.879484 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:23.881037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Returning 404 to user: Instance 87397ac1-d176-430d-b8ee-56755d8beca3 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:23.885878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb9fbc9e-7e13-4914-bbd6-b4f63785f9e4 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3" status: 404 len: 111 microversion: 2.1 time: 0.080822 Nov 03 04:00:23.886353 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1156/2244] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:23 2022] GET /compute/v2.1/servers/87397ac1-d176-430d-b8ee-56755d8beca3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:24.008406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:24.009945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:24.045956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:24.070444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:24.070444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:24.070444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:24.070444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:24.070444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:24.298216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lazy-loading 'services' on Instance uuid bd3de980-af10-4017-b652-4be4a0c2a9df {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:24.389596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=18 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:24.666442 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-272f31da-3467-4de5-ab75-ee92e9673630 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1938 microversion: 2.91 time: 0.778765 Nov 03 04:00:24.667694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1157/2245] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:23 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1938 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:24.672675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:24.673480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:24.679754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:24.680391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:24.680828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:24.684172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:24.684172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:24.684172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:24.865186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=62 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:24.926360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:24.940000 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-677e9386-951c-4428-b8ed-11b6a7284578 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1313 microversion: 2.1 time: 0.271021 Nov 03 04:00:24.940582 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1158/2246] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:24 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:24.955194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:24.955784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:24.969612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:24.970047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:24.970499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:24.973326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:24.977393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:24.977393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.170849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:25.181835 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77a823ab-38b0-40b8-a8c0-04aa1a7e96bd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.239784 Nov 03 04:00:25.184205 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1159/2247] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:24 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:25.190206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ed4a5c6-5a11-49bd-832e-c6417bd91431 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] Calling method '.version_select at 0x7ff7fd4923a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:25.204183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:25.352306 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ed4a5c6-5a11-49bd-832e-c6417bd91431 tempest-ServersTestBootFromVolume-1432378890 tempest-ServersTestBootFromVolume-1432378890-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207748112" status: 202 len: 0 microversion: 2.1 time: 0.166849 Nov 03 04:00:25.353278 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1160/2248] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207748112 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:00:25.358694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:25.361566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:25.372506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:25.373166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:25.378995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.381833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:25.382533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:25.383195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.499570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lazy-loading 'services' on Instance uuid bd3de980-af10-4017-b652-4be4a0c2a9df {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:25.529239 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5ad1fc07-870f-41e2-a174-2419c4a5a8c5 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1938 microversion: 2.91 time: 0.174575 Nov 03 04:00:25.530154 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1161/2249] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:25 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1938 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:25.536220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:25.536220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:25.542691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:25.543207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:25.543637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.544356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:25.544814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:25.551682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.769123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:25.780835 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b568a421-4369-414a-9490-b01b5899e6c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1501 microversion: 2.1 time: 0.249405 Nov 03 04:00:25.794306 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1162/2250] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:25 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:25.811748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6ee83e45-6d75-4677-b2c3-2915516154d7 req-f5efd110-d6df-43c9-bc0a-68fe028dcb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67547679-067f-4736-93bd-945ea21d5b84", "tag": "f232a1d1-38d9-479b-8f03-e2c3e4e1c953"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:25.833324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6ee83e45-6d75-4677-b2c3-2915516154d7 req-f5efd110-d6df-43c9-bc0a-68fe028dcb0c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:25.834993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6ee83e45-6d75-4677-b2c3-2915516154d7 req-f5efd110-d6df-43c9-bc0a-68fe028dcb0c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:25.837088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6ee83e45-6d75-4677-b2c3-2915516154d7 req-f5efd110-d6df-43c9-bc0a-68fe028dcb0c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.888886 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6ee83e45-6d75-4677-b2c3-2915516154d7 req-f5efd110-d6df-43c9-bc0a-68fe028dcb0c service nova] Creating event network-changed:f232a1d1-38d9-479b-8f03-e2c3e4e1c953 for instance 67547679-067f-4736-93bd-945ea21d5b84 on n-h1-854653-7 Nov 03 04:00:25.890616 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6ee83e45-6d75-4677-b2c3-2915516154d7 req-f5efd110-d6df-43c9-bc0a-68fe028dcb0c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089103 Nov 03 04:00:25.891693 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1163/2251] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:25.898140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:25.903457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:25.903965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:25.904818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.905885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:25.907274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:25.907942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:25.982189 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86ddf514-18a2-48bb-bdfe-2c735a1345b6 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.089248 Nov 03 04:00:25.983186 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1164/2252] 10.222.0.30 () {60 vars in 1217 bytes} [Thu Nov 3 04:00:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:00:25.994210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:25.994969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:26.009256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:26.009256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:26.009256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:26.009256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:26.009693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:26.009983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:26.363519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:26.381458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16523ad0-0e57-42bc-aa77-95a18c85c18a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1501 microversion: 2.1 time: 0.396832 Nov 03 04:00:26.386335 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1165/2253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:25 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1501 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:26.397280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:26.398661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:26.409429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:26.410196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:26.411147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:26.412458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:26.413129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:26.414683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:26.696281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:26.705181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f34732e2-a957-4407-b153-d135d2a172bf tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1313 microversion: 2.1 time: 0.317239 Nov 03 04:00:26.705765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1166/2254] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:26 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:26.712665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:26.727396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:26.743742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:26.744512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:26.745191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:26.746134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:26.746604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:26.747289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:26.803228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lazy-loading 'flavor' on Instance uuid bd3de980-af10-4017-b652-4be4a0c2a9df {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:32.145303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=35 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:32.759771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:35.924482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:36.741832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:37.217826 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2ab0d6c-79e3-4c16-b6df-92aa7e096132 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 200 len: 1454 microversion: 2.1 time: 14.443907 Nov 03 04:00:37.221056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1089/2255] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:22 2022] GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 1454 bytes in 14445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:37.223398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:37.224020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:37.230592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.231200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.231651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.232384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.232844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.233441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.352312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:37.383214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:37.396658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a49346b-0b0e-4eb9-87fa-0d6fc259d899 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.176728 Nov 03 04:00:37.399654 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1090/2256] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:37 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:37.412756 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef887ba5-353a-4697-a062-1b2d58d781df tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action" status: 202 len: 0 microversion: 2.91 time: 10.703667 Nov 03 04:00:37.413615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:37.414180 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1167/2257] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:00:26 2022] POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action => generated 0 bytes in 10708 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:37.414506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:37.425295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:37.426016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:37.433213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.435956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.436213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.436330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.436531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.436633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.436781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.436870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.436870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.437573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.438792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.439416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.468467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:00:37.605331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:37.614241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a220322-0613-48d7-aace-2da8dd1296a7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1313 microversion: 2.1 time: 0.196849 Nov 03 04:00:37.614889 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1168/2258] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:37 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:37.620527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e018645a-befa-4b5b-b907-35df01715424 req-27c5e86a-c727-443b-9ee5-afc06119909c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f01a566-a0bd-43f8-944f-19c1027b5d02", "name": "network-vif-plugged", "status": "completed", "tag": "7820cb7c-9957-4620-823d-950195cdadaf"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:37.630756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e018645a-befa-4b5b-b907-35df01715424 req-27c5e86a-c727-443b-9ee5-afc06119909c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.631250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e018645a-befa-4b5b-b907-35df01715424 req-27c5e86a-c727-443b-9ee5-afc06119909c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.631690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e018645a-befa-4b5b-b907-35df01715424 req-27c5e86a-c727-443b-9ee5-afc06119909c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.644434 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e018645a-befa-4b5b-b907-35df01715424 req-27c5e86a-c727-443b-9ee5-afc06119909c service nova] Creating event network-vif-plugged:7820cb7c-9957-4620-823d-950195cdadaf for instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 on n-h1-854653-7 Nov 03 04:00:37.649346 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e018645a-befa-4b5b-b907-35df01715424 req-27c5e86a-c727-443b-9ee5-afc06119909c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032391 Nov 03 04:00:37.650472 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1169/2259] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:37.655563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:37.656270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:37.663287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.663782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.664228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.665406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:37.665406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:37.665849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:37.739618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:37.752989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:37.756938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:37.762759 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8cbfd949-60ca-4ae0-88f9-9fa2f0fdfa45 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.111094 Nov 03 04:00:37.764289 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1170/2260] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:37 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:38.070657 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9e057d4b-690e-46ed-90a7-2427e95ccf8d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 204 len: 0 microversion: 2.1 time: 0.660518 Nov 03 04:00:38.074565 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1091/2261] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:37 2022] DELETE /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:38.080165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:38.080796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:38.088402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.088897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.089549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.090267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.090873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.091312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.232877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:38.238604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6bdb345-d6f9-4c2f-b288-e5b716b517d2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f91f68b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:38.242391 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83bb6268-e02a-48b9-b0ec-0481394b4cec tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1507 microversion: 2.1 time: 0.166133 Nov 03 04:00:38.242988 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1171/2262] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:38 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:38.296608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6bdb345-d6f9-4c2f-b288-e5b716b517d2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 200 len: 1463 microversion: 2.1 time: 0.065882 Nov 03 04:00:38.297196 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1092/2263] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:38 2022] GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 1463 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:38.311264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d46e5a2-ae5a-4a01-a1e8-5410f4355967 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5aaca0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:38.360971 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d46e5a2-ae5a-4a01-a1e8-5410f4355967 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 200 len: 1463 microversion: 2.1 time: 0.053514 Nov 03 04:00:38.369613 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1172/2264] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:38 2022] GET /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 1463 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:38.376127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:38.376864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:38.383915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.384500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.384824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.385557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.386013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.386438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.429934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:38.430479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:38.437742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.438868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.439540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.440277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.440724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.441193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.585628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:38.594795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f0ef06db-790b-4633-9bec-f331811bfac9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1465 microversion: 2.1 time: 0.222088 Nov 03 04:00:38.595496 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1093/2265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:38 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:38.613448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:38.622185 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ead3207-137c-4f2e-8b04-611321184ff5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.196113 Nov 03 04:00:38.622474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1230210254"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:38.622992 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1173/2266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:38 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:38.625684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:38.632350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.634674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.634674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.634674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.635081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.635611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.639037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:38.639970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:38.648150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.648674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.649231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.650182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.650809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.651246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.830846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:38.842082 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42650e35-9fbe-4b66-9657-526f1ec5dd3e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1313 microversion: 2.1 time: 0.208034 Nov 03 04:00:38.843006 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1174/2267] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:38 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:38.861637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:38.862389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:38.870419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.871066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.871627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.872494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:38.873079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:38.873609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:38.973599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:38.986773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:38.988827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:39.006811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a682726d-7b4b-4fbc-ba14-f5b4283ba5cf tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.151078 Nov 03 04:00:39.014016 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1175/2268] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:38 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:39.257323 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6079fc9-4dba-4924-86d8-d70169be2cc4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "POST /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d/action" status: 202 len: 0 microversion: 2.1 time: 0.639009 Nov 03 04:00:39.258961 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1094/2269] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:00:38 2022] POST /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:00:39.267688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:39.272237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:39.286001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:39.286526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:39.286976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:39.288094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5659dbfe-6995-449c-a6a0-e5a6135f21ec tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4d9f70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:39.291256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:39.291738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:39.303149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:39.345241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5659dbfe-6995-449c-a6a0-e5a6135f21ec tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.067953 Nov 03 04:00:39.347186 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1095/2270] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:39 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:39.503280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:39.513488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ea715269-b836-4619-b1ce-80df1fbbd461 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1507 microversion: 2.1 time: 0.250541 Nov 03 04:00:39.515111 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1176/2271] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:39 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:39.648476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:39.649601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:39.657309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:39.658075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:39.658697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:39.659583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:39.660190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:39.660777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:39.700470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c93e7531-6b33-45ce-ac8c-ba0c7cb63fc9 req-6a3efa44-afbe-4a87-aefc-503614a51582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67547679-067f-4736-93bd-945ea21d5b84", "name": "network-vif-plugged", "status": "completed", "tag": "f232a1d1-38d9-479b-8f03-e2c3e4e1c953"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:39.712269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c93e7531-6b33-45ce-ac8c-ba0c7cb63fc9 req-6a3efa44-afbe-4a87-aefc-503614a51582 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:39.713240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c93e7531-6b33-45ce-ac8c-ba0c7cb63fc9 req-6a3efa44-afbe-4a87-aefc-503614a51582 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:39.713863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c93e7531-6b33-45ce-ac8c-ba0c7cb63fc9 req-6a3efa44-afbe-4a87-aefc-503614a51582 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:39.728653 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c93e7531-6b33-45ce-ac8c-ba0c7cb63fc9 req-6a3efa44-afbe-4a87-aefc-503614a51582 service nova] Creating event network-vif-plugged:f232a1d1-38d9-479b-8f03-e2c3e4e1c953 for instance 67547679-067f-4736-93bd-945ea21d5b84 on n-h1-854653-7 Nov 03 04:00:39.736644 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c93e7531-6b33-45ce-ac8c-ba0c7cb63fc9 req-6a3efa44-afbe-4a87-aefc-503614a51582 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039804 Nov 03 04:00:39.737611 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1177/2272] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:00:39.867290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:39.868185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:39.886493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:39.889337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:39.889337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:39.889337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:39.889337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:39.892997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:40.302126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:40.316317 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89cfac06-0229-4c38-983e-79d5e9c02dcd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1325 microversion: 2.1 time: 0.672241 Nov 03 04:00:40.316908 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1096/2273] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:39 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1325 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:40.323322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:40.323935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:40.339771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:40.340348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:40.340862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:40.341718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:40.342465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:40.342962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:40.458990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:40.467946 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-06a797f2-5ac4-4aa6-99ab-0e90815c86f4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1313 microversion: 2.1 time: 0.604960 Nov 03 04:00:40.468534 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1178/2274] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:39 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:40.474259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fee4522d-47c3-4def-a63d-4d4c177d07e9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5aaee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:40.475649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:40.502236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:40.507102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:40.522901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bda56172-d84c-47ce-a686-89d39dc6f799 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.204730 Nov 03 04:00:40.525835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1097/2275] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:40 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:40.550858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:40.551739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:40.559868 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fee4522d-47c3-4def-a63d-4d4c177d07e9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.089379 Nov 03 04:00:40.560973 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1179/2276] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:40 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:40.573328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:40.574627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:40.575230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:40.576243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:40.579197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:40.579885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:40.918839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:40.928875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-95eaad21-2d9b-4dfb-920a-0e0958976ad1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1507 microversion: 2.1 time: 0.391564 Nov 03 04:00:40.941732 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1098/2277] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:40 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1507 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:41.260462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-18d47f64-0f7e-4537-8a2a-834d691a5d3a req-559b7e68-dcc1-45dd-bec8-09f8729bd63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59785d6-020a-45d0-ae18-48edbc2fc755", "name": "network-vif-deleted", "tag": "91938d23-1465-4b5b-a8f2-318a3f7e1699"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:41.278752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-18d47f64-0f7e-4537-8a2a-834d691a5d3a req-559b7e68-dcc1-45dd-bec8-09f8729bd63e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.279616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-18d47f64-0f7e-4537-8a2a-834d691a5d3a req-559b7e68-dcc1-45dd-bec8-09f8729bd63e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.280219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-18d47f64-0f7e-4537-8a2a-834d691a5d3a req-559b7e68-dcc1-45dd-bec8-09f8729bd63e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.295544 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-18d47f64-0f7e-4537-8a2a-834d691a5d3a req-559b7e68-dcc1-45dd-bec8-09f8729bd63e service nova] Creating event network-vif-deleted:91938d23-1465-4b5b-a8f2-318a3f7e1699 for instance f59785d6-020a-45d0-ae18-48edbc2fc755 on n-h1-854653-7 Nov 03 04:00:41.302552 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-18d47f64-0f7e-4537-8a2a-834d691a5d3a req-559b7e68-dcc1-45dd-bec8-09f8729bd63e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044988 Nov 03 04:00:41.309462 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1180/2278] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:41.348398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:41.350619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:41.365505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.366275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.366943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.367826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.369103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.369707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.492931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:41.493698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:41.525219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.525924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.530728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.530728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.530728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.530728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.578869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:41.589050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc50e862-1cd8-488b-b508-555741720f10 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1522 microversion: 2.1 time: 0.248522 Nov 03 04:00:41.630921 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1099/2279] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:41 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:41.643301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:41.652135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:41.663444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.664019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.668025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.669367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.670018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.670779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.725860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:41.734795 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-456cf9df-bbb1-46a6-910e-2b593006fe9a tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1313 microversion: 2.1 time: 0.246348 Nov 03 04:00:41.735863 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1181/2280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:41 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:41.749919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4161a98-b526-441d-b67b-4608510260c0 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd564af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:41.787872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:41.826481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:41.828054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:41.831071 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d4161a98-b526-441d-b67b-4608510260c0 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.093963 Nov 03 04:00:41.834847 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1182/2281] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:41 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:41.861907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:41.865043 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a33b50e0-ece8-422a-8885-3032fe92c465 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.226844 Nov 03 04:00:41.867808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:41.868611 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1100/2282] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:41 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:41.898858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.900862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.902058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.903578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.904484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:41.905431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:41.959938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:41.964281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:41.999197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:41.999905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:42.001523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:42.003025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:42.004620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:42.009056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:42.128101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:42.129095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:42.129778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:42.131357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lazy-loading 'fault' on Instance uuid f59785d6-020a-45d0-ae18-48edbc2fc755 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:42.220892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:42.288388 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dcc763d8-074c-4908-b05d-018ea2da19b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 200 len: 1310 microversion: 2.1 time: 0.336448 Nov 03 04:00:42.289379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1101/2283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:41 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 1310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:42.408010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:42.439060 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-299e4479-7ab6-4066-81c2-0186f2cbb9a5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1522 microversion: 2.1 time: 0.601337 Nov 03 04:00:42.440384 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1183/2284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:41 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:42.470398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1329995483"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:42.486569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:42.498030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:42.499428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:42.500047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:42.501057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:42.501812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:42.502765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:42.762887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:42.764161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:42.778639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:42.779425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:42.780028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:42.780913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:42.781615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:42.786960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:43.079296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:43.090938 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3aefbe16-6821-477c-ace2-8f5857517348 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1500 microversion: 2.1 time: 0.331412 Nov 03 04:00:43.103626 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1184/2285] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:42 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1500 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:43.125860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef6a0652-ce71-46a6-8f0d-2ac7cbe8760c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd564790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:43.153145 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f9e4d3f-550d-4154-aa6f-2561ef1d8ac7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02/action" status: 202 len: 0 microversion: 2.1 time: 0.687601 Nov 03 04:00:43.155616 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1102/2286] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:00:42 2022] POST /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:00:43.167463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:43.169707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:43.183465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:43.190744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:43.191487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:43.192980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:43.193750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:43.194862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:43.221991 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef6a0652-ce71-46a6-8f0d-2ac7cbe8760c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.109014 Nov 03 04:00:43.230336 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1185/2287] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:43 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:43.234006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:43.235172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:43.254171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:43.255774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:43.257625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:43.258428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:43.258912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:43.259359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:43.382014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lazy-loading 'flavor' on Instance uuid 67547679-067f-4736-93bd-945ea21d5b84 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:43.391298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:43.395523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:43.416995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:43.438639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:43.460913 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a8b15ec5-7598-4eac-bad0-33105ce5c92e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.302521 Nov 03 04:00:43.473233 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1103/2288] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:43 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:43.486934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-834e6aa3-63ad-48a8-92e8-c77384625d97 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '.version_select at 0x7ff7f8b67820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:43.895851 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e203e52-b8be-46fe-96ba-d077d2fc4af8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "POST /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84/action" status: 202 len: 0 microversion: 2.1 time: 0.670201 Nov 03 04:00:43.898492 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1186/2289] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:00:43 2022] POST /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:00:43.925990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b368ee7f-2670-47f3-a6ea-bdd755a68cff req-e4b1871d-fef7-4d09-9638-c3817630143d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1547c889-73e4-4a6a-8925-439fba280d99", "name": "network-vif-unplugged", "status": "completed", "tag": "8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:43.947196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b368ee7f-2670-47f3-a6ea-bdd755a68cff req-e4b1871d-fef7-4d09-9638-c3817630143d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:43.969848 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-834e6aa3-63ad-48a8-92e8-c77384625d97 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354" status: 204 len: 0 microversion: 2.1 time: 0.495392 Nov 03 04:00:43.976192 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1104/2290] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:43 2022] DELETE /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:43.979830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b368ee7f-2670-47f3-a6ea-bdd755a68cff req-e4b1871d-fef7-4d09-9638-c3817630143d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:43.982193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b368ee7f-2670-47f3-a6ea-bdd755a68cff req-e4b1871d-fef7-4d09-9638-c3817630143d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:43.986247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:43.986887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:44.016368 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b368ee7f-2670-47f3-a6ea-bdd755a68cff req-e4b1871d-fef7-4d09-9638-c3817630143d service nova] Creating event network-vif-unplugged:8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac for instance 1547c889-73e4-4a6a-8925-439fba280d99 on n-h2-854653-7 Nov 03 04:00:44.017617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.018128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.018594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.032689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.032689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.032689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.056361 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b368ee7f-2670-47f3-a6ea-bdd755a68cff req-e4b1871d-fef7-4d09-9638-c3817630143d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154495 Nov 03 04:00:44.059497 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1187/2291] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:44.074458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 HTTP/1.1 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f59785d6-020a-45d0-ae18-48edbc2fc755'} Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:44.080267 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.086268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:44.086737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:44.086737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:44.096289 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c0e8bca-d2aa-4f60-b631-301cf97c5475 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 404 len: 111 microversion: 2.1 time: 0.104729 Nov 03 04:00:44.098319 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1105/2292] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:43 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:44.106305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.111882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.112487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.113929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8105b549-a789-4d97-88d2-8051c3d1af39 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '.version_select at 0x7ff7fd4790d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:44.114808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.115327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.115748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.166402 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-8105b549-a789-4d97-88d2-8051c3d1af39 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Image not found. Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8105b549-a789-4d97-88d2-8051c3d1af39 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354 HTTP/1.1 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a4d705d7-3486-4379-8a65-afc643c20354'} Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a4d705d7-3486-4379-8a65-afc643c20354 Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 04:00:44.169285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4d705d7-3486-4379-8a65-afc643c20354 could not be found. Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:44.173690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8105b549-a789-4d97-88d2-8051c3d1af39 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:44.178454 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8105b549-a789-4d97-88d2-8051c3d1af39 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354" status: 404 len: 62 microversion: 2.1 time: 0.073014 Nov 03 04:00:44.178454 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1106/2293] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:44 2022] GET /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:00:44.188769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51f98118-b241-42b9-9697-0bfa60528387 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: .version_select at 0x7ff7f8bc2940>, body: {"keypair": {"name": "tempest-key-267894292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+xR7vtGy+0Tkf8T4QsB2eeKrV5jYk0GDOwu5OQMXaR3zpuT+pwbhjJRDIqlQC6IU8RHFBVCLTUQ8ZEPPNl8YcM9k63oZJ0euUJwKdw6vHoQwx2rjmaLi5Q5xPmngOCBQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:44.221574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-51f98118-b241-42b9-9697-0bfa60528387 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:44.230675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-51f98118-b241-42b9-9697-0bfa60528387 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:44.356801 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51f98118-b241-42b9-9697-0bfa60528387 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.181162 Nov 03 04:00:44.357702 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1107/2294] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:00:44 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:44.363114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:44.363745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:44.368103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:44.378399 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-238e8ab2-74dd-4d98-9cfc-cd29ac01c293 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1508 microversion: 2.1 time: 0.317454 Nov 03 04:00:44.380050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1188/2295] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:44 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:44.382533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.385986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.385986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.385986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.385986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.385986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.386359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5691f51e-7230-4248-9bd8-2348e6f720d0 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd597280>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:44.471528 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5691f51e-7230-4248-9bd8-2348e6f720d0 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.090154 Nov 03 04:00:44.472175 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1189/2296] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:44 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:44.491442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4579bbb3-3273-4f1f-8c38-e42e5001b14e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '.version_select at 0x7ff7fd59e8b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:44.498464 n-d-854653-7 devstack@n-api.service[127594]: WARNING oslo_db.sqlalchemy.utils [None req-4579bbb3-3273-4f1f-8c38-e42e5001b14e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 03 04:00:44.514005 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4579bbb3-3273-4f1f-8c38-e42e5001b14e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.036933 Nov 03 04:00:44.519414 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1190/2297] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:00:44 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:44.539809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:44.544228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:44.578905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.579657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.579921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.582821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:44.583336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:44.583776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:44.621350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:44.717163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:44.727846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:44.738158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:44.747328 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-11962600-86bb-459e-9d9c-a48ce8172ddc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.221850 Nov 03 04:00:44.751046 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1191/2298] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:44 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:44.757739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1825803567", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-key-267894292", "networks": [{"uuid": "1f101308-9db8-4b30-b5f1-954d8d42482e"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:44.784105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:44.797507 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be2aec05-ef91-4a76-8fb1-90b700bf0482 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1534 microversion: 2.1 time: 0.434278 Nov 03 04:00:44.797507 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1108/2299] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:44 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1534 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:44.844875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:00:45.419120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:45.419812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:45.432523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:45.433119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:45.438365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:45.439196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:45.439693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:45.440142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:45.750495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:00:45.752444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:00:45.753205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:00:45.753895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:00:45.754831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:00:45.780126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:45.783300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:45.783897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:45.784997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:45.788724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:45.790896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:45.797080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:45.806812 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b1594a9-ecf9-4679-b1c2-87d8ecf29ffa tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1491 microversion: 2.1 time: 0.391177 Nov 03 04:00:45.808000 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1109/2300] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:45 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1491 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:45.827217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-63498126-70d5-4570-a47b-cbbbbde89a81 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd49e9d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:45.836268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:45.846811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:45.863475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:00:45.867626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:00:45.915656 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-63498126-70d5-4570-a47b-cbbbbde89a81 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.106350 Nov 03 04:00:45.919386 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1110/2301] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:45 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:45.943012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:45.943749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:45.958671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:45.959968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:45.961200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:45.962140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:45.963752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:45.965326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:46.117724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:46.152285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:46.175132 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80ea6e24-1aa1-46dd-b7f0-76dd3f4b255f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421010 Nov 03 04:00:46.175603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:46.175786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1192/2302] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:00:46.187394 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f16d2d86-f16e-42c1-a5f2-b21fcab1c6af tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.266619 Nov 03 04:00:46.189727 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1111/2303] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:45 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:46.195570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:46.196391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:46.203297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:46.204086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:46.207467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:46.209068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:46.209729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:46.221464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:46.235414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:46.235414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:46.235815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:46.235815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:46.235815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:46.235815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:46.243818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:46.244374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:46.331492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:00:46.704948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:46.724736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b9e1a26-3567-4a85-a2fc-9a55f421f675 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1540 microversion: 2.1 time: 0.522798 Nov 03 04:00:46.736215 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1193/2304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:46 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1540 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:46.758592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61d9e518-202f-43a1-a9c1-d1953db016ea tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:46.759775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61d9e518-202f-43a1-a9c1-d1953db016ea tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:46.859998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-61d9e518-202f-43a1-a9c1-d1953db016ea tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:46.874622 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61d9e518-202f-43a1-a9c1-d1953db016ea tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1228 microversion: 2.1 time: 0.124187 Nov 03 04:00:46.876386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1194/2305] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:46 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1228 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:46.940391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee0b16e4-f6ba-432e-8afc-e6c509feafb4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5645e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:46.974194 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f15bfba2-bae6-405f-ba2b-5e939c641efe tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 204 len: 0 microversion: 2.1 time: 0.782193 Nov 03 04:00:46.976527 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1112/2306] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:46 2022] DELETE /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:46.986386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:46.987369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:47.002826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:47.003595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:47.011925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:47.012773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:47.016734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:47.017250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:47.036804 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee0b16e4-f6ba-432e-8afc-e6c509feafb4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.104215 Nov 03 04:00:47.037811 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1195/2307] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:46 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:47.262882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:47.289467 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f42fa282-0844-4c5a-ab5c-55ed2ec30ee5 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1497 microversion: 2.1 time: 0.306031 Nov 03 04:00:47.289467 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1113/2308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:46 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1497 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:47.301970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:47.304794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:47.329861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:47.330508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:47.331155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:47.332666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:47.333314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:47.333783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:47.336550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3caadd69-0dbf-4175-a119-18f1f4f78783 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Action: 'create', calling method: .version_select at 0x7ff7fd5aae50>, body: {"keypair": {"name": "tempest-keypair-2088626782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKMUUONZXmMZ3ZYvgD1X1xgZe7KH3iEqUWrEM1XVACFH6iIcXWz10SbzFD2I7XV42nU/H5g8GqSBlRMDOQBWpatTiIMcWOLEgRrUoePepQvE7NfSE+l6FtQDeDU3zv5bw=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:47.380697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-3caadd69-0dbf-4175-a119-18f1f4f78783 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Getting quotas for project ce056d754ef1484f9bd20656daba2813. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:47.396309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-3caadd69-0dbf-4175-a119-18f1f4f78783 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Getting quotas for user 783d7e87604342bd9b0ea39a7d28234f and project ce056d754ef1484f9bd20656daba2813. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:47.477787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:47.495404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:47.499010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:47.511547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b6ae79b-b609-465b-8c1a-5ee9fb7224a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.220026 Nov 03 04:00:47.513932 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1114/2309] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:47 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:47.520709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-918f9c21-b7d9-4c6d-9300-7dd0bd576a99 req-6647ea70-dda7-44e7-af38-90a8a64a26d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60129a1a-b160-4e7e-a855-dd553c4acf5d", "name": "network-vif-plugged", "status": "completed", "tag": "08ee2daa-805b-4703-9a93-903066d40144"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:47.538201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-918f9c21-b7d9-4c6d-9300-7dd0bd576a99 req-6647ea70-dda7-44e7-af38-90a8a64a26d2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:47.538201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-918f9c21-b7d9-4c6d-9300-7dd0bd576a99 req-6647ea70-dda7-44e7-af38-90a8a64a26d2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:47.538201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-918f9c21-b7d9-4c6d-9300-7dd0bd576a99 req-6647ea70-dda7-44e7-af38-90a8a64a26d2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:47.580983 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3caadd69-0dbf-4175-a119-18f1f4f78783 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.531877 Nov 03 04:00:47.581696 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1196/2310] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:00:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:47.583954 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-918f9c21-b7d9-4c6d-9300-7dd0bd576a99 req-6647ea70-dda7-44e7-af38-90a8a64a26d2 service nova] Creating event network-vif-plugged:08ee2daa-805b-4703-9a93-903066d40144 for instance 60129a1a-b160-4e7e-a855-dd553c4acf5d on n-h2-854653-7 Nov 03 04:00:47.601403 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-918f9c21-b7d9-4c6d-9300-7dd0bd576a99 req-6647ea70-dda7-44e7-af38-90a8a64a26d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085870 Nov 03 04:00:47.604865 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1115/2311] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:47.753893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:47.754665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:47.764820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:47.766926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:47.767726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:47.769271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:47.770151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:47.771159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:47.902366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d263f20-762d-470c-9e26-758e7adf5df8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:47.903373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d263f20-762d-470c-9e26-758e7adf5df8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:48.077904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d263f20-762d-470c-9e26-758e7adf5df8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:48.085044 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d263f20-762d-470c-9e26-758e7adf5df8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1228 microversion: 2.1 time: 0.187068 Nov 03 04:00:48.091946 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1116/2312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:47 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1228 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:48.098960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20cb1c2c-6438-4056-b768-018722d42b90 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f8be9940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:48.163030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:48.176024 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d67aa21-3448-41a8-9b55-01cdd2219812 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1540 microversion: 2.1 time: 0.426531 Nov 03 04:00:48.177235 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1197/2313] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:47 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1540 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:48.201541 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20cb1c2c-6438-4056-b768-018722d42b90 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.106998 Nov 03 04:00:48.202630 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1117/2314] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:48 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:48.316370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:48.317783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:48.329347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:48.330155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:48.330877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:48.331787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:48.332551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:48.333410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:48.547183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:48.548078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:48.562622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:48.564058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:48.565743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:48.566740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:48.569294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:48.571760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:48.572048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:48.588279 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5db7ec31-062d-4c8e-b088-e76a4bc4dfae tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1497 microversion: 2.1 time: 0.277810 Nov 03 04:00:48.590388 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1198/2315] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:48 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:48.742303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:48.752914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:48.752914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:48.773776 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abef1fb6-8864-4333-8712-52518073068a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.232097 Nov 03 04:00:48.774778 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1118/2316] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:48 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:00:49.140877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:49.148478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:49.205541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:49.207070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:49.233653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.238155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.246467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.254703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.255442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.256376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.256680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.262929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.267329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.268012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.274200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.278560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.520420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:49.531278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a856ef6b-5525-41ee-b654-091e60024c42 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1280 microversion: 2.1 time: 0.423903 Nov 03 04:00:49.534788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1199/2317] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:49 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1280 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:49.542953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84ef0433-1490-476d-9c83-833f3fa124e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd539790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:49.643565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84ef0433-1490-476d-9c83-833f3fa124e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.106001 Nov 03 04:00:49.644857 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1200/2318] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:49 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:49.657224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:49.662633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:49.667083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:49.673511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.674255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.674874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.676404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.677075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.677732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.678313 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d2c751e-4006-4f1e-85d4-8df0b9cf841f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1540 microversion: 2.1 time: 0.478899 Nov 03 04:00:49.688611 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1119/2319] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:49 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1540 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:49.751921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9383d405-3f73-4f18-934c-7304f8d17e20 req-0515956c-721a-44c2-8d7e-6144fdcdc14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f01a566-a0bd-43f8-944f-19c1027b5d02", "name": "network-vif-plugged", "status": "completed", "tag": "7820cb7c-9957-4620-823d-950195cdadaf"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:49.773381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9383d405-3f73-4f18-934c-7304f8d17e20 req-0515956c-721a-44c2-8d7e-6144fdcdc14d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.773558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9383d405-3f73-4f18-934c-7304f8d17e20 req-0515956c-721a-44c2-8d7e-6144fdcdc14d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.776711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9383d405-3f73-4f18-934c-7304f8d17e20 req-0515956c-721a-44c2-8d7e-6144fdcdc14d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.798097 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9383d405-3f73-4f18-934c-7304f8d17e20 req-0515956c-721a-44c2-8d7e-6144fdcdc14d service nova] Creating event network-vif-plugged:7820cb7c-9957-4620-823d-950195cdadaf for instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 on n-h1-854653-7 Nov 03 04:00:49.810360 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9383d405-3f73-4f18-934c-7304f8d17e20 req-0515956c-721a-44c2-8d7e-6144fdcdc14d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062857 Nov 03 04:00:49.812725 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1120/2320] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:49.819256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:49.820475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:49.830885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.831606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.832213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:49.845465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:49.846470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:49.848757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:50.221606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:50.238650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:50.240107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:50.260705 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ee3fae7-5dff-4620-b4a2-d9cd3e358ae4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.440496 Nov 03 04:00:50.260868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:50.265141 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1121/2321] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:49 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:50.271485 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e1ad1c3b-89d5-408b-b652-ab57a381777c tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1497 microversion: 2.1 time: 0.623879 Nov 03 04:00:50.292998 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1201/2322] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:49 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1497 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:50.561679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:50.563139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:50.583170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:50.584113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:50.584709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:50.585721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:50.586503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:50.592198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:50.662272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-861bac1b-a28c-4f8e-9784-7c5e59f6d348 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd492550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:50.706162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:50.714932 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7f2c15c-3f2a-4de6-8c62-38de371ef2e4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1280 microversion: 2.1 time: 0.157278 Nov 03 04:00:50.716801 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1122/2323] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:50 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:50.721674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:50.722499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:50.732166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:50.732737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:50.733222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:50.734199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:50.734724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:50.735161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:50.741388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-861bac1b-a28c-4f8e-9784-7c5e59f6d348 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.085199 Nov 03 04:00:50.741969 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1202/2324] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:50 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:50.879626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:50.887481 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f4e1d955-a678-47e7-bfc4-e08f77a39085 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1540 microversion: 2.1 time: 0.169374 Nov 03 04:00:50.888056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1123/2325] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:50 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1540 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:51.202499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0a53129b-4cf9-4b69-abcb-0b6b2843c272 req-2b29746d-3e56-494e-8463-fe4c44aee269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67547679-067f-4736-93bd-945ea21d5b84", "name": "network-vif-deleted", "tag": "f232a1d1-38d9-479b-8f03-e2c3e4e1c953"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:51.218992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a53129b-4cf9-4b69-abcb-0b6b2843c272 req-2b29746d-3e56-494e-8463-fe4c44aee269 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.218992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a53129b-4cf9-4b69-abcb-0b6b2843c272 req-2b29746d-3e56-494e-8463-fe4c44aee269 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.218992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a53129b-4cf9-4b69-abcb-0b6b2843c272 req-2b29746d-3e56-494e-8463-fe4c44aee269 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.250024 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0a53129b-4cf9-4b69-abcb-0b6b2843c272 req-2b29746d-3e56-494e-8463-fe4c44aee269 service nova] Creating event network-vif-deleted:f232a1d1-38d9-479b-8f03-e2c3e4e1c953 for instance 67547679-067f-4736-93bd-945ea21d5b84 on n-h1-854653-7 Nov 03 04:00:51.287127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0a53129b-4cf9-4b69-abcb-0b6b2843c272 req-2b29746d-3e56-494e-8463-fe4c44aee269 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088758 Nov 03 04:00:51.298938 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1203/2326] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:51.299043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:51.299043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:51.306546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:51.307284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:51.310786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.311516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.312933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.313910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.315568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.316070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.316240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.316517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.316851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.317262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.317733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.318301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.518015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:51.522035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:51.567925 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a964ad1-1faa-4603-8dbe-c4da9192f88e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1455 microversion: 2.1 time: 0.270815 Nov 03 04:00:51.569708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:51.572727 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1204/2327] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:51 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1455 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:51.575372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:51.590608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:51.602232 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-13bfd51f-63eb-4976-976c-922d64313e12 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.313173 Nov 03 04:00:51.620212 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1124/2328] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:51 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:51.742553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:51.750459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:51.752658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.753399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.754029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.754952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.755572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.756161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.758620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ff24c23-b9f6-417f-9828-6c0c7b80283b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd475790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:51.854035 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ff24c23-b9f6-417f-9828-6c0c7b80283b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.100855 Nov 03 04:00:51.855196 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1125/2329] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:51 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:51.899672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:51.908843 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-808e4785-20dc-4161-abfc-bcb9b5b32279 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1298 microversion: 2.1 time: 0.170395 Nov 03 04:00:51.911993 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1205/2330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:51 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:51.912782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:51.913699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:51.926379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.929501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.934047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:51.934047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:51.934047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:51.934047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:52.276047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:52.286061 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de7a305d-5c83-4595-8b0a-7709b08d4805 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1535 microversion: 2.1 time: 0.377720 Nov 03 04:00:52.303050 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1126/2331] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:51 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1535 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:52.598683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:52.599305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:52.614774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:52.624976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:52.625657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:52.644026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:52.644774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:52.661695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:52.667834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:52.671051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:52.698951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:52.701366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:52.702449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:52.710957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:52.711489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:52.711976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:52.807055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:52.807875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:52.811126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:52.814917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lazy-loading 'fault' on Instance uuid 67547679-067f-4736-93bd-945ea21d5b84 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:52.893221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:52.902133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:52.906270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:52.909136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:52.918782 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8aa079c8-7d5b-4eee-9ef6-568cc8a6a43c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.268658 Nov 03 04:00:52.919805 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1127/2332] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:52 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:52.947772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ebc8d37-6ab2-466f-9a29-5e4be49b154d tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd49e160>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:52.999200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa7ebbbe2c14c82b5a07fef33cc214a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '337f8c15ac624e38ba1ad67d77e8f725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:53.012914 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9516cf64-17c8-4aa4-b0bf-7d509ba663df tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 200 len: 1303 microversion: 2.1 time: 0.418990 Nov 03 04:00:53.019126 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1206/2333] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:52 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 1303 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:53.036001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:53.037816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:53.048193 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ebc8d37-6ab2-466f-9a29-5e4be49b154d tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.112372 Nov 03 04:00:53.048808 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1128/2334] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:52 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:53.052596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:53.055884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:53.056947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:53.057622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:53.058750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:53.059179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:53.059609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:53.149382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:53.162800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3fb8241-b56f-40a1-b54f-1e2535194106 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1286 microversion: 2.1 time: 0.142235 Nov 03 04:00:53.163654 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1207/2335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:53 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:53.239381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "1653dd06-bfd1-49e0-adcc-dc4778d954c1"}], "security_groups": [{"name": "tempest-securitygroup--245187489"}], "key_name": "tempest-keypair-2088626782", "user_data": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:53.317547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:53.318569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:53.337502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:53.339479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:53.340124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:53.344537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:53.346257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:53.352113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:53.386663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] validate_networks() for [('1653dd06-bfd1-49e0-adcc-dc4778d954c1', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:00:53.661221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:53.671208 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d8a1c9e-6b25-4f66-b8a9-494ccaf02795 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1522 microversion: 2.1 time: 0.358450 Nov 03 04:00:53.678022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1208/2336] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:53 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:53.709343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:53.709857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:53.725571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:53.729820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:53.729820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:53.732040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:53.733778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:53.736101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:53.783353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:00:54.142831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:00:54.143367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:00:54.143982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:00:54.144401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:00:54.144821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:00:54.157069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.157581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.158086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.159040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.159554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.160048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.181906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Getting quotas for project ce056d754ef1484f9bd20656daba2813. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:00:54.188563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Getting quotas for user 783d7e87604342bd9b0ea39a7d28234f and project ce056d754ef1484f9bd20656daba2813. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:00:54.204724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:00:54.208007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:00:54.291466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f9e962d-dbb3-469c-9df8-43d1ee4ea232 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 204 len: 0 microversion: 2.1 time: 0.585767 Nov 03 04:00:54.293170 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1209/2337] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:53 2022] DELETE /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:00:54.298104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:54.299027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:54.304916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.305676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.306386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.307350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.308024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.308667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.401796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:54.415324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:54.417244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:54.420758 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c084fc12-8509-43d7-971b-6f88fe7bdc10 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.184632 Nov 03 04:00:54.427400 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-143d4c07-9825-4078-bbec-665926be01c5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.133591 Nov 03 04:00:54.433664 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1210/2338] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:54 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:54.433778 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1129/2339] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:00:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:00:54.435388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:54.436233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:54.444006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.444918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.445577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.446147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-66e3fb8b-4f8e-42cd-86cb-edd05fda269d tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f8bc20d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:54.446657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.447348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.448122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.472216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 HTTP/1.1 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '67547679-067f-4736-93bd-945ea21d5b84'} Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:54.474338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:54.479017 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:54.479017 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:54.479017 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:54.479017 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:54.479017 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:54.479017 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:54.479017 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:54.481830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:54.484584 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65c6008f-1dcb-43aa-a2ac-9ca8fdc93b8e tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 404 len: 111 microversion: 2.1 time: 0.052697 Nov 03 04:00:54.491530 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1211/2340] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:54 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:54.495124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:54.495762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:54.505758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.507311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.507311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.507728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.508013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.508448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.531675 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-66e3fb8b-4f8e-42cd-86cb-edd05fda269d tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.102034 Nov 03 04:00:54.541966 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1130/2341] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:54 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:54.541966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:54.541966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:54.547710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.548203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.548646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.549374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.549830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.550264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.823908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:54.837830 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c50de162-46ce-440a-931b-13d6145389b5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1328 microversion: 2.1 time: 0.346363 Nov 03 04:00:54.838437 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1212/2342] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:54 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1328 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:54.853926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9a7b628-4ca3-4065-8510-339b656cbf02 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:54.858148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d9a7b628-4ca3-4065-8510-339b656cbf02 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:54.943312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:54.954671 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ad6d4d3-e140-4e79-b03f-31418b365e83 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1528 microversion: 2.1 time: 0.420000 Nov 03 04:00:54.957146 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1131/2343] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:54 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1528 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:54.971171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:54.974774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d9a7b628-4ca3-4065-8510-339b656cbf02 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:54.975105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:54.982218 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9a7b628-4ca3-4065-8510-339b656cbf02 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1226 microversion: 2.1 time: 0.133331 Nov 03 04:00:54.989546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.993053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.993894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:54.994221 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1213/2344] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:54 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:54.997167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:54.997167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:54.997167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.017372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 HTTP/1.1 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '67547679-067f-4736-93bd-945ea21d5b84'} Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.029739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61d54dbd-c49a-474b-b547-08fdc291eb8d tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 404 len: 111 microversion: 2.1 time: 0.061000 Nov 03 04:00:55.033775 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1132/2345] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:54 2022] DELETE /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.034517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.034517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 67547679-067f-4736-93bd-945ea21d5b84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.039817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.040311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.041535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.042520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.044563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.045171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.051985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:55.061677 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 HTTP/1.1 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '67547679-067f-4736-93bd-945ea21d5b84'} Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.063336 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 67547679-067f-4736-93bd-945ea21d5b84 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-29e4565b-dba6-4b16-8920-8a173cc04516 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84" status: 404 len: 111 microversion: 2.1 time: 0.039323 Nov 03 04:00:55.067062 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1214/2346] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/67547679-067f-4736-93bd-945ea21d5b84 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:00:55.076906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.077953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.088053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.088552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.089041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.090312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.090970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.091623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.107031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-87a27ea0-1558-426f-bdbb-c7203452cc7f req-22859126-3cb7-44c7-a621-98577d75da22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f150d9-b90b-47b7-b37a-ea408fb5ca3a", "tag": "6db0a46b-c334-49c6-98e3-fbe4c3ad0e70"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 HTTP/1.1 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f90a0c21-607b-4f27-b2f5-f06fa4cbe765'} Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.112591 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.115966 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.118244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.119445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5dd82f4-3728-471c-9582-b105c3f73840 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 404 len: 111 microversion: 2.1 time: 0.049798 Nov 03 04:00:55.123441 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1133/2347] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:55 2022] DELETE /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.129071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.130321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: f90a0c21-607b-4f27-b2f5-f06fa4cbe765] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.136367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-87a27ea0-1558-426f-bdbb-c7203452cc7f req-22859126-3cb7-44c7-a621-98577d75da22 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.136976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-87a27ea0-1558-426f-bdbb-c7203452cc7f req-22859126-3cb7-44c7-a621-98577d75da22 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.137453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-87a27ea0-1558-426f-bdbb-c7203452cc7f req-22859126-3cb7-44c7-a621-98577d75da22 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.137969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.138663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.139313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.140845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.141522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.142205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.158262 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 HTTP/1.1 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f90a0c21-607b-4f27-b2f5-f06fa4cbe765'} Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.160140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.169088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance f90a0c21-607b-4f27-b2f5-f06fa4cbe765 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.171070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-87a27ea0-1558-426f-bdbb-c7203452cc7f req-22859126-3cb7-44c7-a621-98577d75da22 service nova] Creating event network-changed:6db0a46b-c334-49c6-98e3-fbe4c3ad0e70 for instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a on n-h2-854653-7 Nov 03 04:00:55.171262 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c8fe06d-f2b6-4d49-a123-f3a1f904ea69 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765" status: 404 len: 111 microversion: 2.1 time: 0.038690 Nov 03 04:00:55.171262 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1134/2348] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/f90a0c21-607b-4f27-b2f5-f06fa4cbe765 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.171604 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-87a27ea0-1558-426f-bdbb-c7203452cc7f req-22859126-3cb7-44c7-a621-98577d75da22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069159 Nov 03 04:00:55.171782 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1215/2349] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:55.176277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.176804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.185287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.190164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.190164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.190164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.190164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.190164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.208263 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 HTTP/1.1 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '328fceff-bafd-4b2a-a220-f1f9d57deb42'} Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.212552 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.216633 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa935d3b-edad-4025-b24d-a1de6af72b2b tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 404 len: 111 microversion: 2.1 time: 0.045233 Nov 03 04:00:55.220153 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1135/2350] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:55 2022] DELETE /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.229935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.231203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 328fceff-bafd-4b2a-a220-f1f9d57deb42] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.239741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.240754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.241547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.242649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.244247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.244930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.263312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 HTTP/1.1 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '328fceff-bafd-4b2a-a220-f1f9d57deb42'} Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.265616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 328fceff-bafd-4b2a-a220-f1f9d57deb42 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc19594b-edf8-4a61-b2b8-0342ce6e8fe8 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42" status: 404 len: 111 microversion: 2.1 time: 0.046131 Nov 03 04:00:55.269798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1216/2351] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/328fceff-bafd-4b2a-a220-f1f9d57deb42 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.276832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.279514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.285668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.286520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.287268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.288239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.288942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.289628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.307229 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac HTTP/1.1 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac'} Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.309238 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c4588e2-136d-461f-a2d4-714d593ede24 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 404 len: 111 microversion: 2.1 time: 0.043099 Nov 03 04:00:55.319827 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1136/2352] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:55 2022] DELETE /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.324055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.324786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.332259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.333099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.333886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.334821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.335581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.336218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.353347 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac HTTP/1.1 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac'} Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.356080 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.360517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.361740 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4436ee7-f388-488c-842c-bb75b330536f tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac" status: 404 len: 111 microversion: 2.1 time: 0.041386 Nov 03 04:00:55.364860 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1217/2353] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/bf9a5b55-d7c2-44ca-8226-ee1d9b34a0ac => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.371728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.372597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.379974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.380846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.381351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.382640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.382640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.383323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 HTTP/1.1 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '060f75ff-1ed7-40dc-8719-39b56ee5cad8'} Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.406803 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-02445592-a151-4397-a9fa-89f7c0fa5798 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 404 len: 111 microversion: 2.1 time: 0.035487 Nov 03 04:00:55.410274 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1137/2354] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:00:55 2022] DELETE /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.414754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.416111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: 060f75ff-1ed7-40dc-8719-39b56ee5cad8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.423532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.424282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.424914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.425835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.426459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.427471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.459823 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 HTTP/1.1 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '060f75ff-1ed7-40dc-8719-39b56ee5cad8'} Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:00:55.461782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.465485 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:00:55.465485 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:00:55.465485 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:00:55.465485 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:00:55.465485 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:00:55.465485 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. Nov 03 04:00:55.465485 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:00:55.465859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.465859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.466340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance 060f75ff-1ed7-40dc-8719-39b56ee5cad8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:00:55.467225 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f9f0fdf4-1338-4ac2-97a2-abda7b48a2d7 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8" status: 404 len: 111 microversion: 2.1 time: 0.057985 Nov 03 04:00:55.474478 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1218/2355] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/060f75ff-1ed7-40dc-8719-39b56ee5cad8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:00:55.486926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.489510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.491437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.494626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.495445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.496421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.548887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-623910dd-5b08-4f46-a8f4-a8de4c65561f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd62c9d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.602762 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-623910dd-5b08-4f46-a8f4-a8de4c65561f tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.058662 Nov 03 04:00:55.604057 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1219/2356] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:55.626516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:55.640533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:55.642164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:55.648946 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3727757f-0655-48d4-bbbb-7ce74973289a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.190805 Nov 03 04:00:55.660534 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1138/2357] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:00:55.863417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.864202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.880335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:00:55.924582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.927086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.927621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.928625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.929389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:55.930043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:55.980499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:55.987480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:55.995016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:55.995636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:56.005863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:56.006502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:56.007164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:56.007810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:56.256463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:56.266691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1797b541-9783-46e3-ac72-8da53a35689a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1328 microversion: 2.1 time: 0.407988 Nov 03 04:00:56.269882 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1220/2358] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1328 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:56.280360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb53fbcd-86f0-4348-8665-f492d981d37f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:56.319424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb53fbcd-86f0-4348-8665-f492d981d37f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:56.354908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:56.371164 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3bb16002-16e3-47a2-8626-a63fb253686d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1528 microversion: 2.1 time: 0.393644 Nov 03 04:00:56.371458 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1139/2359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:55 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1528 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:56.402661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb53fbcd-86f0-4348-8665-f492d981d37f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:56.411754 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb53fbcd-86f0-4348-8665-f492d981d37f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1226 microversion: 2.1 time: 0.140354 Nov 03 04:00:56.412345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1221/2360] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:56 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1226 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:56.619800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bd73ca7e-e386-4456-b613-37c2b6caaff1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4af670>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:56.674891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bd73ca7e-e386-4456-b613-37c2b6caaff1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.059059 Nov 03 04:00:56.683681 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1140/2361] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:56 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:56.685264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:56.686045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:56.692555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:56.693241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:56.693760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:56.694724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:56.695268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:56.695773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:56.834748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:56.843750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:56.845370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:56.851054 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f74e6c5f-2b88-4773-ad98-71dd413d1bc4 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1560 microversion: 2.91 time: 0.170841 Nov 03 04:00:56.851904 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1222/2362] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:56 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:57.302405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:57.303362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:57.311349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.313700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.315460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.316456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.317219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.317908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.397316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:57.399971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:57.435003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.435893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.438862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.440177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.444120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.447636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.674092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:57.694765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20e51652-c8db-4b91-8994-5e3d42e2c9b8 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1486 microversion: 2.1 time: 0.302090 Nov 03 04:00:57.695943 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1223/2363] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:57 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1486 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:57.707017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:57.715381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:57.727701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.728204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.728719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.730054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.730547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.731081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.809864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:57.824663 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38229289-9de4-4355-b0e9-a9bcb7eb0a52 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1328 microversion: 2.1 time: 0.524070 Nov 03 04:00:57.825633 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1141/2364] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:57 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1328 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:57.836897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7a21eee-cb71-43ed-a430-524c340258f4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4afee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:57.917868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:57.932357 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7a21eee-cb71-43ed-a430-524c340258f4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.104347 Nov 03 04:00:57.935386 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-289b0ac6-ade6-4572-a4cc-264c95f2bd9a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1222 microversion: 2.1 time: 0.233395 Nov 03 04:00:57.935975 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1224/2365] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:57 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1222 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:57.946796 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1142/2366] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:57 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:57.956848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5f102bd9-90a2-4f27-ac79-59dbd7667fe5 req-19c2e513-9263-48d0-923d-fdff0a0e3846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f01a566-a0bd-43f8-944f-19c1027b5d02", "name": "network-vif-deleted", "tag": "7820cb7c-9957-4620-823d-950195cdadaf"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:00:57.965290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:57.967663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:57.980578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5f102bd9-90a2-4f27-ac79-59dbd7667fe5 req-19c2e513-9263-48d0-923d-fdff0a0e3846 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.989983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5f102bd9-90a2-4f27-ac79-59dbd7667fe5 req-19c2e513-9263-48d0-923d-fdff0a0e3846 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.990585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.990585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.990585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.990585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:57.990585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:57.990893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5f102bd9-90a2-4f27-ac79-59dbd7667fe5 req-19c2e513-9263-48d0-923d-fdff0a0e3846 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:57.990975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:58.014001 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5f102bd9-90a2-4f27-ac79-59dbd7667fe5 req-19c2e513-9263-48d0-923d-fdff0a0e3846 service nova] Creating event network-vif-deleted:7820cb7c-9957-4620-823d-950195cdadaf for instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 on n-h1-854653-7 Nov 03 04:00:58.027127 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5f102bd9-90a2-4f27-ac79-59dbd7667fe5 req-19c2e513-9263-48d0-923d-fdff0a0e3846 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078876 Nov 03 04:00:58.035967 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1143/2367] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:00:58.097473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:58.120355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:58.127585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:58.140497 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-012c8975-1025-41e5-9f05-446c7a3d746d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1560 microversion: 2.91 time: 0.187712 Nov 03 04:00:58.142184 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1225/2368] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:57 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:00:58.722559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:58.723576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:58.733590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:58.736774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:58.739766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:58.742185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:58.742865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:58.744230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:58.800410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:58.800911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:58.801393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:58.801860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 0f01a566-a0bd-43f8-944f-19c1027b5d02 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:00:58.857790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:58.858580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:58.866340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:58.867076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:58.867887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:58.868811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:58.869512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:58.870145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:58.960479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:58.989213 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89009f00-0668-447b-a7d4-ccd41ff2816e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 200 len: 1315 microversion: 2.1 time: 0.266639 Nov 03 04:00:59.000352 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1144/2369] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:58 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:59.010453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40288dea-a749-40bc-86fa-dae951e10b9d tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4a6c10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:59.083144 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40288dea-a749-40bc-86fa-dae951e10b9d tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.091015 Nov 03 04:00:59.083994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1145/2370] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:00:58 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:59.095626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:59.101164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:59.112847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:59.113376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:59.113820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:59.114555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:59.115014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:59.115447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:59.236072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:59.251251 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-afe3ea2f-af61-4f0e-abc6-da04c2d32452 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1328 microversion: 2.1 time: 0.391013 Nov 03 04:00:59.252146 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1226/2371] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:58 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:00:59.257323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:00:59.257949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:00:59.271251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:59.281753 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8d1a8a3-4fc0-4a02-bca7-28853a06be37 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1286 microversion: 2.1 time: 0.195865 Nov 03 04:00:59.287629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:59.288135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:59.288584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:59.289341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:00:59.289838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:00:59.290245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:00:59.293360 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1146/2372] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:00:59 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:00:59.439237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:59.455956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:59.457588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:00:59.464275 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f96484e-4aa2-4ea3-8d91-470da7b704a5 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1560 microversion: 2.91 time: 0.211051 Nov 03 04:00:59.484517 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1227/2373] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:00:59 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:00.020231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:00.020777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:00.028148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:00.028881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:00.029735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:00.030738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:00.031813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:00.032254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:00.047627 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 HTTP/1.1 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '0f01a566-a0bd-43f8-944f-19c1027b5d02'} Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.049373 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-59f704b4-b5c6-432d-9dca-2e885cad8e73 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 404 len: 111 microversion: 2.1 time: 0.034587 Nov 03 04:01:00.053542 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1147/2374] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:00 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:00.101944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a44057f2-8641-4639-aeec-2ea8d199a747 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd6113a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:00.205774 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a44057f2-8641-4639-aeec-2ea8d199a747 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.107678 Nov 03 04:01:00.206371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1228/2375] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:00 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:00.260559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:00.260900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:00.274460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:00.274971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:00.278983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:00.282159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:00.282465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:00.283628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:00.284355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:00.285149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:00.292439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:00.297315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:00.297931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:00.298791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:00.299375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:00.305592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:00.309929 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c HTTP/1.1 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'eaed2ca2-aa0c-4edc-ba31-ff198664526c'} Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:00.311608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c5138a6a-c12d-4ccf-b779-177d00c072fc tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 404 len: 111 microversion: 2.1 time: 0.057258 Nov 03 04:01:00.315608 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1148/2376] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:00 2022] DELETE /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:00.320945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1577400087", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:00.427473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] validate_networks() for [('5b8fe51f-9af2-47f9-8ae4-cb9d7cbdd61a', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:01:00.986007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:00.998069 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d9926d7-bf61-4eb4-a283-aabfc44e32b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1328 microversion: 2.1 time: 0.723934 Nov 03 04:01:00.998794 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1229/2377] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:00 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1328 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:01.009916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:01.013165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:01.032304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.032304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.032304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.032304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.032304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.032304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.654760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:01.664853 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2fec98e3-93b1-4a3d-9997-220010e5d4f7 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.664256 Nov 03 04:01:01.667031 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1230/2378] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:00 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:01.672474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:01.673461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: eaed2ca2-aa0c-4edc-ba31-ff198664526c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:01.680025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.680796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.681516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.682472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.683275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.683939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.722898 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c HTTP/1.1 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'eaed2ca2-aa0c-4edc-ba31-ff198664526c'} Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:01.726047 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:01.731408 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:01.731408 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:01.731408 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:01.731408 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:01.731408 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:01.731408 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. Nov 03 04:01:01.731408 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:01.734581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance eaed2ca2-aa0c-4edc-ba31-ff198664526c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:01.736263 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3eded417-202a-45bd-8983-032b2de1f2e4 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c" status: 404 len: 111 microversion: 2.1 time: 0.067352 Nov 03 04:01:01.739883 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1231/2379] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:01 2022] GET /compute/v2.1/servers/eaed2ca2-aa0c-4edc-ba31-ff198664526c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:01.744315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:01.744983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:01.752598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.753190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.754532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.755303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.756157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.756774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.820500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:01:01.821105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:01:01.821456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:01:01.822019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:01:01.822632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:01:01.840084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.840585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.846654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.847516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:01.847994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:01.848398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:01.876366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for project 0c64c3da724e48709d5f073189b61fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:01:01.882766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Getting quotas for user c25b2e8e63e54fada80ba039c1be2501 and project 0c64c3da724e48709d5f073189b61fc4. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:01:01.904379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:01:01.907980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:01:02.003656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:02.014090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:02.015939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:02.023470 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da08d986-2b21-4faf-a807-27633aacfbd2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.285078 Nov 03 04:01:02.024317 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1232/2380] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:01 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:02.049598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-efe57979-8778-4680-8ff8-4a85c397dfa9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd62c160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:02.558023 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90a58b8c-2b6a-465c-989b-0f794cde6588 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.241920 Nov 03 04:01:02.559547 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1149/2381] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:01:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:01:02.566292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:02.568633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:02.576054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:02.576560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:02.577007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:02.577925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:02.578764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:02.579201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:02.628017 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b HTTP/1.1 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e18ffe8f-e3ae-4756-80f7-b670c11ac21b'} Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:02.633315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:02.636612 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:02.637379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:02.637647 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d269804-4532-4695-8f37-cee8a8a985db tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 404 len: 111 microversion: 2.1 time: 0.076938 Nov 03 04:01:02.642696 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1150/2382] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:02 2022] DELETE /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:02.656922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:02.657644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:02.683648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:02.683648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:02.684094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:02.685967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:02.688530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:02.689001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:02.757648 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-efe57979-8778-4680-8ff8-4a85c397dfa9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1455 microversion: 2.1 time: 0.717797 Nov 03 04:01:02.760998 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1233/2383] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:02 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1455 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:02.769590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbcb22c2-b3e4-4aa7-b85e-ccec8c7689ad tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:02.769590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dbcb22c2-b3e4-4aa7-b85e-ccec8c7689ad tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:02.932104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dbcb22c2-b3e4-4aa7-b85e-ccec8c7689ad tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:02.942880 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dbcb22c2-b3e4-4aa7-b85e-ccec8c7689ad tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1225 microversion: 2.1 time: 0.180723 Nov 03 04:01:02.948408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1234/2384] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:02 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:02.959083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:02.963412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] [instance: e18ffe8f-e3ae-4756-80f7-b670c11ac21b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:02.981743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:02.981743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:02.981743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:02.981743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:02.981743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:02.983634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:03.018366 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] HTTP exception thrown: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Request method failure captured: Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b HTTP/1.1 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzuSIweA603KKJX4N9Lmn7d4fAqsDMMvpNZTdUB5_fSBS_IlZ8H8Nt7s6CAyjGjcrnMlQsqHOP__Q-a9_sk0cz817cxfWDpzmSeVFfWRgEXz4ip18W2nKnyiwf-m80sriUJekKb1i-gJDn04QERaghYa0NbCs5UUYNDQCiID8p1JSLA Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_337f8c15ac624e38ba1ad67d77e8f725", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/337f8c15ac624e38ba1ad67d77e8f725"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/337f8c15ac624e38ba1ad67d77e8f725"}]}] Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 337f8c15ac624e38ba1ad67d77e8f725 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-753791641 Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: baa7ebbbe2c14c82b5a07fef33cc214a Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-753791641-project Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e18ffe8f-e3ae-4756-80f7-b670c11ac21b'} Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:03.020218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] Returning 404 to user: Instance e18ffe8f-e3ae-4756-80f7-b670c11ac21b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e615e6c8-a264-44d1-afbf-347309a03447 tempest-DeleteServersTestJSON-753791641 tempest-DeleteServersTestJSON-753791641-project] 10.222.0.30 "GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b" status: 404 len: 111 microversion: 2.1 time: 0.072117 Nov 03 04:01:03.030340 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1235/2385] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:02 2022] GET /compute/v2.1/servers/e18ffe8f-e3ae-4756-80f7-b670c11ac21b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:03.036427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:03.036427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:03.064607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:03.066745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:03.068711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:03.070109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:03.071525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:03.074526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:03.146312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:03.155363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72b351bb-3e28-467c-a36b-02160a3cedb0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1328 microversion: 2.1 time: 0.510309 Nov 03 04:01:03.161805 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1151/2386] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:02 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1328 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:03.181767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c8ee6aed-3213-472f-8e6c-5ff7a8e26ded req-6c53dd82-b9c4-4825-85c2-19a5e043237c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f150d9-b90b-47b7-b37a-ea408fb5ca3a", "name": "network-vif-plugged", "status": "completed", "tag": "6db0a46b-c334-49c6-98e3-fbe4c3ad0e70"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:03.192303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8ee6aed-3213-472f-8e6c-5ff7a8e26ded req-6c53dd82-b9c4-4825-85c2-19a5e043237c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:03.193080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8ee6aed-3213-472f-8e6c-5ff7a8e26ded req-6c53dd82-b9c4-4825-85c2-19a5e043237c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:03.193818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8ee6aed-3213-472f-8e6c-5ff7a8e26ded req-6c53dd82-b9c4-4825-85c2-19a5e043237c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:03.206922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c8ee6aed-3213-472f-8e6c-5ff7a8e26ded req-6c53dd82-b9c4-4825-85c2-19a5e043237c service nova] Creating event network-vif-plugged:6db0a46b-c334-49c6-98e3-fbe4c3ad0e70 for instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a on n-h2-854653-7 Nov 03 04:01:03.214465 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c8ee6aed-3213-472f-8e6c-5ff7a8e26ded req-6c53dd82-b9c4-4825-85c2-19a5e043237c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050343 Nov 03 04:01:03.218449 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1152/2387] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:03.228424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-726847514", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2752c8c3-e485-420b-a57b-73b9e6895e51"}], "block_device_mapping_v2": [{"uuid": "96221541-0785-404e-9cc2-4b1927c47b54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:03.339020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] validate_networks() for [('2752c8c3-e485-420b-a57b-73b9e6895e51', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:01:03.600598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:03.610118 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91e333c3-15b6-43a0-a069-c2f00679b70d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.585490 Nov 03 04:01:03.610972 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1236/2388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:03 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:03.641869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:03.642541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:03.655795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:03.656341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:03.656793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:03.657552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:03.665748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:03.666215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:03.840194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:03.861791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:03.865434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:03.886842 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c88975cf-eac7-4393-890a-14d988fb829f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.274752 Nov 03 04:01:03.889669 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1237/2389] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:03 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:03.918482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3f972a41-498c-449d-8fe6-d63e4d7f68c4 req-b246af87-1763-4efb-a1db-55851ccbe638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53589e40-4455-4b27-8d9c-d63fe9f193d1", "tag": "29588292-eaad-405c-8c1d-20aa98f187a5"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:03.932331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3f972a41-498c-449d-8fe6-d63e4d7f68c4 req-b246af87-1763-4efb-a1db-55851ccbe638 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:03.933241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3f972a41-498c-449d-8fe6-d63e4d7f68c4 req-b246af87-1763-4efb-a1db-55851ccbe638 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:03.933889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3f972a41-498c-449d-8fe6-d63e4d7f68c4 req-b246af87-1763-4efb-a1db-55851ccbe638 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:03.955193 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3f972a41-498c-449d-8fe6-d63e4d7f68c4 req-b246af87-1763-4efb-a1db-55851ccbe638 service nova] Creating event network-changed:29588292-eaad-405c-8c1d-20aa98f187a5 for instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 on n-h1-854653-7 Nov 03 04:01:03.961953 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3f972a41-498c-449d-8fe6-d63e4d7f68c4 req-b246af87-1763-4efb-a1db-55851ccbe638 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069876 Nov 03 04:01:03.963085 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1238/2390] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:03.971113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcd83b49-fdc5-4307-8410-d0dc6ab1fa94 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5e4160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:04.468260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:01:04.469460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:01:04.469761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:01:04.470397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:01:04.470768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:01:04.486018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:04.489135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:04.489135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:04.489135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:04.489587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:04.490247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:04.513502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:01:04.520665 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bcd83b49-fdc5-4307-8410-d0dc6ab1fa94 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1464 microversion: 2.1 time: 0.555576 Nov 03 04:01:04.521636 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1239/2391] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:03 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1464 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:04.522952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Getting quotas for user 7ebbc13908db44e88853d5c14c8e2102 and project 4a9b6a4c4189418eb86c45bd82cb0ca8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:01:04.536603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:04.537396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:04.547914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:04.548478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:04.548922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:04.549919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:04.550771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:04.551709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:04.596675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:01:04.599284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96221541-0785-404e-9cc2-4b1927c47b54',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:01:04.648504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:04.659420 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9fb598e7-51fd-40f1-9707-ae92e4f648a7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1229 microversion: 2.1 time: 0.126795 Nov 03 04:01:04.673122 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1240/2392] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:04 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1229 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:04.673122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:04.673122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:04.675382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:04.675872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:04.676309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:04.677243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:04.677761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:04.678340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:04.902910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:04.919123 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02c1bc7d-5a80-49b6-9068-b3c022f903ad tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1328 microversion: 2.1 time: 0.257670 Nov 03 04:01:04.919932 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1241/2393] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:04 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1328 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:04.940266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-912e6e8d-3ae2-4a40-88d2-66e45c1d2505 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5aaf70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:05.051213 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-912e6e8d-3ae2-4a40-88d2-66e45c1d2505 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 200 len: 1464 microversion: 2.1 time: 0.130336 Nov 03 04:01:05.052133 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1242/2394] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:04 2022] GET /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 1464 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:05.090584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:05.091153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:05.127080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.127604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.128068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.131742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.132457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.135131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.143200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:05.255327 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da5ac214-c143-4b4f-b4fd-c15427f21f46 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.034239 Nov 03 04:01:05.257780 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1153/2395] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:01:05.270389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:05.271278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:05.305085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.306986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.308187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.311455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.315952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.316612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.335763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.349201 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8659ad97-92c8-425f-a376-7a2001dfad24 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.295685 Nov 03 04:01:05.351556 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1243/2396] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:05 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:05.363028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:05.363917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:05.376539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.379467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.380134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.381260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.382832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.383471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.535428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.560387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.563369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.567034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:05.572390 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5bd7a2e4-11aa-4be5-a319-af8176396a1c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.310466 Nov 03 04:01:05.573378 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1154/2397] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:05 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:05.582650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93296485-00f2-4701-a4da-6c31428ef776 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:05.583590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-93296485-00f2-4701-a4da-6c31428ef776 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:05.686004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93296485-00f2-4701-a4da-6c31428ef776 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.689124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=25 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:05.715488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93296485-00f2-4701-a4da-6c31428ef776 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.719026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93296485-00f2-4701-a4da-6c31428ef776 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.728588 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93296485-00f2-4701-a4da-6c31428ef776 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1103 microversion: 2.25 time: 0.148711 Nov 03 04:01:05.732520 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1155/2398] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:05 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1103 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:05.738691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:05.748049 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-035c418c-968d-445f-a031-3ee631a1c8d6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1468 microversion: 2.1 time: 0.395230 Nov 03 04:01:05.749110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1244/2399] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:05 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1468 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:05.753162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:05.754698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:05.774313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.778599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.779282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.782165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.782801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.783405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.784957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-326666885"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:05.788349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:05.799395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.800139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.801354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:05.802253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:05.802914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:05.803741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.003205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:06.016290 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4ae27a6-15cd-4e8d-80e8-9c7f3fba3aa6 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1221 microversion: 2.1 time: 0.281888 Nov 03 04:01:06.022570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1156/2400] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:05 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:06.033237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:06.041944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:06.064982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.065531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.065984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.066685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.067236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.067598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.353934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:06.369191 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6cab38ec-ff89-4e6d-ba36-91159b88768f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1509 microversion: 2.1 time: 0.345406 Nov 03 04:01:06.370530 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1157/2401] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:06 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:06.377876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:06.378853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:06.387218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.393237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.394033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.395051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.395751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.396449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.575169 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5257e47c-7463-4fc8-9c41-c25f21f9300b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "POST /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99/action" status: 202 len: 0 microversion: 2.1 time: 0.797049 Nov 03 04:01:06.579515 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1245/2402] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:01:05 2022] POST /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:01:06.601578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:06.601578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:06.612789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.616184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.617648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.618635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.620879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.621626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.689343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:06.701617 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3d379d2-87d0-44d7-995b-92617d54b844 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.328187 Nov 03 04:01:06.705259 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1158/2403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:06 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:06.710474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85aea47b-ab6b-48f7-a0ad-401d26583d93 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4af940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:06.803365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85aea47b-ab6b-48f7-a0ad-401d26583d93 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.096671 Nov 03 04:01:06.815772 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1159/2404] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:06 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:06.826114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:06.826999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:06.848696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.849848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.850313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.851050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:06.851526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:06.851967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:06.887341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:07.117110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.130938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.134955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.149345 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fb700787-79a1-4c46-bcf6-012282fc6f1d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.331313 Nov 03 04:01:07.151385 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1160/2405] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:06 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:07.161205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:07.161205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:07.183731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.184402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.184866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.185700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.186278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.187150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.208640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.224762 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7de51239-cff5-4fc9-a638-5de5321db2e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1509 microversion: 2.1 time: 0.629894 Nov 03 04:01:07.226015 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1246/2406] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:06 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1509 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:07.241071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:07.241912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:07.272392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.274787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.275441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.276369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.278529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.279179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.400907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.413729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.415493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.416653 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7837147d-0989-4b3d-9179-d283fcc559f0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1184 microversion: 2.25 time: 0.265051 Nov 03 04:01:07.417259 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1161/2407] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:07 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1184 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:07.446358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:07.450217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:07.473369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.473987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.474448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.475203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.475849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.476440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.518340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:07.535506 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c16f98d7-2021-4079-aafb-36039e63d927 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1277 microversion: 2.1 time: 0.304990 Nov 03 04:01:07.537734 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1247/2408] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:07 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:07.541260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:01:07.728632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:07.729605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:07.737036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.738049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.738672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.739451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:07.739972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:07.740417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:07.869564 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1fc10294-c16f-497d-8281-e24964d33ce9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 204 len: 0 microversion: 2.1 time: 0.439212 Nov 03 04:01:07.870164 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1162/2409] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:07 2022] DELETE /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:07.880601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42cdcb65-2558-445a-b442-cff41f5f5fd4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4d9d30>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:07.993411 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42cdcb65-2558-445a-b442-cff41f5f5fd4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.119961 Nov 03 04:01:07.997182 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1163/2410] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:07 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:08.014055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:08.018206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:08.032223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.037163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.037735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.043813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.044719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.045435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.128203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.136818 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e911ced-1d40-4f91-98a3-4d72d4df780a tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.412451 Nov 03 04:01:08.143797 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1248/2411] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:07 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:08.190073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:08.190912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:08.201116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.201866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.204403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.205305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.205889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.210290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.419924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.440078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.443023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.451677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:08.453857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d552076c-9493-4bf7-bb54-1dab985f2a5f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.270056 Nov 03 04:01:08.455971 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1249/2412] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:08 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:08.465444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:08.466099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:08.478885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.479444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.479904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.480963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.481463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.482365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.672144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.681329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.686092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.687301 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e331d56d-48d2-47c4-bb82-75f0c1a856d2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1232 microversion: 2.25 time: 0.229843 Nov 03 04:01:08.692780 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1250/2413] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:08 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1232 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:08.703851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:08.711842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:08.722220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.722772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.723240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.723997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.724462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.724941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.745027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:08.756639 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce6401b0-2299-4cbd-9a89-990b86159dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1515 microversion: 2.1 time: 0.756948 Nov 03 04:01:08.757539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1164/2414] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:07 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1515 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:08.839876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6f11736b-aab3-4181-9b13-5fcb80dc09e9 req-ad2cbfc9-8a01-499b-8ba0-195e36c069f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60129a1a-b160-4e7e-a855-dd553c4acf5d", "name": "network-vif-unplugged", "status": "completed", "tag": "08ee2daa-805b-4703-9a93-903066d40144"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:08.859582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6f11736b-aab3-4181-9b13-5fcb80dc09e9 req-ad2cbfc9-8a01-499b-8ba0-195e36c069f3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:08.860543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6f11736b-aab3-4181-9b13-5fcb80dc09e9 req-ad2cbfc9-8a01-499b-8ba0-195e36c069f3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:08.862143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6f11736b-aab3-4181-9b13-5fcb80dc09e9 req-ad2cbfc9-8a01-499b-8ba0-195e36c069f3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:08.894675 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6f11736b-aab3-4181-9b13-5fcb80dc09e9 req-ad2cbfc9-8a01-499b-8ba0-195e36c069f3 service nova] Creating event network-vif-unplugged:08ee2daa-805b-4703-9a93-903066d40144 for instance 60129a1a-b160-4e7e-a855-dd553c4acf5d on n-h2-854653-7 Nov 03 04:01:08.903665 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6f11736b-aab3-4181-9b13-5fcb80dc09e9 req-ad2cbfc9-8a01-499b-8ba0-195e36c069f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068166 Nov 03 04:01:08.907672 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1165/2415] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:01:09.010442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-35efaddd-dbfd-4d46-b935-dfb426fcff22 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4a69d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:09.113513 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-35efaddd-dbfd-4d46-b935-dfb426fcff22 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.107508 Nov 03 04:01:09.115726 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1166/2416] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:09 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:09.169409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:09.170460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:09.179465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.180322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.187639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.187639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.187639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.187639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.277965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.288137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce1c7fdb-422f-47fa-af60-200af7e43c7b tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1295 microversion: 2.1 time: 0.592181 Nov 03 04:01:09.291338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1251/2417] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:08 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1295 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:09.487275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:09.488782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:09.505632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.505830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.506282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.507041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.507524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.507951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.668922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.678383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.679846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.686112 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60bbfebc-fa67-426b-b798-afe179c964fd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.203662 Nov 03 04:01:09.701568 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1252/2418] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:09 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:09.722547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:09.723185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:09.736852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.742559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.742559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.742559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.742559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.742559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.784494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.801001 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd487ba4-eea9-4aa2-b49c-0ff26adde9db tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.635949 Nov 03 04:01:09.801988 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1167/2419] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:09 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:09.807717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:09.809334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:09.844140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.845657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.846566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.847689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:09.849077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:09.849955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:09.933806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.961362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.965998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:09.981398 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7f054ea5-1519-4b28-ad9b-26aa7473367d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1240 microversion: 2.25 time: 0.259005 Nov 03 04:01:09.984372 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1253/2420] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:09 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1240 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:10.131771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a10eeaa3-2fcd-4b1f-ac8a-c021edbd8596 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5fff70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:10.218055 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a10eeaa3-2fcd-4b1f-ac8a-c021edbd8596 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.091924 Nov 03 04:01:10.218994 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1254/2421] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:10 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:10.396670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7b24d88e-6851-4c87-adc9-27e98f3c6d6c req-ed4ac631-b0cc-4a8d-9bc1-6e684408ec83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f150d9-b90b-47b7-b37a-ea408fb5ca3a", "name": "network-vif-deleted", "tag": "6db0a46b-c334-49c6-98e3-fbe4c3ad0e70"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:10.428860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b24d88e-6851-4c87-adc9-27e98f3c6d6c req-ed4ac631-b0cc-4a8d-9bc1-6e684408ec83 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:10.430253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b24d88e-6851-4c87-adc9-27e98f3c6d6c req-ed4ac631-b0cc-4a8d-9bc1-6e684408ec83 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:10.436447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b24d88e-6851-4c87-adc9-27e98f3c6d6c req-ed4ac631-b0cc-4a8d-9bc1-6e684408ec83 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:10.467257 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7b24d88e-6851-4c87-adc9-27e98f3c6d6c req-ed4ac631-b0cc-4a8d-9bc1-6e684408ec83 service nova] Creating event network-vif-deleted:6db0a46b-c334-49c6-98e3-fbe4c3ad0e70 for instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a on n-h2-854653-7 Nov 03 04:01:10.477300 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7b24d88e-6851-4c87-adc9-27e98f3c6d6c req-ed4ac631-b0cc-4a8d-9bc1-6e684408ec83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256333 Nov 03 04:01:10.478632 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1255/2422] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:10.487407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:10.488401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:10.497320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:10.497974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:10.498499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:10.499371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:10.500519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:10.501119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:10.685968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:10.701941 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b94d9b4-4cbc-4a00-9d1b-6dc96c04b992 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1515 microversion: 2.1 time: 0.898520 Nov 03 04:01:10.703640 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1168/2423] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:09 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1515 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:10.715618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:10.716531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:10.752392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:10.759605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:10.760445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:10.762831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:10.764625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:10.766199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:10.864036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:10.872633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc483e35-550d-4eeb-bffa-4b6cd3f83b62 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1283 microversion: 2.1 time: 0.392568 Nov 03 04:01:10.890126 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1256/2424] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:10 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1283 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:10.910647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:10.927303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:10.935256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:10.935912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:10.939510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:10.940602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:10.941293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:10.941751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:10.961217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:10.971324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:10.977137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:10.990762 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dbf9087a-9e27-4ba6-8bbd-25405542497f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.278837 Nov 03 04:01:10.993984 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1169/2425] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:10 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:11.018667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:11.019557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:11.029924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.031480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.033335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:11.034369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.035985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.038221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:11.204782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:11.215079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:11.220018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:11.234414 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2055876-35cf-4224-b8ae-aaabb0fa2c56 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1250 microversion: 2.25 time: 0.215524 Nov 03 04:01:11.234414 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1170/2426] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:11 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1250 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:11.241430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9c8a598-58f3-470a-a5c9-a50b8f8c4ede tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd479ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:11.344833 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9c8a598-58f3-470a-a5c9-a50b8f8c4ede tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.112459 Nov 03 04:01:11.345578 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1171/2427] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:11 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:11.503521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:11.504356 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c9e90c6f-4914-4578-b6ce-7893a454734d tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.597498 Nov 03 04:01:11.509396 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1257/2428] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:10 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:11.728004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:11.729365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:11.738512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.748242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.749897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:11.750794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.751528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.752192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:11.794732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cd081270-fcc9-45c1-8518-8d8744447432 req-66b17aa8-0eb3-4050-9ff5-11c514078082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53589e40-4455-4b27-8d9c-d63fe9f193d1", "name": "network-vif-plugged", "status": "completed", "tag": "29588292-eaad-405c-8c1d-20aa98f187a5"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:11.824532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cd081270-fcc9-45c1-8518-8d8744447432 req-66b17aa8-0eb3-4050-9ff5-11c514078082 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.825543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.826300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.826967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:11.828208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lazy-loading 'fault' on Instance uuid e8f150d9-b90b-47b7-b37a-ea408fb5ca3a {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:11.832175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cd081270-fcc9-45c1-8518-8d8744447432 req-66b17aa8-0eb3-4050-9ff5-11c514078082 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.832770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cd081270-fcc9-45c1-8518-8d8744447432 req-66b17aa8-0eb3-4050-9ff5-11c514078082 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:11.862820 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cd081270-fcc9-45c1-8518-8d8744447432 req-66b17aa8-0eb3-4050-9ff5-11c514078082 service nova] Creating event network-vif-plugged:29588292-eaad-405c-8c1d-20aa98f187a5 for instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 on n-h1-854653-7 Nov 03 04:01:11.873868 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cd081270-fcc9-45c1-8518-8d8744447432 req-66b17aa8-0eb3-4050-9ff5-11c514078082 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078923 Nov 03 04:01:11.874612 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1258/2429] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:01:11.937995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:11.941412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:11.974645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.981378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.984940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:11.986909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:11.987392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:11.994959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:12.037971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.051268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b58c865-fa9e-4627-b50c-5d0c96c9ee5c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 200 len: 1318 microversion: 2.1 time: 0.327053 Nov 03 04:01:12.074451 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1172/2430] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:11 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:12.085806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:12.086701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:12.099023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:12.099812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:12.103278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:12.106974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:12.106974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:12.106974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:12.186478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.201008 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b28d16b1-014e-4abd-8de9-809a58c3d122 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1283 microversion: 2.1 time: 0.295110 Nov 03 04:01:12.201876 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1259/2431] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:11 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1283 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:12.262111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:12.262111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:12.271644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:12.272380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:12.277623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:12.278599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:12.279256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:12.279705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:12.306448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.318255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.319728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.342578 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4bac6e7-6f2f-46ce-a76b-c66f9385273a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.266306 Nov 03 04:01:12.345328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1173/2432] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:12 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:12.363363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-18855045-43b0-40ad-bcec-a4f7e49b584b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd49e3a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:12.482348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.509879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:12.532417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.536027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:12.540036 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01eac3f9-fe87-4c8e-a00b-942399fbf07f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1250 microversion: 2.25 time: 0.282186 Nov 03 04:01:12.543164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1260/2433] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:12 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1250 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:12.554140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:12.560724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:12.579910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:12.580428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:12.580884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:12.581678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:12.582379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:12.582657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:12.941671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=18 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:13.072172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:13.091120 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-440edcc6-ca44-4c42-9fcc-03f53b29f103 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1351 microversion: 2.1 time: 0.543413 Nov 03 04:01:13.106420 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1261/2434] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:12 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1351 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:13.126504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:13.129724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:13.154122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:13.154846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:13.156231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:13.168726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:13.170375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:13.172442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:13.214552 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a HTTP/1.1 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e8f150d9-b90b-47b7-b37a-ea408fb5ca3a'} Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:13.219312 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:13.223687 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:13.223687 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:13.223687 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:13.223687 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:13.223687 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:13.223687 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:01:13.223687 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:13.226131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:13.232748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a255aa32-fcfa-40b4-b161-0b074d6ad128 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 404 len: 111 microversion: 2.1 time: 0.119281 Nov 03 04:01:13.238310 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1262/2435] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:13 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:13.245196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:13.246402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:13.264950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:13.266365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:13.267106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:13.269321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:13.270082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:13.270741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:13.975751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:13.993200 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cd81f0e9-6367-48b3-af07-0fdf8b293ff3 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1325 microversion: 2.1 time: 0.751167 Nov 03 04:01:13.994074 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1263/2436] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:13 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1325 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:14.012199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90604459-7030-4d46-b78c-b526bd56d2c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '.version_select at 0x7ff7fd492f70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:14.142884 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90604459-7030-4d46-b78c-b526bd56d2c0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-key-267894292" status: 202 len: 0 microversion: 2.1 time: 0.146589 Nov 03 04:01:14.158308 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1264/2437] 10.222.0.30 () {58 vars in 1206 bytes} [Thu Nov 3 04:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-267894292 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:01:14.167716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:14.168620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:14.181103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:14.181913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:14.182553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:14.183445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:14.184149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:14.184737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:14.324674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:14.344411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:14.356640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:14.368522 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a996152-bf00-4bfa-b756-8b449b143eca tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.208776 Nov 03 04:01:14.379866 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1265/2438] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:14 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:14.390146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:14.400766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:14.415223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:14.427491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:14.430954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:14.432343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:14.439459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:14.441133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:14.503337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:15.085826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:15.099262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:15.106894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:15.109894 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65cd26e5-1771-49dc-b2bb-4c3e1b6c7a9e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1292 microversion: 2.25 time: 0.722172 Nov 03 04:01:15.109894 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1266/2439] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:14 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1292 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:15.122629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c1f9d84c-2404-4f44-b831-75e5cc327e9e req-90382414-44e1-4628-85b1-00db54fe9a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1547c889-73e4-4a6a-8925-439fba280d99", "name": "network-vif-plugged", "status": "completed", "tag": "8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:15.151177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1f9d84c-2404-4f44-b831-75e5cc327e9e req-90382414-44e1-4628-85b1-00db54fe9a0b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:15.152055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1f9d84c-2404-4f44-b831-75e5cc327e9e req-90382414-44e1-4628-85b1-00db54fe9a0b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:15.152715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1f9d84c-2404-4f44-b831-75e5cc327e9e req-90382414-44e1-4628-85b1-00db54fe9a0b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:15.177682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c1f9d84c-2404-4f44-b831-75e5cc327e9e req-90382414-44e1-4628-85b1-00db54fe9a0b service nova] Creating event network-vif-plugged:8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac for instance 1547c889-73e4-4a6a-8925-439fba280d99 on n-h2-854653-7 Nov 03 04:01:15.191171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c1f9d84c-2404-4f44-b831-75e5cc327e9e req-90382414-44e1-4628-85b1-00db54fe9a0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072472 Nov 03 04:01:15.196317 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1267/2440] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:15.214199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:15.217369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:15.227668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:15.240804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:15.242612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:15.245049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:15.246931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:15.248682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:15.831807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:15.841412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-26f2d93d-9909-47e9-9502-3706dc98281e tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1541 microversion: 2.1 time: 0.633877 Nov 03 04:01:15.844738 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1268/2441] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:15 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1541 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:15.863607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1571046785", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1f101308-9db8-4b30-b5f1-954d8d42482e"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:15.868045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:22.312382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:22.343294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:23.947791 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-18855045-43b0-40ad-bcec-a4f7e49b584b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 11.588975 Nov 03 04:01:23.948899 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1174/2442] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:12 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 11591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:23.962089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:23.963130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:23.963742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:01:23.989847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:23.991264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:23.991264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:23.991509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:24.010330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:24.011752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:24.268160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:24.276775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-064a8058-38c3-4b78-98af-ed552e3d4f7c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1325 microversion: 2.1 time: 0.326746 Nov 03 04:01:24.277416 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1175/2443] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:23 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:24.696823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:24.697607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:24.710918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:24.713368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:24.714081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:24.716614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:24.717333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:24.719622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:24.777722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:01:24.778150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:01:24.778627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:01:24.779045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:01:24.779458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:01:24.794917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:24.795411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:24.795852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:24.797194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:24.797641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:24.798071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:24.862541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:01:24.879313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:01:24.901698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:01:24.904940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:01:25.053634 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-89790df8-2666-4c2f-8d71-9c4c43b23602 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.207624 Nov 03 04:01:25.065221 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1269/2444] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 9213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:01:25.082504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:25.083433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:25.098704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.100603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.100732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:25.101833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.106483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.107348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.108060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.135078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:25.136830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:25.142197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57180ca4-8ae6-4663-9108-340ebcffcc1d tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2944 microversion: 2.32 time: 0.860338 Nov 03 04:01:25.143124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1176/2445] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:24 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2944 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:25.154381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:25.156753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:25.181657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.182640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.183439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.186817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.189577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.190321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.289750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:25.305263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:25.306771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:25.317253 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3457a832-7fb3-4d98-9c21-16eed5598c94 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.250365 Nov 03 04:01:25.317861 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1270/2446] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:25 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:25.341596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:25.342816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:25.370635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.371990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.374675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.375420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.375898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.376341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.389101 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c186c02-5f6f-41bc-ad4d-fbe777ab44e1 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244233 Nov 03 04:01:25.390795 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1177/2447] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:01:25 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1/os-interface => generated 284 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:25.396280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-89bb2a78-1211-4172-b88e-ec776fbe5065 req-d088ee51-b788-4498-967b-f3179d9f534b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ff97d8-a5de-49ec-8ab6-49252fa26a4c", "tag": "4f57820b-e8d1-4673-9e84-6d40df1a9e04"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:25.424642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-89bb2a78-1211-4172-b88e-ec776fbe5065 req-d088ee51-b788-4498-967b-f3179d9f534b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.428003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-89bb2a78-1211-4172-b88e-ec776fbe5065 req-d088ee51-b788-4498-967b-f3179d9f534b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.428835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-89bb2a78-1211-4172-b88e-ec776fbe5065 req-d088ee51-b788-4498-967b-f3179d9f534b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.463494 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-89bb2a78-1211-4172-b88e-ec776fbe5065 req-d088ee51-b788-4498-967b-f3179d9f534b service nova] Creating event network-changed:4f57820b-e8d1-4673-9e84-6d40df1a9e04 for instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c on n-h1-854653-7 Nov 03 04:01:25.478210 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-89bb2a78-1211-4172-b88e-ec776fbe5065 req-d088ee51-b788-4498-967b-f3179d9f534b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085244 Nov 03 04:01:25.478860 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1178/2448] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:25.493764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c690ac80-e3bb-42d5-ae22-f77ef2d187b9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4881f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:25.579332 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c690ac80-e3bb-42d5-ae22-f77ef2d187b9 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.098953 Nov 03 04:01:25.582998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1179/2449] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:25 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:25.591778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8de77909-096b-4bae-a074-23612e922cd9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:25.592529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8de77909-096b-4bae-a074-23612e922cd9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:25.826227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8de77909-096b-4bae-a074-23612e922cd9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:25.840997 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8de77909-096b-4bae-a074-23612e922cd9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1209 microversion: 2.1 time: 0.254622 Nov 03 04:01:25.841862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1180/2450] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:25 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1209 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:25.849493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:25.855752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:25.867817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.872001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.872001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:25.873269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:25.874016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:25.875165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:26.063252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:26.083576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:26.087336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:26.091575 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db6ca62b-9124-48a0-ad86-f9bc69437eef tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 0.766495 Nov 03 04:01:26.119786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1271/2451] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:25 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:26.131594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:26.136688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:26.154550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:26.155469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:26.156773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:26.161906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:26.162690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:26.163366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:26.392043 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-021bf81f-1131-45e6-b747-0e2dee436228 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.546323 Nov 03 04:01:26.392939 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1181/2452] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 04:01:25 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa/os-interface => generated 1831 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:26.400956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:26.404769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:26.425505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:26.436010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:26.438074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:26.440104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:26.443199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:26.444060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:26.919215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:26.945672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:26.949540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:26.977493 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5e6f18bf-0984-4798-a211-b426f63bb319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1537 microversion: 2.91 time: 0.567249 Nov 03 04:01:26.977493 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1182/2453] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:26 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1537 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:26.977493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3e69f0ea-b8cf-43f3-9594-d74718c186f2 req-b3d35523-55d9-4355-8b3b-f30344890d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80effada-5529-4cbb-b06a-7365c0b82b20", "name": "network-vif-plugged", "status": "completed", "tag": "3ffc61a6-c0d5-43b8-914e-2a4d59d2cdb3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:26.984790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3e69f0ea-b8cf-43f3-9594-d74718c186f2 req-b3d35523-55d9-4355-8b3b-f30344890d72 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:26.984790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3e69f0ea-b8cf-43f3-9594-d74718c186f2 req-b3d35523-55d9-4355-8b3b-f30344890d72 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:26.984790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3e69f0ea-b8cf-43f3-9594-d74718c186f2 req-b3d35523-55d9-4355-8b3b-f30344890d72 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:27.004894 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3e69f0ea-b8cf-43f3-9594-d74718c186f2 req-b3d35523-55d9-4355-8b3b-f30344890d72 service nova] Creating event network-vif-plugged:3ffc61a6-c0d5-43b8-914e-2a4d59d2cdb3 for instance 80effada-5529-4cbb-b06a-7365c0b82b20 on n-h1-854653-7 Nov 03 04:01:27.023952 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3e69f0ea-b8cf-43f3-9594-d74718c186f2 req-b3d35523-55d9-4355-8b3b-f30344890d72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057978 Nov 03 04:01:27.025241 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1183/2454] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:27.035746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3cb243e3-65a4-4f0f-8808-9144866013da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f91f6f70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:27.081075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:27.090202 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abf669c1-0ba1-4e0c-9466-38331ff28ca7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1325 microversion: 2.1 time: 0.968716 Nov 03 04:01:27.090807 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1272/2455] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:26 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1325 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:27.122868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:27.123512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:27.164433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:27.164944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:27.165433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:27.166156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:27.167930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:27.168589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:27.173340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3cb243e3-65a4-4f0f-8808-9144866013da tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.146761 Nov 03 04:01:27.178466 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1184/2456] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:27 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:27.195744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:27.196505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:27.218727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:27.219234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:27.220116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:27.238742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:27.239395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:27.241916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:27.332375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:27.345069 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-74baf298-55bf-42a1-b779-ede406c8dee2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1205 microversion: 2.1 time: 0.253152 Nov 03 04:01:27.346672 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1273/2457] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:27 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1205 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:27.657181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1801320085", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "53b9ab60-f71a-4332-8ec5-d34d089f34dd"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:27.696534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:27.709994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:27.713286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:27.714458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4bb91d71-cf2d-4a50-871a-423946c410b9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 0.535001 Nov 03 04:01:27.717773 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1185/2458] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:27 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:27.728912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ce9325f4-b049-4a25-aed7-e24a9984eb3c req-30a7f530-bb16-4a47-9505-e6279ce4c0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80effada-5529-4cbb-b06a-7365c0b82b20", "tag": "3ffc61a6-c0d5-43b8-914e-2a4d59d2cdb3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:27.756726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce9325f4-b049-4a25-aed7-e24a9984eb3c req-30a7f530-bb16-4a47-9505-e6279ce4c0e9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:27.765879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce9325f4-b049-4a25-aed7-e24a9984eb3c req-30a7f530-bb16-4a47-9505-e6279ce4c0e9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:27.770004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce9325f4-b049-4a25-aed7-e24a9984eb3c req-30a7f530-bb16-4a47-9505-e6279ce4c0e9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:27.795707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] validate_networks() for [('53b9ab60-f71a-4332-8ec5-d34d089f34dd', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:01:27.802847 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ce9325f4-b049-4a25-aed7-e24a9984eb3c req-30a7f530-bb16-4a47-9505-e6279ce4c0e9 service nova] Creating event network-changed:3ffc61a6-c0d5-43b8-914e-2a4d59d2cdb3 for instance 80effada-5529-4cbb-b06a-7365c0b82b20 on n-h1-854653-7 Nov 03 04:01:27.830185 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ce9325f4-b049-4a25-aed7-e24a9984eb3c req-30a7f530-bb16-4a47-9505-e6279ce4c0e9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110543 Nov 03 04:01:27.834106 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1186/2459] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:28.005352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:28.006087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:28.019391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:28.019915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:28.020369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:28.023087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:28.023578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:28.024017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:28.591253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:28.629145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:28.636509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:28.664968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ea418f5-9e62-4871-bf11-6fe52c6986cd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1537 microversion: 2.91 time: 0.666618 Nov 03 04:01:28.665607 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1187/2460] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:27 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1537 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:28.683582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:28.688685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:28.710432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:28.725970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:28.728791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:28.729612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:28.730111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:28.736072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:29.641772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:29.654552 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcc63022-fa36-4988-aa5b-19fdae4625d4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1325 microversion: 2.1 time: 0.984273 Nov 03 04:01:29.655181 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1188/2461] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:28 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1325 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:29.663031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7989c8f-04c3-449b-b042-bcbfc5db3f94 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5195e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:29.734432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7989c8f-04c3-449b-b042-bcbfc5db3f94 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.076972 Nov 03 04:01:29.737697 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1189/2462] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:29 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:29.746317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:29.747326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:29.756195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:29.756694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:29.757161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:29.757875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:29.758471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:29.758907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:29.941863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:29.945452 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6c8db24-b4e8-457a-9acc-2979b8efd15e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1267 microversion: 2.1 time: 0.208493 Nov 03 04:01:29.961314 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1190/2463] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:29 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:29.966387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:29.966976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:29.982771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:29.982771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:29.982771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:29.982771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:29.983177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:29.983660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:30.222219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:01:30.224193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:01:30.225121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:01:30.225872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:01:30.229918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:01:30.272067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:30.272944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:30.278157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:30.279218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:30.280271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:30.282564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:30.341042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Getting quotas for project 7f6e97a2ad2b4807b584ec8a9fa8d7cf. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:01:30.361601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Getting quotas for user 6f66a270dc1943b18d445c3b7b1d2078 and project 7f6e97a2ad2b4807b584ec8a9fa8d7cf. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:01:30.404931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:01:30.410785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:01:30.470671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.496467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.511924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.521794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-044fd992-d1a3-43b4-8504-ff19d1209875 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 0.559194 Nov 03 04:01:30.525573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1191/2464] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:29 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:30.542481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:30.543182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:30.555638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:30.556077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:30.556549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:30.557311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:30.557795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:30.558238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:30.658508 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71a26b66-1ba0-4477-b742-87bbc53d38d4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.146315 Nov 03 04:01:30.667750 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1274/2465] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3156 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:01:30.675691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8811e00a-7317-4bc3-ade9-1ec7712839f6 req-79a382bf-1c67-4476-aa87-331945c4a747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53589e40-4455-4b27-8d9c-d63fe9f193d1", "tag": "29588292-eaad-405c-8c1d-20aa98f187a5"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:30.692099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8811e00a-7317-4bc3-ade9-1ec7712839f6 req-79a382bf-1c67-4476-aa87-331945c4a747 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:30.692857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8811e00a-7317-4bc3-ade9-1ec7712839f6 req-79a382bf-1c67-4476-aa87-331945c4a747 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:30.693512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8811e00a-7317-4bc3-ade9-1ec7712839f6 req-79a382bf-1c67-4476-aa87-331945c4a747 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:30.712682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8811e00a-7317-4bc3-ade9-1ec7712839f6 req-79a382bf-1c67-4476-aa87-331945c4a747 service nova] Creating event network-changed:29588292-eaad-405c-8c1d-20aa98f187a5 for instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 on n-h1-854653-7 Nov 03 04:01:30.734651 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8811e00a-7317-4bc3-ade9-1ec7712839f6 req-79a382bf-1c67-4476-aa87-331945c4a747 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064711 Nov 03 04:01:30.750026 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1275/2466] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:30.756677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cb16c46a-87ba-410a-84c5-140582995a20 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:30.757586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cb16c46a-87ba-410a-84c5-140582995a20 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:30.880125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.901197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.902784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.924907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cb16c46a-87ba-410a-84c5-140582995a20 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.935329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cb16c46a-87ba-410a-84c5-140582995a20 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.938889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cb16c46a-87ba-410a-84c5-140582995a20 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:30.939563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe8108d1-2cac-4619-9c6b-d32fdc57d66f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1480 microversion: 2.91 time: 0.412408 Nov 03 04:01:30.940053 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cb16c46a-87ba-410a-84c5-140582995a20 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1259 microversion: 2.21 time: 0.188278 Nov 03 04:01:30.940169 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1192/2467] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:30 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1480 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:30.940772 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1276/2468] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:30 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:30.951907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:30.952594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:30.953525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4905334d-192d-489d-94d8-afc1463f95a8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5ffaf0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:30.978178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:30.978701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:30.979157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:30.987411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:30.988004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:30.994861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:31.024319 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4905334d-192d-489d-94d8-afc1463f95a8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.082211 Nov 03 04:01:31.034653 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1277/2469] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:30 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:31.039762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:31.042274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:31.050191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:31.050695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:31.051146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:31.051919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:31.052562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:31.053251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:31.143221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-854653-7". {{(pid=127594) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 03 04:01:31.602947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8c03a30-7007-48f8-ab06-64c5a0340c9a tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action" status: 202 len: 0 microversion: 2.91 time: 0.566895 Nov 03 04:01:31.605113 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1278/2470] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:01:31 2022] POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:31.612933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:31.615240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:31.626343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:31.627189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:31.627873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:31.628916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:31.629619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:31.630342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:31.637296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:31.649583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20db5afb-ec0f-4379-805c-93926798d2c5 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1325 microversion: 2.1 time: 0.708232 Nov 03 04:01:31.654593 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1193/2471] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:30 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1325 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:31.668100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:31.678463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:31.701895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:31.704779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:31.709483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:31.712119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:31.713444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:31.716349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:32.498663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.511433 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e3d0b97-5d16-4de7-817e-73808e2fd067 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.904733 Nov 03 04:01:32.519110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1279/2472] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:31 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:32.533566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:32.537353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:32.555453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:32.560886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:32.564542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:32.565370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:32.570744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:32.574294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:32.574294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:32.654707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.673288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.679558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.684603 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2614653d-71fd-4980-a02c-1adcbfc9ca31 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 1.025429 Nov 03 04:01:32.687867 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1194/2473] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:31 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:32.698756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:32.699834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:32.718850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:32.720054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:32.720702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:32.721655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:32.722303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:32.723510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:32.753710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.763024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.785228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.804807 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99ff42aa-f3c9-45b2-b85e-5a6655b8e683 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1488 microversion: 2.91 time: 0.283691 Nov 03 04:01:32.818931 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1280/2474] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:32 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1488 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:32.818931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33b81bc9-29d4-4014-9a09-eb49af048441 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f9737940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:32.876848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.887309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.898546 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33b81bc9-29d4-4014-9a09-eb49af048441 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1454 microversion: 2.1 time: 0.089801 Nov 03 04:01:32.904334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:32.907387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1281/2475] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:32 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:32.909487 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae575697-d877-4aeb-94f4-55ab030ca8c6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1263 microversion: 2.21 time: 0.219401 Nov 03 04:01:32.913685 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1195/2476] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:32 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1263 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:32.922873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:32.926036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:32.948952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:32.951930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:32.953174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:32.960078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:32.961262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:32.961948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:32.973163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4b4bd14c-ff56-4988-a8ba-d283346c22a6 req-87f910c7-0ef9-4f03-b444-2a95e9e6deed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3177696f-f3bd-4b41-bc6f-56a7fc3d94e2", "tag": "72ae0aaf-1f0f-4f0a-aecc-bcf7eb680b76"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:33.003971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4b4bd14c-ff56-4988-a8ba-d283346c22a6 req-87f910c7-0ef9-4f03-b444-2a95e9e6deed service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.006616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4b4bd14c-ff56-4988-a8ba-d283346c22a6 req-87f910c7-0ef9-4f03-b444-2a95e9e6deed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.008722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4b4bd14c-ff56-4988-a8ba-d283346c22a6 req-87f910c7-0ef9-4f03-b444-2a95e9e6deed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.052052 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4b4bd14c-ff56-4988-a8ba-d283346c22a6 req-87f910c7-0ef9-4f03-b444-2a95e9e6deed service nova] Creating event network-changed:72ae0aaf-1f0f-4f0a-aecc-bcf7eb680b76 for instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 on n-h2-854653-7 Nov 03 04:01:33.083662 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4b4bd14c-ff56-4988-a8ba-d283346c22a6 req-87f910c7-0ef9-4f03-b444-2a95e9e6deed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107041 Nov 03 04:01:33.083662 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1196/2477] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:33.319656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:33.334393 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-67110349-9534-4876-89fe-de5be8a89c09 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1523 microversion: 2.1 time: 0.425214 Nov 03 04:01:33.338896 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1282/2478] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:32 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:33.374689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:33.375672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:33.383337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.384082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.385171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.386445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.387164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.387826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.449848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:01:33.493334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:33.547938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:33.548787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:33.557625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.558222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.558730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.559771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.560242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.562190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.588874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:33.751948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:33.786094 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a0b9d849-5ba4-4977-9d76-b577830b48c2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.246034 Nov 03 04:01:33.791146 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1283/2479] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:33 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:33.817533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:33.818616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:33.830698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.831777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.834476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.835321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.835885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.836398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.837912 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-879bab1e-f504-4dee-9c2b-f7813a98c856 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 204 len: 0 microversion: 2.1 time: 0.468102 Nov 03 04:01:33.838512 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1197/2480] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:33 2022] DELETE /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:33.846564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:33.847374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:33.854906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.855580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.856101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.857295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.857745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.858822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d90743d-5e3d-46c3-ad16-bd0a08cb8aa0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1488 microversion: 2.91 time: 0.117926 Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1198/2481] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:33 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1488 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:33.976820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.977458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.977680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:33.978942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:33.979615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:33.980374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:34.128260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.139109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.141118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.142413 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-44e3fa09-cf5c-41ec-a2aa-9d49c04f83e8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 0.349143 Nov 03 04:01:34.160777 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1284/2482] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:33 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:34.161410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.165603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f1e66e8-7191-4134-9c4e-c47cb16f7624 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f94e95e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.168967 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-97d26dc5-80f8-473a-b61c-45cd6e757bb2 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1529 microversion: 2.1 time: 0.207500 Nov 03 04:01:34.169391 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1199/2483] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:33 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1529 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:34.177229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.178076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:34.184656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:34.185296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:34.185747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:34.186486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:34.186952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:34.187386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:34.219718 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f1e66e8-7191-4134-9c4e-c47cb16f7624 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1463 microversion: 2.1 time: 0.072530 Nov 03 04:01:34.221036 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1285/2484] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1463 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:34.236503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13ffb780-d1e5-4a68-ba48-2bb9b0de6764 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd492a60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.258975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.267544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.268943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.270107 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80500b66-05c8-4fed-a254-946e4c8b9804 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1311 microversion: 2.21 time: 0.099496 Nov 03 04:01:34.273886 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1200/2485] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:34.299046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13ffb780-d1e5-4a68-ba48-2bb9b0de6764 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 200 len: 1463 microversion: 2.1 time: 0.068379 Nov 03 04:01:34.299684 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1286/2486] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 1463 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:34.315527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.320110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:34.322876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:34.323557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:34.323995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:34.324700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:34.325185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:34.325630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:34.464659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:34.474567 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5456a2dd-0b8c-48a6-b238-1f640ae5e145 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1465 microversion: 2.1 time: 0.163007 Nov 03 04:01:34.475471 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1201/2487] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1465 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:34.498595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3aa6005-3103-431f-b06c-6c91881688b6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f94e9430>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.605136 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3aa6005-3103-431f-b06c-6c91881688b6 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?changes-since=2022-11-03T03%3A59%3A53Z" status: 200 len: 1901 microversion: 2.1 time: 0.110339 Nov 03 04:01:34.605735 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1287/2488] 10.222.0.30 () {58 vars in 1199 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images?changes-since=2022-11-03T03%3A59%3A53Z => generated 1901 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:34.620042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b6381238-4a7a-4fc6-8fa7-0b51c2b9fc51 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f92e4940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.698014 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b6381238-4a7a-4fc6-8fa7-0b51c2b9fc51 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1958076582" status: 200 len: 485 microversion: 2.1 time: 0.081737 Nov 03 04:01:34.698591 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1202/2489] 10.222.0.30 () {58 vars in 1231 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1958076582 => generated 485 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:01:34.714009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a99243db-c69c-464f-9cff-3fb5b5724e44 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd60fa60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.810365 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a99243db-c69c-464f-9cff-3fb5b5724e44 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?server=1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 956 microversion: 2.1 time: 0.100757 Nov 03 04:01:34.812604 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1288/2490] 10.222.0.30 () {58 vars in 1209 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images?server=1547c889-73e4-4a6a-8925-439fba280d99 => generated 956 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:34.817226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.818068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:34.830276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:34.831193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:34.831841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:34.832744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:34.833524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:34.833944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4114e17e-7468-4aaa-bd1b-a313f97a47f2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f9737e50>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.839911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:34.898572 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4114e17e-7468-4aaa-bd1b-a313f97a47f2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 485 microversion: 2.1 time: 0.073270 Nov 03 04:01:34.899160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1289/2491] 10.222.0.30 () {58 vars in 1317 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 485 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:01:34.918358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2786d8a8-aa8b-4601-878d-90c51408f606 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd60fdc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:34.978739 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2786d8a8-aa8b-4601-878d-90c51408f606 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 485 microversion: 2.1 time: 0.068315 Nov 03 04:01:34.979490 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1290/2492] 10.222.0.30 () {58 vars in 1303 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 485 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:34.996459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eeaff0be-bf68-4713-b0a7-b7dfb4a6dbbe tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f95a34c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.045106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.054472 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0317075d-15f9-4542-a3ec-9f0d10dd55aa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.241792 Nov 03 04:01:35.055068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1203/2493] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:35.060252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.061186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:35.068330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.068961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.069500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.070303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.070853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.071355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.154210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eeaff0be-bf68-4713-b0a7-b7dfb4a6dbbe tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.165321 Nov 03 04:01:35.155419 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1291/2494] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 04:01:34 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:35.174392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.178934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.178934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:35.183472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.184929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.191304 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be34248d-797c-4ca8-8104-03fe2fba4d9f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1488 microversion: 2.91 time: 0.134886 Nov 03 04:01:35.191885 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1204/2495] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1488 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:35.193288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.193862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.194322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.197518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a2b08592-051f-437f-b238-b39d89cf4fad tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4793a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.198763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.199291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.199747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.278920 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a2b08592-051f-437f-b238-b39d89cf4fad tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.085738 Nov 03 04:01:35.279507 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1205/2496] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:35.291543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.292258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:35.303412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.303914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.304546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.305335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.305818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.306259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.459124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.486045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.488622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.493499 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6433f065-7e94-4015-9031-8d3795934299 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 0.323692 Nov 03 04:01:35.493499 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1292/2497] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:35.496995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c61a5e93-4219-47b8-a4ee-78bde645916c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f95a3af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.606330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c61a5e93-4219-47b8-a4ee-78bde645916c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.110854 Nov 03 04:01:35.607272 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1293/2498] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:35.618894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.622612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:35.637176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.637924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.638543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.640107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:35.650325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:35.651010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:35.710714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.732168 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ed2a838-7117-4571-ab22-4b60c9ab49b1 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1529 microversion: 2.1 time: 0.438914 Nov 03 04:01:35.734109 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1206/2499] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1529 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:35.754870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73d61072-536c-43db-a794-bdfb3a09a7e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4793a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:35.833581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:35.834184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.844027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.845522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:35.846768 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d409e25-db6a-4d8d-8248-90d00d44d5ec tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1311 microversion: 2.21 time: 0.236721 Nov 03 04:01:35.853171 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1294/2500] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1311 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:35.911537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73d61072-536c-43db-a794-bdfb3a09a7e1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/detail?changes-since=2022-11-03T03%3A59%3A48Z" status: 200 len: 6333 microversion: 2.1 time: 0.176025 Nov 03 04:01:35.912895 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1207/2501] 10.222.0.30 () {58 vars in 1220 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-03T03%3A59%3A48Z => generated 6333 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:35.940826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a46fca7e-1279-496a-889b-d8d0782da828 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f9737670>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:36.009914 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a46fca7e-1279-496a-889b-d8d0782da828 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1958076582" status: 200 len: 665 microversion: 2.1 time: 0.073344 Nov 03 04:01:36.025847 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1295/2502] 10.222.0.30 () {58 vars in 1252 bytes} [Thu Nov 3 04:01:35 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1958076582 => generated 665 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:36.038638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3aaacfbb-ba8d-4007-b8b2-f85e23eebfad tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4af700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:36.083790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:36.101338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:36.101338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:36.101745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:36.102206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:36.102945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:36.103470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:36.103914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:36.184331 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3aaacfbb-ba8d-4007-b8b2-f85e23eebfad tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1467 microversion: 2.1 time: 0.155895 Nov 03 04:01:36.188565 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1208/2503] 10.222.0.30 () {58 vars in 1338 bytes} [Thu Nov 3 04:01:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fv2.1%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1467 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:36.205908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1aedb10c-b5d9-4a13-acb8-1c3a4f9457b2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f93895e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:36.274510 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1aedb10c-b5d9-4a13-acb8-1c3a4f9457b2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1467 microversion: 2.1 time: 0.074331 Nov 03 04:01:36.275719 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1209/2504] 10.222.0.30 () {58 vars in 1324 bytes} [Thu Nov 3 04:01:36 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.30%2Fcompute%2Fservers%2F60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1467 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:36.282293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:36.284011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:36.292024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:36.293531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:36.294244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:36.295241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:36.295896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:36.296577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:36.774147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:36.783523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:36.785431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:36.791768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7c71da6-ee42-48c3-84e8-44fd6aacc3ce tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.514563 Nov 03 04:01:36.792957 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1210/2505] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:36 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:36.798880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-53f45da6-087f-4d54-9fd0-721e8a47b726 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f92e4ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:36.829907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:36.846149 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d943be00-c698-4bc0-8aa0-b5c469242dd6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.767429 Nov 03 04:01:36.851581 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1296/2506] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:36 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:36.949064 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-53f45da6-087f-4d54-9fd0-721e8a47b726 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.154804 Nov 03 04:01:36.949980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1211/2507] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Nov 3 04:01:36 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:36.954930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:36.955780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:36.970080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:36.970845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:36.971448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:36.972474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:36.973141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:36.973757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:36.984624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b85f8b9f-4f39-45ac-8434-87f1aab35035 req-aa3507eb-5b00-4f0c-a4c5-834ed93b9c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff97d8-a5de-49ec-8ab6-49252fa26a4c", "name": "network-vif-plugged", "status": "completed", "tag": "4f57820b-e8d1-4673-9e84-6d40df1a9e04"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:36.995718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b85f8b9f-4f39-45ac-8434-87f1aab35035 req-aa3507eb-5b00-4f0c-a4c5-834ed93b9c73 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.000887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b85f8b9f-4f39-45ac-8434-87f1aab35035 req-aa3507eb-5b00-4f0c-a4c5-834ed93b9c73 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.000887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b85f8b9f-4f39-45ac-8434-87f1aab35035 req-aa3507eb-5b00-4f0c-a4c5-834ed93b9c73 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.012147 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b85f8b9f-4f39-45ac-8434-87f1aab35035 req-aa3507eb-5b00-4f0c-a4c5-834ed93b9c73 service nova] Creating event network-vif-plugged:4f57820b-e8d1-4673-9e84-6d40df1a9e04 for instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c on n-h1-854653-7 Nov 03 04:01:37.028947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b85f8b9f-4f39-45ac-8434-87f1aab35035 req-aa3507eb-5b00-4f0c-a4c5-834ed93b9c73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179612 Nov 03 04:01:37.029959 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1297/2508] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:37.035554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:37.036276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:37.052883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.053384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.054199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.054547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.055003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.055440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.430967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.460945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.462663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.469000 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55b2fde5-86d2-4453-864f-bfa546379396 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 0.517971 Nov 03 04:01:37.470147 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1212/2509] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:36 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:37.475694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:37.476750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:37.497620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.498628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.499361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.500687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.501387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.502377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.539670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.555819 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75ae2e1b-1878-4a35-83f9-a4bc2f56b021 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1529 microversion: 2.1 time: 0.524269 Nov 03 04:01:37.556654 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1298/2510] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:37 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1529 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:37.573184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-961288db-c4dc-4587-835d-c10923c0ee12 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd60fa60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:37.665423 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-961288db-c4dc-4587-835d-c10923c0ee12 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.107382 Nov 03 04:01:37.678729 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1299/2511] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Nov 3 04:01:37 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:37.782740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.788076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f445cf7e-1be6-487a-98c3-664e4633dbaa req-39dcc989-f4a8-4c9c-a1cb-3c92bcd2e477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80effada-5529-4cbb-b06a-7365c0b82b20", "name": "network-vif-deleted", "tag": "3ffc61a6-c0d5-43b8-914e-2a4d59d2cdb3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:37.795087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.798818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.800063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a478fd88-2ba7-423b-8589-36844d2c9103 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1359 microversion: 2.21 time: 0.328279 Nov 03 04:01:37.800630 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1213/2512] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:37 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1359 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:37.817100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b268895c-9276-45c2-8043-4a7369fa7bcc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f97481f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:37.823144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f445cf7e-1be6-487a-98c3-664e4633dbaa req-39dcc989-f4a8-4c9c-a1cb-3c92bcd2e477 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.824132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f445cf7e-1be6-487a-98c3-664e4633dbaa req-39dcc989-f4a8-4c9c-a1cb-3c92bcd2e477 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.825427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f445cf7e-1be6-487a-98c3-664e4633dbaa req-39dcc989-f4a8-4c9c-a1cb-3c92bcd2e477 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.852870 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f445cf7e-1be6-487a-98c3-664e4633dbaa req-39dcc989-f4a8-4c9c-a1cb-3c92bcd2e477 service nova] Creating event network-vif-deleted:3ffc61a6-c0d5-43b8-914e-2a4d59d2cdb3 for instance 80effada-5529-4cbb-b06a-7365c0b82b20 on n-h1-854653-7 Nov 03 04:01:37.864473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f445cf7e-1be6-487a-98c3-664e4633dbaa req-39dcc989-f4a8-4c9c-a1cb-3c92bcd2e477 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184099 Nov 03 04:01:37.869419 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b268895c-9276-45c2-8043-4a7369fa7bcc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/9282dbed-69cc-4288-b866-d4c7962a81f1" status: 200 len: 784 microversion: 2.1 time: 0.057709 Nov 03 04:01:37.870447 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1214/2513] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:01:37 2022] GET /compute/v2.1/images/9282dbed-69cc-4288-b866-d4c7962a81f1 => generated 784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:37.873830 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1300/2514] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:37.876797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:37.877825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:37.886728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:37.887030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.887649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:37.887899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.888524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.889451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.890167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.890745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.917736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.919565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.920114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.921594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:37.922130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:37.922735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:37.990464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:37.998200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:38.000199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:38.011999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b5e4737-1f2f-4821-9d70-9b1a12577477 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.140122 Nov 03 04:01:38.012583 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1215/2515] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:37 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:38.028948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c30be38-832c-4d4f-851c-80249bc4b51e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd5190d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:38.096428 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c30be38-832c-4d4f-851c-80249bc4b51e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.082752 Nov 03 04:01:38.104502 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1216/2516] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 04:01:38 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:38.113036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ed03067-887a-4a11-b109-7c620c31848c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7fd4791f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:38.143720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:38.153423 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71d18d8f-e75c-4ed0-9ec5-7fd3f057a09b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.277855 Nov 03 04:01:38.154299 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1301/2517] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:37 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:38.496663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:38.497618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:38.512651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:38.515739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:38.516706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:38.521059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:38.522271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:38.526284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:38.779790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:38.794496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:38.797377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:38.799084 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07e96f1a-ba88-48a4-9ee3-b9773fe2b52c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1280 microversion: 2.25 time: 0.306891 Nov 03 04:01:38.800834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1302/2518] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:38 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1280 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:38.811048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:38.812427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:38.820943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:38.821701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:38.822324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:38.823387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:38.824276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:38.824869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:38.878656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:38.880046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:38.880738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:38.881709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:38.981267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:38.995039 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-547da6bf-f077-4a6a-bada-2d6b1227e64a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.192646 Nov 03 04:01:38.997932 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1303/2519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:38 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:39.010601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6f3ae1f2-75ff-450d-aa7c-f0aba447d1e5 req-6f3c5f38-5a75-4aaf-af8f-fe901d99ed5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65d40bb6-7973-4724-98b4-d40f50ffc161", "tag": "ca850996-9dac-46ee-a91a-bdcbd1d542e2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:39.032719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6f3ae1f2-75ff-450d-aa7c-f0aba447d1e5 req-6f3c5f38-5a75-4aaf-af8f-fe901d99ed5f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.033238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6f3ae1f2-75ff-450d-aa7c-f0aba447d1e5 req-6f3c5f38-5a75-4aaf-af8f-fe901d99ed5f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.033686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6f3ae1f2-75ff-450d-aa7c-f0aba447d1e5 req-6f3c5f38-5a75-4aaf-af8f-fe901d99ed5f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.066607 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6f3ae1f2-75ff-450d-aa7c-f0aba447d1e5 req-6f3c5f38-5a75-4aaf-af8f-fe901d99ed5f service nova] Creating event network-changed:ca850996-9dac-46ee-a91a-bdcbd1d542e2 for instance 65d40bb6-7973-4724-98b4-d40f50ffc161 on n-h2-854653-7 Nov 03 04:01:39.078421 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6f3ae1f2-75ff-450d-aa7c-f0aba447d1e5 req-6f3c5f38-5a75-4aaf-af8f-fe901d99ed5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076300 Nov 03 04:01:39.079843 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1304/2520] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:39.094820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:39.095901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:39.111815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.112374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.112828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.114361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.114843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.115931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.391306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:39.406610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:39.408290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:39.413008 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0f7bd25c-4070-4f23-b5b2-b0ea2c714303 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1359 microversion: 2.21 time: 0.330828 Nov 03 04:01:39.415756 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1305/2521] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:39 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1359 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:39.427211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:39.429364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:39.448568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.449214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.449757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.450595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.451130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.451622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.565112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:39.587470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:39.588942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:39.595127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9428ec1-2c71-4c4f-863c-1626827c6612 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.177610 Nov 03 04:01:39.596018 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1306/2522] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:39 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:39.617292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2f95dcca-85f5-44e6-8b63-c0b4f2eafbd0 req-cc29fc76-b40b-4af1-90a4-731f534c679f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1547c889-73e4-4a6a-8925-439fba280d99", "name": "network-vif-unplugged", "status": "completed", "tag": "8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:39.629424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2f95dcca-85f5-44e6-8b63-c0b4f2eafbd0 req-cc29fc76-b40b-4af1-90a4-731f534c679f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.629940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2f95dcca-85f5-44e6-8b63-c0b4f2eafbd0 req-cc29fc76-b40b-4af1-90a4-731f534c679f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.630380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2f95dcca-85f5-44e6-8b63-c0b4f2eafbd0 req-cc29fc76-b40b-4af1-90a4-731f534c679f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.643404 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2f95dcca-85f5-44e6-8b63-c0b4f2eafbd0 req-cc29fc76-b40b-4af1-90a4-731f534c679f service nova] Creating event network-vif-unplugged:8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac for instance 1547c889-73e4-4a6a-8925-439fba280d99 on n-h2-854653-7 Nov 03 04:01:39.649364 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2f95dcca-85f5-44e6-8b63-c0b4f2eafbd0 req-cc29fc76-b40b-4af1-90a4-731f534c679f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051961 Nov 03 04:01:39.650297 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1307/2523] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:39.656363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:39.657108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:39.664289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.664781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.665259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.666133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.666592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.667028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.869833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:39.878949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-695f661a-812d-4d64-b499-ce617b08f9a9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.227430 Nov 03 04:01:39.880138 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1308/2524] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:39 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:39.884911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:39.885554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:39.892233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.892995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.893686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:39.894649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:39.895288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:39.895954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.076446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:40.086068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:40.087523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:40.088754 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9e8dcd6-8c29-4bb6-a493-cf48358f5a62 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1477 microversion: 2.25 time: 0.207621 Nov 03 04:01:40.089283 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1309/2525] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:39 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1477 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:40.093769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:40.094406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:40.100387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.100870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.112006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.112006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.112006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.112006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.145581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.146139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.146587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.147045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:40.193618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:40.201777 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b299985d-80d8-4beb-985e-dba42cc214a0 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.111464 Nov 03 04:01:40.202362 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1310/2526] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:40 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:40.320430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:40.361696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:40.366680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:40.372576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.375378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.378273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.379292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.380997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.381677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.543938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid c8ff97d8-a5de-49ec-8ab6-49252fa26a4c {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:40.553413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:40.565869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5a0365db-46f5-4e96-bc7e-a5887f6fb229 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1969 microversion: 2.25 time: 0.362449 Nov 03 04:01:40.578105 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1311/2527] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:40 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1969 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:40.583551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:40.584181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:40.592001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.593098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.593556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.594279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.594747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.595187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.675152 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ed03067-887a-4a11-b109-7c620c31848c tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14" status: 204 len: 0 microversion: 2.1 time: 2.566673 Nov 03 04:01:40.676384 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1217/2528] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:38 2022] DELETE /compute/v2.1/images/7d88fd28-d5ec-4686-bf71-fbbb5ecb2c14 => generated 0 bytes in 2569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:01:40.684446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:40.688858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:40.703085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.704630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.707731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.708781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.709337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.710010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.831337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:40.840320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:40.841799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:40.842980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53bca56a-7933-4b89-a024-d406c13c3f6b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1359 microversion: 2.21 time: 0.263498 Nov 03 04:01:40.844037 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1312/2529] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:40 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:40.861457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:40.862085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:40.869632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.870123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.870568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.871275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:40.871733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:40.872164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:40.940190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=14 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:40.960895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid c8ff97d8-a5de-49ec-8ab6-49252fa26a4c {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:41.000676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:41.006094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-980991d7-6f3c-439d-8900-09dc74ee52ff tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1969 microversion: 2.25 time: 0.327205 Nov 03 04:01:41.006752 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1218/2530] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:40 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:41.011569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-01624dc4-8343-4711-8914-14636995facf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f994a160>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:41.046317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:41.046317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:41.067535 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bfa669a0-227c-4ff9-ace7-f0691140cdfc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.220940 Nov 03 04:01:41.081050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1313/2531] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:40 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:41.090509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:41.090509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:41.105067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.105067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.105067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.112173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.113239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.113698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.340713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:41.353004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c4a3397-0489-47c8-a771-59daf308da49 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.282610 Nov 03 04:01:41.355202 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1314/2532] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:41 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:41.365755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:41.370706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.375073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.375631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.376890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.377051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.377427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.403948 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-74cd417a-a95f-4b5f-bb2b-a4982901dbfb tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.047188 Nov 03 04:01:41.405621 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1315/2533] 10.222.0.30 () {60 vars in 1217 bytes} [Thu Nov 3 04:01:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:01:41.417751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:41.418541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:41.424780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.428164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.428164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.428164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.428164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.428164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.472156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.473209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.473855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.474535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:41.524270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:41.532561 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb4cdf8a-5417-445d-acae-a36b1e6616cd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.118602 Nov 03 04:01:41.533564 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1316/2534] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:41 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:41.568048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854653-7", "block_migration": "auto"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:41.575133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:41.587975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.589057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.589542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.590264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:41.590729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:41.595063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:41.658232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'flavor' on Instance uuid c8ff97d8-a5de-49ec-8ab6-49252fa26a4c {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:41.673460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Going to try to live migrate instance to n-h2-854653-7 {{(pid=127594) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 04:01:43.252833 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-01624dc4-8343-4711-8914-14636995facf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c" status: 204 len: 0 microversion: 2.1 time: 2.242094 Nov 03 04:01:43.252833 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1219/2535] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:41 2022] DELETE /compute/v2.1/images/7662d0f3-2ed5-472b-8542-818ce83a8c1c => generated 0 bytes in 2243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:43.257889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-336cea18-152b-40f0-a13a-27f83f5765f4 req-0415e107-8225-4411-95fd-10d9bb08c59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3177696f-f3bd-4b41-bc6f-56a7fc3d94e2", "name": "network-vif-plugged", "status": "completed", "tag": "72ae0aaf-1f0f-4f0a-aecc-bcf7eb680b76"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:43.269800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-336cea18-152b-40f0-a13a-27f83f5765f4 req-0415e107-8225-4411-95fd-10d9bb08c59e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:43.270282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-336cea18-152b-40f0-a13a-27f83f5765f4 req-0415e107-8225-4411-95fd-10d9bb08c59e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:43.287129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-336cea18-152b-40f0-a13a-27f83f5765f4 req-0415e107-8225-4411-95fd-10d9bb08c59e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:43.287129 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-336cea18-152b-40f0-a13a-27f83f5765f4 req-0415e107-8225-4411-95fd-10d9bb08c59e service nova] Creating event network-vif-plugged:72ae0aaf-1f0f-4f0a-aecc-bcf7eb680b76 for instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 on n-h2-854653-7 Nov 03 04:01:43.290143 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-336cea18-152b-40f0-a13a-27f83f5765f4 req-0415e107-8225-4411-95fd-10d9bb08c59e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038328 Nov 03 04:01:43.291134 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1220/2536] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:43.296585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:43.297596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:43.304283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:43.305045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:43.305658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:43.306549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:43.307198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:43.307804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:43.522008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:43.536205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:43.538205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:43.539907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0233d441-7598-45e4-acdf-c84018d59ead tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1359 microversion: 2.21 time: 0.247470 Nov 03 04:01:43.545113 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1221/2537] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:43 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:43.547716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:43.548569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:43.555742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:43.556687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:43.557488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:43.558449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:43.559166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:43.559871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:43.720132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:43.732067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:43.733895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:43.749744 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f02eccbb-0697-476c-9201-ae6bf2201713 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.207573 Nov 03 04:01:43.761323 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1222/2538] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:43 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:43.761323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:43.761323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:43.775708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:43.777439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:43.778312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:43.779400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:43.780669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:43.783469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:43.999715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:44.009591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ebea1c8b-47d0-4b70-88f5-1a865dccdbdf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1309 microversion: 2.1 time: 0.256576 Nov 03 04:01:44.011172 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1223/2539] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:43 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1309 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:44.021824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:44.023333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:44.030242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:44.030677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:44.031125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:44.031849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:44.032312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:44.032778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:44.037471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:44.086347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:44.088222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:44.088795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:44.089276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:44.089819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:44.134641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:44.145136 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aee54b72-da84-4edd-9605-617fd13e79d7 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.132622 Nov 03 04:01:44.146312 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1224/2540] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:44 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:44.151997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ed01539-5a55-4d73-a4e4-d9b3fa4fbf8b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f98a7820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:46.059548 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ed01539-5a55-4d73-a4e4-d9b3fa4fbf8b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e" status: 204 len: 0 microversion: 2.1 time: 1.911935 Nov 03 04:01:46.061695 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1225/2541] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:44 2022] DELETE /compute/v2.1/images/7ecaac54-642c-4c9c-8caa-82c38b9b1b1e => generated 0 bytes in 1915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:46.067325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:46.067944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:46.086444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.086954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.087401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.088165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.088707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.089274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.235235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.243790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.245311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.246436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d4bd230-d0ab-4ae9-9892-411b12634c75 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1359 microversion: 2.21 time: 0.183652 Nov 03 04:01:46.247000 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1226/2542] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:46 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:46.252091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:46.252927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:46.259345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.259844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.260294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.261037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.261609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.262065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.328036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.336535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.338055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.342985 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-726f5965-9309-4051-8108-a1669d282da0 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.095030 Nov 03 04:01:46.343547 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1227/2543] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:46 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:46.348956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:46.349595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:46.355098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.355589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.356035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.356736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.357236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.358192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.491509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.500048 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bcc4516b-cd75-4239-839a-c1ba89cd50a4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1491 microversion: 2.1 time: 0.155521 Nov 03 04:01:46.500605 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1228/2544] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:46 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1491 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:46.505196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:46.505821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:46.511566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.512055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.512534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.513285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.513753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.514197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.560733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.561831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.562278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.562738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:46.603701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:46.612470 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f48872e-40e4-4f20-bb98-946b2851071d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.110880 Nov 03 04:01:46.613053 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1229/2545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:46 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:46.617529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-aaa703b7-befb-437f-b80e-6f78ce2524b3 req-9aa911fa-c080-44da-9fdf-833ca7727099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d40bb6-7973-4724-98b4-d40f50ffc161", "name": "network-vif-plugged", "status": "completed", "tag": "ca850996-9dac-46ee-a91a-bdcbd1d542e2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:46.627199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aaa703b7-befb-437f-b80e-6f78ce2524b3 req-9aa911fa-c080-44da-9fdf-833ca7727099 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.627714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aaa703b7-befb-437f-b80e-6f78ce2524b3 req-9aa911fa-c080-44da-9fdf-833ca7727099 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.628155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aaa703b7-befb-437f-b80e-6f78ce2524b3 req-9aa911fa-c080-44da-9fdf-833ca7727099 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.639380 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-aaa703b7-befb-437f-b80e-6f78ce2524b3 req-9aa911fa-c080-44da-9fdf-833ca7727099 service nova] Creating event network-vif-plugged:ca850996-9dac-46ee-a91a-bdcbd1d542e2 for instance 65d40bb6-7973-4724-98b4-d40f50ffc161 on n-h2-854653-7 Nov 03 04:01:46.644176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-aaa703b7-befb-437f-b80e-6f78ce2524b3 req-9aa911fa-c080-44da-9fdf-833ca7727099 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029966 Nov 03 04:01:46.644753 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1230/2546] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:46.649697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:46.650288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:46.656122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.656609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.657075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.657782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:46.658246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:46.658688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:46.684572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:01:46.914256 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad1024ed-e6f6-4686-adac-cfe072b7fc3b tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 204 len: 0 microversion: 2.1 time: 0.267979 Nov 03 04:01:46.915027 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1231/2547] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:46 2022] DELETE /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:46.920004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1571046785", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1f101308-9db8-4b30-b5f1-954d8d42482e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:46.976616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:01:47.422248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:01:47.422842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:01:47.423071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:01:47.423489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:01:47.423903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:01:47.432765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:47.433316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:47.433759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:47.434490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:47.434947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:47.435377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:47.453137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:01:47.460200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:01:47.470745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:01:47.473240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:01:47.641340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-28cc92e1-ec1f-456d-aca2-6a78d911e3dc tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725326 Nov 03 04:01:47.642002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1232/2548] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:01:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:01:47.647693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:47.648521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:47.658404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:47.658905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:47.659360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:47.660081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:47.660668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:47.661319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:47.798354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:47.807394 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5f3f05a2-4ebc-4b27-a9da-1a2e7db978bf tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1474 microversion: 2.1 time: 0.163363 Nov 03 04:01:47.808184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1233/2549] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:47 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1474 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:47.812928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:47.813605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:47.819643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:47.820133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:47.820570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:47.821742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:47.822370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:47.822980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:47.974806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:47.983848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:47.985435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:47.986841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca528fec-2976-4f6f-ba8a-bd561f7c21b6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1359 microversion: 2.21 time: 0.177714 Nov 03 04:01:47.987406 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1234/2550] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:47 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:47.992429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:47.993169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:47.999473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:48.000052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:48.000500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:48.001288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:48.001718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:48.002156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:48.072124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:48.081484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:48.083388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:48.088731 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a5a41a8a-d48c-4389-a5cb-bf0ab7c601b2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.100031 Nov 03 04:01:48.089352 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1235/2551] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:47 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:48.095293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:48.096099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:48.103623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:48.104135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:48.105119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:48.106196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:48.106827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:48.107429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:48.140468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:48.141097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:48.141541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:48.141993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:48.189484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:48.200078 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2bc801ac-e2c0-49c1-aa93-93340a74108d tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.109413 Nov 03 04:01:48.200820 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1236/2552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:48 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:48.207591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ac6c82c-0cca-4cf5-aefd-811e1a443068 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:48.209413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ac6c82c-0cca-4cf5-aefd-811e1a443068 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:48.267786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ac6c82c-0cca-4cf5-aefd-811e1a443068 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:48.274754 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ac6c82c-0cca-4cf5-aefd-811e1a443068 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1209 microversion: 2.1 time: 0.072541 Nov 03 04:01:48.275442 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1237/2553] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:48 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1209 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:48.830389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:48.831032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:48.838592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:48.839085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:48.839560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:48.840269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:48.840733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:48.841232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:48.974840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:48.982733 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f58f7fb-949f-40f9-8ea9-bc3020028424 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1474 microversion: 2.1 time: 0.156263 Nov 03 04:01:48.983410 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1238/2554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:48 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1474 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:49.014365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:49.015589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:49.021755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.022249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.022690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.023399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.023858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.024290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.155888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.164369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.165929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.166979 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-424f629a-409a-4f4e-834a-905528d50494 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1359 microversion: 2.21 time: 0.156492 Nov 03 04:01:49.167551 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1239/2555] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:49 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:49.172849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:49.173494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:49.179619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.180279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.180915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.181648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.182274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.182710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.248236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.257141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.258609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.263708 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9d7a78fa-b29f-4091-ae22-32dc54eec37a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.095190 Nov 03 04:01:49.268555 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1240/2556] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:49 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:49.269334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:49.270105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:49.276173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.276669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.277173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.280609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.280609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.280609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.299420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:49.315613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.316106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.316550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.317008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:49.364181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.372462 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8331de2-58d0-4b6f-a51c-bac0e399e2fa tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.106580 Nov 03 04:01:49.373068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1241/2557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:49 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:49.378991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:49.379613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:49.385810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.386300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.386741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.387442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:49.387901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:49.388328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:49.454360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:49.463182 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3db0929d-fa1b-47d3-85bd-4eb27c15d9f7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1213 microversion: 2.1 time: 0.088937 Nov 03 04:01:49.463978 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1242/2558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:49 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:50.009050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:50.009050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:50.017437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.017437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.017718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.018560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.019182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.019454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.114933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.124778 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70b3ad89-d5fd-4c4e-9e4e-35769f3ce3e4 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1432 microversion: 2.1 time: 0.121510 Nov 03 04:01:50.125698 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1243/2559] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:50 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1432 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:50.130893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d6f51f07-d9e2-4e32-921a-0641d7b122f1 req-5ec3b2b3-a7a1-4e9d-97c5-9615510aae99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60129a1a-b160-4e7e-a855-dd553c4acf5d", "name": "network-vif-deleted", "tag": "08ee2daa-805b-4703-9a93-903066d40144"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:50.143261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d6f51f07-d9e2-4e32-921a-0641d7b122f1 req-5ec3b2b3-a7a1-4e9d-97c5-9615510aae99 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.143829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d6f51f07-d9e2-4e32-921a-0641d7b122f1 req-5ec3b2b3-a7a1-4e9d-97c5-9615510aae99 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.144409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d6f51f07-d9e2-4e32-921a-0641d7b122f1 req-5ec3b2b3-a7a1-4e9d-97c5-9615510aae99 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.156994 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d6f51f07-d9e2-4e32-921a-0641d7b122f1 req-5ec3b2b3-a7a1-4e9d-97c5-9615510aae99 service nova] Creating event network-vif-deleted:08ee2daa-805b-4703-9a93-903066d40144 for instance 60129a1a-b160-4e7e-a855-dd553c4acf5d on n-h2-854653-7 Nov 03 04:01:50.162779 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d6f51f07-d9e2-4e32-921a-0641d7b122f1 req-5ec3b2b3-a7a1-4e9d-97c5-9615510aae99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035740 Nov 03 04:01:50.163404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1244/2560] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:50.194651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:50.195374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:50.202575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.203059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.203625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.204477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.204945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.205426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.388076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.397747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.399225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.400408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a51ac3fe-92ce-4fad-a5c2-f79eed2f71f0 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1552 microversion: 2.21 time: 0.210465 Nov 03 04:01:50.400998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1245/2561] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:50 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1552 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:50.406309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:50.406927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:50.413290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.413786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.414283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.415008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.415473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.415910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.488787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.497534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.499073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.505939 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-badad56a-138b-47d7-a1b4-ca764aac586c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.103771 Nov 03 04:01:50.511300 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1246/2562] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:50 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:50.518946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:50.520569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:50.532372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.532889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.533366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.534400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.534866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.535328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.569344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.569838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.570286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.570743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:50.634224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:50.643297 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f4e0fa51-3c02-4292-af4a-a5212753cecb tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.129149 Nov 03 04:01:50.644076 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1247/2563] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:50 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:50.648732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:50.649302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:50.656206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.656705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.657198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.657910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:50.658370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:50.658807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:50.693359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:01:51.010467 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19efdf28-28c3-4d5d-91dd-20e71ea3cebf tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 204 len: 0 microversion: 2.21 time: 0.365116 Nov 03 04:01:51.011363 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1248/2564] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:01:50 2022] DELETE /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:01:51.017963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:51.018882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:51.025647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.026103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.026558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.027270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.027806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.028381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.097535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.108143 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-88c90049-5e4a-4c12-9eb2-1b1d477a65fe tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1205 microversion: 2.1 time: 0.095434 Nov 03 04:01:51.109916 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1249/2565] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:51 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:51.115612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:51.116463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:51.123611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.128182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.128182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.128182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.128182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.128182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.313942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.322990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.324624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.325895 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3207140f-6e36-4fe2-be8e-68205bc8aa8c tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1558 microversion: 2.21 time: 0.214665 Nov 03 04:01:51.326457 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1250/2566] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:51 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:51.331135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:51.332950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:51.338985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.339485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.340101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.340809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.341303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.341738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.374954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.375439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.375878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.376332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lazy-loading 'fault' on Instance uuid 60129a1a-b160-4e7e-a855-dd553c4acf5d {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:51.386114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:51.428106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.436094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f0297cd-ae91-4b19-bd81-0e8065773664 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1308 microversion: 2.1 time: 0.108575 Nov 03 04:01:51.436665 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1251/2567] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:51 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:51.535819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:51.536576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:51.539647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:51.543118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.543546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.543983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.544683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.545193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.545625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.615541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.623938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.625498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.630450 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7fe476af-e437-4b24-b314-d4b54dd05581 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.099340 Nov 03 04:01:51.631016 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1252/2568] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:51 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:51.666680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:51.667292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:51.673281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.673762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.674199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.674888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.675340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.675803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.690869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=69 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:51.708188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.708188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.708592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.709079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:51.751514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:51.759349 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8062d351-152c-41b7-9b68-8c1c6a2c70f4 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.096855 Nov 03 04:01:51.759925 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1253/2569] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:51 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:51.864766 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b698e5fd-4a8e-45c1-b878-82767c706620 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c/action" status: 202 len: 0 microversion: 2.25 time: 10.309900 Nov 03 04:01:51.865371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1317/2570] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:01:41 2022] POST /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c/action => generated 0 bytes in 10331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:51.873510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:51.874132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:51.880882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.881431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.881873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:51.882566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:51.883031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:51.883459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.016863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.025865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.027307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.028483 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8876a8d9-6fd2-4b75-aaf5-4cfa90d3680c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.158920 Nov 03 04:01:52.029071 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1254/2571] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:51 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:52.141195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:52.141847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:52.144173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:52.149410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.149903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.156348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.156348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.156348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.156348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.216548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.225313 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73655c6f-badd-43fd-8169-27ad5655b60e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1261 microversion: 2.1 time: 0.088220 Nov 03 04:01:52.225888 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1318/2572] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:52 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:52.351850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:52.353294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:52.358700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.359202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.359659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.360957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.361148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.361584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.460171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:52.460922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:52.473317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.473813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.474253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.474963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.475419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.475843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.510836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.511324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.511766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.511973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.512842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lazy-loading 'fault' on Instance uuid 60129a1a-b160-4e7e-a855-dd553c4acf5d {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:52.516075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:52.521529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.523006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.524188 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e99cb996-16e6-418e-ae30-017a11531b4b tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1558 microversion: 2.21 time: 0.176392 Nov 03 04:01:52.524759 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1255/2573] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:52 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:52.560949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.567913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1e7b60b-52d2-4f69-a34f-d1ae7b6153b8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 200 len: 1308 microversion: 2.1 time: 0.111917 Nov 03 04:01:52.568561 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1319/2574] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:52 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:52.660196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:52.660813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:52.667014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.667445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.667880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.668576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.669051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.669485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.739507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.747872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.749355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.754821 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b65e56fc-0a8f-42d1-9de1-b09ebf7da61f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.099414 Nov 03 04:01:52.755393 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1256/2575] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:52 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:52.783342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:52.784080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:52.792595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.793221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.793727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.794521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.795049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.795543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.829128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:52.829615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:52.830054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:52.830713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lazy-loading 'fault' on Instance uuid 80effada-5529-4cbb-b06a-7365c0b82b20 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:52.872313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c25b2e8e63e54fada80ba039c1be2501', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c64c3da724e48709d5f073189b61fc4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:52.880615 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb2b990b-c343-4434-ab6a-8853704eab3f tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 200 len: 1315 microversion: 2.1 time: 0.101958 Nov 03 04:01:52.881443 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1320/2576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:52 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 1315 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:53.054891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:53.055527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:53.063257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.063748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.064193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.064893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.065449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.065971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.207764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.218551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.223814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.228143 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e140e82-5889-418b-92e1-da034b5978a9 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.174509 Nov 03 04:01:53.229283 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1257/2577] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:53 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:53.249147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:53.250512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:53.261067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.261835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.262438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.264939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.265831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.275041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.339687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.351205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6104c224-8c14-453b-9c54-d48353ea4ecd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1261 microversion: 2.1 time: 0.106411 Nov 03 04:01:53.351966 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1321/2578] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:53 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1261 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:53.518689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-17d45a8a-eaea-4d99-a60e-e4d74653d11e req-ba6b6078-158e-4e17-8553-618acb9e0220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65d40bb6-7973-4724-98b4-d40f50ffc161", "name": "network-vif-deleted", "tag": "ca850996-9dac-46ee-a91a-bdcbd1d542e2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:53.533264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-17d45a8a-eaea-4d99-a60e-e4d74653d11e req-ba6b6078-158e-4e17-8553-618acb9e0220 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.533877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-17d45a8a-eaea-4d99-a60e-e4d74653d11e req-ba6b6078-158e-4e17-8553-618acb9e0220 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.534694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-17d45a8a-eaea-4d99-a60e-e4d74653d11e req-ba6b6078-158e-4e17-8553-618acb9e0220 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.552094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-17d45a8a-eaea-4d99-a60e-e4d74653d11e req-ba6b6078-158e-4e17-8553-618acb9e0220 service nova] Creating event network-vif-deleted:ca850996-9dac-46ee-a91a-bdcbd1d542e2 for instance 65d40bb6-7973-4724-98b4-d40f50ffc161 on n-h2-854653-7 Nov 03 04:01:53.552290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:53.552968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:53.557310 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-17d45a8a-eaea-4d99-a60e-e4d74653d11e req-ba6b6078-158e-4e17-8553-618acb9e0220 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043289 Nov 03 04:01:53.558321 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1258/2579] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:01:53.565266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.565266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.565266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.568577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.569759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.570592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.592802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:53.594195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 60129a1a-b160-4e7e-a855-dd553c4acf5d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:53.600795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.601644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.602128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.603031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.603851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.604334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.622326 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] HTTP exception thrown: Instance 60129a1a-b160-4e7e-a855-dd553c4acf5d could not be found. Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Request method failure captured: Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d HTTP/1.1 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyzAotu531HjEQnFyfaUnFlfosEtuw3S6tDnm0H3KVP-YwX_NsYkq4jlJ-0c9DS8gz2JdTPfBD4DygsvDpLzlIR8OLbQqxOibVPm490qBzc0wqxvyo6b3MtdznMnXTeVMkQQ6xccHSCa3liJWpWVmDSSufFgxvsHcTphvi_HYN8BKQ Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 405fb920cbb2441d8f3ef5c9749f2ff0 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListImageFiltersTestJSON-1509712053 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/405fb920cbb2441d8f3ef5c9749f2ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_405fb920cbb2441d8f3ef5c9749f2ff0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/405fb920cbb2441d8f3ef5c9749f2ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/405fb920cbb2441d8f3ef5c9749f2ff0"}]}] Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListImageFiltersTestJSON-1509712053 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 405fb920cbb2441d8f3ef5c9749f2ff0 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1509712053 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListImageFiltersTestJSON-1509712053-project Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ee1303e758764c42a30fbe07e5e5f823 Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListImageFiltersTestJSON-1509712053-project Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 60129a1a-b160-4e7e-a855-dd553c4acf5d could not be found. Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '60129a1a-b160-4e7e-a855-dd553c4acf5d'} Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60129a1a-b160-4e7e-a855-dd553c4acf5d could not be found. Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60129a1a-b160-4e7e-a855-dd553c4acf5d could not be found. Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:53.624644 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60129a1a-b160-4e7e-a855-dd553c4acf5d could not be found. Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Returning 404 to user: Instance 60129a1a-b160-4e7e-a855-dd553c4acf5d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:53.628478 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cb95efd5-601f-4407-a623-612b396dd6a1 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d" status: 404 len: 111 microversion: 2.1 time: 0.038720 Nov 03 04:01:53.630192 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1259/2580] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:53 2022] GET /compute/v2.1/servers/60129a1a-b160-4e7e-a855-dd553c4acf5d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:01:53.635462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:53.636179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:53.643056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.643646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.644172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.644880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.645395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.645816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.652936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.659218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.660843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.662147 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84def68c-4f27-4da5-b214-0f43f77b22cb tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1516 microversion: 2.21 time: 0.115852 Nov 03 04:01:53.663173 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1322/2581] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:53 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1516 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:53.677554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:01:53.783848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:53.784473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:53.798323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.798922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.800076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.800076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.800499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.800934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.899411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.909527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.911013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:53.916471 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1eec4186-86dc-4293-affa-21703c73bf91 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.136663 Nov 03 04:01:53.919679 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1323/2582] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:53 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:53.943491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:53.944139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 80effada-5529-4cbb-b06a-7365c0b82b20] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:53.950504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.951008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.951459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.952173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:53.952679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:53.953145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:53.967338 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Instance 80effada-5529-4cbb-b06a-7365c0b82b20 could not be found. Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 HTTP/1.1 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 80effada-5529-4cbb-b06a-7365c0b82b20 could not be found. Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '80effada-5529-4cbb-b06a-7365c0b82b20'} Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80effada-5529-4cbb-b06a-7365c0b82b20 could not be found. Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80effada-5529-4cbb-b06a-7365c0b82b20 could not be found. Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.969397 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80effada-5529-4cbb-b06a-7365c0b82b20 could not be found. Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Instance 80effada-5529-4cbb-b06a-7365c0b82b20 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:53.972964 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40a00ef4-039f-4dd9-ab68-b3ada619807c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20" status: 404 len: 111 microversion: 2.1 time: 0.051246 Nov 03 04:01:53.974667 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1324/2583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:53 2022] GET /compute/v2.1/servers/80effada-5529-4cbb-b06a-7365c0b82b20 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:53.979480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-873666d7-3424-4cbd-b023-d8b9969ff05a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '.version_select at 0x7ff7f95eeee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.002700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-873666d7-3424-4cbd-b023-d8b9969ff05a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Image not found. Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-873666d7-3424-4cbd-b023-d8b9969ff05a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354 HTTP/1.1 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a4d705d7-3486-4379-8a65-afc643c20354'} Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a4d705d7-3486-4379-8a65-afc643c20354 to delete Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a4d705d7-3486-4379-8a65-afc643c20354 could not be found. Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:54.004347 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:01:54.008697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.016353 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-33f86797-e8cd-47a8-b93c-ae5c53b730a5 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 204 len: 0 microversion: 2.1 time: 0.373916 Nov 03 04:01:54.016497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-873666d7-3424-4cbd-b023-d8b9969ff05a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:54.016497 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-873666d7-3424-4cbd-b023-d8b9969ff05a tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354" status: 404 len: 62 microversion: 2.1 time: 0.035251 Nov 03 04:01:54.016883 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1260/2584] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:53 2022] DELETE /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:01:54.017064 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1325/2585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:53 2022] DELETE /compute/v2.1/images/a4d705d7-3486-4379-8a65-afc643c20354 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:01:54.021887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.022476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:54.022598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.023842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:54.030330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.030956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.031473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.032247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.032999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.033153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.039160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.039651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.040120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.040825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.041324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.041755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.049054 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 HTTP/1.1 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0f01a566-a0bd-43f8-944f-19c1027b5d02'} Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:54.050756 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a3fb97ca-8865-4353-9dba-28f3f48b6ffd tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 404 len: 111 microversion: 2.1 time: 0.034650 Nov 03 04:01:54.054793 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1326/2586] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:54 2022] DELETE /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:54.060757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.061422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 0f01a566-a0bd-43f8-944f-19c1027b5d02] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:54.067815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.068987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.068987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.069462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.069925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.070378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.083979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 HTTP/1.1 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0f01a566-a0bd-43f8-944f-19c1027b5d02'} Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.085589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Instance 0f01a566-a0bd-43f8-944f-19c1027b5d02 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:54.089381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b2cfe978-88ab-4e5a-ab16-e6a521c46d47 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02" status: 404 len: 111 microversion: 2.1 time: 0.029925 Nov 03 04:01:54.090638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1327/2587] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:54 2022] GET /compute/v2.1/servers/0f01a566-a0bd-43f8-944f-19c1027b5d02 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:01:54.095428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4115028d-0e2c-40c3-81ca-f1cca847698c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '.version_select at 0x7ff7fd564700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.206257 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4115028d-0e2c-40c3-81ca-f1cca847698c tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760121176" status: 202 len: 0 microversion: 2.1 time: 0.114486 Nov 03 04:01:54.206850 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1328/2588] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 04:01:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760121176 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:01:54.253551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.256812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.257679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:54.265801 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-33d72c6e-4a36-4745-b81a-476a3e11a896 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1471 microversion: 2.1 time: 0.247292 Nov 03 04:01:54.267330 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1261/2589] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:54 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1471 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:54.284643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.285194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.285651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.286525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.286999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.287439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.375559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.376703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:54.383177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.383911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.384542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.385283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.385750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.386179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.462005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.473098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.478418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-25da8724-864a-4804-b6f5-d758aff7b7b1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1269 microversion: 2.1 time: 0.105780 Nov 03 04:01:54.478418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1262/2590] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:54 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:54.487800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.494805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.496205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1a0238c-f99e-4960-9543-ce12ae44fa60 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.245072 Nov 03 04:01:54.497165 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1329/2591] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:54 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:54.688746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.689637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:54.695694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.696193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.696638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.697378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.697846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.698296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.730112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.730610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.731057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.731516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lazy-loading 'fault' on Instance uuid 65d40bb6-7973-4724-98b4-d40f50ffc161 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:54.783575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.796980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.799982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:54.801536 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f1004af-ec10-4ec5-ad58-1331f06219f4 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1349 microversion: 2.21 time: 0.116729 Nov 03 04:01:54.802411 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1263/2592] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:54 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1349 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:54.950318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:54.950952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:54.958387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.958885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.959337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:54.960046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:54.960528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:54.960957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.035853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:55.046107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:55.047656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:55.054501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08364fd9-6ab7-4915-9499-798855026023 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.108615 Nov 03 04:01:55.055089 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1330/2593] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:54 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:55.104275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ac89ad3-30d4-4205-8591-bbc174f3621e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '.version_select at 0x7ff7fd5355e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:55.127160 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-0ac89ad3-30d4-4205-8591-bbc174f3621e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Image not found. Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ac89ad3-30d4-4205-8591-bbc174f3621e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/6de7cf50-299c-486c-b179-da4a926bd4bc HTTP/1.1 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '6de7cf50-299c-486c-b179-da4a926bd4bc'} Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6de7cf50-299c-486c-b179-da4a926bd4bc to delete Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6de7cf50-299c-486c-b179-da4a926bd4bc could not be found. Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:55.129208 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ac89ad3-30d4-4205-8591-bbc174f3621e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ac89ad3-30d4-4205-8591-bbc174f3621e tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/images/6de7cf50-299c-486c-b179-da4a926bd4bc" status: 404 len: 62 microversion: 2.1 time: 0.030288 Nov 03 04:01:55.133113 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1264/2594] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:55 2022] DELETE /compute/v2.1/images/6de7cf50-299c-486c-b179-da4a926bd4bc => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:01:55.140832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:55.140832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:55.146524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.147019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.147468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.148181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.148646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.149120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.163021 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 HTTP/1.1 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7e28a87c-e822-45ba-891c-c932a261bc97'} Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:55.164747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6ebd0ff-0608-4ed1-9f16-7b297f3ad2db tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 404 len: 111 microversion: 2.1 time: 0.030901 Nov 03 04:01:55.168553 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1331/2595] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:01:55 2022] DELETE /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:55.175148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:55.175777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] [instance: 7e28a87c-e822-45ba-891c-c932a261bc97] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:55.182926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.183424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.183868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.184582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.185075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.185514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.199363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] HTTP exception thrown: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Request method failure captured: Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 HTTP/1.1 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyY1skj8HrfHBAHLhejYbk4xi5ruEspJhvtxz_PTuABWWkVmd58pg7fkB4xW6exuh3IFF4kC-3JgkUsNKV4Fgo0OsjVlcseNFX7xKZPl9lszSwXQWpHXRJKMXY7-6qcJ2wy4erBFj9Z09D7JpA0xN0F3KMniAUyeVmXb9f6fv1-HKI Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c64c3da724e48709d5f073189b61fc4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c64c3da724e48709d5f073189b61fc4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c64c3da724e48709d5f073189b61fc4"}]}] Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0c64c3da724e48709d5f073189b61fc4 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c25b2e8e63e54fada80ba039c1be2501 Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1459646853-project Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7e28a87c-e822-45ba-891c-c932a261bc97'} Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.200927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] Returning 404 to user: Instance 7e28a87c-e822-45ba-891c-c932a261bc97 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:55.207162 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de70a18b-0568-4bae-89b3-99e616ae5e91 tempest-ImagesOneServerNegativeTestJSON-1459646853 tempest-ImagesOneServerNegativeTestJSON-1459646853-project] 10.222.0.30 "GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97" status: 404 len: 111 microversion: 2.1 time: 0.031247 Nov 03 04:01:55.213260 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1265/2596] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:55 2022] GET /compute/v2.1/servers/7e28a87c-e822-45ba-891c-c932a261bc97 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:55.295489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:55.298797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:55.303170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.303668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.304117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.305133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.305602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.306048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.503043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:55.503722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:55.512050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.512840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.513798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.517223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.517984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.518767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.559911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:55.586540 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5fcd329e-d076-4a20-8da5-46e2af22f485 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1471 microversion: 2.1 time: 0.295549 Nov 03 04:01:55.604775 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1332/2597] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:55 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:55.615546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:55.619573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:55.644638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.645168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.646110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.647014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:55.647647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:55.648254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:55.949134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:55.962148 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-81c96588-7b77-4a93-a63c-137a2d3cf0e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.464489 Nov 03 04:01:55.963425 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1266/2598] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:55 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:56.000676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.012753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:56.013422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:56.013871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.015993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.022057 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41396d77-aa73-4571-8d1f-d7eaf15fe02d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.411118 Nov 03 04:01:56.023629 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1333/2599] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:55 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:56.049484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:56.050250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:56.050888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:56.051767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:56.052379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:56.053003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:56.087833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:56.088731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:56.099345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:56.100091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:56.101377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:56.102716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:56.109581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:56.110994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:56.130472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:56.131017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:56.131475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:56.131932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lazy-loading 'fault' on Instance uuid 65d40bb6-7973-4724-98b4-d40f50ffc161 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:56.219003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.229564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.231564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6f66a270dc1943b18d445c3b7b1d2078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e97a2ad2b4807b584ec8a9fa8d7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.233608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c6acaa2-02fa-4065-a1e2-0d0fcebc31f3 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 200 len: 1349 microversion: 2.21 time: 0.268693 Nov 03 04:01:56.235154 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1267/2600] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:55 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 1349 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:56.279027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.288555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.290732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:56.297421 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f489d45a-8b42-4164-970e-80ce2952580b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.217453 Nov 03 04:01:56.298586 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1334/2601] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:56 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:01:56.644440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:56.644978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:56.659037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:56.659524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:56.665848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:56.667768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:56.673744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:56.678994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:56.988452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:56.989120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:57.005257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.005895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.006214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.006951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.008880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.008880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.067541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:57.081431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61bbb17d-ee60-4533-8c1b-8ff3bfbc39fc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1471 microversion: 2.1 time: 0.451195 Nov 03 04:01:57.083367 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1268/2602] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:56 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1471 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:57.091483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:57.092712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:57.102994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.104183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.104923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.106052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.106730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.107425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.444207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:57.801381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:57.817885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21430b47-db38-416e-a23b-22e299f4a265 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.834736 Nov 03 04:01:57.818875 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1335/2603] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:56 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:57.826938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:57.834416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:57.845569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.850474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.851675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.854524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.855298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.857170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.892309 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] HTTP exception thrown: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Request method failure captured: Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 HTTP/1.1 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz0Xk4gmQuN6cC8XEZRgBqI9d14IMFiENOdDqJ9_v8i-wuHUT-sFA_B5ydhExc6-uEubb6zVZVe-GyO5mS_U1vP5EoMK8yuaS7eGK6yQvTX-zcoqQa5eReHULPWtH11IQF750D_iUUPEjaDsLf_TD4g0F_rhKp6gcLXF2MATsQWEjXI Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.21 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 7f6e97a2ad2b4807b584ec8a9fa8d7cf Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7f6e97a2ad2b4807b584ec8a9fa8d7cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}] Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 7f6e97a2ad2b4807b584ec8a9fa8d7cf Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-InstanceActionsV221TestJSON-1950634434-project Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6f66a270dc1943b18d445c3b7b1d2078 Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-InstanceActionsV221TestJSON-1950634434-project Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '65d40bb6-7973-4724-98b4-d40f50ffc161'} Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:57.897907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:57.903108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:57.903642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:57.907073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Returning 404 to user: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:57.909844 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-768fb46b-d6fd-48fe-9d1e-755e6c3b84e6 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 404 len: 111 microversion: 2.21 time: 0.088536 Nov 03 04:01:57.910676 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1336/2604] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:57 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:01:57.919665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:57.926085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:57.929768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be6562de-d894-4157-af82-432ca68d142b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.843417 Nov 03 04:01:57.934374 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1269/2605] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:57 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:57.934938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:57.936648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '.version_select at 0x7ff7f9414040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:57.937607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:57.937787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:57.945916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.946683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.947576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.949037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.950322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.950462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.951115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.951910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.953713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:57.954586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:57.957770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:57.958292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.230097 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4bd9e395-2022-4e16-b26c-4313c6456542 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.296400 Nov 03 04:01:58.245344 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1270/2606] 10.222.0.30 () {60 vars in 1337 bytes} [Thu Nov 3 04:01:57 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161/os-instance-actions => generated 611 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:01:58.261314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-693a7428-b9f5-436e-8d5e-2f10a9fd3d59 req-6262ff23-0256-4bf8-a829-ace77527d8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1547c889-73e4-4a6a-8925-439fba280d99", "name": "network-vif-deleted", "tag": "8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:58.286152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:58.299766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-693a7428-b9f5-436e-8d5e-2f10a9fd3d59 req-6262ff23-0256-4bf8-a829-ace77527d8b8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.300450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-693a7428-b9f5-436e-8d5e-2f10a9fd3d59 req-6262ff23-0256-4bf8-a829-ace77527d8b8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.300586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:58.301732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-693a7428-b9f5-436e-8d5e-2f10a9fd3d59 req-6262ff23-0256-4bf8-a829-ace77527d8b8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.312081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:58.316814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:58.319024 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-693a7428-b9f5-436e-8d5e-2f10a9fd3d59 req-6262ff23-0256-4bf8-a829-ace77527d8b8 service nova] Creating event network-vif-deleted:8ade59b6-47e6-4f6a-b54e-3bbacf2fd1ac for instance 1547c889-73e4-4a6a-8925-439fba280d99 on n-h2-854653-7 Nov 03 04:01:58.330381 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-693a7428-b9f5-436e-8d5e-2f10a9fd3d59 req-6262ff23-0256-4bf8-a829-ace77527d8b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077114 Nov 03 04:01:58.331880 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1271/2607] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:58.332073 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8537271-e4c1-40a7-8d29-17a643d63425 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1533 microversion: 2.91 time: 0.419403 Nov 03 04:01:58.336502 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1337/2608] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:57 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1533 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:58.350357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:58.351284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:58.358944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0b1e2237-c463-4ed5-93b4-ca16f0253ad6 req-db1f77a3-2270-4d00-b1e5-1302f8772a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c26a321-3d19-44d6-bb6e-c842c452d1f4", "tag": "3c96f060-a35e-4330-a302-c4103fa2f098"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:58.363873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.366635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.370590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.371580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.372222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.372818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.386541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0b1e2237-c463-4ed5-93b4-ca16f0253ad6 req-db1f77a3-2270-4d00-b1e5-1302f8772a9e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.387004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0b1e2237-c463-4ed5-93b4-ca16f0253ad6 req-db1f77a3-2270-4d00-b1e5-1302f8772a9e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.387453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0b1e2237-c463-4ed5-93b4-ca16f0253ad6 req-db1f77a3-2270-4d00-b1e5-1302f8772a9e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.404936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0b1e2237-c463-4ed5-93b4-ca16f0253ad6 req-db1f77a3-2270-4d00-b1e5-1302f8772a9e service nova] Creating event network-changed:3c96f060-a35e-4330-a302-c4103fa2f098 for instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 on n-h1-854653-7 Nov 03 04:01:58.420362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0b1e2237-c463-4ed5-93b4-ca16f0253ad6 req-db1f77a3-2270-4d00-b1e5-1302f8772a9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084078 Nov 03 04:01:58.436418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1272/2609] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:01:58.436418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:58.436418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:58.439135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.439639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.440078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.440847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.445774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.446260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.459232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.459768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.465240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.465240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lazy-loading 'fault' on Instance uuid 1547c889-73e4-4a6a-8925-439fba280d99 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:58.482048 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] HTTP exception thrown: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Request method failure captured: Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 HTTP/1.1 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz0Xk4gmQuN6cC8XEZRgBqI9d14IMFiENOdDqJ9_v8i-wuHUT-sFA_B5ydhExc6-uEubb6zVZVe-GyO5mS_U1vP5EoMK8yuaS7eGK6yQvTX-zcoqQa5eReHULPWtH11IQF750D_iUUPEjaDsLf_TD4g0F_rhKp6gcLXF2MATsQWEjXI Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.21 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 7f6e97a2ad2b4807b584ec8a9fa8d7cf Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7f6e97a2ad2b4807b584ec8a9fa8d7cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}] Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 7f6e97a2ad2b4807b584ec8a9fa8d7cf Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-InstanceActionsV221TestJSON-1950634434-project Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6f66a270dc1943b18d445c3b7b1d2078 Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-InstanceActionsV221TestJSON-1950634434-project Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '65d40bb6-7973-4724-98b4-d40f50ffc161'} Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:58.490821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Returning 404 to user: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80eb4a1e-1958-49fb-bc5d-53b698bac297 tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 404 len: 111 microversion: 2.21 time: 0.068945 Nov 03 04:01:58.502046 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1273/2610] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:01:58 2022] DELETE /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:01:58.517405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:58.518204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:58.528088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.528591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.529053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.542307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.543010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.543477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.579017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee1303e758764c42a30fbe07e5e5f823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405fb920cbb2441d8f3ef5c9749f2ff0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:58.584909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:58.606307 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-be20d38f-6333-4729-926d-d737900826bc tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 200 len: 1306 microversion: 2.1 time: 0.263805 Nov 03 04:01:58.607639 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1338/2611] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:58 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:01:58.645059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:58.646361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] [instance: 65d40bb6-7973-4724-98b4-d40f50ffc161] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:58.659190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.664945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.665633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.666596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.667329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.668376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.692403 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] HTTP exception thrown: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Request method failure captured: Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 HTTP/1.1 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz0Xk4gmQuN6cC8XEZRgBqI9d14IMFiENOdDqJ9_v8i-wuHUT-sFA_B5ydhExc6-uEubb6zVZVe-GyO5mS_U1vP5EoMK8yuaS7eGK6yQvTX-zcoqQa5eReHULPWtH11IQF750D_iUUPEjaDsLf_TD4g0F_rhKp6gcLXF2MATsQWEjXI Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.21 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 7f6e97a2ad2b4807b584ec8a9fa8d7cf Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7f6e97a2ad2b4807b584ec8a9fa8d7cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7f6e97a2ad2b4807b584ec8a9fa8d7cf"}]}] Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 7f6e97a2ad2b4807b584ec8a9fa8d7cf Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1950634434 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-InstanceActionsV221TestJSON-1950634434-project Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6f66a270dc1943b18d445c3b7b1d2078 Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-InstanceActionsV221TestJSON-1950634434-project Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '65d40bb6-7973-4724-98b4-d40f50ffc161'} Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.695467 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. Nov 03 04:01:58.700703 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:01:58.709396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] Returning 404 to user: Instance 65d40bb6-7973-4724-98b4-d40f50ffc161 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:58.715504 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2766720-0326-40b5-8ea2-dcca8ea8df6d tempest-InstanceActionsV221TestJSON-1950634434 tempest-InstanceActionsV221TestJSON-1950634434-project] 10.222.0.30 "GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161" status: 404 len: 111 microversion: 2.21 time: 0.100699 Nov 03 04:01:58.716568 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1339/2612] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:58 2022] GET /compute/v2.1/servers/65d40bb6-7973-4724-98b4-d40f50ffc161 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:01:58.848760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:58.849566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:58.856212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.857066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.857747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.859467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.860177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.861258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.906633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lazy-loading 'services' on Instance uuid bd3de980-af10-4017-b652-4be4a0c2a9df {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:58.938101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:01:58.955961 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9847b455-36ce-40d4-a8f3-fa91aff7dcdc tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1938 microversion: 2.91 time: 0.460078 Nov 03 04:01:58.968604 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1274/2613] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:58 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1938 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:58.968604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:58.977071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:58.990852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.991595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.991877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:58.992630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:58.993832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:58.997916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:59.186748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:59.196049 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5a0f25f5-ad8c-4fb7-8cbf-fa12bc382253 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.352990 Nov 03 04:01:59.200016 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1340/2614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:58 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:01:59.206530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:01:59.207280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:59.217232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:59.218010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:59.223544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:59.224480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:59.225276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:59.227862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:59.273372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lazy-loading 'flavor' on Instance uuid bd3de980-af10-4017-b652-4be4a0c2a9df {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:01:59.298882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:59.315691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:59.321007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:01:59.322846 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd472de9-5a53-4a88-a9d6-2dedbf4dd08f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.361381 Nov 03 04:01:59.328147 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1275/2615] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:01:58 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:01:59.650186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:01:59.651075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] [instance: 1547c889-73e4-4a6a-8925-439fba280d99] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:01:59.680853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:59.681938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:59.690228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:59.690228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:01:59.690228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:01:59.690228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:01:59.707900 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] HTTP exception thrown: Instance 1547c889-73e4-4a6a-8925-439fba280d99 could not be found. Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Request method failure captured: Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 HTTP/1.1 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyzAotu531HjEQnFyfaUnFlfosEtuw3S6tDnm0H3KVP-YwX_NsYkq4jlJ-0c9DS8gz2JdTPfBD4DygsvDpLzlIR8OLbQqxOibVPm490qBzc0wqxvyo6b3MtdznMnXTeVMkQQ6xccHSCa3liJWpWVmDSSufFgxvsHcTphvi_HYN8BKQ Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 405fb920cbb2441d8f3ef5c9749f2ff0 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListImageFiltersTestJSON-1509712053 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/405fb920cbb2441d8f3ef5c9749f2ff0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_405fb920cbb2441d8f3ef5c9749f2ff0", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/405fb920cbb2441d8f3ef5c9749f2ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/405fb920cbb2441d8f3ef5c9749f2ff0"}]}] Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListImageFiltersTestJSON-1509712053 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 405fb920cbb2441d8f3ef5c9749f2ff0 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1509712053 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListImageFiltersTestJSON-1509712053-project Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ee1303e758764c42a30fbe07e5e5f823 Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListImageFiltersTestJSON-1509712053-project Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1547c889-73e4-4a6a-8925-439fba280d99 could not be found. Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1547c889-73e4-4a6a-8925-439fba280d99'} Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1547c889-73e4-4a6a-8925-439fba280d99 could not be found. Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1547c889-73e4-4a6a-8925-439fba280d99 could not be found. Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:01:59.710215 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:59.714924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:01:59.714924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:01:59.714924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:01:59.714924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:01:59.714924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:01:59.714924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1547c889-73e4-4a6a-8925-439fba280d99 could not be found. Nov 03 04:01:59.714924 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:01:59.717505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Returning 404 to user: Instance 1547c889-73e4-4a6a-8925-439fba280d99 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:01:59.724067 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-daa1fa93-4c03-4ee5-ade4-8c85f31386d8 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99" status: 404 len: 111 microversion: 2.1 time: 0.079652 Nov 03 04:01:59.730109 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1276/2616] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:59 2022] GET /compute/v2.1/servers/1547c889-73e4-4a6a-8925-439fba280d99 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:01:59.736543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f7b7672-b547-4754-822e-b4efe02d0886 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f91f6af0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:00.018868 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17c8c427-7124-4d80-8d67-6d6b93928093 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action" status: 202 len: 0 microversion: 2.91 time: 0.817353 Nov 03 04:02:00.019485 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1341/2617] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:01:59 2022] POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:00.029512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:00.034133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:00.041741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:00.042406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:00.042973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:00.043746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:00.044401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:00.044965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:00.127967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:00.136895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:00.138440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:00.147949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5ed691f8-ba1c-4a95-abcc-5de2108c27fa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.123601 Nov 03 04:02:00.148870 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1342/2618] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:00 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:00.223634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:00.224480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:00.231001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:00.231497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:00.232129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:00.237585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:00.239801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:00.240499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:00.463892 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f7b7672-b547-4754-822e-b4efe02d0886 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/images/29b8015d-2502-45c6-8f3d-7109d4699e81" status: 204 len: 0 microversion: 2.1 time: 0.732157 Nov 03 04:02:00.465103 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1277/2619] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:01:59 2022] DELETE /compute/v2.1/images/29b8015d-2502-45c6-8f3d-7109d4699e81 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:00.471029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:00.471659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:00.472560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:00.482784 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17010254-09b0-416d-857d-54e38a1d3e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.263087 Nov 03 04:02:00.483350 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1343/2620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:00 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:00.490719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-056f8378-1b9e-4c4c-9c6b-52a4baa1e62e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f9456f70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:00.498676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:00.502230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:00.503936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:00.506032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:00.509769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:00.511186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:00.705302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:00.715044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:00.717219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:00.718753 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e47a71b0-9547-49e0-b1c4-94c1efc87f72 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.252648 Nov 03 04:02:00.719907 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1278/2621] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:00 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:01.095090 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-056f8378-1b9e-4c4c-9c6b-52a4baa1e62e tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/images/64d56063-0b45-4b28-a7d0-08a4560f2a57" status: 204 len: 0 microversion: 2.1 time: 0.609574 Nov 03 04:02:01.095817 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1344/2622] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:00 2022] DELETE /compute/v2.1/images/64d56063-0b45-4b28-a7d0-08a4560f2a57 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:01.104008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-01c28c2c-676b-4fde-9214-c402c8cc6cd2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] Calling method '.version_select at 0x7ff7f99f0ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:01.176801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:01.178156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:01.187786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:01.188297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:01.188759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:01.189570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:01.190088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:01.190544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:01.407682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:01.417140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:01.421774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:01.438721 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-686cded0-1b07-4fae-8cb7-f3a11ba77ec1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.266010 Nov 03 04:02:01.449844 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1345/2623] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:01 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:01.509353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:01.511211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:01.530053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:01.530053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:01.530053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:01.530053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:01.533167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:01.533870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:01.809879 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-01c28c2c-676b-4fde-9214-c402c8cc6cd2 tempest-ListImageFiltersTestJSON-1509712053 tempest-ListImageFiltersTestJSON-1509712053-project] 10.222.0.30 "DELETE /compute/v2.1/images/775aa719-69ea-4fbe-94ef-37e07c3bef14" status: 204 len: 0 microversion: 2.1 time: 0.709739 Nov 03 04:02:01.811379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1279/2624] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:01 2022] DELETE /compute/v2.1/images/775aa719-69ea-4fbe-94ef-37e07c3bef14 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:01.817382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:01.818022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:01.832527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:01.833038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:01.833598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:01.836170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:01.836631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:01.837717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:01.898138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:01.907290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae1f00b7-e831-4ec9-b8c1-07131da6f449 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.403322 Nov 03 04:02:01.910122 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1346/2625] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:01 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:02.483066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:02.484794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:02.497090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:02.498850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:02.501411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:02.503247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:02.505361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:02.506745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:02.508008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:02.512438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:02.514272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:02.517422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad0a6531-8b9d-4dda-a388-01f81d62b2d0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.704840 Nov 03 04:02:02.520298 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1280/2626] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:01 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:02.764277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:02.793596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:02.798468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:02.811005 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-47ba4930-a37a-486c-bd18-518bec88908a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.334635 Nov 03 04:02:02.816751 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1347/2627] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:02 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:02.938294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:02.944406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:02.950704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:02.955440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:02.957413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:02.958349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:02.963874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:02.964954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:03.351002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:03.360888 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74345476-e9b1-4d18-80f7-fa73731915cd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.426428 Nov 03 04:02:03.363708 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1281/2628] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:02 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:03.554559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:03.554559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:03.574912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:03.575422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:03.581492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:03.582390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:03.582895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:03.583354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:03.830960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:03.851116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:03.851813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:03.872293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:03.893635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:03.894156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:03.897559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:03.897922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:03.899588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:03.900552 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08a61f63-f83e-4fd4-93ca-8d05fc6e04c7 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.354989 Nov 03 04:02:03.921605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:03.927787 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1348/2629] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:03 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:03.929690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:04.093978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:04.109826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:04.111670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:04.143862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8211d025-cec2-472e-945f-9d43b782cd08 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.292846 Nov 03 04:02:04.143862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1282/2630] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:03 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:04.403203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:04.750508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:04.761665 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b807dc6d-81cf-4306-9a3c-62f398016a09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.378527 Nov 03 04:02:04.762468 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1349/2631] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:04 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:04.934592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:04.937565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:04.970543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:04.971041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:04.976524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:04.976524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:04.976524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:04.976524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:05.170439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:05.171213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:05.184498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:05.185048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:05.185570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:05.186139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:05.186642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:05.187080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:05.272482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:05.279757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:05.283828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:05.285518 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b50b2ac-b700-4b8f-818f-3c7c436b6885 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.356262 Nov 03 04:02:05.286355 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1283/2632] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:04 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:05.370313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:05.380396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:05.385874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:05.398357 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fbc04fcb-0346-454a-80e6-355811de6428 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.234246 Nov 03 04:02:05.398954 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1350/2633] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:05 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:05.787436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:05.788758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:05.798370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:05.799514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:05.800316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:05.801759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:05.802403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:05.803043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:05.930102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-49d2b93f-6123-4552-8149-b92d1ab7b509 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Action: 'create', calling method: .version_select at 0x7ff7f93f0820>, body: {"keypair": {"name": "tempest-keypair-743932564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDEP6VvHeeBUcMO9IrZYOSZPO1O4zW3SoY8ymj24uvT84aNodW6LirZ4f4flfGy50lyk2gMo+DzTHpMXbbw/eEcOMQppFhJB43Hc9TeY4kuLX5piaFoo40/lTgNmfHJTA=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:05.956917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-49d2b93f-6123-4552-8149-b92d1ab7b509 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:05.963823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-49d2b93f-6123-4552-8149-b92d1ab7b509 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for user d60a62b251e9406bae47253082232c46 and project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:05.987381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:05.999800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-872dd203-21b7-49b7-b0d1-d293e3e05789 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.216210 Nov 03 04:02:06.001457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1351/2634] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:05 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:06.048267 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-49d2b93f-6123-4552-8149-b92d1ab7b509 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.519548 Nov 03 04:02:06.049204 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1284/2635] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:02:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:06.060246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cedc348-ae77-41d4-a8b6-d820ae031690 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f92cd9d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:06.070685 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9cedc348-ae77-41d4-a8b6-d820ae031690 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs/tempest-keypair-743932564" status: 200 len: 497 microversion: 2.1 time: 0.014665 Nov 03 04:02:06.071471 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1352/2636] 10.222.0.30 () {58 vars in 1215 bytes} [Thu Nov 3 04:02:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-743932564 => generated 497 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:06.085059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1ffcc58-351f-49ae-8485-64c401077070 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f95a94c0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:06.197934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dc902cc2-debe-46df-a81c-944503e25425 req-a68868b3-5a7e-42b5-92c5-37f1bb3d6cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c26a321-3d19-44d6-bb6e-c842c452d1f4", "name": "network-vif-plugged", "status": "completed", "tag": "3c96f060-a35e-4330-a302-c4103fa2f098"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:06.207601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc902cc2-debe-46df-a81c-944503e25425 req-a68868b3-5a7e-42b5-92c5-37f1bb3d6cc8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:06.208095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc902cc2-debe-46df-a81c-944503e25425 req-a68868b3-5a7e-42b5-92c5-37f1bb3d6cc8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:06.208623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc902cc2-debe-46df-a81c-944503e25425 req-a68868b3-5a7e-42b5-92c5-37f1bb3d6cc8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:06.211656 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1ffcc58-351f-49ae-8485-64c401077070 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-743932564" status: 202 len: 0 microversion: 2.1 time: 0.131025 Nov 03 04:02:06.219499 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1285/2637] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 04:02:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-743932564 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:02:06.223759 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dc902cc2-debe-46df-a81c-944503e25425 req-a68868b3-5a7e-42b5-92c5-37f1bb3d6cc8 service nova] Creating event network-vif-plugged:3c96f060-a35e-4330-a302-c4103fa2f098 for instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 on n-h1-854653-7 Nov 03 04:02:06.224737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27aba062-9a0a-41b6-8ae8-703c01a5e6ad tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Action: 'create', calling method: .version_select at 0x7ff7f92d1b80>, body: {"keypair": {"name": "tempest-keypair-2078281956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJaWQuGCgWhJdQ/yK0dJUvZa7nCJ5lvhsE609Xg5ftduWslZHnTmu5ZTBikG9gBFek3Zm05CjOmVyZ3O7mD87Jba4njRooziFlWtWRxQknasU4amaArQEbSqLuxnBWJAA=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:06.228738 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dc902cc2-debe-46df-a81c-944503e25425 req-a68868b3-5a7e-42b5-92c5-37f1bb3d6cc8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034955 Nov 03 04:02:06.229380 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1353/2638] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:02:06.241902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-27aba062-9a0a-41b6-8ae8-703c01a5e6ad tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:06.248612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-27aba062-9a0a-41b6-8ae8-703c01a5e6ad tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for user d60a62b251e9406bae47253082232c46 and project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:06.250481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:06.319798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:06.324726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:06.327765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:06.328266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:06.328718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:06.329470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:06.329936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:06.330399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:06.401915 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27aba062-9a0a-41b6-8ae8-703c01a5e6ad tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180940 Nov 03 04:02:06.403047 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1286/2639] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:02:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:06.413968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3c34b17-63b2-4632-9168-85fb1eefe758 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f9573d30>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:06.511362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3c34b17-63b2-4632-9168-85fb1eefe758 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078281956" status: 202 len: 0 microversion: 2.1 time: 0.101102 Nov 03 04:02:06.512584 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1287/2640] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:02:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078281956 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:02:06.519423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:06.520151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:06.526651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:06.527229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:06.527814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:06.528668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:06.529236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:06.529749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:06.536224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:06.545164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:06.547413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:06.549076 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a9e35b23-b04d-41d2-b215-f498ec5a0402 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.233724 Nov 03 04:02:06.549858 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1354/2641] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:06 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:06.554808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b1ad5a6-6590-4a1d-a246-1c04dedcfc9f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Action: 'create', calling method: .version_select at 0x7ff7fd5daaf0>, body: {"keypair": {"name": "tempest-keypair-18856843", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:06.576069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8b1ad5a6-6590-4a1d-a246-1c04dedcfc9f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:06.578855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:06.583138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8b1ad5a6-6590-4a1d-a246-1c04dedcfc9f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for user d60a62b251e9406bae47253082232c46 and project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:06.664261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:06.673068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:06.674717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:06.679801 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d991ff5e-f1a4-42bb-9397-49506f4998e1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.166013 Nov 03 04:02:06.680379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1288/2642] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:06 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:06.708589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b1ad5a6-6590-4a1d-a246-1c04dedcfc9f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.157400 Nov 03 04:02:06.709347 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1355/2643] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:02:06 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:06.719890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df083904-f2b3-4622-9d62-92d477f396db tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f9573af0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:06.868877 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df083904-f2b3-4622-9d62-92d477f396db tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18856843" status: 202 len: 0 microversion: 2.1 time: 0.152906 Nov 03 04:02:06.869504 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1289/2644] 10.222.0.30 () {58 vars in 1215 bytes} [Thu Nov 3 04:02:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18856843 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:02:06.882934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0d2eac10-cb52-47e0-b345-60440533604a tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Action: 'create', calling method: .version_select at 0x7ff7f94ef0d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-288278599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRi+I4N3QVSvjJNlnrjhPjoqsNsXtom/oj6HXnOrsocbQWI3hdbF5WKS/cGnd55H0szwHq1OAdKi+f3rp0OpEpBW0Ze8ekw6HpNZkgcDGZp8mPmNyq7mju+bTTBm9gQ0A=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:06.906083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0d2eac10-cb52-47e0-b345-60440533604a tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:06.913905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0d2eac10-cb52-47e0-b345-60440533604a tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for user d60a62b251e9406bae47253082232c46 and project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:07.023977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:07.024600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:07.030910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:07.031406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:07.031861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:07.032551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:07.033027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:07.033489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:07.092147 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0d2eac10-cb52-47e0-b345-60440533604a tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.213956 Nov 03 04:02:07.101384 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1356/2645] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:02:06 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:07.106512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-052c169b-3ca4-4ee1-b0e8-23b53e116b11 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Action: 'create', calling method: .version_select at 0x7ff7f9456820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-56981692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXx3twk6MAHwuj+Lgb2iDcyd+erJgeO1uqX2HXq51/N4yTqfWHcqCr1eDzY6VF0dPA5jhd4UqWV4EXN3tPO789u+nJxHkGanIvLsuZ7aSGTNU6dXW8777UU1ypPhJqK+w=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:07.123166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-052c169b-3ca4-4ee1-b0e8-23b53e116b11 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:07.128342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-052c169b-3ca4-4ee1-b0e8-23b53e116b11 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for user d60a62b251e9406bae47253082232c46 and project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:07.180309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:07.188256 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0b94ac70-004b-44b3-a6ac-a74231af2ec7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1309 microversion: 2.1 time: 0.168722 Nov 03 04:02:07.188822 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1290/2646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:07 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1309 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:07.255483 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-052c169b-3ca4-4ee1-b0e8-23b53e116b11 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.148636 Nov 03 04:02:07.255483 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1357/2647] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:02:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:02:07.272384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-716f4791-b5de-4501-bc72-c3a8d3a9681f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Action: 'create', calling method: .version_select at 0x7ff7f998adc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-655412748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnGhIuy6OkHlME+pSvl+MD8SYi94tJu+5BfjG/RDdgN+oeGEDbM2YOzT//YgTG7REMeeIM7CoNmOI/+CpnHxHKG/kZVDd81rdz6oh1a7o8Q4OP9G7WLHEoB1Z6VlQ57Gw=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:07.292202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-716f4791-b5de-4501-bc72-c3a8d3a9681f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:07.297992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-716f4791-b5de-4501-bc72-c3a8d3a9681f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Getting quotas for user d60a62b251e9406bae47253082232c46 and project 413b69e0c63540d39c7178d7427fc454. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:07.434425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-716f4791-b5de-4501-bc72-c3a8d3a9681f tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.170925 Nov 03 04:02:07.435967 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1291/2648] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:02:07 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:07.446809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c57e95ae-c27c-4e31-82c7-230f210b1394 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f93d2e50>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:07.450686 n-d-854653-7 devstack@n-api.service[127594]: WARNING oslo_db.sqlalchemy.utils [None req-c57e95ae-c27c-4e31-82c7-230f210b1394 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 03 04:02:07.460032 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c57e95ae-c27c-4e31-82c7-230f210b1394 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "GET /compute/v2.1/os-keypairs" status: 200 len: 1090 microversion: 2.1 time: 0.017088 Nov 03 04:02:07.460603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1358/2649] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:02:07 2022] GET /compute/v2.1/os-keypairs => generated 1090 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:07.478738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61b376a0-d97b-47c3-a2e8-3a07e09fad12 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f95a95e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:07.578708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:07.579417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:07.586540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:07.587031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:07.587475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:07.588830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:07.589316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:07.589778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:07.659071 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61b376a0-d97b-47c3-a2e8-3a07e09fad12 tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-655412748" status: 202 len: 0 microversion: 2.1 time: 0.184540 Nov 03 04:02:07.659872 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1292/2650] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-655412748 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:02:07.669343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cba7dde0-4276-4e00-adfa-812ce980c1fc tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f99f0820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:07.730292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:07.740524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:07.742829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:07.744099 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95a25ba3-6ce9-4b9f-a21f-cda73a799f64 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.169221 Nov 03 04:02:07.744839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1359/2651] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:07 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:07.751430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:07.752093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:07.763131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:07.763886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:07.765858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:07.766622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:07.766847 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cba7dde0-4276-4e00-adfa-812ce980c1fc tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-56981692" status: 202 len: 0 microversion: 2.1 time: 0.101737 Nov 03 04:02:07.767093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:07.767641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:07.767821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1293/2652] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-56981692 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:02:07.778353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9abe9afb-512b-40bf-a240-8ab78e9c5f9e tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] Calling method '.version_select at 0x7ff7f9bded30>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:07.880851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:07.885524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:07.892201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:07.893115 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9abe9afb-512b-40bf-a240-8ab78e9c5f9e tempest-KeyPairsV2TestJSON-1655071475 tempest-KeyPairsV2TestJSON-1655071475-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-288278599" status: 202 len: 0 microversion: 2.1 time: 0.120795 Nov 03 04:02:07.896377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:07.909583 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1294/2653] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:02:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-288278599 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:02:07.909786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5291b5a8-055b-4c27-a5dd-3b343360a94c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.163012 Nov 03 04:02:07.910335 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1360/2654] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:07 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:08.212332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:08.213181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:08.221245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.221750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.222192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:08.222942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.223361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.224340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:08.395385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:08.407844 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cafb4396-f0b2-4107-ab72-2ac149275d78 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1490 microversion: 2.1 time: 0.199722 Nov 03 04:02:08.408697 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1295/2655] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:08 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1490 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:08.432461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:08.433583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:08.440047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.440545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.440989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:08.453705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.454458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.455799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:08.703501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:08.716642 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-072ee76d-c7b4-4228-ba2d-4b85ad390c45 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1491 microversion: 2.1 time: 0.287713 Nov 03 04:02:08.718694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1361/2656] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:08 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1491 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:08.744324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:08.744949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:08.755041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.755732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.755976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:08.756886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.757312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.757741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:08.775176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:08.775801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:08.787218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.787716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.788162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:08.796974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:08.797513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:08.797993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:09.162756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:09.174686 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c921261-0cc3-4467-aea5-823769d38b7c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1490 microversion: 2.1 time: 0.436083 Nov 03 04:02:09.179765 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1296/2657] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:08 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1490 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:09.190808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:09.192268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:09.213064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:09.213814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:09.214261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:09.215148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:09.215609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:09.216076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:09.224241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:09.237965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:09.241122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:09.244191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ca94332e-2bd2-4694-ad95-a6870f0ba591 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.476893 Nov 03 04:02:09.269160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1362/2658] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:08 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:09.269912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:09.270489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:09.277170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:09.277802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:09.278258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:09.278963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:09.279420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:09.279848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:09.318192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:09.324120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:02:09.328392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:09.330192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:09.335970 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b66a6f34-c1c6-47da-a060-1e73de780cb7 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.149854 Nov 03 04:02:09.336551 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1297/2659] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:09 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:09.810687 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d7543b6c-7d1c-4e9c-8b3c-baa0a9a78ba3 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 204 len: 0 microversion: 2.1 time: 0.546666 Nov 03 04:02:09.812195 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1363/2660] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:02:09 2022] DELETE /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:09.821754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:09.823059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:09.829788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:09.830531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:09.830970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:09.831680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:09.832137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:09.832560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:10.190567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:10.199215 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e076c2b4-8214-4c51-921c-838ceb646779 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1496 microversion: 2.1 time: 0.381808 Nov 03 04:02:10.200370 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1298/2661] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:09 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1496 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:10.281182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:10.282635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:10.294713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:10.298745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:10.298745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:10.298745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:10.298745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:10.298745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:10.369731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:10.370456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:10.380867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:10.380867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:10.380867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:10.380867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:10.385090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:10.385090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:10.539021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:10.548576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:10.558612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:10.572774 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4147333e-d601-4833-aef4-300b95aad9a3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.207075 Nov 03 04:02:10.573557 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1299/2662] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:10 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:10.759890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:10.775031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:10.776578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:10.785700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7582f0c5-8e73-40d2-926e-58e0c51f99e5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.516702 Nov 03 04:02:10.789680 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1364/2663] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:10 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:11.224637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:11.225299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:11.232810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:11.234448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:11.234896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:11.236036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:11.236528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:11.236957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:11.507187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:11.521215 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-69160675-b1d7-4539-992b-26f3c7ca317f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1496 microversion: 2.1 time: 0.300998 Nov 03 04:02:11.548124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1300/2664] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:11 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1496 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:11.602670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:11.603891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:11.612087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:11.612819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:11.613452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:11.614324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:11.614953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:11.615535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:11.750568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:11.762222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:11.763733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:11.777851 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-531576ec-5048-42b9-adbc-e2395f6fc6dc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.179018 Nov 03 04:02:11.783538 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1365/2665] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:11 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:11.822825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:11.824135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:11.836002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:11.841572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:11.842391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:11.845752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:11.847702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:11.848831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:12.166274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:12.185202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:12.187397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:12.192634 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3f0b8aa-cc37-48f5-a75b-f69735d08456 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.381544 Nov 03 04:02:12.193124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1301/2666] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:11 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:12.580503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:12.582367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:12.607368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:12.610131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:12.611135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:12.614624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:12.615618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:12.618190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:12.660241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0e0fb65b-65d2-4293-b016-bda8b7207d0b req-29fb3d95-7c81-45d5-88d9-9d7313d91808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c26a321-3d19-44d6-bb6e-c842c452d1f4", "name": "network-vif-deleted", "tag": "3c96f060-a35e-4330-a302-c4103fa2f098"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:12.693406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0e0fb65b-65d2-4293-b016-bda8b7207d0b req-29fb3d95-7c81-45d5-88d9-9d7313d91808 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:12.694327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0e0fb65b-65d2-4293-b016-bda8b7207d0b req-29fb3d95-7c81-45d5-88d9-9d7313d91808 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:12.694961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0e0fb65b-65d2-4293-b016-bda8b7207d0b req-29fb3d95-7c81-45d5-88d9-9d7313d91808 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:12.736735 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0e0fb65b-65d2-4293-b016-bda8b7207d0b req-29fb3d95-7c81-45d5-88d9-9d7313d91808 service nova] Creating event network-vif-deleted:3c96f060-a35e-4330-a302-c4103fa2f098 for instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 on n-h1-854653-7 Nov 03 04:02:12.748130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0e0fb65b-65d2-4293-b016-bda8b7207d0b req-29fb3d95-7c81-45d5-88d9-9d7313d91808 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091959 Nov 03 04:02:12.749935 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1302/2667] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:02:12.779233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-468bf677-33cb-4044-a85e-10c87a973561 req-53d3ab4d-de53-4b2b-aa28-394c207ed167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff97d8-a5de-49ec-8ab6-49252fa26a4c", "name": "network-vif-unplugged", "status": "completed", "tag": "4f57820b-e8d1-4673-9e84-6d40df1a9e04"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:12.803187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-468bf677-33cb-4044-a85e-10c87a973561 req-53d3ab4d-de53-4b2b-aa28-394c207ed167 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:12.803560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-468bf677-33cb-4044-a85e-10c87a973561 req-53d3ab4d-de53-4b2b-aa28-394c207ed167 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:12.804437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-468bf677-33cb-4044-a85e-10c87a973561 req-53d3ab4d-de53-4b2b-aa28-394c207ed167 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:12.825168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:12.835199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0cb8cfb-2568-4a37-90af-c515d21829e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1454 microversion: 2.1 time: 0.286881 Nov 03 04:02:12.838321 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1366/2668] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:12 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1454 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:12.841719 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-468bf677-33cb-4044-a85e-10c87a973561 req-53d3ab4d-de53-4b2b-aa28-394c207ed167 service nova] Creating event network-vif-unplugged:4f57820b-e8d1-4673-9e84-6d40df1a9e04 for instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c on n-h1-854653-7 Nov 03 04:02:12.850473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:12.852325 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-468bf677-33cb-4044-a85e-10c87a973561 req-53d3ab4d-de53-4b2b-aa28-394c207ed167 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077168 Nov 03 04:02:12.852983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:12.867599 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1303/2669] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:02:12.867929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:12.867929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:12.867929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:12.867929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:12.867929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:12.867929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:13.012169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:13.028482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:13.033458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:13.041651 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65346e4a-0397-4771-9329-0f928fa4b4b6 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.199539 Nov 03 04:02:13.044130 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1367/2670] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:12 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:13.220087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:13.221191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:13.229094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:13.239006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:13.240542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:13.241532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:13.242137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:13.248679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:13.279036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:13.573490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:13.581077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:13.589979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:13.592123 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-493b38fb-e088-4111-821c-f87ff9f153c0 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.376876 Nov 03 04:02:13.609546 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1304/2671] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:13 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:13.862737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:13.867634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:13.894979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:13.897277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:13.898606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:13.901258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:13.915002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:13.917139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:13.992660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:13.993211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:13.993663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:13.994130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lazy-loading 'fault' on Instance uuid 4c26a321-3d19-44d6-bb6e-c842c452d1f4 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:02:14.087427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:14.088855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:14.105820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:14.109692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:14.110471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:14.111793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:14.115668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:14.116550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:14.147011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:14.162880 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0e08b6b-ea25-4840-947e-4e7ea270f4d9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 200 len: 1299 microversion: 2.1 time: 0.304320 Nov 03 04:02:14.164908 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1368/2672] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:13 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 1299 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:14.271564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:14.288641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:14.290862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:14.327542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30b8f56b-746b-48b3-8fea-7d380c3f5046 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.254011 Nov 03 04:02:14.329840 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1305/2673] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:14 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:14.621759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:14.622930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:14.632349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:14.633926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:14.635761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:14.637485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:14.639867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:14.640434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:14.868777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-40e7033d-d1dc-4d40-9d92-8897c8a99313 req-30c782ae-dcf7-45a9-9a7d-99766f43a817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ff97d8-a5de-49ec-8ab6-49252fa26a4c", "tag": "4f57820b-e8d1-4673-9e84-6d40df1a9e04"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:14.879787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-40e7033d-d1dc-4d40-9d92-8897c8a99313 req-30c782ae-dcf7-45a9-9a7d-99766f43a817 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:14.880644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-40e7033d-d1dc-4d40-9d92-8897c8a99313 req-30c782ae-dcf7-45a9-9a7d-99766f43a817 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:14.881337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-40e7033d-d1dc-4d40-9d92-8897c8a99313 req-30c782ae-dcf7-45a9-9a7d-99766f43a817 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:14.899126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-40e7033d-d1dc-4d40-9d92-8897c8a99313 req-30c782ae-dcf7-45a9-9a7d-99766f43a817 service nova] Creating event network-changed:4f57820b-e8d1-4673-9e84-6d40df1a9e04 for instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c on n-h1-854653-7 Nov 03 04:02:14.907277 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-40e7033d-d1dc-4d40-9d92-8897c8a99313 req-30c782ae-dcf7-45a9-9a7d-99766f43a817 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042454 Nov 03 04:02:14.912482 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1306/2674] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:02:15.195192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:15.195901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:15.204123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.204722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.205260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.206042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.206577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.207075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.221687 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 HTTP/1.1 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '4c26a321-3d19-44d6-bb6e-c842c452d1f4'} Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:15.223844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2369c65-ee9a-4f1d-b18d-8fd7474ad4e9 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 404 len: 111 microversion: 2.1 time: 0.034318 Nov 03 04:02:15.231445 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1307/2675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:15 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:02:15.238198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:15.238198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:15.242811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.243534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.244444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.245375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.245841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.246558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.281845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:02:15.412815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:15.425638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:15.431453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:15.434287 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2dc0995e-f0f8-4c7a-9456-8a92f715e2a5 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.816436 Nov 03 04:02:15.436790 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1369/2676] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:14 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:15.442669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:15.443684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:15.462926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.463544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.465144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.466160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.466600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.466831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.728976 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-498998e1-be77-43ed-b5fa-45c320efc7ed tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 204 len: 0 microversion: 2.1 time: 0.494736 Nov 03 04:02:15.733542 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1308/2677] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:02:15 2022] DELETE /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:15.746568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:15.750119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:15.750483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:15.757673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.758480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.759215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.760414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:15.761756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:15.762116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:15.762683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:15.766063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:15.782618 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8a070c68-77b0-4940-be6d-e5a238a97f3d tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.344480 Nov 03 04:02:15.783230 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1370/2678] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:15 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:16.382485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:16.386583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9281314-e30e-49b0-a2f8-d4d4abd97be6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1497 microversion: 2.1 time: 0.648238 Nov 03 04:02:16.387191 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1309/2679] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:15 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1497 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:16.464171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:16.464996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:16.478450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:16.478952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:16.481386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:16.482696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:16.483511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:16.484111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:16.811914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:16.812544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:16.824855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:16.825464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:16.825979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:16.826806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:16.827334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:16.829927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:17.072608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:17.084000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:17.086375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:17.097723 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bab0eacf-ac2c-485a-b495-dd8c1973e784 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.286409 Nov 03 04:02:17.101059 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1310/2680] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:16 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:17.136258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:17.196813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:17.223926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:17.227243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:17.228872 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-733a58e7-f368-44d4-80b3-459081248ee3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.768850 Nov 03 04:02:17.229697 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1371/2681] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:16 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:17.418313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:17.418903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:17.422748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=12 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:17.438862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:17.439616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:17.440264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:17.441270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:17.441980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:17.442784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:18.137589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:18.139724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:18.162602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:18.163304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:18.164736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:18.175770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:18.176813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:18.177591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:18.605527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:18.634931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:18.640539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:18.653978 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ee00e25-5813-41d1-8e36-201129ebb96c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.520349 Nov 03 04:02:18.656145 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1372/2682] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:18 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:18.669793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:18.670836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:18.685344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:18.691638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:18.691638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:18.691638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:18.692951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:18.694318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:18.697562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:18.703299 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-49d8234d-fa41-47ae-aef8-22aec6c17a15 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1497 microversion: 2.1 time: 1.293053 Nov 03 04:02:18.708823 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1311/2683] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:17 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1497 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:18.887780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-509a7645-50f7-4e0e-9e52-e6582754a34c req-ae43b30f-9198-455b-a379-814a18f20014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3177696f-f3bd-4b41-bc6f-56a7fc3d94e2", "name": "network-vif-deleted", "tag": "72ae0aaf-1f0f-4f0a-aecc-bcf7eb680b76"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:18.929819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-509a7645-50f7-4e0e-9e52-e6582754a34c req-ae43b30f-9198-455b-a379-814a18f20014 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:18.932091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-509a7645-50f7-4e0e-9e52-e6582754a34c req-ae43b30f-9198-455b-a379-814a18f20014 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:18.933897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-509a7645-50f7-4e0e-9e52-e6582754a34c req-ae43b30f-9198-455b-a379-814a18f20014 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:18.976937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-509a7645-50f7-4e0e-9e52-e6582754a34c req-ae43b30f-9198-455b-a379-814a18f20014 service nova] Creating event network-vif-deleted:72ae0aaf-1f0f-4f0a-aecc-bcf7eb680b76 for instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 on n-h2-854653-7 Nov 03 04:02:18.995407 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-509a7645-50f7-4e0e-9e52-e6582754a34c req-ae43b30f-9198-455b-a379-814a18f20014 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108965 Nov 03 04:02:18.997178 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1312/2684] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:19.505582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:19.518009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:19.522660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:19.523914 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-985cd523-ebc0-499d-b8cb-1a7f1db2371f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.865986 Nov 03 04:02:19.532525 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1373/2685] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:18 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:19.688171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:19.689430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:19.706568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:19.710868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:19.711270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:19.712027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:19.712551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:19.713042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:19.742590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:19.744325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:19.762997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:19.763805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:19.765935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:19.767440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:19.774320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:19.775179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:19.864821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:19.865618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:19.866232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:19.866863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lazy-loading 'fault' on Instance uuid 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:02:20.034976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:20.038944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:20.040906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:20.042603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:20.049492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-293c6d95-7d90-4af2-ba75-cded1b41378a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1560 microversion: 2.91 time: 0.368972 Nov 03 04:02:20.050060 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1313/2686] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:19 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1560 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:20.055975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb414123-13e7-47d2-9c52-8d23a6eb8d94 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 200 len: 1299 microversion: 2.1 time: 0.324533 Nov 03 04:02:20.056724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1374/2687] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:19 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 1299 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:20.552656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:20.553300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:20.574642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:20.575145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:20.575774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:20.576705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:20.577344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:20.577996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:21.040257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:21.053802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:21.055672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:21.057579 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fccf849f-ae39-4673-be8e-086323c340bb tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.508738 Nov 03 04:02:21.058723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1314/2688] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:20 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:21.081763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:21.083136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:21.090087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:21.090636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:21.091264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:21.092881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:21.095035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:21.095793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:21.096253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:21.096850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:21.105102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:21.105269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:21.105941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:21.106288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:21.106956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:21.108446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:21.109149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:21.109789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:21.150014 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 HTTP/1.1 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '3177696f-f3bd-4b41-bc6f-56a7fc3d94e2'} Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:21.152735 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:21.157545 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:21.157545 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:21.157545 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:21.157545 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:02:21.157545 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:02:21.157545 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:02:21.157545 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:21.159381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:02:21.160502 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f0ecc03-33d7-41f2-a828-c1ac3898ce26 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 404 len: 111 microversion: 2.1 time: 0.075565 Nov 03 04:02:21.174189 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1315/2689] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:21 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:02:21.318539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-935262881", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1f101308-9db8-4b30-b5f1-954d8d42482e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:21.339991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:21.367514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:21.367514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:21.379921 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f25c2182-1aac-446e-a434-cf2da6f2e238 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1560 microversion: 2.91 time: 0.304565 Nov 03 04:02:21.380867 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1375/2690] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:21 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1560 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:21.420833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:02:22.087549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:22.088827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:22.109236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:22.110058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:22.111039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:22.112419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:22.125882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:22.126710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:22.496649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:02:22.497750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:02:22.499067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:02:22.499662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:02:22.500697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:02:22.518497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:22.519288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:22.520537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:22.521531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:22.524789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:22.525531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:22.575528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:22.582041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:22.605147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:02:22.608481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:02:22.664785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:22.701882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:22.734683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:22.737714 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d014709-7948-42ae-8f0e-90ebde18134d tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.654313 Nov 03 04:02:22.746730 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1376/2691] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:22 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:22.780210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:22.781143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:22.812156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:22.812156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:22.812156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:22.812391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:22.812769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:22.813230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:22.828268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4821e75f-074d-4152-9267-613cbea6ab5e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513395 Nov 03 04:02:22.828720 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1316/2692] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:02:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:02:22.840250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-887d7d58-3a90-48d7-840f-2d47633e3ce0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:22.843267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-887d7d58-3a90-48d7-840f-2d47633e3ce0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:23.011840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-887d7d58-3a90-48d7-840f-2d47633e3ce0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:23.021316 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-887d7d58-3a90-48d7-840f-2d47633e3ce0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1208 microversion: 2.1 time: 0.185180 Nov 03 04:02:23.038708 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1317/2693] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:22 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1208 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:23.209795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:23.221320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:23.240215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:23.253579 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b5a5f92-d4bf-4855-8f0d-3572304fc7a8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1560 microversion: 2.91 time: 0.504302 Nov 03 04:02:23.258211 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1377/2694] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:22 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1560 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:23.774415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:23.775657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:23.785237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:23.788840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:23.789540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:23.792990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:23.793776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:23.796880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:24.050186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-54483e06-ae94-467e-8cab-7112d523c8d0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:24.051888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-54483e06-ae94-467e-8cab-7112d523c8d0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:24.325091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-54483e06-ae94-467e-8cab-7112d523c8d0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:24.352930 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-54483e06-ae94-467e-8cab-7112d523c8d0 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1208 microversion: 2.1 time: 0.309367 Nov 03 04:02:24.374270 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1378/2695] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:24 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1208 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:24.394827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:24.395676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:24.405898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:24.427385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:24.427385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:24.427385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:24.427385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:24.427385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:24.427385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:24.456873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:24.471311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:24.489184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:24.489184 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba618dde-1768-49b1-b385-e277505c8b0b tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.704407 Nov 03 04:02:24.511500 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1318/2696] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:23 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:24.582291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:24.606432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:24.619727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:24.641045 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9f4a720-a4d0-4ed6-bca2-30398c26acbe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.258771 Nov 03 04:02:24.646771 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1379/2697] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:24 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:24.949658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa103529-4d73-49b5-a586-337c6132d7f9 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Action: 'create', calling method: .version_select at 0x7ff7f97aedc0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:25.000462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fa103529-4d73-49b5-a586-337c6132d7f9 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Getting quotas for project 2287f8fa7de6426b84e95a7ebb0a432e. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:25.022588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fa103529-4d73-49b5-a586-337c6132d7f9 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Getting quotas for user 72cc493b0d984409ae9fa93ed44f1003 and project 2287f8fa7de6426b84e95a7ebb0a432e. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:25.275555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fa103529-4d73-49b5-a586-337c6132d7f9 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Getting quotas for project 2287f8fa7de6426b84e95a7ebb0a432e. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:25.286681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fa103529-4d73-49b5-a586-337c6132d7f9 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Getting quotas for user 72cc493b0d984409ae9fa93ed44f1003 and project 2287f8fa7de6426b84e95a7ebb0a432e. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:25.323019 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa103529-4d73-49b5-a586-337c6132d7f9 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.809980 Nov 03 04:02:25.324019 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1319/2698] 10.222.0.30 () {62 vars in 1214 bytes} [Thu Nov 3 04:02:24 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:02:25.337349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c461573d-265b-4c96-aa78-87f5b0eb6c84 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:25.379254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:25.380781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:25.416958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:25.423047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:25.423651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:25.425062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:25.426466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c461573d-265b-4c96-aa78-87f5b0eb6c84 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.093540 Nov 03 04:02:25.428063 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1380/2699] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Nov 3 04:02:25 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:02:25.428326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:25.428931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:25.446860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-64ba4b4d-f055-4ff7-a421-57f1fb868594 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:25.469589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-64ba4b4d-f055-4ff7-a421-57f1fb868594 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/c988bc80-b16d-4b29-951d-dc4e9c6a0d5e" status: 200 len: 235 microversion: 2.64 time: 0.034531 Nov 03 04:02:25.472293 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1381/2700] 10.222.0.30 () {60 vars in 1304 bytes} [Thu Nov 3 04:02:25 2022] GET /compute/v2.1/os-server-groups/c988bc80-b16d-4b29-951d-dc4e9c6a0d5e => generated 235 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:02:25.483977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0fa0ad4-1e10-47d8-bf05-0665e84ccee6 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:25.550075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:25.563490 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-86ecb61a-3e26-4983-8320-f41526b0accd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1260 microversion: 2.1 time: 0.190566 Nov 03 04:02:25.565123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1320/2701] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:25 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:25.592661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:25.593780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:25.614391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:25.615109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:25.617747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:25.621138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:25.622523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:25.625956 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0fa0ad4-1e10-47d8-bf05-0665e84ccee6 tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/c988bc80-b16d-4b29-951d-dc4e9c6a0d5e" status: 204 len: 0 microversion: 2.64 time: 0.146704 Nov 03 04:02:25.627111 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1382/2702] 10.222.0.30 () {60 vars in 1307 bytes} [Thu Nov 3 04:02:25 2022] DELETE /compute/v2.1/os-server-groups/c988bc80-b16d-4b29-951d-dc4e9c6a0d5e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 03 04:02:25.627737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:25.636237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9079f1c1-e92a-448a-9b37-cfbdde783b1c tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:25.664814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9079f1c1-e92a-448a-9b37-cfbdde783b1c tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] HTTP exception thrown: Instance group c988bc80-b16d-4b29-951d-dc4e9c6a0d5e could not be found. Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9079f1c1-e92a-448a-9b37-cfbdde783b1c tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Request method failure captured: Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-server-groups/c988bc80-b16d-4b29-951d-dc4e9c6a0d5e HTTP/1.1 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1QN15kBtTIkUm3FFuLy4aH_QXLPnysB6Rwak3m_Zem9-LHSnBPokKbfHWdHRXByzcLJFxpjC57QGODBkyDgBNb_ipeUpcB75F5Z4_PqdWyMYXM6KbKJOEwf5QL_LCm-pyKpofpDyV1QNay4zx_l9QeCtmGGRAVP4JpFCdz--4EfhI Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.64 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2287f8fa7de6426b84e95a7ebb0a432e Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerGroup264TestJSON-936358979 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2287f8fa7de6426b84e95a7ebb0a432e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2287f8fa7de6426b84e95a7ebb0a432e", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2287f8fa7de6426b84e95a7ebb0a432e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2287f8fa7de6426b84e95a7ebb0a432e"}]}] Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerGroup264TestJSON-936358979 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2287f8fa7de6426b84e95a7ebb0a432e Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerGroup264TestJSON-936358979 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerGroup264TestJSON-936358979-project Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 72cc493b0d984409ae9fa93ed44f1003 Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerGroup264TestJSON-936358979-project Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance group c988bc80-b16d-4b29-951d-dc4e9c6a0d5e could not be found. Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'c988bc80-b16d-4b29-951d-dc4e9c6a0d5e'} Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c988bc80-b16d-4b29-951d-dc4e9c6a0d5e could not be found. Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c988bc80-b16d-4b29-951d-dc4e9c6a0d5e could not be found. Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:25.683253 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:25.688385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:25.688385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:25.688385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:02:25.688385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:02:25.688385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c988bc80-b16d-4b29-951d-dc4e9c6a0d5e could not be found. Nov 03 04:02:25.688385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:25.688385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9079f1c1-e92a-448a-9b37-cfbdde783b1c tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] Returning 404 to user: Instance group c988bc80-b16d-4b29-951d-dc4e9c6a0d5e could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:02:25.689721 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9079f1c1-e92a-448a-9b37-cfbdde783b1c tempest-ServerGroup264TestJSON-936358979 tempest-ServerGroup264TestJSON-936358979-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/c988bc80-b16d-4b29-951d-dc4e9c6a0d5e" status: 404 len: 117 microversion: 2.64 time: 0.057580 Nov 03 04:02:25.690933 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1383/2703] 10.222.0.30 () {60 vars in 1307 bytes} [Thu Nov 3 04:02:25 2022] DELETE /compute/v2.1/os-server-groups/c988bc80-b16d-4b29-951d-dc4e9c6a0d5e => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 03 04:02:25.711661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:25.714625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:25.763781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:25.770619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:25.773543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:25.774926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:25.781042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:25.781641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:26.203018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:26.217483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:26.219601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:26.232238 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6fe54865-0cce-4992-a4d8-57e03c179071 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.540109 Nov 03 04:02:26.253520 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1384/2704] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:25 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:26.596393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:26.604774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:26.636624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:26.647483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:26.648292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:26.649408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:26.650119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:26.650808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:26.937711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:26.958090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:26.960013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:26.963082 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba35c2c3-8731-4ae2-bec2-1850ea12f2aa tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 1.395118 Nov 03 04:02:26.965087 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1321/2705] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:25 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:27.005307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:27.019865 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a08c5cd3-791e-42bb-8e6d-66227bd57896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1278 microversion: 2.1 time: 0.432376 Nov 03 04:02:27.022836 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1385/2706] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:26 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1278 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:27.264991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:27.266024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:27.286278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:27.286799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:27.288400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:27.289185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:27.291471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:27.291955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:27.451643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:27.462946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:27.464917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:27.471560 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8343bc7-b8ba-4531-971e-41037e26435a tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.211473 Nov 03 04:02:27.487650 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1322/2707] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:27 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:27.999593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:28.001982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:28.036285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:28.037715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:28.047100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:28.047314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:28.049399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:28.049728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:28.050262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:28.053257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:28.064382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:28.064980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:28.069238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:28.084444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:28.085221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:28.087811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:28.283038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:28.293821 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a6ee234-0dba-4520-9844-d50eea43203d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1266 microversion: 2.1 time: 0.251277 Nov 03 04:02:28.305823 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1323/2708] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:28 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:28.502817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:28.503849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:28.515322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:28.518044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:28.518739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:28.522524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:28.523277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:28.527856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:28.679884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:28.724174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:28.730962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:28.732252 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-93488b83-6324-4da3-b5ab-9d99c1349f45 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1487 microversion: 2.25 time: 0.743866 Nov 03 04:02:28.743870 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1386/2709] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:27 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1487 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:28.873095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:28.878030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:28.918320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:28.926922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:28.978239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e7e2b426-af80-4611-b9cd-2ad39c1c0fb2 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.476157 Nov 03 04:02:28.983330 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1324/2710] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:28 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:29.333066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:29.334741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:29.353949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:29.355842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:29.355842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:29.356699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:29.359698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:29.360381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:29.775432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:29.776800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:29.798432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:29.803161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:29.804549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:29.806266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:29.809801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:29.810874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:30.063744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:30.075406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf9b2ae6-be1c-4d1c-a846-fc5407fed6df tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.746612 Nov 03 04:02:30.078639 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1387/2711] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:29 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:30.087416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:30.091652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:30.109075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:30.109861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:30.110484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:30.111705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:30.114411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:30.115043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:30.444035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:30.499324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:30.510703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:30.532658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f44abfdf-f4fc-4c80-8794-10daf4697a7e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.451034 Nov 03 04:02:30.549045 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1388/2712] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:30 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:30.816023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa76a62b-c8af-4da1-8739-89b4f31e0b7b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7f9329ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-451318846", "description": "tempest-description-2077230328"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:31.066818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:31.082674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:31.085523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:31.093372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be24115a-de78-43e4-8e68-cc735e1aae7f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1477 microversion: 2.25 time: 1.325432 Nov 03 04:02:31.097062 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1325/2713] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:29 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1477 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:31.124187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:31.125246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:31.134024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:31.135989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:31.136789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:31.138897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:31.139727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:31.144725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:31.892457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:31.909924 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ffbeb703-6e00-4d27-bdd8-2064c4e96851 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.798490 Nov 03 04:02:31.912656 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1326/2714] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:31 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:31.927973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9a489d0d-74b3-4217-a8c2-d9faf1bb4597 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '.version_select at 0x7ff7f9573ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:31.936528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a489d0d-74b3-4217-a8c2-d9faf1bb4597 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:31.944854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a489d0d-74b3-4217-a8c2-d9faf1bb4597 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:31.946594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a489d0d-74b3-4217-a8c2-d9faf1bb4597 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:31.972507 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9a489d0d-74b3-4217-a8c2-d9faf1bb4597 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/os-migrations" status: 200 len: 1698 microversion: 2.25 time: 0.058480 Nov 03 04:02:31.979739 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1327/2715] 10.222.0.30 () {60 vars in 1184 bytes} [Thu Nov 3 04:02:31 2022] GET /compute/v2.1/os-migrations => generated 1698 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:31.993183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:31.994262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:32.010736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:32.012724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:32.014515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:32.020382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:32.026231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:32.027180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:32.385054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:32.403692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:32.415047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:32.426809 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d21bfae2-f4b3-4b38-94fd-1b37853ff108 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.445346 Nov 03 04:02:32.430150 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1328/2716] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:31 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:32.445219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:32.447731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:32.468645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:32.474393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:32.474393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:32.474393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:32.475963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:32.478107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:32.581281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:33.808292 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa76a62b-c8af-4da1-8739-89b4f31e0b7b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 3.118127 Nov 03 04:02:33.808960 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1389/2717] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:02:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 3122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:33.823515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:33.836548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:33.855921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:33.858815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:33.861037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:33.861806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:33.864375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:33.864870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:33.936337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:02:34.130674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] Lazy-loading 'services' on Instance uuid c8ff97d8-a5de-49ec-8ab6-49252fa26a4c {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:02:34.183249 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e8a0981-809a-4f74-805d-f7e42ef23125 tempest-LiveAutoBlockMigrationV225Test-1150369331 tempest-LiveAutoBlockMigrationV225Test-1150369331-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1969 microversion: 2.25 time: 1.750893 Nov 03 04:02:34.184713 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1329/2718] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:32 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1969 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:34.190830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:34.191721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:34.218955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:34.220667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:34.222345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:34.224940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:34.227870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:34.228576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:34.352517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:34.418845 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8df86455-84f1-48d8-97b1-ef77fc4c3f11 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "DELETE /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 204 len: 0 microversion: 2.1 time: 0.605214 Nov 03 04:02:34.428735 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1390/2719] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:02:33 2022] DELETE /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:34.439313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:34.440624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:34.465483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:34.466449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:34.467434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:34.478437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:34.480025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:34.480996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:34.677731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:34.695434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:34.706890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:34.725890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b1aa3f8-24ff-41d5-95b0-372363212a46 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.295232 Nov 03 04:02:34.727081 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1391/2720] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:34 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:34.740394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f54918a2-cbf9-4fbb-b45b-3bdff068560d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7f9329c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-126105500", "description": "tempest-description-1400142362"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:35.055680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:35.072125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3cb1f6cb-5dae-48a4-ba56-4a60fc248844 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.885385 Nov 03 04:02:35.078570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1330/2721] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:34 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:35.098568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d617aa2e-58ac-459b-945c-12c75cf31201 req-abab6dbb-729a-4dbf-b7ee-d2008fabb8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50411c90-335b-499c-b7e2-24e5686bb4b0", "tag": "b88a6870-0e94-4516-9dba-6bc5cd510dd8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:35.131668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d617aa2e-58ac-459b-945c-12c75cf31201 req-abab6dbb-729a-4dbf-b7ee-d2008fabb8a1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:35.137369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d617aa2e-58ac-459b-945c-12c75cf31201 req-abab6dbb-729a-4dbf-b7ee-d2008fabb8a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:35.138420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d617aa2e-58ac-459b-945c-12c75cf31201 req-abab6dbb-729a-4dbf-b7ee-d2008fabb8a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:35.193304 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d617aa2e-58ac-459b-945c-12c75cf31201 req-abab6dbb-729a-4dbf-b7ee-d2008fabb8a1 service nova] Creating event network-changed:b88a6870-0e94-4516-9dba-6bc5cd510dd8 for instance 50411c90-335b-499c-b7e2-24e5686bb4b0 on n-h1-854653-7 Nov 03 04:02:35.203455 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d617aa2e-58ac-459b-945c-12c75cf31201 req-abab6dbb-729a-4dbf-b7ee-d2008fabb8a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122901 Nov 03 04:02:35.208804 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1331/2722] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:35.212680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:35.220679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:35.243276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:35.243276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:35.243700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:35.246052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:35.250085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:35.251368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:35.328349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:35.351522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:02:35.742739 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f54918a2-cbf9-4fbb-b45b-3bdff068560d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.012680 Nov 03 04:02:35.744254 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1392/2723] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:02:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:35.750527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:35.751536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:35.822503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:35.831072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:35.832470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:35.838405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:35.840191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:35.844718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:35.908260 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3610729c-507d-4498-b376-92fa4bbc7d1e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 204 len: 0 microversion: 2.25 time: 0.701986 Nov 03 04:02:35.909972 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1332/2724] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:02:35 2022] DELETE /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:02:35.915738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:35.925504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:35.940433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:35.941231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:35.943770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:35.944769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:35.946482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:35.948420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:36.657805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:36.682215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:36.683814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:36.707668 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d300787-d2fa-4829-9886-765d33b5895b tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.796895 Nov 03 04:02:36.736778 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1333/2725] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:35 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:36.752544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:36.761714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:36.784929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:36.791554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:36.797843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:36.799064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:36.805731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:36.807181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:36.920173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:36.935622 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ba9db8f-92ca-4643-a7cd-7cd0d83ae603 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1666 microversion: 2.1 time: 1.187861 Nov 03 04:02:36.936856 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1393/2726] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:35 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1666 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:36.945384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1810975832", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "bb2c6852-0894-49d2-b49a-7d506865e490"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:37.127612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] validate_networks() for [('bb2c6852-0894-49d2-b49a-7d506865e490', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:02:37.481478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:37.502817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:37.512758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:37.514353 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9e7e6feb-0e05-46f5-b946-cfb8a4f7416a tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1483 microversion: 2.25 time: 0.776415 Nov 03 04:02:37.514968 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1334/2727] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:36 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1483 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:37.535782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:37.555348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:37.585822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:37.587020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:37.591904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:37.593068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:37.596286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:37.601962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:38.344545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:38.355827 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8443c618-2289-4c4b-9b8a-56b98f65e319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.834319 Nov 03 04:02:38.361211 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1335/2728] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:37 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:38.394742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:38.395377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:38.418511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:38.420491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:38.420939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:38.421742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:38.424793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:38.425263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:39.026850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:39.054730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:39.064824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:39.075096 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-efc46dbc-bdc4-419e-b72c-127e4b7c7c54 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.712516 Nov 03 04:02:39.101552 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1336/2729] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:38 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:39.113462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:39.114456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:39.150505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:39.152859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:39.155905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:39.160125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:39.161975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:39.164921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:39.778997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:02:39.781234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:02:39.787162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:02:39.788010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:02:39.788841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:02:39.811446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:39.814652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:39.815338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:39.816593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:39.819710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:39.822140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:39.878269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Getting quotas for project 2509709ccbc04cb0a157454541ddd369. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:02:39.887854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Getting quotas for user 98b69b997a6644698103e40fe23bcebf and project 2509709ccbc04cb0a157454541ddd369. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:02:39.929436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:02:39.933000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:02:40.000333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:40.024772 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f65122d4-83c8-4e55-9b66-3132c48a7a3f tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1599 microversion: 2.1 time: 0.920901 Nov 03 04:02:40.025801 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1337/2730] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:39 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1599 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:40.053377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:40.067098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:40.070152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:40.084051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:40.084886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:40.085557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:40.086731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:40.097774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:40.098496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:40.145994 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4bfaddcf-7b29-4e9c-b2d9-31ca49e70577 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.207772 Nov 03 04:02:40.159461 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1394/2731] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:02:40.175060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-35250afd-2a73-4ec5-a358-7608f9d0ba94 req-a28b6253-4c8e-4069-8e28-c4969aa1694a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ff97d8-a5de-49ec-8ab6-49252fa26a4c", "name": "network-vif-deleted", "tag": "4f57820b-e8d1-4673-9e84-6d40df1a9e04"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:40.234332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-35250afd-2a73-4ec5-a358-7608f9d0ba94 req-a28b6253-4c8e-4069-8e28-c4969aa1694a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:40.238291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-35250afd-2a73-4ec5-a358-7608f9d0ba94 req-a28b6253-4c8e-4069-8e28-c4969aa1694a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:40.238948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-35250afd-2a73-4ec5-a358-7608f9d0ba94 req-a28b6253-4c8e-4069-8e28-c4969aa1694a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:40.272233 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-35250afd-2a73-4ec5-a358-7608f9d0ba94 req-a28b6253-4c8e-4069-8e28-c4969aa1694a service nova] Creating event network-vif-deleted:4f57820b-e8d1-4673-9e84-6d40df1a9e04 for instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c on n-h2-854653-7 Nov 03 04:02:40.279671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-35250afd-2a73-4ec5-a358-7608f9d0ba94 req-a28b6253-4c8e-4069-8e28-c4969aa1694a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118024 Nov 03 04:02:40.280649 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1395/2732] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:40.288928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:40.289754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:40.307662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:40.308489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:40.309163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:40.310816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:40.311468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:40.312070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:41.148338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:41.168280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:41.174104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:41.175418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2cc8c12e-94d1-428d-8a7a-ea450eeb0ac2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1265 microversion: 2.25 time: 1.148412 Nov 03 04:02:41.175994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1338/2733] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:40 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1265 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:41.212817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:41.233432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:41.254412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:41.271152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:41.275069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:41.287767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:41.287767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:41.287767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:41.620252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:41.652124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:41.665269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:41.687565 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-022a6aee-d578-4c84-89f7-8a435e64fcd9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.504370 Nov 03 04:02:41.689829 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1339/2734] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:41 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:41.717446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:41.727594 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e600825-3109-47fc-99cc-849952ac8fe1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 1.445476 Nov 03 04:02:41.729539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c29d171-b66c-4d87-9e07-570705f37ed7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:41.733969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c29d171-b66c-4d87-9e07-570705f37ed7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:41.751658 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1396/2735] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:40 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:41.758843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:41.786655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:41.823494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:41.833156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:41.839180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:41.840122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:41.848620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:41.853080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:42.056407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:42.063946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:42.067546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:42.070824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lazy-loading 'fault' on Instance uuid 53589e40-4455-4b27-8d9c-d63fe9f193d1 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:02:42.948086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6c29d171-b66c-4d87-9e07-570705f37ed7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:42.973701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c29d171-b66c-4d87-9e07-570705f37ed7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1216 microversion: 2.1 time: 1.274445 Nov 03 04:02:42.974335 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1340/2736] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:41 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1216 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:42.989897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-86fd3cfe-4a87-429a-98e6-d09f45792c7b req-d46a5b66-ce81-4c21-a7dd-c53590b6db5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53589e40-4455-4b27-8d9c-d63fe9f193d1", "name": "network-vif-deleted", "tag": "29588292-eaad-405c-8c1d-20aa98f187a5"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:43.025555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '783d7e87604342bd9b0ea39a7d28234f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce056d754ef1484f9bd20656daba2813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:43.027817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-86fd3cfe-4a87-429a-98e6-d09f45792c7b req-d46a5b66-ce81-4c21-a7dd-c53590b6db5d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:43.028582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-86fd3cfe-4a87-429a-98e6-d09f45792c7b req-d46a5b66-ce81-4c21-a7dd-c53590b6db5d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:43.030804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-86fd3cfe-4a87-429a-98e6-d09f45792c7b req-d46a5b66-ce81-4c21-a7dd-c53590b6db5d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:43.035786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0fc6d34-f9a2-4eb5-8618-d33619b0abbb tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 200 len: 1316 microversion: 2.1 time: 1.280711 Nov 03 04:02:43.049398 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1397/2737] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:41 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 1316 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:43.065372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:43.069098 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-86fd3cfe-4a87-429a-98e6-d09f45792c7b req-d46a5b66-ce81-4c21-a7dd-c53590b6db5d service nova] Creating event network-vif-deleted:29588292-eaad-405c-8c1d-20aa98f187a5 for instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 on n-h1-854653-7 Nov 03 04:02:43.080574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-86fd3cfe-4a87-429a-98e6-d09f45792c7b req-d46a5b66-ce81-4c21-a7dd-c53590b6db5d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104240 Nov 03 04:02:43.081782 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1341/2738] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:43.088718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:43.089647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:43.097605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:43.098759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:43.099383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:43.100870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:43.101634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:43.105265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:43.105947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:43.129971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:43.132897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:43.134740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:43.138753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:43.143241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:43.147289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:43.169767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:43.173309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:43.371136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:43.384377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:43.386291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:43.393607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:43.399763 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07b567db-5361-47c1-85f1-22862cbb4362 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.316523 Nov 03 04:02:43.429976 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1342/2739] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:43 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:43.433975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:43.449037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:43.449287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:43.455880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:43.459913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1fac5f09-c335-4100-8a27-4ddca548705e tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1265 microversion: 2.25 time: 0.405772 Nov 03 04:02:43.465095 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1398/2740] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:43 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1265 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:43.485347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:43.487130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:43.489148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:43.491900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:43.492573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:43.493483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.011749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:44.013066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:44.061693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.062341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.065588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.066364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.072528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.093821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.111005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:44.126960 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f41947b-9726-4fbf-9b68-b6bc6321c041 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.695281 Nov 03 04:02:44.145651 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1343/2741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:43 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:44.160040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:44.161490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] [instance: 53589e40-4455-4b27-8d9c-d63fe9f193d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:44.177323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.177965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.178509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.179353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.185275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.188799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.261930 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] HTTP exception thrown: Instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 could not be found. Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Request method failure captured: Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 HTTP/1.1 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzzu6-zMkrICMvMYbCMQp-GRUi0_vuUa5x2F-zgi4ddPdhtej34kH2cRjNR62WS34dGCGYl4v0rLkgSBmIGDSXTc1Fexzl-7241zOHGazcr5sk9KG2vrC838ktdeS2Jn9_1UmmjOOwqYnB4EFUIx-fdF_hL_QnAvSLOp3tpYgLpFNU4 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: ce056d754ef1484f9bd20656daba2813 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestFqdnHostnames-1741046336 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce056d754ef1484f9bd20656daba2813"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ce056d754ef1484f9bd20656daba2813", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ce056d754ef1484f9bd20656daba2813"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ce056d754ef1484f9bd20656daba2813"}]}] Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestFqdnHostnames-1741046336 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: ce056d754ef1484f9bd20656daba2813 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1741046336 Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestFqdnHostnames-1741046336-project Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 783d7e87604342bd9b0ea39a7d28234f Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestFqdnHostnames-1741046336-project Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 could not be found. Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '53589e40-4455-4b27-8d9c-d63fe9f193d1'} Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 could not be found. Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 could not be found. Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:44.290674 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 could not be found. Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:02:44.300907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Returning 404 to user: Instance 53589e40-4455-4b27-8d9c-d63fe9f193d1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:02:44.317646 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-706abac3-69b7-4aaa-bca9-83d0e6cd1629 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1" status: 404 len: 111 microversion: 2.1 time: 0.170609 Nov 03 04:02:44.323756 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1344/2742] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:44 2022] GET /compute/v2.1/servers/53589e40-4455-4b27-8d9c-d63fe9f193d1 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:02:44.368239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff7c43d6-5d2c-4f11-a2b6-ddcbef935637 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] Calling method '.version_select at 0x7ff7f912fc10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:44.417459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:44.439256 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d08d84e-1230-45cc-a90b-172058245c99 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1268 microversion: 2.1 time: 0.434027 Nov 03 04:02:44.440136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1399/2743] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:43 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1268 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:44.458361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:44.461253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:44.478941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.479441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.479881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.480617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.481131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.482247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.486789 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff7c43d6-5d2c-4f11-a2b6-ddcbef935637 tempest-ServersTestFqdnHostnames-1741046336 tempest-ServersTestFqdnHostnames-1741046336-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088626782" status: 202 len: 0 microversion: 2.1 time: 0.142279 Nov 03 04:02:44.487922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1345/2744] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:02:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2088626782 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:02:44.493764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:44.497683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:44.510316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.513118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.513744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.518403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:44.519289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:44.524014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:44.859192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:44.882355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:44.887814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:44.916601 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aebccbc8-50e0-4a4c-8216-ed0c5009b319 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.456364 Nov 03 04:02:44.926720 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1400/2745] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:44 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:44.992046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:45.015642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:45.019232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:45.022164 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-28175fcb-4123-418e-a8ae-fa9858563f25 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1265 microversion: 2.25 time: 0.532930 Nov 03 04:02:45.026819 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1346/2746] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:44 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1265 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:45.158563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:45.159727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:45.172679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:45.173552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:45.175169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:45.176058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:45.178020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:45.178653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:45.470146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:45.471846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:45.494108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:45.496338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:45.497919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:45.500719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:45.502106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:45.503633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:46.033927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.045258 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f28ed2d7-2e1f-4560-8482-f615f0b87e2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.890561 Nov 03 04:02:46.052493 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1401/2747] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:45 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:46.063500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:46.065724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:46.093708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:46.094597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:46.095376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:46.102307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:46.102892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:46.103346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:46.162318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.183107 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93797099-15b5-4488-b1d5-e3d9d751e883 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1274 microversion: 2.1 time: 0.707750 Nov 03 04:02:46.187213 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1347/2748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:45 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1274 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:46.207568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:46.208205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:46.244979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:46.252769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:46.253752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:46.255101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:46.255744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:46.256926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:46.553593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.553593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.557273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.571802 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd2bc7a6-3627-445d-b3b7-9c6ef5304eaa tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.517020 Nov 03 04:02:46.578415 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1402/2749] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:46 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:46.692911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.718329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.720702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:46.728228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c390036b-9248-4dbb-ba90-94ce66112730 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1265 microversion: 2.25 time: 0.534492 Nov 03 04:02:46.742679 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1348/2750] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:46 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1265 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:47.078058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:47.079027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:47.090740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:47.092120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:47.094386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:47.096382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:47.098148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:47.099562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:47.222314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:47.222995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:47.258473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:47.259335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:47.259851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:47.260702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:47.261207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:47.261638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:47.461836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:47.461836 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e9c2254-b88e-4dc4-a0e5-f8200af3fb6f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.366685 Nov 03 04:02:47.461836 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1403/2751] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:47 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:47.611681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:47.614862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:47.640231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:47.640776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:47.648687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:47.649600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:47.652133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:47.653897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:47.915966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:47.930842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:47.940879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:47.958717 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9db7045e-4f3e-4616-8bc6-7772a57b5b0c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.354778 Nov 03 04:02:47.973763 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1404/2752] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:47 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:47.979584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:47.986738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:48.004128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:48.004456 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd7873d6-f40d-421c-9aa9-176269311cf9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 0.787064 Nov 03 04:02:48.004456 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1349/2753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:47 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:48.004655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:48.004655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:48.005000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:48.006057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:48.012476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:48.012476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:48.037148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2ead09bc-8ef4-4583-b091-8b7f1574482e req-58b13938-c260-45a2-800e-89414f2ece97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50411c90-335b-499c-b7e2-24e5686bb4b0", "name": "network-vif-plugged", "status": "completed", "tag": "b88a6870-0e94-4516-9dba-6bc5cd510dd8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:48.069868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ead09bc-8ef4-4583-b091-8b7f1574482e req-58b13938-c260-45a2-800e-89414f2ece97 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:48.071277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ead09bc-8ef4-4583-b091-8b7f1574482e req-58b13938-c260-45a2-800e-89414f2ece97 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:48.072494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ead09bc-8ef4-4583-b091-8b7f1574482e req-58b13938-c260-45a2-800e-89414f2ece97 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:48.089427 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2ead09bc-8ef4-4583-b091-8b7f1574482e req-58b13938-c260-45a2-800e-89414f2ece97 service nova] Creating event network-vif-plugged:b88a6870-0e94-4516-9dba-6bc5cd510dd8 for instance 50411c90-335b-499c-b7e2-24e5686bb4b0 on n-h1-854653-7 Nov 03 04:02:48.122603 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2ead09bc-8ef4-4583-b091-8b7f1574482e req-58b13938-c260-45a2-800e-89414f2ece97 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099499 Nov 03 04:02:48.128999 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1350/2754] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:48.465564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:48.466480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:48.494024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:48.504451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:48.505185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:48.511070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:48.511801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:48.512646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:48.868118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:48.883437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:48.892710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:48.894337 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3c76a6d-902e-4754-9105-defcdf8f5f52 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1265 microversion: 2.25 time: 0.919381 Nov 03 04:02:48.895011 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1405/2755] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:47 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1265 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:48.992261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:48.992886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:49.004379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:49.005630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:49.006483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:49.009325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:49.010778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:49.011501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:49.317410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:49.334828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:49.336704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:49.348019 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0d86665-a977-4cf0-82bd-d1accfbac63f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.359859 Nov 03 04:02:49.362499 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1406/2756] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:48 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:49.370913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:49.386274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:49.407460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:49.408312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:49.408976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:49.409968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:49.410651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:49.411278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:49.559975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:49.585837 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65326a03-5844-4159-b3ad-729886a3c7d5 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 1.125752 Nov 03 04:02:49.590457 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1351/2757] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:48 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:49.762563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:49.773644 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35499d53-5368-4374-8613-0323618ef2a7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 0.406494 Nov 03 04:02:49.774237 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1407/2758] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:49 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:49.927582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:49.930511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:49.946303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:49.947508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:49.948754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:49.952509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:49.958256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:49.958902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:50.158026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:50.173570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:50.179587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:50.183760 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-732457d4-6c8d-4ebd-8849-4babd4caffb8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1265 microversion: 2.25 time: 0.260567 Nov 03 04:02:50.200903 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1352/2759] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:49 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:50.248391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ac262530-1e30-4054-9de5-84d5521a5de5 req-2e675416-074a-40d9-8565-aa7e6186738b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19fb334-80cd-46cc-b646-44482c5992e5", "tag": "2fe8dc5e-e383-431e-b1b9-44756d315b6c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:50.264647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:50.265450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:50.286647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ac262530-1e30-4054-9de5-84d5521a5de5 req-2e675416-074a-40d9-8565-aa7e6186738b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:50.287395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ac262530-1e30-4054-9de5-84d5521a5de5 req-2e675416-074a-40d9-8565-aa7e6186738b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:50.288086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ac262530-1e30-4054-9de5-84d5521a5de5 req-2e675416-074a-40d9-8565-aa7e6186738b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:50.313736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ac262530-1e30-4054-9de5-84d5521a5de5 req-2e675416-074a-40d9-8565-aa7e6186738b service nova] Creating event network-changed:2fe8dc5e-e383-431e-b1b9-44756d315b6c for instance e19fb334-80cd-46cc-b646-44482c5992e5 on n-h2-854653-7 Nov 03 04:02:50.320109 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ac262530-1e30-4054-9de5-84d5521a5de5 req-2e675416-074a-40d9-8565-aa7e6186738b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075690 Nov 03 04:02:50.327590 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1408/2760] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:02:50.394782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:50.395644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:50.405629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:50.408797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:50.411485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:50.412372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:50.415264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:50.415835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:50.613346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:50.614560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:50.629243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:50.633916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:50.634857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:50.635536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:50.639266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:50.640260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:50.640907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:50.802836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:50.862509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:50.871586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:50.906462 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b6ed0f61-443a-44cc-9217-85cd61cbf155 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.512587 Nov 03 04:02:50.932879 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1353/2761] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:50 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:50.955871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:50.959046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:50.990053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:50.994035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:50.995503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:50.998746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:51.000891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:51.001969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:51.053883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:51.069404 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-016a387e-e322-4b12-af04-14a4edf6e6e2 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1308 microversion: 2.1 time: 0.455425 Nov 03 04:02:51.073616 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1409/2762] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:50 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:51.213966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:51.214594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:51.225037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:51.228474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:51.229057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:51.229886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:51.230869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:51.239087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:51.708210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:51.729246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:51.738320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:51.739741 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fdd06bf9-fb60-407f-9410-e2fe38010906 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1265 microversion: 2.25 time: 0.530710 Nov 03 04:02:51.748778 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1410/2763] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:51 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1265 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:51.938946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:51.939574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:51.953586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:51.954135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:51.956339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:51.957778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:51.959619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:51.960089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.002146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:52.018862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-622013e1-9c75-4ac6-941c-87bab6d2a65a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 1.084433 Nov 03 04:02:52.026138 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1354/2764] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:50 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:52.098426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:52.099409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:52.108220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:52.109201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:52.111370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.113584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:52.117404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:52.118600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.362947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:52.399710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:52.401235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:52.488627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92265a04-0f86-466e-8082-bf2252136207 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.551953 Nov 03 04:02:52.510243 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1411/2765] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:51 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:52.679303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:52.695824 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-95cc4ad3-9e89-48a4-a8eb-ce50d4fc45fa tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1490 microversion: 2.1 time: 0.601892 Nov 03 04:02:52.713193 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1355/2766] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:52 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1490 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:52.725391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:52.748331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:52.770876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:52.773964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:52.788491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:52.792245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:52.796423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:52.797252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.798282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:52.798970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:52.801821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.803327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:52.803786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.811008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:52.811511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:52.813824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.911703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:52.912437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:52.913217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:52.914394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lazy-loading 'fault' on Instance uuid c8ff97d8-a5de-49ec-8ab6-49252fa26a4c {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:02:52.958692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:53.009753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:53.024955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:53.026961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:53.032312 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-775ab32c-8459-43ca-9179-6c3ed91f64a8 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 200 len: 1270 microversion: 2.25 time: 0.265915 Nov 03 04:02:53.033457 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1356/2767] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:52 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:53.052722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:53.053654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:53.067461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:53.067963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:53.068585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:53.072395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:53.073090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:53.073692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:53.124540 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0db6d27b-e9f6-4025-8305-8e10347e8d0f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "PUT /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1085 microversion: 2.1 time: 0.407658 Nov 03 04:02:53.128743 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1412/2768] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:02:52 2022] PUT /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1085 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:53.151882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:53.151882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:53.163686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:53.164181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:53.169381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:53.173228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:53.173809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:53.174410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:54.128630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:54.141222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-28ee7851-2dd7-45fc-bd39-940cfeb6f3d5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 1.092424 Nov 03 04:02:54.142462 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1357/2769] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:53 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:54.147499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:54.153619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:54.156574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:54.157302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:54.157987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:54.159017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:54.159636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:54.160225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:54.634251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:54.643126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:54.644573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:54.646095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:54.659775 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6020bcb7-928c-4613-99bd-a4de6112c09a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1511 microversion: 2.1 time: 1.512995 Nov 03 04:02:54.672481 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c527cc94-4b2f-478f-b7fb-60bf63c3915f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.528763 Nov 03 04:02:54.676494 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1413/2770] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:53 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1511 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:02:54.685172 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1358/2771] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:54 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:54.703490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:54.705633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: c8ff97d8-a5de-49ec-8ab6-49252fa26a4c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:54.706679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:54.712687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:54.726773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:54.727899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:54.729429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:54.730385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:54.731084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:54.731732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:54.738685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:54.741050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:54.742300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:54.743070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:54.743598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:54.744037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:54.794645 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] HTTP exception thrown: Instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c could not be found. Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Request method failure captured: Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c HTTP/1.1 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt8GBfN7Dwbk_OBNyizTGr6KfY4izFHnn_hhMX05lLIWMRbV5AvM3e4ljCNmV6u5qTFaB7aoBarGqoR5n6M60uAliLF3reKQ1w3zKQGv8w42xmbitU4c-RTiUUUfGv9g1bg0Aho1FsQO1T2iqFaUMEU6RXM7p3YEx84LDLmXw1byjE Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.25 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4a9b6a4c4189418eb86c45bd82cb0ca8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}] Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ebbc13908db44e88853d5c14c8e2102 Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c could not be found. Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'c8ff97d8-a5de-49ec-8ab6-49252fa26a4c'} Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c could not be found. Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c could not be found. Nov 03 04:02:54.796338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c could not be found. Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:02:54.800378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Returning 404 to user: Instance c8ff97d8-a5de-49ec-8ab6-49252fa26a4c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:02:54.801281 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fe365883-d725-4087-b17b-86d32ba06ca3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c" status: 404 len: 111 microversion: 2.25 time: 0.105550 Nov 03 04:02:54.802405 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1414/2772] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:54 2022] GET /compute/v2.1/servers/c8ff97d8-a5de-49ec-8ab6-49252fa26a4c => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:02:55.124503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:55.135569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-62325e62-107d-4195-bd50-4670a1c2c786 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1511 microversion: 2.1 time: 0.444654 Nov 03 04:02:55.141359 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1359/2773] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:54 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:55.171922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:55.175195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:55.177007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:55.181785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:55.190014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.192907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.192907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.192907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.192907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.195862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.204654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.205229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.205687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.206430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.207651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.214022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.274888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:02:55.298534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:55.338035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:02:55.741001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:55.755059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ac577a0-5277-44a5-bf83-b58dd9e587e7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 0.587521 Nov 03 04:02:55.763129 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1415/2774] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:55 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:55.780240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:55.785505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:55.806630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.813855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.815420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.816192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.816663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.824451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.864892 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5201d863-aeac-410c-b46b-389e4d737519 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 204 len: 0 microversion: 2.1 time: 0.693981 Nov 03 04:02:55.870717 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1360/2775] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:02:55 2022] DELETE /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:02:55.886893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:55.891237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:55.913112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.915904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.919957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.922185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:55.924472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:55.925379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:55.959552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:55.972171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:55.973668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:55.984343 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b6108d9-66e0-4412-b710-df1e3881c399 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.224560 Nov 03 04:02:55.991552 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1416/2776] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:55 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:56.422028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:56.446665 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6f9c47c-658f-49ce-abe2-27f6ab48ca18 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1517 microversion: 2.1 time: 0.567636 Nov 03 04:02:56.457181 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1361/2777] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:55 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:56.786441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:56.787181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:56.796772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:56.797313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:56.797759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:56.798485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:56.798963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:56.799365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:57.047008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:57.052167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:57.058845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:57.073862 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35e4471c-2251-48db-8982-bfc7f4c471f6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 0.291307 Nov 03 04:02:57.079479 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1417/2778] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:56 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:57.103265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:57.107689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:57.113481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:57.114368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:57.114873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:57.115335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:57.262852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:57.276205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:57.278861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:57.300775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1f268e7-6c45-4e25-b935-58ee2c299a40 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.276188 Nov 03 04:02:57.307081 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1362/2779] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:57 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:02:57.477047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:57.477692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:57.492429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:57.508351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:57.508351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:57.508351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:57.508351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:57.510868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:58.051275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:58.052318 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02c2e8f3-210d-49e3-b007-d7886224b319 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1517 microversion: 2.1 time: 0.579729 Nov 03 04:02:58.060801 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1418/2780] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:57 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1517 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:58.104861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:58.106229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:58.118516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:58.118516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:58.118516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:58.118516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:58.119278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:58.120166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:58.340312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:58.341064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:58.358351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:58.367500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:58.370735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:58.387590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:58.387590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:58.387590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:58.656389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:58.674550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:58.680259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:58.707370 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b61821c-1d9e-4f10-9c8e-3cd16f5e5313 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.370989 Nov 03 04:02:58.713064 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1419/2781] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:58 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:02:58.881676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-89192966-8600-40b7-95a4-52b8de8f67bf req-6b204bd1-13c6-4f5d-aa13-12df093a20ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50411c90-335b-499c-b7e2-24e5686bb4b0", "name": "network-vif-deleted", "tag": "b88a6870-0e94-4516-9dba-6bc5cd510dd8"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:58.897980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-89192966-8600-40b7-95a4-52b8de8f67bf req-6b204bd1-13c6-4f5d-aa13-12df093a20ed service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:58.906689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-89192966-8600-40b7-95a4-52b8de8f67bf req-6b204bd1-13c6-4f5d-aa13-12df093a20ed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:58.906689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-89192966-8600-40b7-95a4-52b8de8f67bf req-6b204bd1-13c6-4f5d-aa13-12df093a20ed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:58.923111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-89192966-8600-40b7-95a4-52b8de8f67bf req-6b204bd1-13c6-4f5d-aa13-12df093a20ed service nova] Creating event network-vif-deleted:b88a6870-0e94-4516-9dba-6bc5cd510dd8 for instance 50411c90-335b-499c-b7e2-24e5686bb4b0 on n-h1-854653-7 Nov 03 04:02:58.929669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:58.929838 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-89192966-8600-40b7-95a4-52b8de8f67bf req-6b204bd1-13c6-4f5d-aa13-12df093a20ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060871 Nov 03 04:02:58.930848 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1420/2782] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:02:58.940298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6a14212-ead8-4dc5-9aac-0f9f597090eb tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 0.840143 Nov 03 04:02:58.941573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1363/2783] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:58 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:59.081201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:59.082078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:59.098324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:59.105183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:59.106954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:59.110827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:59.115256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:59.117985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:59.302275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:59.320247 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-44714f42-b04a-4070-a7e0-7ef74241fb75 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1314 microversion: 2.1 time: 0.243607 Nov 03 04:02:59.323495 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1421/2784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:59 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:02:59.744739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:59.746225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:59.754865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:59.755637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:59.756425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:59.757388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:59.758001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:59.758615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:59.806989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-eb43ef58-697f-4722-b2d3-8c7d9412d4bf req-9d232fea-3755-44e5-ae94-2e26c32a8605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19fb334-80cd-46cc-b646-44482c5992e5", "name": "network-vif-plugged", "status": "completed", "tag": "2fe8dc5e-e383-431e-b1b9-44756d315b6c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:02:59.836640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-eb43ef58-697f-4722-b2d3-8c7d9412d4bf req-9d232fea-3755-44e5-ae94-2e26c32a8605 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:59.841172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-eb43ef58-697f-4722-b2d3-8c7d9412d4bf req-9d232fea-3755-44e5-ae94-2e26c32a8605 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:02:59.841635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-eb43ef58-697f-4722-b2d3-8c7d9412d4bf req-9d232fea-3755-44e5-ae94-2e26c32a8605 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:02:59.869717 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-eb43ef58-697f-4722-b2d3-8c7d9412d4bf req-9d232fea-3755-44e5-ae94-2e26c32a8605 service nova] Creating event network-vif-plugged:2fe8dc5e-e383-431e-b1b9-44756d315b6c for instance e19fb334-80cd-46cc-b646-44482c5992e5 on n-h2-854653-7 Nov 03 04:02:59.886326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-eb43ef58-697f-4722-b2d3-8c7d9412d4bf req-9d232fea-3755-44e5-ae94-2e26c32a8605 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082788 Nov 03 04:02:59.886326 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1422/2785] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:02:59.967380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:59.972098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:02:59.976438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:02:59.981488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:59.987363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:02:59.995455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:02:59.999009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:00.000239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:00.006309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:00.006875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c0c74855-ac96-4599-a97c-f6fff889608c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1555 microversion: 2.91 time: 0.264608 Nov 03 04:03:00.007864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1364/2786] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:02:59 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1555 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:00.010063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:00.012718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:00.347467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:00.348338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:00.359163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:00.359917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:00.362488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:00.363530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:00.370343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:00.372416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:00.500775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:00.502951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:00.503587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:00.507526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lazy-loading 'fault' on Instance uuid 50411c90-335b-499c-b7e2-24e5686bb4b0 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:00.704325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:00.722771 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-75b5202d-a240-4106-ae69-6b7a6cf47410 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 200 len: 1319 microversion: 2.1 time: 0.379465 Nov 03 04:03:00.724755 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1365/2787] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:00 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:00.779808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:00.789142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf4a3eac-68e8-4295-ac69-958feb26490a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 0.824041 Nov 03 04:03:00.793988 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1423/2788] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:02:59 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:01.048008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:01.048647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:01.065907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.066429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.066886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:01.067625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.068096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.068528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:01.231667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:01.248475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:01.251566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:01.258945 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b44bc015-8765-4f23-b0a8-7dd914fbd4be tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1537 microversion: 2.91 time: 0.221057 Nov 03 04:03:01.260126 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1366/2789] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:01 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:01.755174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:01.756060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:01.765646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.766170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.768647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:01.769586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.775295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.775295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:01.786228 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 HTTP/1.1 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '50411c90-335b-499c-b7e2-24e5686bb4b0'} Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:01.788753 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5f7227f-df7f-4322-8f35-341f4e894a24 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 404 len: 111 microversion: 2.1 time: 0.040057 Nov 03 04:03:01.792735 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1424/2790] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:01 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:03:01.812979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:01.813638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:01.823234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.825267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.825728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:01.826466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.826965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.827403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:01.956913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:01.959729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:01.974851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.977430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.977430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:01.977430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:01.978392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:01.979334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:02.016748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:03:02.140490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:02.151012 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-695106ea-ea3c-4e6d-bbf8-f29031b69e87 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1316 microversion: 2.1 time: 0.343098 Nov 03 04:03:02.152519 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1367/2791] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:01 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:02.159194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1436050080", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1f101308-9db8-4b30-b5f1-954d8d42482e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:02.262516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] validate_networks() for [('1f101308-9db8-4b30-b5f1-954d8d42482e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:03:02.427114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-adafcbb3-c5d5-48a5-aac9-a04091602ea1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 204 len: 0 microversion: 2.25 time: 0.475379 Nov 03 04:03:02.428100 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1425/2792] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:03:01 2022] DELETE /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 03 04:03:02.437224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:02.438178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:02.468819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:02.470102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:02.471183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:02.476532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:02.478216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:02.478865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:02.677926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:02.705216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:02.712078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:02.725252 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ff9684fb-eb18-45c6-8a0e-6a172ada1d4f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1537 microversion: 2.91 time: 0.295527 Nov 03 04:03:02.741087 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1426/2793] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:02 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1537 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:02.741087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:02.741087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:02.754858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:02.756563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:02.757047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:02.757817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:02.758280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:02.758879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:03.175329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:03.193596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:03.195599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:03.196795 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e9bd9b2-9da4-4494-9832-63d9e9ab0eea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1730 microversion: 2.25 time: 0.467413 Nov 03 04:03:03.209109 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1427/2794] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:02 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1730 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:03.209109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:03.210362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:03.227525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:03.227805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:03.229150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:03.229805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:03.231684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:03.232276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:03.295671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:03:03.295671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:03:03.296359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:03:03.296783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:03:03.297225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:03:03.318918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:03.319464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:03.320147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:03.325156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:03.326622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:03.327241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:03.380806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:03:03.391757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Getting quotas for user cf58b2529baa41099821b8b2b0970d61 and project 433d2397269f416eadd793a38002a763. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:03:03.434543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:03:03.442648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:03:03.463347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:03.483706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:03.493357 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b89368cf-6052-477b-982e-ea89939d90ee tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1505 microversion: 2.1 time: 0.294353 Nov 03 04:03:03.494329 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1428/2795] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:03 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:03.516739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-451318846"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:03.517342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:03.523461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:03.523959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:03.524410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:03.525166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:03.525633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:03.526070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:03.695643 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.security_group_api [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Adding security group 074c101d-5fd7-4d7f-86bd-922c198cdce8 to port 2fe8dc5e-e383-431e-b1b9-44756d315b6c Nov 03 04:03:03.711050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9dbc095-b27d-46ca-84ca-c0993a316c0e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.556338 Nov 03 04:03:03.716895 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1368/2796] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:03:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:03:03.732319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96899bea-0f43-4ef9-9c9f-7f2645fa9343 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:03.734445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96899bea-0f43-4ef9-9c9f-7f2645fa9343 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:03.955465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96899bea-0f43-4ef9-9c9f-7f2645fa9343 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:03.965445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96899bea-0f43-4ef9-9c9f-7f2645fa9343 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1209 microversion: 2.1 time: 0.241067 Nov 03 04:03:03.971111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1369/2797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:03 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1209 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:03.988490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:03.997342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:04.016081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.016973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.018332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:04.019317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.020260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.020911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:04.164388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:04.189822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:04.190224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:04.227904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9459ff45-283e-4f7d-b608-923c917434bd tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1540 microversion: 2.91 time: 0.246390 Nov 03 04:03:04.228545 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1370/2798] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:03 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1540 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:04.248062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:04.257405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:04.269116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.281217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.281217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:04.281217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.281217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.281217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:04.750018 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-51419dec-5bab-4030-b1f3-13742cfe789e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5/action" status: 202 len: 0 microversion: 2.1 time: 1.237787 Nov 03 04:03:04.750573 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1429/2799] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:03:03 2022] POST /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5/action => generated 0 bytes in 1239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:03:04.755432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:04.765132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:04.805395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.805904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.806406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:04.817032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.817632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.818081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:04.890552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-854653-7". {{(pid=127594) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 03 04:03:04.916580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:04.929625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:04.931018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:04.932226 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ce73cc8-278f-4602-848e-c179f4005d34 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1730 microversion: 2.25 time: 0.702624 Nov 03 04:03:04.944768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1371/2800] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:04 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1730 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:04.950865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-126105500"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:04.958975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:04.973252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.974009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.974616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:04.976203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:04.976873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:04.977406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:05.178199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ccbc2c0e-1c2b-4c13-8fe3-0f4036215397 tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action" status: 202 len: 0 microversion: 2.91 time: 0.426581 Nov 03 04:03:05.178821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1430/2801] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:03:04 2022] POST /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:03:05.192019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7dd53467-7b3c-4c53-ac60-9dd4e992ffd2 req-8bc528f6-0a23-41fc-b0d1-faccc9bf0620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19fb334-80cd-46cc-b646-44482c5992e5", "tag": "2fe8dc5e-e383-431e-b1b9-44756d315b6c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:05.232502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7dd53467-7b3c-4c53-ac60-9dd4e992ffd2 req-8bc528f6-0a23-41fc-b0d1-faccc9bf0620 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:05.233060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7dd53467-7b3c-4c53-ac60-9dd4e992ffd2 req-8bc528f6-0a23-41fc-b0d1-faccc9bf0620 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:05.233482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7dd53467-7b3c-4c53-ac60-9dd4e992ffd2 req-8bc528f6-0a23-41fc-b0d1-faccc9bf0620 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:05.253948 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7dd53467-7b3c-4c53-ac60-9dd4e992ffd2 req-8bc528f6-0a23-41fc-b0d1-faccc9bf0620 service nova] Creating event network-changed:2fe8dc5e-e383-431e-b1b9-44756d315b6c for instance e19fb334-80cd-46cc-b646-44482c5992e5 on n-h2-854653-7 Nov 03 04:03:05.275138 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7dd53467-7b3c-4c53-ac60-9dd4e992ffd2 req-8bc528f6-0a23-41fc-b0d1-faccc9bf0620 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086685 Nov 03 04:03:05.279705 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1431/2802] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:05.283440 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.network.security_group_api [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Adding security group 8b8c2178-484b-4edf-a027-a0429fa8330e to port 2fe8dc5e-e383-431e-b1b9-44756d315b6c Nov 03 04:03:05.300151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:05.300874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:05.320662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:05.327331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:05.329138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:05.332937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:05.333734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:05.334345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:05.341283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:05.517464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:05.539673 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0570a94f-a725-4449-bb9c-789079489923 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1213 microversion: 2.1 time: 0.245963 Nov 03 04:03:05.541071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1432/2803] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:05 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1213 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:05.546713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:05.553327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:05.564202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:05.566685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:05.566685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:05.570383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:05.573635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:05.574374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:05.995009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:06.007011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:06.012682 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-862acb5c-28c8-4911-b625-cf53d20a4215 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5/action" status: 202 len: 0 microversion: 2.1 time: 1.066493 Nov 03 04:03:06.013315 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1372/2804] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:03:04 2022] POST /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5/action => generated 0 bytes in 1068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:06.015611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:06.021744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:06.022429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:06.031693 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1acb64f0-70c6-406c-904d-2d2502d34661 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1488 microversion: 2.91 time: 0.489305 Nov 03 04:03:06.032944 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1433/2805] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:05 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1488 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:06.049790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:06.049790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:06.049790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:06.049790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:06.050500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:06.054744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:06.073529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:06.085241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:06.102549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:06.103051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:06.107929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:06.108906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:06.110929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:06.112466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:06.367135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:06.387544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:06.393142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:06.398147 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-653ddf75-7b87-46bb-ad7b-887a844767e3 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1664 microversion: 2.25 time: 0.378148 Nov 03 04:03:06.429601 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1373/2806] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:06 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1664 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:06.567705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:06.568337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:06.580828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:06.581381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:06.581828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:06.582545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:06.583009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:06.583442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:06.814373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:06.843342 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf71d0be-8d82-418d-9682-8fad2c27f682 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1261 microversion: 2.1 time: 0.275430 Nov 03 04:03:06.844390 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1374/2807] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:06 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1261 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:06.859505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-55cc1a4d-ea7a-4745-a3ae-0f562216ecbe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.822985 Nov 03 04:03:06.861140 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1434/2808] 10.222.0.30 () {58 vars in 1293 bytes} [Thu Nov 3 04:03:06 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5/os-security-groups => generated 1157 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:06.880621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4661f90-dc03-40c7-8a4b-051812073f93 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7fd658550>, body: {"security_group": {"name": " tempest-securitygroup -1918963115 ", "description": "tempest-description-270683981"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:07.011398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9c24e4c6-1ff1-4aab-8f4c-1497fe8c651f req-df1a2cce-0a78-46fc-a150-713e4d35df4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed94eeeb-28e0-4472-8d19-c980456ffa0f", "name": "network-vif-deleted", "tag": "936b3ab5-5256-4926-b068-f44770180c56"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:07.039621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9c24e4c6-1ff1-4aab-8f4c-1497fe8c651f req-df1a2cce-0a78-46fc-a150-713e4d35df4c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:07.048385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9c24e4c6-1ff1-4aab-8f4c-1497fe8c651f req-df1a2cce-0a78-46fc-a150-713e4d35df4c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:07.049233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9c24e4c6-1ff1-4aab-8f4c-1497fe8c651f req-df1a2cce-0a78-46fc-a150-713e4d35df4c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:07.084895 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9c24e4c6-1ff1-4aab-8f4c-1497fe8c651f req-df1a2cce-0a78-46fc-a150-713e4d35df4c service nova] Creating event network-vif-deleted:936b3ab5-5256-4926-b068-f44770180c56 for instance ed94eeeb-28e0-4472-8d19-c980456ffa0f on n-h2-854653-7 Nov 03 04:03:07.100376 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9c24e4c6-1ff1-4aab-8f4c-1497fe8c651f req-df1a2cce-0a78-46fc-a150-713e4d35df4c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092954 Nov 03 04:03:07.103864 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1435/2809] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:07.119681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:07.122167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:07.139524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:07.141239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:07.142881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:07.143890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:07.147253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:07.149114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:07.557628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:07.583351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:07.593355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:07.616548 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13be2ecf-c46f-4503-b850-be59a86562b8 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1488 microversion: 2.91 time: 0.509734 Nov 03 04:03:07.617412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1436/2810] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:07 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1488 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:07.639287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:07.641367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:07.655688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:07.656259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:07.656794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:07.659699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:07.659699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:07.659699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:07.734534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:07.735299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:07.736209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:07.736869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lazy-loading 'fault' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:07.912560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:07.928862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:07.930473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:07.937154 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b29b38b6-2545-4d21-a529-7bb1ca1783a1 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1375 microversion: 2.25 time: 0.315758 Nov 03 04:03:07.940263 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1437/2811] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:07 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1375 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:07.945141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5a2e6570-ad6b-4060-88ba-888d5ba5ff41 req-dbf0bdd8-7e33-4ac8-b549-23a117b783a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19fb334-80cd-46cc-b646-44482c5992e5", "tag": "2fe8dc5e-e383-431e-b1b9-44756d315b6c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:07.957801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5a2e6570-ad6b-4060-88ba-888d5ba5ff41 req-dbf0bdd8-7e33-4ac8-b549-23a117b783a3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:07.958336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5a2e6570-ad6b-4060-88ba-888d5ba5ff41 req-dbf0bdd8-7e33-4ac8-b549-23a117b783a3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:07.959813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5a2e6570-ad6b-4060-88ba-888d5ba5ff41 req-dbf0bdd8-7e33-4ac8-b549-23a117b783a3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:07.990194 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5a2e6570-ad6b-4060-88ba-888d5ba5ff41 req-dbf0bdd8-7e33-4ac8-b549-23a117b783a3 service nova] Creating event network-changed:2fe8dc5e-e383-431e-b1b9-44756d315b6c for instance e19fb334-80cd-46cc-b646-44482c5992e5 on n-h2-854653-7 Nov 03 04:03:07.998786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5a2e6570-ad6b-4060-88ba-888d5ba5ff41 req-dbf0bdd8-7e33-4ac8-b549-23a117b783a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059268 Nov 03 04:03:08.010822 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1438/2812] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:08.016312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:08.024507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:08.045154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:08.046845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:08.052349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:08.052349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:08.052832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:08.053322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:08.814583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c4661f90-dc03-40c7-8a4b-051812073f93 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.940404 Nov 03 04:03:08.816025 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1375/2813] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:03:06 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:08.820413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:08.828832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:08.833136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:08.845897 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f8245ee-3884-4f9d-a9f8-7740b5cbff9b tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1267 microversion: 2.1 time: 0.835552 Nov 03 04:03:08.847086 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1439/2814] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:08 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1267 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:08.857691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:08.903752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:08.904418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:08.905872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:08.906161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4b154bc-d783-4fb0-af7b-9909f3162d03 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f90c5d30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:08.909714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:08.913056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:09.086431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:09.127158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:09.137535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:09.147562 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4b154bc-d783-4fb0-af7b-9909f3162d03 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a" status: 200 len: 223 microversion: 2.1 time: 0.289781 Nov 03 04:03:09.147562 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1440/2815] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:03:08 2022] GET /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a => generated 223 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:09.147562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:09.147562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:09.159622 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2d47da3-2243-4cd4-ada0-3c9d6d16505f tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.340926 Nov 03 04:03:09.160367 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1376/2816] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:08 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:09.165671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e569adc-5464-4c86-9d59-f81421e66195 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f912f040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:09.167319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:09.169580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:09.170392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:09.171347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:09.173755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:09.176611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:09.245103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:09.248619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:09.249381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:09.251950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lazy-loading 'fault' on Instance uuid ed94eeeb-28e0-4472-8d19-c980456ffa0f {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:09.362785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:09.375304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:09.379379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:09.383203 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72582caf-b8ca-401f-b209-7c59a12aa988 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 200 len: 1375 microversion: 2.25 time: 0.240019 Nov 03 04:03:09.387339 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1441/2817] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:09 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 1375 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:09.874239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:09.874823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:09.896405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:09.896940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:09.897426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:09.898179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:09.898653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:09.899094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:10.467851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:10.475986 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e569adc-5464-4c86-9d59-f81421e66195 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a" status: 202 len: 0 microversion: 2.1 time: 1.314153 Nov 03 04:03:10.476714 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1377/2818] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:03:09 2022] DELETE /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a => generated 0 bytes in 1316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:10.511567 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d514fe9c-befd-41a0-97d8-a6cb5e153e09 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 0.637650 Nov 03 04:03:10.514521 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1442/2819] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:09 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:10.566488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:10.572686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:10.618954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:10.622170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:10.626054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:10.634470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:10.638007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:10.640427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:10.970293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1889140830", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:11.007463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:11.020345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:11.026755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:11.049431 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2cb11bf-1c96-48df-8276-7df7fb0b5f17 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.510034 Nov 03 04:03:11.057091 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1443/2820] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:10 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:11.087658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:11.088302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: ed94eeeb-28e0-4472-8d19-c980456ffa0f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:11.138388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:11.144428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:11.147210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:11.147976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:11.151140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:11.151651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:11.158591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] validate_networks() for [('07bf4346-3dcb-476a-95fa-07d33215036b', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:03:11.224470 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] HTTP exception thrown: Instance ed94eeeb-28e0-4472-8d19-c980456ffa0f could not be found. Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Request method failure captured: Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f HTTP/1.1 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt8GBfN7Dwbk_OBNyizTGr6KfY4izFHnn_hhMX05lLIWMRbV5AvM3e4ljCNmV6u5qTFaB7aoBarGqoR5n6M60uAliLF3reKQ1w3zKQGv8w42xmbitU4c-RTiUUUfGv9g1bg0Aho1FsQO1T2iqFaUMEU6RXM7p3YEx84LDLmXw1byjE Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.25 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4a9b6a4c4189418eb86c45bd82cb0ca8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}] Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ebbc13908db44e88853d5c14c8e2102 Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ed94eeeb-28e0-4472-8d19-c980456ffa0f could not be found. Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ed94eeeb-28e0-4472-8d19-c980456ffa0f'} Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed94eeeb-28e0-4472-8d19-c980456ffa0f could not be found. Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed94eeeb-28e0-4472-8d19-c980456ffa0f could not be found. Nov 03 04:03:11.226206 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed94eeeb-28e0-4472-8d19-c980456ffa0f could not be found. Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Returning 404 to user: Instance ed94eeeb-28e0-4472-8d19-c980456ffa0f could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3aeb9eb-1197-40f8-bd66-dd16b51ed1f2 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f" status: 404 len: 111 microversion: 2.25 time: 0.169200 Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1444/2821] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:11 2022] GET /compute/v2.1/servers/ed94eeeb-28e0-4472-8d19-c980456ffa0f => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:11.250258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae7d742b-8d2e-4c34-a431-63894a72e3d6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f90fd550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:11.559320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-ae7d742b-8d2e-4c34-a431-63894a72e3d6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:03:11.559998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-ae7d742b-8d2e-4c34-a431-63894a72e3d6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group a79ef0e8-07da-4bf5-bd46-f400e88e345a not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:03:11.560488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ae7d742b-8d2e-4c34-a431-63894a72e3d6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:03:11.560488 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-6a6425c6-e2d8-4f23-bad7-7186dda10158'] Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae7d742b-8d2e-4c34-a431-63894a72e3d6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a HTTP/1.1 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-6a6425c6-e2d8-4f23-bad7-7186dda10158'] Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a79ef0e8-07da-4bf5-bd46-f400e88e345a'} Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:03:11.563320 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a6425c6-e2d8-4f23-bad7-7186dda10158'] Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a6425c6-e2d8-4f23-bad7-7186dda10158'] Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a6425c6-e2d8-4f23-bad7-7186dda10158'] Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a6425c6-e2d8-4f23-bad7-7186dda10158'] Nov 03 04:03:11.568541 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:11.575518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae7d742b-8d2e-4c34-a431-63894a72e3d6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:03:11.575518 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-6a6425c6-e2d8-4f23-bad7-7186dda10158'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:11.575518 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae7d742b-8d2e-4c34-a431-63894a72e3d6 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a" status: 404 len: 194 microversion: 2.1 time: 0.341372 Nov 03 04:03:11.575518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1445/2822] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:03:11 2022] GET /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a => generated 194 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:03:11.581477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4aaab4c2-493a-4101-96ba-993ee273efda tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '.version_select at 0x7ff7f8f1eb80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:11.630243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:11.783024 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4aaab4c2-493a-4101-96ba-993ee273efda tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018292931" status: 204 len: 0 microversion: 2.25 time: 0.209458 Nov 03 04:03:11.783638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1446/2823] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 04:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018292931 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:03:11.788511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:11.789399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:11.812046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:11.813450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:11.818491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:11.820701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:11.822680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:11.823312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:12.543135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:12.598128 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a6bd440-aced-4735-babb-01a58a01ea69 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 0.813138 Nov 03 04:03:12.609058 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1447/2824] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:11 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:12.626916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8923d7b-1ff3-4888-8d07-7406fdf8d771 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7f911c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-977762924", "description": "tempest-description-455679830"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:13.357508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:13.452509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:03:13.453314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:03:13.454291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:03:13.454753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:03:13.455748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:03:13.474219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:13.474906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:13.477906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:13.477906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:13.477906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:13.477906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:13.571437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Getting quotas for project 07fb4ed51df846749adb393bcff2d621. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:03:13.584551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Getting quotas for user c97199542b1245c78c7216160aa50af2 and project 07fb4ed51df846749adb393bcff2d621. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:03:13.642592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:03:13.678273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:03:13.738290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8923d7b-1ff3-4888-8d07-7406fdf8d771 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.127728 Nov 03 04:03:13.749379 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1448/2825] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:03:12 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:13.757747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:13.764705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:13.788640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:13.789170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:13.795914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:13.802113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:13.802113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:13.802113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:13.906743 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-32c8494f-1e11-4541-9a95-dc9c9b5bc380 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.428673 Nov 03 04:03:13.918728 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1378/2826] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:03:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:03:13.927412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7cfcc084-c28f-437e-90c0-3cf17aeacb70 req-86d9c698-1e50-4f01-aafa-e2ac27934129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d8d747-5e33-4edb-a517-7f9542a8f7b4", "tag": "d04e1cd4-702e-4d7d-9a42-bd43628210b4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:13.962352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7cfcc084-c28f-437e-90c0-3cf17aeacb70 req-86d9c698-1e50-4f01-aafa-e2ac27934129 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:13.963725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7cfcc084-c28f-437e-90c0-3cf17aeacb70 req-86d9c698-1e50-4f01-aafa-e2ac27934129 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:13.965243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7cfcc084-c28f-437e-90c0-3cf17aeacb70 req-86d9c698-1e50-4f01-aafa-e2ac27934129 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:14.020291 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7cfcc084-c28f-437e-90c0-3cf17aeacb70 req-86d9c698-1e50-4f01-aafa-e2ac27934129 service nova] Creating event network-changed:d04e1cd4-702e-4d7d-9a42-bd43628210b4 for instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 on n-h1-854653-7 Nov 03 04:03:14.051027 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7cfcc084-c28f-437e-90c0-3cf17aeacb70 req-86d9c698-1e50-4f01-aafa-e2ac27934129 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129608 Nov 03 04:03:14.053776 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1379/2827] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:14.085332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:14.093717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:14.121783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:14.139018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:14.140508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:14.140954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:14.141439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:14.142184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:14.142673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:14.146098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:14.149281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:14.160815 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-957dd0ce-7786-4556-ba9f-4123e17f6218 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.409410 Nov 03 04:03:14.166491 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1449/2828] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:13 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:14.186186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6beb3d90-1d55-4fea-8f6a-cca872df62e1 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7f93d2af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1260540044", "description": "tempest-description-952724073"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:15.086695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:15.106466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd85fd95-4bdd-4a7d-b242-e427d175234a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 1.037843 Nov 03 04:03:15.116409 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1380/2829] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:14 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:15.119193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3722fd74-2726-4cc9-aa75-966ec7e797eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:15.122743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3722fd74-2726-4cc9-aa75-966ec7e797eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:15.336688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3722fd74-2726-4cc9-aa75-966ec7e797eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:15.344150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3722fd74-2726-4cc9-aa75-966ec7e797eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1223 microversion: 2.1 time: 0.229304 Nov 03 04:03:15.347453 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1381/2830] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:15 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1223 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:15.355356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:15.361561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:15.376579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:15.377743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:15.378378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:15.382493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:15.382493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:15.382493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:15.427470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:15.453490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:03:16.191775 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6beb3d90-1d55-4fea-8f6a-cca872df62e1 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.023775 Nov 03 04:03:16.205768 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1450/2831] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:03:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:16.216926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:16.216926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:16.237630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:16.238301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:16.239074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:16.239910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:16.240668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:16.242836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:16.356701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:16.371998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:16.374720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:16.382987 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-09bcec53-b5f9-497d-960f-0b118ce87738 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.181629 Nov 03 04:03:16.389043 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1451/2832] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:16 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:16.410712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:16.411733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:16.418780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:16.419930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:16.420567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:16.421487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:16.422107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:16.422879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:16.579569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-09928bc7-e61e-46bf-a18c-a3976330ec17 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "DELETE /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 204 len: 0 microversion: 2.25 time: 1.232213 Nov 03 04:03:16.583398 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1382/2833] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:03:15 2022] DELETE /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 0 bytes in 1234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:03:16.586197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e65a782-c618-4fc6-97ee-bfd851a47840 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7f8ba1430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1259215240", "description": "tempest-description-207290108"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:16.741919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:16.755435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08224a07-18db-450e-9634-785ae3f85362 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 0.356452 Nov 03 04:03:16.791086 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1452/2834] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:16 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:16.833300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:16.833300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:16.853231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:16.854076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:16.856012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:16.858061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:16.859780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:16.861653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:17.029379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:17.039551 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1be5bdb9-d2b7-4dc1-8963-cf5522c36b81 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1227 microversion: 2.1 time: 0.248865 Nov 03 04:03:17.045954 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1453/2835] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:16 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1227 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:17.050933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:17.051574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:17.067000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:17.067898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:17.068461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:17.069236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:17.069701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:17.070296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:17.382213 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e65a782-c618-4fc6-97ee-bfd851a47840 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.790947 Nov 03 04:03:17.382213 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1383/2836] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:03:16 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:17.387348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-92670cfe-6281-4bfd-9455-d3872c31e29f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8b4dca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:17.492122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:17.518918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:17.524795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:17.531788 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21893eb3-1307-4f15-a69e-c0d7ce3784ea tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1549 microversion: 2.25 time: 0.490608 Nov 03 04:03:17.557205 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1454/2837] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:17 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1549 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:17.572437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:17.574823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:17.592772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:17.603837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:17.607185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:17.608200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:17.608948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:17.609692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:17.677191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:17.775295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:17.789344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:17.791253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:17.797923 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3049c707-6f0a-4e2a-8d70-009c19b2febc tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.229271 Nov 03 04:03:17.849255 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1455/2838] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:17 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:17.857297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:17.872153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:17.885344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:17.886859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:17.887541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:17.888476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:17.889217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:17.889894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:17.939046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-92670cfe-6281-4bfd-9455-d3872c31e29f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.556487 Nov 03 04:03:17.945862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1384/2839] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 04:03:17 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:17.959732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bfdc01bc-1a7a-4611-8b26-b58b4c72ed86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7fd6588b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:18.391951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:18.412331 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1480189d-93a2-4dfa-bffe-20f4be83edd1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 0.557839 Nov 03 04:03:18.415879 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1456/2840] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:17 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:18.437469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:18.438866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:18.460010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:18.460866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:18.461514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:18.462539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:18.463432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:18.464484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:18.611458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:18.624011 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05ce280d-c6ac-4b2a-8291-0d98131ee25d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1219 microversion: 2.1 time: 0.204384 Nov 03 04:03:18.626829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1457/2841] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:18 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:18.637219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:18.640152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:18.652449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:18.653551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:18.654658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:18.655407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:18.663652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:18.664192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:18.991086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:19.027296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:19.032905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:19.035640 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-527e96a1-b51a-4a23-9966-9f6f6fc3dba6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1549 microversion: 2.25 time: 0.407482 Nov 03 04:03:19.038809 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1458/2842] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:18 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1549 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:19.045690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:19.048705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:19.057249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:19.057728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:19.059078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:19.059796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:19.060633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:19.061103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:19.098150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bfdc01bc-1a7a-4611-8b26-b58b4c72ed86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de" status: 202 len: 0 microversion: 2.1 time: 1.141964 Nov 03 04:03:19.099996 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1385/2843] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:03:17 2022] DELETE /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de => generated 0 bytes in 1144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:19.108588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e715d6c-636e-492c-93c3-b9060ccb5198 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8b1aca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-7e715d6c-636e-492c-93c3-b9060ccb5198 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.security_group_api [None req-7e715d6c-636e-492c-93c3-b9060ccb5198 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group 95d3469b-8f80-46ea-8809-bdc37e3732de not found {{(pid=127593) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7e715d6c-636e-492c-93c3-b9060ccb5198 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-fd3638d9-0f82-4bbe-b516-ec0674cf1f88'] Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e715d6c-636e-492c-93c3-b9060ccb5198 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de HTTP/1.1 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-fd3638d9-0f82-4bbe-b516-ec0674cf1f88'] Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '95d3469b-8f80-46ea-8809-bdc37e3732de'} Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:03:19.217278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd3638d9-0f82-4bbe-b516-ec0674cf1f88'] Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd3638d9-0f82-4bbe-b516-ec0674cf1f88'] Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd3638d9-0f82-4bbe-b516-ec0674cf1f88'] Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd3638d9-0f82-4bbe-b516-ec0674cf1f88'] Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e715d6c-636e-492c-93c3-b9060ccb5198 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-fd3638d9-0f82-4bbe-b516-ec0674cf1f88'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7e715d6c-636e-492c-93c3-b9060ccb5198 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de" status: 404 len: 194 microversion: 2.1 time: 0.107361 Nov 03 04:03:19.221483 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1386/2844] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:03:19 2022] GET /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de => generated 194 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:03:19.232280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40d6ceeb-b3e5-4124-9fc7-5679b645ac15 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f99b4430>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:19.343840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:19.357190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:19.361943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:19.382493 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c95a3d3a-a5ff-47ae-b6cb-daa4024184f3 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.341832 Nov 03 04:03:19.385458 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1459/2845] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:19 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:19.420896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4f4cf1fb-6335-4379-a816-fd4c7163575f req-c36c29bb-20ef-45f9-9819-4fcf729c1e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b0ee6b-7653-4811-8177-e49f8fbc62d5", "name": "network-vif-deleted", "tag": "3ec28101-cd78-498e-95a0-58c0353148ab"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:19.448634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4f4cf1fb-6335-4379-a816-fd4c7163575f req-c36c29bb-20ef-45f9-9819-4fcf729c1e4b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:19.449191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4f4cf1fb-6335-4379-a816-fd4c7163575f req-c36c29bb-20ef-45f9-9819-4fcf729c1e4b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:19.449604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4f4cf1fb-6335-4379-a816-fd4c7163575f req-c36c29bb-20ef-45f9-9819-4fcf729c1e4b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:19.508887 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4f4cf1fb-6335-4379-a816-fd4c7163575f req-c36c29bb-20ef-45f9-9819-4fcf729c1e4b service nova] Creating event network-vif-deleted:3ec28101-cd78-498e-95a0-58c0353148ab for instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 on n-h2-854653-7 Nov 03 04:03:19.526000 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4f4cf1fb-6335-4379-a816-fd4c7163575f req-c36c29bb-20ef-45f9-9819-4fcf729c1e4b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105010 Nov 03 04:03:19.526000 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1460/2846] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:03:19.548956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:19.570230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:19.615040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:19.617679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:19.634143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:19.638054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:19.638594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:19.639043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:20.341690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:20.372668 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a6512446-d126-4988-b8d3-1128bb638997 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 0.847795 Nov 03 04:03:20.377355 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1461/2847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:19 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:20.388665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:20.405280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:20.416839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:20.417609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:20.443817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:20.447649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:20.448142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:20.449268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:20.589001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:20.601362 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08b84a4f-a591-4781-8388-dc761748dc21 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1293 microversion: 2.1 time: 0.225447 Nov 03 04:03:20.617844 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1462/2848] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:20 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1293 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:20.633662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:20.634298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:20.658801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:20.659382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:20.659828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:20.660554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:20.661042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:20.661483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:20.720067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:20.721065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:20.721065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:20.721868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lazy-loading 'fault' on Instance uuid 41b0ee6b-7653-4811-8177-e49f8fbc62d5 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:20.864250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:20.877964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:20.879599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:20.880655 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73ff4b31-7659-4b46-94f4-67fd8163770f tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 200 len: 1352 microversion: 2.25 time: 0.261726 Nov 03 04:03:20.884762 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1463/2849] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:20 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 1352 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:20.893079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:20.893721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:20.913729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:20.913940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:20.914545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:20.915070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:20.915658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:20.915953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:21.044013 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40d6ceeb-b3e5-4124-9fc7-5679b645ac15 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e" status: 202 len: 0 microversion: 2.1 time: 1.821932 Nov 03 04:03:21.045793 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1387/2850] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:03:19 2022] DELETE /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e => generated 0 bytes in 1828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:21.056213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e7379b7-3b53-4550-9a00-76dc9530c57f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8b1af70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:21.095463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:21.109827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:21.116742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:21.124254 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95484c3c-08bc-4e5d-b06b-4de9f4c8f181 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.238072 Nov 03 04:03:21.137460 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1464/2851] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:20 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:21.147845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-6e7379b7-3b53-4550-9a00-76dc9530c57f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:03:21.150299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.security_group_api [None req-6e7379b7-3b53-4550-9a00-76dc9530c57f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group 2fbd9375-4110-412f-89e0-ffcf5b93625e not found {{(pid=127593) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:03:21.151139 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-6e7379b7-3b53-4550-9a00-76dc9530c57f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:03:21.151139 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-bba4d0ab-fcd8-4f40-8919-b26a3e46207e'] Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e7379b7-3b53-4550-9a00-76dc9530c57f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e HTTP/1.1 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-bba4d0ab-fcd8-4f40-8919-b26a3e46207e'] Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '2fbd9375-4110-412f-89e0-ffcf5b93625e'} Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:03:21.155062 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bba4d0ab-fcd8-4f40-8919-b26a3e46207e'] Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bba4d0ab-fcd8-4f40-8919-b26a3e46207e'] Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bba4d0ab-fcd8-4f40-8919-b26a3e46207e'] Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bba4d0ab-fcd8-4f40-8919-b26a3e46207e'] Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e7379b7-3b53-4550-9a00-76dc9530c57f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-bba4d0ab-fcd8-4f40-8919-b26a3e46207e'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:21.159160 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e7379b7-3b53-4550-9a00-76dc9530c57f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e" status: 404 len: 194 microversion: 2.1 time: 0.107045 Nov 03 04:03:21.168593 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1388/2852] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:03:21 2022] GET /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:03:21.172890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b8f028b-0f18-4685-b6c6-e31d38644868 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f9088c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:21.406144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:21.406144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:21.421062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:21.434879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:21.435811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:21.439059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:21.443355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:21.443355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.067096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:22.080181 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a08d7c92-7a2d-4dfb-8271-f07d852e0f05 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 0.682908 Nov 03 04:03:22.085181 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1389/2853] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:21 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:22.096424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:22.100324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:22.117301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.118202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.118894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.120040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.121276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.123778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.277857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b8f028b-0f18-4685-b6c6-e31d38644868 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995" status: 202 len: 0 microversion: 2.1 time: 1.113243 Nov 03 04:03:22.280550 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1465/2854] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:03:21 2022] DELETE /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995 => generated 0 bytes in 1117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:22.288487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:22.290334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 41b0ee6b-7653-4811-8177-e49f8fbc62d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:22.312525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:22.326663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.328835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.328835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.328835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.331148 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8799f0c2-67da-424a-aede-a9ac8dc07c00 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1281 microversion: 2.1 time: 0.244559 Nov 03 04:03:22.331868 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1390/2855] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:22 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1281 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:22.341034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.345895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.351824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:22.352559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:22.387199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.387722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.392152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.392152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.429986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.432027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.445694 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] HTTP exception thrown: Instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 could not be found. Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Request method failure captured: Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 HTTP/1.1 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt8GBfN7Dwbk_OBNyizTGr6KfY4izFHnn_hhMX05lLIWMRbV5AvM3e4ljCNmV6u5qTFaB7aoBarGqoR5n6M60uAliLF3reKQ1w3zKQGv8w42xmbitU4c-RTiUUUfGv9g1bg0Aho1FsQO1T2iqFaUMEU6RXM7p3YEx84LDLmXw1byjE Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.25 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4a9b6a4c4189418eb86c45bd82cb0ca8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}] Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ebbc13908db44e88853d5c14c8e2102 Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 could not be found. Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '41b0ee6b-7653-4811-8177-e49f8fbc62d5'} Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 could not be found. Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 could not be found. Nov 03 04:03:22.454570 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 could not be found. Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Returning 404 to user: Instance 41b0ee6b-7653-4811-8177-e49f8fbc62d5 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:22.462163 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5aa6b20-d30e-4640-9b24-503836772c3c tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5" status: 404 len: 111 microversion: 2.25 time: 0.176191 Nov 03 04:03:22.472956 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1466/2856] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:22 2022] GET /compute/v2.1/servers/41b0ee6b-7653-4811-8177-e49f8fbc62d5 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:22.494456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2700e39b-579c-4abd-a226-15a42597d399 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8f1e310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:22.603670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-2700e39b-579c-4abd-a226-15a42597d399 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:03:22.604276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-2700e39b-579c-4abd-a226-15a42597d399 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:03:22.605480 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2700e39b-579c-4abd-a226-15a42597d399 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:03:22.605480 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-68d39648-4c49-43f5-9f41-38970874b717'] Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2700e39b-579c-4abd-a226-15a42597d399 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995 HTTP/1.1 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-68d39648-4c49-43f5-9f41-38970874b717'] Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'c2d33aa0-0e3c-429b-91b2-4a1f961eb995'} Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:03:22.607927 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68d39648-4c49-43f5-9f41-38970874b717'] Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68d39648-4c49-43f5-9f41-38970874b717'] Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68d39648-4c49-43f5-9f41-38970874b717'] Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68d39648-4c49-43f5-9f41-38970874b717'] Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2700e39b-579c-4abd-a226-15a42597d399 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-68d39648-4c49-43f5-9f41-38970874b717'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:22.611917 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2700e39b-579c-4abd-a226-15a42597d399 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995" status: 404 len: 194 microversion: 2.1 time: 0.135046 Nov 03 04:03:22.614610 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1467/2857] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:03:22 2022] GET /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995 => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:03:22.624821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:22.630107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:22.634391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:22.648562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:22.650291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:22.656107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.656107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.660569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ce6c2b6-37f3-4716-b701-a15bdef893b1 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.327222 Nov 03 04:03:22.660731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.666274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:22.666463 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1391/2858] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:22 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:22.666582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:22.666582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:22.676632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-138fdf58-c230-4679-b833-bf3b54c9fe5a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8ba15e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:22.752978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:03:23.246633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ba22710e-b322-4850-86c5-88eadcf4dc86 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "DELETE /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 204 len: 0 microversion: 2.25 time: 0.630389 Nov 03 04:03:23.247272 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1468/2859] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:03:22 2022] DELETE /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 0 bytes in 633 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:03:23.255648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:23.258577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:23.271437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:23.271936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:23.272472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:23.273259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:23.273847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:23.274300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:23.602465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:24.209882 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-138fdf58-c230-4679-b833-bf3b54c9fe5a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.546888 Nov 03 04:03:24.210678 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1392/2860] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 04:03:22 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:24.217131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:24.218371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:24.239945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:24.241748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:24.242096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.244391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:24.245933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:24.246867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:24.247702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:24.251785 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8aee0631-e346-4851-b123-e65b3c0a02a7 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 1.003199 Nov 03 04:03:24.254663 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1469/2861] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:23 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:24.272411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:24.273690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:24.282305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:24.282914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:24.283925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:24.286265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:24.287049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:24.290334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:24.512470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.553421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.553421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.553421 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-53241863-372f-447c-a279-cf0df2b19f78 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1522 microversion: 2.25 time: 0.332681 Nov 03 04:03:24.553421 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1393/2862] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:24 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:24.561757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-af686d2c-c531-4a7d-9290-40e4f6391bc8 req-06ea2141-ada7-49e8-ba40-a77df32dfd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d8d747-5e33-4edb-a517-7f9542a8f7b4", "name": "network-vif-plugged", "status": "completed", "tag": "d04e1cd4-702e-4d7d-9a42-bd43628210b4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:24.576440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-af686d2c-c531-4a7d-9290-40e4f6391bc8 req-06ea2141-ada7-49e8-ba40-a77df32dfd39 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:24.576440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-af686d2c-c531-4a7d-9290-40e4f6391bc8 req-06ea2141-ada7-49e8-ba40-a77df32dfd39 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:24.577065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-af686d2c-c531-4a7d-9290-40e4f6391bc8 req-06ea2141-ada7-49e8-ba40-a77df32dfd39 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:24.599953 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-af686d2c-c531-4a7d-9290-40e4f6391bc8 req-06ea2141-ada7-49e8-ba40-a77df32dfd39 service nova] Creating event network-vif-plugged:d04e1cd4-702e-4d7d-9a42-bd43628210b4 for instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 on n-h1-854653-7 Nov 03 04:03:24.611707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-af686d2c-c531-4a7d-9290-40e4f6391bc8 req-06ea2141-ada7-49e8-ba40-a77df32dfd39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064046 Nov 03 04:03:24.612935 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1394/2863] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:24.626361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:24.627065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:24.657252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:24.659000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:24.662261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:24.664583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:24.668474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:24.669253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:24.692075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.701818 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d52f1f1b-1a3a-4f3a-a862-1fd2ed10c44f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1323 microversion: 2.1 time: 0.439374 Nov 03 04:03:24.724817 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1470/2864] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:24 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:24.822464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.836510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.838761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:24.865002 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1cfca256-bf16-4397-be5a-92f6cc675998 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.247134 Nov 03 04:03:24.870241 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1395/2865] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:24 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:24.883381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb7f1208-9a2e-4b91-978e-c17b861e0735 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7f9461820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1738933363", "description": "tempest-description-534188346"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:24.905541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-333351956", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "65a5cf29-9bfd-4ad8-a05b-2a4611e790c0"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:25.077705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] validate_networks() for [('65a5cf29-9bfd-4ad8-a05b-2a4611e790c0', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:03:25.344087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:25.991486 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb7f1208-9a2e-4b91-978e-c17b861e0735 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.117381 Nov 03 04:03:25.993122 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1396/2866] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:03:24 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:25.998762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e1f139d4-a18c-43e9-8541-114ccfb0061a req-848471e2-fac4-4df8-82dd-ead7c029d3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74914149-185f-4400-9df8-cc7132fb7cdf", "name": "network-vif-deleted", "tag": "3d61c39b-2b5c-4d82-806d-4907f6f7ee1e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:26.001375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:03:26.002419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:03:26.003819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:03:26.004487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:03:26.005215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:03:26.019629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e1f139d4-a18c-43e9-8541-114ccfb0061a req-848471e2-fac4-4df8-82dd-ead7c029d3aa service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.022283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e1f139d4-a18c-43e9-8541-114ccfb0061a req-848471e2-fac4-4df8-82dd-ead7c029d3aa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.022934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e1f139d4-a18c-43e9-8541-114ccfb0061a req-848471e2-fac4-4df8-82dd-ead7c029d3aa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.027531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.028031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.028480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.034105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.034714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.036180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.050175 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e1f139d4-a18c-43e9-8541-114ccfb0061a req-848471e2-fac4-4df8-82dd-ead7c029d3aa service nova] Creating event network-vif-deleted:3d61c39b-2b5c-4d82-806d-4907f6f7ee1e for instance 74914149-185f-4400-9df8-cc7132fb7cdf on n-h2-854653-7 Nov 03 04:03:26.057794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e1f139d4-a18c-43e9-8541-114ccfb0061a req-848471e2-fac4-4df8-82dd-ead7c029d3aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062931 Nov 03 04:03:26.058771 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1397/2867] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:26.067799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:26.068788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:26.076145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.076848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.077474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.078353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.078973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.079583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.081905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Getting quotas for project cac71a21d8114b87b1a6d9426f49814d. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:03:26.090324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Getting quotas for user 882370b1b9ca4e5397fed35c54916233 and project cac71a21d8114b87b1a6d9426f49814d. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:03:26.111584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:03:26.114490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:03:26.295794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.316854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1bc3c896-71ca-47d4-b64c-e5c3946e5d9e tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590719 Nov 03 04:03:26.325400 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1471/2868] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:03:26.328625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac92d1d7-d124-4960-b5fa-876db2d2885d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1309 microversion: 2.1 time: 0.268283 Nov 03 04:03:26.344221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:26.346765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:26.355589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.356485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.357221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.357443 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1398/2869] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:26 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:26.358264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.358809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.359451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.389963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:26.390980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:26.407078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.407511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.407968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.408708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.409217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.409658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.416266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.417043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.417643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.420683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lazy-loading 'fault' on Instance uuid 74914149-185f-4400-9df8-cc7132fb7cdf {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:26.520942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.535907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.542115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7ebbc13908db44e88853d5c14c8e2102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a9b6a4c4189418eb86c45bd82cb0ca8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.543716 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27faa579-c411-472b-aab6-ce4d52ac1df6 tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 200 len: 1352 microversion: 2.25 time: 0.216450 Nov 03 04:03:26.560533 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1472/2870] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:26 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 1352 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:26.574301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:26.574301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:26.582062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.583323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.585495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.586879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:26.602708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:26.604294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:26.850738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.855893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:26.861830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.865879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.873941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:26.879131 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1564c7f-e519-4dbe-8e8b-a23f5cdb8e97 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1323 microversion: 2.1 time: 0.519237 Nov 03 04:03:26.880017 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1399/2871] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:26 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:26.889679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bc9757ea-928b-40e5-a9b0-b734f338ae77 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7fd67a940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-331789991", "description": "tempest-description-294101683"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:26.891488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-039006ba-05c9-4494-a205-5cdcc4bc9ba9 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.328965 Nov 03 04:03:26.893637 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1473/2872] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:26 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:26.961713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3c23af9-8928-4417-b828-be14122ffd7c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:26.963193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b3c23af9-8928-4417-b828-be14122ffd7c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:27.136561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b3c23af9-8928-4417-b828-be14122ffd7c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:27.156270 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3c23af9-8928-4417-b828-be14122ffd7c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1215 microversion: 2.1 time: 0.211487 Nov 03 04:03:27.165586 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1474/2873] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:26 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:27.172505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ee0e39eb-9ed7-40d5-8ab4-3a45e6843fbf req-b35bf3fc-1e1e-46fc-a409-e039f16187e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855c9583-d48b-4c48-b59c-8a4096494b67", "tag": "e84aad67-49e8-4efe-8566-d24ab57903bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:27.190285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ee0e39eb-9ed7-40d5-8ab4-3a45e6843fbf req-b35bf3fc-1e1e-46fc-a409-e039f16187e8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.191030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ee0e39eb-9ed7-40d5-8ab4-3a45e6843fbf req-b35bf3fc-1e1e-46fc-a409-e039f16187e8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.191896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ee0e39eb-9ed7-40d5-8ab4-3a45e6843fbf req-b35bf3fc-1e1e-46fc-a409-e039f16187e8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.286621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ee0e39eb-9ed7-40d5-8ab4-3a45e6843fbf req-b35bf3fc-1e1e-46fc-a409-e039f16187e8 service nova] Creating event network-changed:e84aad67-49e8-4efe-8566-d24ab57903bc for instance 855c9583-d48b-4c48-b59c-8a4096494b67 on n-h1-854653-7 Nov 03 04:03:27.299585 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ee0e39eb-9ed7-40d5-8ab4-3a45e6843fbf req-b35bf3fc-1e1e-46fc-a409-e039f16187e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131337 Nov 03 04:03:27.303163 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1475/2874] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:27.362740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:27.364998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:27.389278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.393350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.394062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.397110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.397882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.398619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.577741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:27.585896 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7ecd87a-ac0f-44a8-bdc0-5c03726a9973 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1490 microversion: 2.1 time: 0.228927 Nov 03 04:03:27.586484 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1476/2875] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:27 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1490 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:27.608130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bc9757ea-928b-40e5-a9b0-b734f338ae77 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.727024 Nov 03 04:03:27.608843 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1400/2876] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:03:26 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:27.609791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:27.610493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] [instance: 74914149-185f-4400-9df8-cc7132fb7cdf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:27.618065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.618811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.619106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1257608370"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:27.623382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.623382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.623382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.623382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.623987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:27.640272 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] HTTP exception thrown: Instance 74914149-185f-4400-9df8-cc7132fb7cdf could not be found. Nov 03 04:03:27.642018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Request method failure captured: Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf HTTP/1.1 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzt8GBfN7Dwbk_OBNyizTGr6KfY4izFHnn_hhMX05lLIWMRbV5AvM3e4ljCNmV6u5qTFaB7aoBarGqoR5n6M60uAliLF3reKQ1w3zKQGv8w42xmbitU4c-RTiUUUfGv9g1bg0Aho1FsQO1T2iqFaUMEU6RXM7p3YEx84LDLmXw1byjE Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.25 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4a9b6a4c4189418eb86c45bd82cb0ca8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4a9b6a4c4189418eb86c45bd82cb0ca8"}]}] Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4a9b6a4c4189418eb86c45bd82cb0ca8 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-14009230 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ebbc13908db44e88853d5c14c8e2102 Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-14009230-project Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 74914149-185f-4400-9df8-cc7132fb7cdf could not be found. Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '74914149-185f-4400-9df8-cc7132fb7cdf'} Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74914149-185f-4400-9df8-cc7132fb7cdf could not be found. Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74914149-185f-4400-9df8-cc7132fb7cdf could not be found. Nov 03 04:03:27.646319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74914149-185f-4400-9df8-cc7132fb7cdf could not be found. Nov 03 04:03:27.650161 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:27.650842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.650958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] Returning 404 to user: Instance 74914149-185f-4400-9df8-cc7132fb7cdf could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:27.651042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.651119 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-411d093c-8c13-45a9-9f76-f1902f7965ee tempest-LiveAutoBlockMigrationV225Test-14009230 tempest-LiveAutoBlockMigrationV225Test-14009230-project] 10.222.0.30 "GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf" status: 404 len: 111 microversion: 2.25 time: 0.046285 Nov 03 04:03:27.651194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.651359 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1477/2877] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:27 2022] GET /compute/v2.1/servers/74914149-185f-4400-9df8-cc7132fb7cdf => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:27.651439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.651439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.800684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-313483380", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "bb2c6852-0894-49d2-b49a-7d506865e490"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:27.837790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac321af6-2cb8-490f-b081-7c78c4ad8267 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "PUT /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1075 microversion: 2.1 time: 0.226751 Nov 03 04:03:27.839016 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1401/2878] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:03:27 2022] PUT /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1075 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:27.861872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:27.862570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:27.871411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] validate_networks() for [('bb2c6852-0894-49d2-b49a-7d506865e490', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:03:27.872272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.872789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.873303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:27.874073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:27.874546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:27.874981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.213082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:28.223174 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a3b2647-b094-40c8-863a-266fc5273402 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1501 microversion: 2.1 time: 0.368379 Nov 03 04:03:28.224375 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1402/2879] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:27 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1501 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:28.234013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:28.234013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:28.242158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.242861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.243512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.245238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.245882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.246608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.600602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:28.612905 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-986cb6a7-3cf9-4bc4-939e-ec8c4bd0a839 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1323 microversion: 2.1 time: 0.386813 Nov 03 04:03:28.613665 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1403/2880] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:28 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1323 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:28.628517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:28.628517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:28.639313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.641539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.644098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.647077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.647077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.647077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.674239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:03:28.675282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:03:28.675917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:03:28.676581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:03:28.677238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:03:28.729655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.729655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.729655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.729655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.729655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.729655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.767846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Getting quotas for project 2509709ccbc04cb0a157454541ddd369. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:03:28.785815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:28.791917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:28.805927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:28.806672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Getting quotas for user 98b69b997a6644698103e40fe23bcebf and project 2509709ccbc04cb0a157454541ddd369. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:03:28.810577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:28.822063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2550e478-860e-4d07-b248-69cb48b48e0e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.206534 Nov 03 04:03:28.826061 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1404/2881] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:28 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:28.831805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:28.832107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:28.839436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.839944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.840443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.841508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.841644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:28.842253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:28.847565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:03:28.862692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:03:28.953486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:28.962014 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-992a0432-fd16-4c57-8524-a8a38ac4bc29 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1211 microversion: 2.1 time: 0.134561 Nov 03 04:03:28.980462 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1405/2882] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:28 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:28.988669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:28.990161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:28.998867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:28.999642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:29.000298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:29.001396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:29.001873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:29.002306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:29.104143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3fcf2e11-6bf8-4a1c-9de5-0452903630b0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310413 Nov 03 04:03:29.111499 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1478/2883] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:03:29.116997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d6c5898-0e71-4b65-9f87-b4dd3efaccbd tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:29.117710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d6c5898-0e71-4b65-9f87-b4dd3efaccbd tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:29.254807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d6c5898-0e71-4b65-9f87-b4dd3efaccbd tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:29.266483 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d6c5898-0e71-4b65-9f87-b4dd3efaccbd tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1215 microversion: 2.1 time: 0.153635 Nov 03 04:03:29.266988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:29.267680 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1479/2884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:29 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:29.279786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:29.282636 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9434dc9c-c62e-4394-9ae5-51d471b1e614 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1501 microversion: 2.1 time: 0.300208 Nov 03 04:03:29.293894 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1406/2885] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:28 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:29.309850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60c340aa-5855-461e-a07e-5524259cbfab tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:29.319436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60c340aa-5855-461e-a07e-5524259cbfab tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:29.319940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60c340aa-5855-461e-a07e-5524259cbfab tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:29.320573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60c340aa-5855-461e-a07e-5524259cbfab tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:29.393836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-60c340aa-5855-461e-a07e-5524259cbfab tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Going to try to stop instance {{(pid=127594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:03:29.578730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60c340aa-5855-461e-a07e-5524259cbfab tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "POST /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4/action" status: 202 len: 0 microversion: 2.1 time: 0.273045 Nov 03 04:03:29.581345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1480/2886] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:03:29 2022] POST /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:29.591791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:29.592770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:29.611865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:29.613637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:29.615611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:29.617043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:29.619257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:29.620962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:29.643322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:29.644152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:29.656039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:29.660961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:29.666410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:29.667300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:29.668553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:29.669005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:30.178583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:30.187190 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e28c0a0-72f8-4f7c-b0ab-a825f26f5648 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.601358 Nov 03 04:03:30.188977 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1407/2887] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:29 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:30.194273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:30.195170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:30.202655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:30.203549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:30.204219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:30.205391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:30.206075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:30.212336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:30.306761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:30.316302 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-56732b82-5609-4e6a-adce-3c4afce0ad4f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1323 microversion: 2.1 time: 0.678122 Nov 03 04:03:30.319126 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1481/2888] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:29 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1323 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:30.332015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:30.333777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:30.351245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:30.352143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:30.352944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:30.356594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:30.357508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:30.358351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:30.375112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:30.384231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:30.387947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:30.402807 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6457807b-b275-4de0-8999-c7096c7d6499 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1546 microversion: 2.91 time: 0.212028 Nov 03 04:03:30.403965 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1408/2889] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:30 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:30.418538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-76aa4bff-7484-42a5-a59f-8aefe16326f5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:30.419749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-76aa4bff-7484-42a5-a59f-8aefe16326f5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:30.446119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:30.607581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:30.626827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-89d9a022-1653-4a63-b27b-07d31e73ca4c tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1285 microversion: 2.1 time: 0.306106 Nov 03 04:03:30.631835 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1482/2890] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:30 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1285 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:30.655491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-76aa4bff-7484-42a5-a59f-8aefe16326f5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:30.665550 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-76aa4bff-7484-42a5-a59f-8aefe16326f5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1215 microversion: 2.1 time: 0.260170 Nov 03 04:03:30.682054 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1409/2891] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:30 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:31.212331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:31.213072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:31.223694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.224196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.224708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:31.225708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.226173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.226595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:31.348198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:31.348833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:31.368827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.371702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.371702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:31.371702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.372079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.372197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:31.685972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:31.695762 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80a9e3c1-52f2-4fe5-a800-ceea6edb5cf8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.487540 Nov 03 04:03:31.710136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1483/2892] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:31 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:31.739367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:31.740449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:31.750556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.751394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.752821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:31.753925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.755468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.772711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:31.891844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:31.911623 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d620258-8330-426b-8bdc-a0b1333f455f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1323 microversion: 2.1 time: 0.561825 Nov 03 04:03:31.920653 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1410/2893] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:31 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1323 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:31.932220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:31.943606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:31.947180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:31.959607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:31.963405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:31.967331 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c9778ed-96b9-46e0-b276-63027b4868fe tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1533 microversion: 2.91 time: 0.255520 Nov 03 04:03:31.968270 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1484/2894] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:31 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1533 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:31.974866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:31.986455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:31.987132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.988262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.989697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:31.990992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:31.991811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:31.992766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:32.001994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:32.002753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:32.003387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:32.004366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:32.007075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:32.008379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:32.185854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:32.204134 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bcb0c3a6-f189-4214-a176-4c48e5437e33 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1267 microversion: 2.1 time: 0.234239 Nov 03 04:03:32.204752 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1485/2895] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:31 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:32.215284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:32.216158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:32.231240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:32.232170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:32.233614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:32.234881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:32.235817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:32.236481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:32.734626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] Lazy-loading 'services' on Instance uuid bd3de980-af10-4017-b652-4be4a0c2a9df {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:32.756169 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2238584-3b32-4895-b8b4-64d9f8259abf tempest-UnshelveToHostMultiNodesTest-698860511 tempest-UnshelveToHostMultiNodesTest-698860511-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1938 microversion: 2.91 time: 0.550023 Nov 03 04:03:32.772838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1486/2896] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:32 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1938 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:32.789332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:32.790053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:32.804045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:32.804045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:32.804045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:32.804756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:32.805509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:32.806154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:32.988123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:33.002533 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51e38c76-4c71-4300-b36c-fed0bbe56d13 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 1.077169 Nov 03 04:03:33.009249 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1411/2897] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:31 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:33.020844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:33.022421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:33.030482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.031662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.032413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.033570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.034038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.034469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.053403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:33.063515 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f39afc0-0422-460b-abdf-7c9fc78b71d1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.289286 Nov 03 04:03:33.064110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1487/2898] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:32 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:33.072714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:03:33.074279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:33.075629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:33.083534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.084289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.084743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.086426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.087091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.087756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.456075 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-500cf738-fd1c-4804-8299-5e878f5b7251 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 204 len: 0 microversion: 2.91 time: 0.443421 Nov 03 04:03:33.457467 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1412/2899] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:03:33 2022] DELETE /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:03:33.464927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:33.466058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:33.484124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.484958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.485957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.486962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.487842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.488571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.730585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:33.744159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:33.753836 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a07628a-6213-4722-841e-d1fc91a4fbac tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1273 microversion: 2.1 time: 0.294003 Nov 03 04:03:33.756154 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1413/2900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:33 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:33.757119 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a05d235-fc77-4b8e-85d0-c30dae637daf tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1323 microversion: 2.1 time: 0.690199 Nov 03 04:03:33.763801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:33.764109 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1488/2901] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:33 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1323 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:33.778193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:33.778193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.778766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.779172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.779884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.780387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.780841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.786435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9f576da8-a646-4464-b702-ec1a1b7d833f req-2cedd459-5c38-40a1-b3ce-6cb612572a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855c9583-d48b-4c48-b59c-8a4096494b67", "name": "network-vif-plugged", "status": "completed", "tag": "e84aad67-49e8-4efe-8566-d24ab57903bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:33.815183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9f576da8-a646-4464-b702-ec1a1b7d833f req-2cedd459-5c38-40a1-b3ce-6cb612572a01 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:33.815666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9f576da8-a646-4464-b702-ec1a1b7d833f req-2cedd459-5c38-40a1-b3ce-6cb612572a01 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:33.816555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9f576da8-a646-4464-b702-ec1a1b7d833f req-2cedd459-5c38-40a1-b3ce-6cb612572a01 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:33.830869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9f576da8-a646-4464-b702-ec1a1b7d833f req-2cedd459-5c38-40a1-b3ce-6cb612572a01 service nova] Creating event network-vif-plugged:e84aad67-49e8-4efe-8566-d24ab57903bc for instance 855c9583-d48b-4c48-b59c-8a4096494b67 on n-h1-854653-7 Nov 03 04:03:33.837878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9f576da8-a646-4464-b702-ec1a1b7d833f req-2cedd459-5c38-40a1-b3ce-6cb612572a01 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071800 Nov 03 04:03:33.839102 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1489/2902] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:33.878621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:33.891514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:33.893151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:33.899957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71bf5a55-f686-4880-a11e-0268ed65bb2c tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.142076 Nov 03 04:03:33.909942 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1414/2903] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:33 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:34.039399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:34.043850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:34.079400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-75e1b85d-a48f-421e-bcba-bcb81d70e052 req-a882ea6c-3062-4978-b72c-6b849abc813e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391f4a76-bd33-4408-87e5-ee259b51b788", "tag": "bd83db27-c464-4b01-9885-4d7c0c533c35"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:34.097733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.098234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.098679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.099392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.101677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-75e1b85d-a48f-421e-bcba-bcb81d70e052 req-a882ea6c-3062-4978-b72c-6b849abc813e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.102102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-75e1b85d-a48f-421e-bcba-bcb81d70e052 req-a882ea6c-3062-4978-b72c-6b849abc813e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.102553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-75e1b85d-a48f-421e-bcba-bcb81d70e052 req-a882ea6c-3062-4978-b72c-6b849abc813e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.107729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.111226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.145286 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-75e1b85d-a48f-421e-bcba-bcb81d70e052 req-a882ea6c-3062-4978-b72c-6b849abc813e service nova] Creating event network-changed:bd83db27-c464-4b01-9885-4d7c0c533c35 for instance 391f4a76-bd33-4408-87e5-ee259b51b788 on n-h2-854653-7 Nov 03 04:03:34.163550 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-75e1b85d-a48f-421e-bcba-bcb81d70e052 req-a882ea6c-3062-4978-b72c-6b849abc813e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087599 Nov 03 04:03:34.164177 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1415/2904] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:03:34.175251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:34.175961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:34.209356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.210282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.210760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.211699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.212361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.212990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.527688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:34.539171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0118bb8d-2d17-43f9-8952-2f8060955f0b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 0.504862 Nov 03 04:03:34.542087 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1490/2905] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:34 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:34.617003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:34.635801 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ed30376-6f55-475f-9582-0a1215c756d6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.465427 Nov 03 04:03:34.636889 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1416/2906] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:34 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:34.780326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:34.780964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:34.786814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:34.787773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:34.790153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.792975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.793676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.794558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.797041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.797692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.802290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.802922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.804971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:34.806954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:34.809624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:34.810327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:35.230690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:35.239108 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-29bd45cc-19be-43ad-a576-dbae156e6752 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1323 microversion: 2.1 time: 0.456880 Nov 03 04:03:35.240344 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1417/2907] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:34 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:35.245673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:35.246631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:35.252946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:35.253875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:35.254532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:35.255462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:35.256135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:35.256774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:35.310240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:35.320589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc153fc6-c5fc-4daf-9073-ba8912075f8e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.544065 Nov 03 04:03:35.325417 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1491/2908] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:34 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:35.401894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:35.416581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:35.418826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '718826833702413f9189617cd67107aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec186db9a3a14062a468f5f5106f2cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:35.431989 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65487390-0655-4222-8e21-90a73262204e tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 200 len: 1539 microversion: 2.91 time: 0.190211 Nov 03 04:03:35.433353 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1418/2909] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:35 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 1539 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:35.563364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:35.564208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:35.578944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:35.579725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:35.580326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:35.581237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:35.581853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:35.582438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:35.664404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:35.665281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:35.676818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:35.677578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:35.678195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:35.680344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:35.681005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:35.684161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:36.147815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:36.159369 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-babb11fc-59a0-406d-8449-73a448e58aef tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.499393 Nov 03 04:03:36.160785 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1419/2910] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:35 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:36.190593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:36.200220 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7dc7f03c-4a49-4982-9959-8754bef3a958 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 0.640877 Nov 03 04:03:36.201577 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1492/2911] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:35 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:36.270455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:36.276186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:36.289911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:36.290960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:36.291833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:36.292777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:36.293460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:36.294074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:36.344814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:36.345956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:36.362166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:36.364043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:36.375466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:36.376363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:36.379138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:36.379824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:36.996375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:37.006739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:37.009808 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f72dbdb7-2bb5-4b8b-942d-2cb7625c95ad tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.669764 Nov 03 04:03:37.011334 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1493/2912] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:36 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:37.023356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:37.024853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] [instance: bd3de980-af10-4017-b652-4be4a0c2a9df] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:37.043582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.044364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.045886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.049252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.051122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.051122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.053715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:37.068319 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dbbfcbed-63d8-44ee-b7cb-375fa4fc9bb8 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1518 microversion: 2.1 time: 0.798009 Nov 03 04:03:37.071939 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1420/2913] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:36 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1518 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:37.102659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:37.104941 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] HTTP exception thrown: Instance bd3de980-af10-4017-b652-4be4a0c2a9df could not be found. Nov 03 04:03:37.107745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Request method failure captured: Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df HTTP/1.1 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzzKUTmSRHCb2QoycvokEneMWTUYJ507o6LN5Si2Swefv7tJ0lvdCnkDZa7FA4Na5craTh3y01dh2D1PC7kuRY1hcjGGxqJmj5Ia1bYqFBWnjAtlwUxJcup4kj6l05Vyfzc4flBmk5rr9vxl5KH7ot3Dybxsr-4FqF8IWDHzt6IJMi4 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.91 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: ec186db9a3a14062a468f5f5106f2cec Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-36314882 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec186db9a3a14062a468f5f5106f2cec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ec186db9a3a14062a468f5f5106f2cec", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ec186db9a3a14062a468f5f5106f2cec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ec186db9a3a14062a468f5f5106f2cec"}]}] Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-36314882 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: ec186db9a3a14062a468f5f5106f2cec Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-36314882 Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-UnshelveToHostMultiNodesTest-36314882-project Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 718826833702413f9189617cd67107aa Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-36314882-project Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance bd3de980-af10-4017-b652-4be4a0c2a9df could not be found. Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'bd3de980-af10-4017-b652-4be4a0c2a9df'} Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3de980-af10-4017-b652-4be4a0c2a9df could not be found. Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3de980-af10-4017-b652-4be4a0c2a9df could not be found. Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:37.112913 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3de980-af10-4017-b652-4be4a0c2a9df could not be found. Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] Returning 404 to user: Instance bd3de980-af10-4017-b652-4be4a0c2a9df could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:37.118503 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5f905030-d118-4914-aca3-664d92fa6571 tempest-UnshelveToHostMultiNodesTest-36314882 tempest-UnshelveToHostMultiNodesTest-36314882-project] 10.222.0.30 "GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df" status: 404 len: 111 microversion: 2.91 time: 0.099158 Nov 03 04:03:37.127984 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1494/2914] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:37 2022] GET /compute/v2.1/servers/bd3de980-af10-4017-b652-4be4a0c2a9df => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:37.149807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.153051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.155241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.157109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.157761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.158635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.201360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:37.202259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:37.213192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.218219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.218922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.220262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.226413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.227492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.259078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lazy-loading 'flavor' on Instance uuid 855c9583-d48b-4c48-b59c-8a4096494b67 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:37.510431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:37.693365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a11a205-9f4e-4fda-ae72-39611b0fa6ab tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action" status: 200 len: 32 microversion: 2.1 time: 0.596663 Nov 03 04:03:37.694057 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1421/2915] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:03:37 2022] POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action => generated 32 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 04:03:37.715282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:37.716402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:37.755078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.756659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.757336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.762472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:37.763730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:37.766608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:37.924728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:37.955696 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e434631-19b1-401c-8076-16949a0cf278 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.771198 Nov 03 04:03:37.956888 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1495/2916] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:37 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:37.964672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c90c8163-a74c-4315-a25d-685ea503d801 req-ca6564f4-35fd-4252-a125-f5a800fca24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245744-2606-41a5-95fb-ac3491d55d4f", "tag": "056f57ba-86b8-418c-bc90-75bf359e2fa9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:38.002115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c90c8163-a74c-4315-a25d-685ea503d801 req-ca6564f4-35fd-4252-a125-f5a800fca24d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:38.005116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c90c8163-a74c-4315-a25d-685ea503d801 req-ca6564f4-35fd-4252-a125-f5a800fca24d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:38.005116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c90c8163-a74c-4315-a25d-685ea503d801 req-ca6564f4-35fd-4252-a125-f5a800fca24d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:38.019393 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c90c8163-a74c-4315-a25d-685ea503d801 req-ca6564f4-35fd-4252-a125-f5a800fca24d service nova] Creating event network-changed:056f57ba-86b8-418c-bc90-75bf359e2fa9 for instance 1c245744-2606-41a5-95fb-ac3491d55d4f on n-h1-854653-7 Nov 03 04:03:38.056901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c90c8163-a74c-4315-a25d-685ea503d801 req-ca6564f4-35fd-4252-a125-f5a800fca24d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091441 Nov 03 04:03:38.058576 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1496/2917] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:38.070920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:38.071919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:38.083881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:38.092500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:38.093425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:38.094667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:38.095505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:38.097539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:38.370589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:38.385795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-81237d22-823d-4ac6-9569-0b2ba3bcc4e4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 0.690493 Nov 03 04:03:38.386396 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1422/2918] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:37 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:38.391439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:38.395127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:38.407864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:38.408365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:38.416369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:38.417802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:38.418380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:38.418879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:38.741052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:39.262250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:39.264972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=16 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:39.272454 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abfb1c3f-8c9f-40a0-9c01-a0ebd8b941ff tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 1.212605 Nov 03 04:03:39.287418 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1497/2919] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:38 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:39.297768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:39.298757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:39.302797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:39.306652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:39.307778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:39.308449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:39.309528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:39.310218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:39.310864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:39.319657 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f999cecf-915b-443c-bc79-52a2f7a8421b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.931847 Nov 03 04:03:39.345440 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1423/2920] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:38 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:39.424379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:39.425004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:39.437427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:39.437949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:39.438409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:39.443520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:39.449649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:39.449649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:39.857440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:39.880109 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1753badd-3fc7-483f-a2ba-b0489f93a5c4 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.591267 Nov 03 04:03:39.880705 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1498/2921] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:39 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:40.153752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:40.167389 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-191959f6-9f45-4048-a722-91ee338d77ca tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 0.751111 Nov 03 04:03:40.185472 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1424/2922] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:39 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:40.303753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:40.304683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:40.319574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:40.320747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:40.322824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:40.325518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:40.327321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:40.327794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:40.357846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:40.358507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:40.374102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:40.376546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:40.378894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:40.382293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:40.382293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:40.382293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:40.661128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:40.913472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:40.935402 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b1478b04-dbe2-4335-aaae-dd0702dddf6a tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.583262 Nov 03 04:03:40.937241 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1425/2923] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:40 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:40.942284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:40.942995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:40.949772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:40.950509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:40.951128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:40.952436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:40.952904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:40.953448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:41.008094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:41.024091 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cab9c43-ae5f-44b3-a97b-82eb6fabe4eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.726561 Nov 03 04:03:41.024939 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1499/2924] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:40 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:41.168368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:41.180375 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce60904f-83f6-4f98-8938-2d74ed39b34e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.241529 Nov 03 04:03:41.181404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1426/2925] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:40 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:41.190347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:41.190798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:41.202897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:41.203392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:41.204719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:41.204719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:41.205037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:41.217808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:41.684846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:41.689566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e306dd6-8913-4c14-852f-d0e59f944d2b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Action: 'create', calling method: .version_select at 0x7ff7f8a38040>, body: {"keypair": {"name": "tempest-keypair-1883373805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqHrAHzq8iENIAMwVjYJaxDrDg0UwC3wuGdy7L32pYAJidG5BNYYTzhq3BKC3uyWNxtUBUzSQAee8xpVnwB8kLKagPGV5A/TbjlvyFHghjuqEM9VP7MG1jNKe+GsM9X4w=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:41.694449 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c808c984-b5c5-400d-8602-3f7cccfbdb3b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 0.508039 Nov 03 04:03:41.695672 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1500/2926] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:41 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:41.740537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4e306dd6-8913-4c14-852f-d0e59f944d2b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Getting quotas for project a4a83b4960f4427bb66fa9b086479fbf. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:03:41.755755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4e306dd6-8913-4c14-852f-d0e59f944d2b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Getting quotas for user 1627221c9ae94184ada95f548d62e413 and project a4a83b4960f4427bb66fa9b086479fbf. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:03:41.884268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e306dd6-8913-4c14-852f-d0e59f944d2b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.201156 Nov 03 04:03:41.892291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1427/2927] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 04:03:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 04:03:41.959946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:41.960623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:41.967512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:41.968009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:41.968452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:41.969230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:41.969685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:41.970139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:42.048139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:42.049079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:42.073035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:42.073806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:42.074797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:42.078957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:42.079881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:42.080496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:42.400633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:42.411203 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e787f3e5-26cd-4ab8-8075-bd6f0fd7cec0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.453614 Nov 03 04:03:42.413395 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1501/2928] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:41 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:42.429926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:42.430560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:42.440543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:42.442200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:42.442647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:42.444621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:42.447324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:42.450273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:42.678541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:42.691929 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f112fabd-d627-41ee-8b14-2db022741e80 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.646306 Nov 03 04:03:42.692540 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1428/2929] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:42 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:42.721567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:42.722961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:42.730465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:42.730465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:42.730830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:42.731813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:42.732466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:42.732898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:42.941047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:42.950271 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16c58d42-82af-408b-97a3-a3747732ea65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.535777 Nov 03 04:03:42.950853 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1502/2930] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:42 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:43.032918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:43.040921 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abf34367-8aa0-4a30-aeca-7102d26a95c4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 0.324277 Nov 03 04:03:43.042168 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1429/2931] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:42 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:43.445585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:43.446488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:43.453179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:43.453919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:43.454559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:43.455488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:43.456181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:43.459876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:43.681341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:43.689173 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c359b05-3a90-4ed8-83d6-37981b51650e tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.247403 Nov 03 04:03:43.690129 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1503/2932] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:43 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:43.718709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:43.719503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:43.727542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:43.728287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:43.729332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:43.731498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:43.731498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:43.731498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:43.833616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6cb35a8e-a3f3-4826-8e7e-cae6c11f1e35 req-246bb58c-ca48-43d1-abc2-ff56c31c9488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391f4a76-bd33-4408-87e5-ee259b51b788", "name": "network-vif-plugged", "status": "completed", "tag": "bd83db27-c464-4b01-9885-4d7c0c533c35"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:43.854648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6cb35a8e-a3f3-4826-8e7e-cae6c11f1e35 req-246bb58c-ca48-43d1-abc2-ff56c31c9488 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:43.855153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6cb35a8e-a3f3-4826-8e7e-cae6c11f1e35 req-246bb58c-ca48-43d1-abc2-ff56c31c9488 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:43.855954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6cb35a8e-a3f3-4826-8e7e-cae6c11f1e35 req-246bb58c-ca48-43d1-abc2-ff56c31c9488 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:43.876681 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6cb35a8e-a3f3-4826-8e7e-cae6c11f1e35 req-246bb58c-ca48-43d1-abc2-ff56c31c9488 service nova] Creating event network-vif-plugged:bd83db27-c464-4b01-9885-4d7c0c533c35 for instance 391f4a76-bd33-4408-87e5-ee259b51b788 on n-h2-854653-7 Nov 03 04:03:43.881912 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6cb35a8e-a3f3-4826-8e7e-cae6c11f1e35 req-246bb58c-ca48-43d1-abc2-ff56c31c9488 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052791 Nov 03 04:03:43.882762 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1504/2933] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:43.952885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:43.967028 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d035f78-06c2-4034-906e-1e395c125c9a tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.254687 Nov 03 04:03:43.974797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:43.975516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:43.983971 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1430/2934] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:43 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:43.986430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:43.986936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:43.988130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:43.989115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:43.989753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:43.990545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.064262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:44.064886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:44.074889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.078619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.081619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.085277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.085819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.086260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.223750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:44.239106 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db29c71a-761f-4373-bcc6-e1acd076649e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.268677 Nov 03 04:03:44.253089 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1505/2935] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:43 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:44.338724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:44.348834 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4745067f-6904-427d-9a4e-ca29c2f5fe64 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1315 microversion: 2.1 time: 0.288494 Nov 03 04:03:44.351124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1431/2936] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:44 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:44.712042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:44.713597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:44.719993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.720600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.720913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.721960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.722436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.722877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.767509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f8886550>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:44.771836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.772326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.772770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.780766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.781546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.782333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.790490 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] HTTP exception thrown: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Request method failure captured: Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383 HTTP/1.1 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 56 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz2g5ATTrd0kncIy1GgBdgNOjUDZ25sgJmChddq46GXkXs_COgr9kKmOeSCNOpfox-Tf-7Jc_XCm3IURJh_9HobTlqxMf_8rlGZMCGqtc1Tl5hFJHTBZ1xVZVWcCk9nPSjsmopp8sSQuRmNuxyre_ShmANEuG9Zbz4lx0mHwYy7iKqQ Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.53 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2e5d4ded3ced4a17a5e2d663d6fb25bd Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2e5d4ded3ced4a17a5e2d663d6fb25bd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}] Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2e5d4ded3ced4a17a5e2d663d6fb25bd Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 51a4fad742cf469e8b1d9f9945b266d7 Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: exception: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '15d00fcb-6a12-4a2c-ba07-e2e189cc2383', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:03:44.793481 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.798297 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.799950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Returning 404 to user: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:44.800974 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4655a585-ec56-4730-9544-96fa76381bd3 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383" status: 404 len: 110 microversion: 2.53 time: 0.303377 Nov 03 04:03:44.802058 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1506/2937] 10.222.0.30 () {62 vars in 1309 bytes} [Thu Nov 3 04:03:44 2022] PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383 => generated 110 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:44.817207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f88863a0>, body: {"status": "disabled"} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:44.829383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.830128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.830655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.850159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.850932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.852290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.858424 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] HTTP exception thrown: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Request method failure captured: Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383 HTTP/1.1 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 22 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz2g5ATTrd0kncIy1GgBdgNOjUDZ25sgJmChddq46GXkXs_COgr9kKmOeSCNOpfox-Tf-7Jc_XCm3IURJh_9HobTlqxMf_8rlGZMCGqtc1Tl5hFJHTBZ1xVZVWcCk9nPSjsmopp8sSQuRmNuxyre_ShmANEuG9Zbz4lx0mHwYy7iKqQ Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.53 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2e5d4ded3ced4a17a5e2d663d6fb25bd Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2e5d4ded3ced4a17a5e2d663d6fb25bd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}] Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2e5d4ded3ced4a17a5e2d663d6fb25bd Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 51a4fad742cf469e8b1d9f9945b266d7 Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: {"status": "disabled"} Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: exception: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '15d00fcb-6a12-4a2c-ba07-e2e189cc2383', 'body': {'status': 'disabled'}} Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:03:44.860276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Returning 404 to user: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2fde5b71-8e6c-443f-9ca1-a927e2bfe6ae tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383" status: 404 len: 110 microversion: 2.53 time: 0.053916 Nov 03 04:03:44.864606 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1507/2938] 10.222.0.30 () {62 vars in 1309 bytes} [Thu Nov 3 04:03:44 2022] PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383 => generated 110 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 03 04:03:44.878512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Action: 'update', calling method: .version_select at 0x7ff7f8f59310>, body: {"status": "enabled"} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:44.883926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.884665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.885608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.893625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.894351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.894996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.897214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:44.906203 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] HTTP exception thrown: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.906362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24f8541c-0d8c-42e6-a1f1-7a3e37c1fb4b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.198302 Nov 03 04:03:44.909344 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1432/2939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:44 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Request method failure captured: Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383 HTTP/1.1 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 21 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz2g5ATTrd0kncIy1GgBdgNOjUDZ25sgJmChddq46GXkXs_COgr9kKmOeSCNOpfox-Tf-7Jc_XCm3IURJh_9HobTlqxMf_8rlGZMCGqtc1Tl5hFJHTBZ1xVZVWcCk9nPSjsmopp8sSQuRmNuxyre_ShmANEuG9Zbz4lx0mHwYy7iKqQ Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.53 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2e5d4ded3ced4a17a5e2d663d6fb25bd Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2e5d4ded3ced4a17a5e2d663d6fb25bd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2e5d4ded3ced4a17a5e2d663d6fb25bd"}]}] Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2e5d4ded3ced4a17a5e2d663d6fb25bd Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 51a4fad742cf469e8b1d9f9945b266d7 Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: {"status": "enabled"} Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: exception: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '15d00fcb-6a12-4a2c-ba07-e2e189cc2383', 'body': {'status': 'enabled'}} Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:03:44.909474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Returning 404 to user: Service 15d00fcb-6a12-4a2c-ba07-e2e189cc2383 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-25dcbbf1-bb0f-4ab4-b189-110a6d39ea11 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383" status: 404 len: 110 microversion: 2.53 time: 0.038486 Nov 03 04:03:44.913866 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1508/2940] 10.222.0.30 () {62 vars in 1309 bytes} [Thu Nov 3 04:03:44 2022] PUT /compute/v2.1/os-services/15d00fcb-6a12-4a2c-ba07-e2e189cc2383 => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:44.925092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:44.929120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.929607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.930043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.930974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.937581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.937581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.957151 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79be7791-b63e-4fed-afed-348c42aa3e69 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035841 Nov 03 04:03:44.957765 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1433/2941] 10.222.0.30 () {60 vars in 1178 bytes} [Thu Nov 3 04:03:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:44.970154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:44.973795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.974275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.974713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.975444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:44.975901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:44.976325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:44.995558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:44.996180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:45.002150 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4cfe5826-e364-479d-a65b-cb3c10984ce8 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035691 Nov 03 04:03:45.002306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.002922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.003057 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1509/2942] 10.222.0.30 () {60 vars in 1211 bytes} [Thu Nov 3 04:03:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:45.003378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.004170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.004632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.005134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.016613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.020153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.020633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.021282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.022182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.022738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.023167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.048272 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1dd4b3e-bf03-4858-95af-749065651d72 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035300 Nov 03 04:03:45.048884 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1510/2943] 10.222.0.30 () {60 vars in 1178 bytes} [Thu Nov 3 04:03:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:03:45.064491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.068230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.068971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.069609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.076050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.076050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.076050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.096389 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9d95eda9-8288-46a6-8313-dc569ad1c137 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=n-d-854653-7&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038298 Nov 03 04:03:45.098550 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1511/2944] 10.222.0.30 () {60 vars in 1235 bytes} [Thu Nov 3 04:03:45 2022] GET /compute/v2.1/os-services?host=n-d-854653-7&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:45.115795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.119990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.122745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.122745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.122745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.122745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.122745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.149112 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7204adb-d711-42fd-a3e7-f85e495e01a6 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037543 Nov 03 04:03:45.149734 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1512/2945] 10.222.0.30 () {60 vars in 1178 bytes} [Thu Nov 3 04:03:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:45.163832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.168094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.168799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.169467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.170410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.171393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.172070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.195944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:45.210803 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85490b87-4a49-4eb8-9ae7-b7055c8f7438 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.220045 Nov 03 04:03:45.213895 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2aef6213-a7c9-4750-8552-4731908eac04 tempest-ServicesAdminNegativeV253TestJSON-1750779869 tempest-ServicesAdminNegativeV253TestJSON-1750779869-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.049495 Nov 03 04:03:45.214603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1513/2946] 10.222.0.30 () {60 vars in 1239 bytes} [Thu Nov 3 04:03:45 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:45.216327 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1434/2947] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:44 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:45.263634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.264268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:45.273617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.274124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.274575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.275307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.276319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.276760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.483867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:45.496489 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-700f0ed9-5e44-4afc-b3c2-3c4372ddafcf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.236930 Nov 03 04:03:45.497401 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1514/2948] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:45 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:45.503491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.504564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:45.514504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.515382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.516024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.516944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.517683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.518363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.587558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-416f33f2-8ba9-4535-8aff-a1a9b05bb097 tempest-ServicesAdminNegativeV253TestJSON-2098615080 tempest-ServicesAdminNegativeV253TestJSON-2098615080-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.593204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-416f33f2-8ba9-4535-8aff-a1a9b05bb097 tempest-ServicesAdminNegativeV253TestJSON-2098615080 tempest-ServicesAdminNegativeV253TestJSON-2098615080-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'e7380f20e9b14341b3bac3bb99ed2a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '499864f2b8d24cfaaaf9b320e322fb05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-416f33f2-8ba9-4535-8aff-a1a9b05bb097 tempest-ServicesAdminNegativeV253TestJSON-2098615080 tempest-ServicesAdminNegativeV253TestJSON-2098615080-project] Request method failure captured: Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz2fejRSuoEbQjp_UsOYm0QZDMhZDUZjEsWTzEvKpcNCd2SLMapsG9XpAM70fgVsZxfR9lMV8oECgRsJHE8qADdHH6tJYalYAMLeJPrVkLlAB-y1tyy3XPsJV22oLy28mqDg0M1LCcP-1JcE8Zf3yVzXeP3TL8x3__Mk-wdT7lcfbhw Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.53 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 499864f2b8d24cfaaaf9b320e322fb05 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2098615080 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/499864f2b8d24cfaaaf9b320e322fb05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_499864f2b8d24cfaaaf9b320e322fb05", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/499864f2b8d24cfaaaf9b320e322fb05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/499864f2b8d24cfaaaf9b320e322fb05"}]}] Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2098615080 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 499864f2b8d24cfaaaf9b320e322fb05 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2098615080 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2098615080-project Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: e7380f20e9b14341b3bac3bb99ed2a17 Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2098615080-project Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: action_args: {} Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 04:03:45.595829 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 03 04:03:45.600458 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:45.602333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-416f33f2-8ba9-4535-8aff-a1a9b05bb097 tempest-ServicesAdminNegativeV253TestJSON-2098615080 tempest-ServicesAdminNegativeV253TestJSON-2098615080-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:45.603200 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-416f33f2-8ba9-4535-8aff-a1a9b05bb097 tempest-ServicesAdminNegativeV253TestJSON-2098615080 tempest-ServicesAdminNegativeV253TestJSON-2098615080-project] 10.222.0.30 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.379309 Nov 03 04:03:45.605270 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1435/2949] 10.222.0.30 () {60 vars in 1178 bytes} [Thu Nov 3 04:03:45 2022] GET /compute/v2.1/os-services => generated 112 bytes in 381 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:45.614143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-889218415", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "223af0a1-2840-4cab-81a7-10041b1c2537"}, {"port": "003860eb-1280-48b6-9513-ea8500694f1b", "tag": "port-1"}, {"port": "72a0b145-87de-4be0-9f7f-ac127448f825", "tag": "port-2"}, {"uuid": "aa2e9b45-67e3-4c80-ab7d-7faeed8b5472", "tag": "net-1"}, {"uuid": "aa2e9b45-67e3-4c80-ab7d-7faeed8b5472"}, {"uuid": "041ffe04-0248-4f10-b69b-70938f273f89", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "041ffe04-0248-4f10-b69b-70938f273f89", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8128e2c4-e20c-448d-96c7-6651a55612b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6d3b542a-d5e1-4729-8543-0ba2ecd13fb2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "83afca08-3673-4ae5-853b-71db13baab01", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1695972935"}], "key_name": "tempest-keypair-1883373805", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:45.707731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:45.718736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-46b225a3-ce52-44e2-89bf-2959264812d4 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1502 microversion: 2.1 time: 0.220064 Nov 03 04:03:45.719943 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1515/2950] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:45 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:45.747305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:45.748372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:45.757857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.759589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.760997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.763586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.765669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.767790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:45.780965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] validate_networks() for [('223af0a1-2840-4cab-81a7-10041b1c2537', None, None, None, None, None), (None, None, '003860eb-1280-48b6-9513-ea8500694f1b', None, None, None), (None, None, '72a0b145-87de-4be0-9f7f-ac127448f825', None, None, None), ('aa2e9b45-67e3-4c80-ab7d-7faeed8b5472', None, None, None, None, None), ('aa2e9b45-67e3-4c80-ab7d-7faeed8b5472', None, None, None, None, None), ('041ffe04-0248-4f10-b69b-70938f273f89', '10.2.2.100', None, None, None, None), ('041ffe04-0248-4f10-b69b-70938f273f89', '10.2.2.200', None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:03:45.876259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:45.961565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12064e22-c8bd-4019-8600-8a228dfbe096 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "DELETE /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.219174 Nov 03 04:03:45.962180 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1516/2951] 10.222.0.30 () {58 vars in 1296 bytes} [Thu Nov 3 04:03:45 2022] DELETE /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788/os-server-password => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:03:45.967439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c1e66f3b-3805-4f37-a890-77a4aaee1296 req-accce9b1-d7ee-4489-b49b-d1449b9bd30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c245744-2606-41a5-95fb-ac3491d55d4f", "name": "network-vif-plugged", "status": "completed", "tag": "056f57ba-86b8-418c-bc90-75bf359e2fa9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:45.984381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1e66f3b-3805-4f37-a890-77a4aaee1296 req-accce9b1-d7ee-4489-b49b-d1449b9bd30d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:45.985339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1e66f3b-3805-4f37-a890-77a4aaee1296 req-accce9b1-d7ee-4489-b49b-d1449b9bd30d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:45.989177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1e66f3b-3805-4f37-a890-77a4aaee1296 req-accce9b1-d7ee-4489-b49b-d1449b9bd30d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.004527 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c1e66f3b-3805-4f37-a890-77a4aaee1296 req-accce9b1-d7ee-4489-b49b-d1449b9bd30d service nova] Creating event network-vif-plugged:056f57ba-86b8-418c-bc90-75bf359e2fa9 for instance 1c245744-2606-41a5-95fb-ac3491d55d4f on n-h1-854653-7 Nov 03 04:03:46.008908 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c1e66f3b-3805-4f37-a890-77a4aaee1296 req-accce9b1-d7ee-4489-b49b-d1449b9bd30d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044565 Nov 03 04:03:46.009848 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1517/2952] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:46.015909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:46.016683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:46.024531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.025036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.025567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.026495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.027001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.027427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.329942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:46.344975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9bbda719-1c8b-4e0d-97ef-2e8fa93d97f7 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1315 microversion: 2.1 time: 0.333179 Nov 03 04:03:46.346652 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1518/2953] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:46 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:46.358401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:46.359468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:46.365554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:46.367231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.367906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.368353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.369107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.370267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.370863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.401621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2c0c1c4-147a-4372-8a70-ba85a7708de0 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.053670 Nov 03 04:03:46.402205 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1519/2954] 10.222.0.30 () {58 vars in 1293 bytes} [Thu Nov 3 04:03:46 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788/os-server-password => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:03:46.409594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:46.410626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:46.417730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.418456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.418904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.419628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.420091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.420524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.642552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:46.650226 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ff0f502d-0468-4d8e-a154-4d34191252eb tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.246668 Nov 03 04:03:46.651559 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1520/2955] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:46 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:46.656318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:46.656986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:46.662841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.663500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.663939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.664634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:46.665129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:46.665567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:46.694888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:03:47.495619 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0aa9981e-ab51-42b2-9f13-e27eb5298ec6 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "DELETE /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 204 len: 0 microversion: 2.1 time: 0.842563 Nov 03 04:03:47.499613 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1521/2956] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:03:46 2022] DELETE /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:03:47.503255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:47.503965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:47.510429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:47.510921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:47.511367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:47.512067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:47.512525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:47.512958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:47.741439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:47.764173 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db8c459d-9777-420b-94a8-b84ef90d10fb tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.265261 Nov 03 04:03:47.779294 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1522/2957] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:47 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:48.082014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-674155340", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": "none"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:48.152754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:03:48.153312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:03:48.153914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:03:48.154403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:03:48.154894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:03:48.165906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.166404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.166887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.167765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.168301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.168807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.190084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Getting quotas for project 6f69d2a2ad5c4f56b93b149758ab9ca7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:03:48.198341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Getting quotas for user 1a2035f1312c48df80044eb5ed36551e and project 6f69d2a2ad5c4f56b93b149758ab9ca7. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:03:48.215953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:03:48.220301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:03:48.370827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db8acbdc-0291-4cef-87c8-8ce9f1331e8b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.589970 Nov 03 04:03:48.378659 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1523/2958] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:03:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:03:48.383952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:48.385649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:48.394691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.395559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.396239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.411712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.412479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.413058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.616784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:48.627171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c0c8b04-6769-4419-8bdd-5efeaaab7ab2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1504 microversion: 2.1 time: 0.247200 Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1524/2959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:48 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.647604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.872325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:48.879684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:03:48.880207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:03:48.880571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:03:48.880981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:03:48.881414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:03:48.889849 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e22cf2e-ea35-4813-8972-94443f014203 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1508 microversion: 2.1 time: 0.256323 Nov 03 04:03:48.890432 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1525/2960] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:48 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:48.896251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.898476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.902646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:48.903314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.904531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.905199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.905804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.909320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:48.923281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.923989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.924969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.926054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:48.926694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:48.927123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:48.947839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Getting quotas for project a4a83b4960f4427bb66fa9b086479fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:03:48.955412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Getting quotas for user 1627221c9ae94184ada95f548d62e413 and project a4a83b4960f4427bb66fa9b086479fbf. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:03:49.104578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:49.118749 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87deed83-951d-4395-9ea7-280978ac24dd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.216121 Nov 03 04:03:49.118749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1526/2961] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:48 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:49.120025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-62dd8542-24ef-4810-ba8e-724786dd7201 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:49.122730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-62dd8542-24ef-4810-ba8e-724786dd7201 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:49.172095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:03:49.179969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8128e2c4-e20c-448d-96c7-6651a55612b7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6d3b542a-d5e1-4729-8543-0ba2ecd13fb2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83afca08-3673-4ae5-853b-71db13baab01',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:03:49.206327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-62dd8542-24ef-4810-ba8e-724786dd7201 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:49.216343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-62dd8542-24ef-4810-ba8e-724786dd7201 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:49.217927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-62dd8542-24ef-4810-ba8e-724786dd7201 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:49.224578 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-62dd8542-24ef-4810-ba8e-724786dd7201 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "PUT /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1358 microversion: 2.75 time: 0.108907 Nov 03 04:03:49.225384 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1527/2962] 10.222.0.30 () {62 vars in 1297 bytes} [Thu Nov 3 04:03:49 2022] PUT /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1358 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:49.245436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1738933363"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:49.245996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:49.255524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:49.256023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:49.256522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:49.257312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:49.257953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:49.258520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:49.441493 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.security_group_api [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Adding security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 to port 056f57ba-86b8-418c-bc90-75bf359e2fa9 Nov 03 04:03:49.938547 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-908ed80e-804f-4920-853e-aacadba45c86 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f/action" status: 202 len: 0 microversion: 2.1 time: 0.712095 Nov 03 04:03:49.940629 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1528/2963] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:03:49 2022] POST /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:49.951297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:49.952559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:49.961871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:49.963321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:49.964890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:49.966603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:49.967508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:49.968283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.152802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:50.162333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8d21277-214f-4eaf-b685-a8b2030f3c5d tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.220145 Nov 03 04:03:50.163763 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1529/2964] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:49 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:50.168760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:50.169954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:50.176361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.177325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.177946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.178827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.179445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.180035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.260366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:50.271809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:50.284485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:50.291666 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ea8f1c7a-2f8b-47f1-80a6-b2b8810f662e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1354 microversion: 2.75 time: 0.126855 Nov 03 04:03:50.292634 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1530/2965] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:50 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:50.297482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-69c83b4a-0f0e-4f31-8e93-78e34228a6c9 req-f02119b2-7f1a-4f9d-b555-725ad618e80e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391f4a76-bd33-4408-87e5-ee259b51b788", "name": "network-vif-deleted", "tag": "bd83db27-c464-4b01-9885-4d7c0c533c35"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:50.339670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69c83b4a-0f0e-4f31-8e93-78e34228a6c9 req-f02119b2-7f1a-4f9d-b555-725ad618e80e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.340462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69c83b4a-0f0e-4f31-8e93-78e34228a6c9 req-f02119b2-7f1a-4f9d-b555-725ad618e80e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.341079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69c83b4a-0f0e-4f31-8e93-78e34228a6c9 req-f02119b2-7f1a-4f9d-b555-725ad618e80e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.366991 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-69c83b4a-0f0e-4f31-8e93-78e34228a6c9 req-f02119b2-7f1a-4f9d-b555-725ad618e80e service nova] Creating event network-vif-deleted:bd83db27-c464-4b01-9885-4d7c0c533c35 for instance 391f4a76-bd33-4408-87e5-ee259b51b788 on n-h2-854653-7 Nov 03 04:03:50.366991 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-69c83b4a-0f0e-4f31-8e93-78e34228a6c9 req-f02119b2-7f1a-4f9d-b555-725ad618e80e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069084 Nov 03 04:03:50.366991 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1531/2966] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:50.374658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:50.376068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:50.384213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.387748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.387748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.387748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.387748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.387748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.423467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.424126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.424658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.428405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lazy-loading 'fault' on Instance uuid 391f4a76-bd33-4408-87e5-ee259b51b788 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:03:50.469228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882370b1b9ca4e5397fed35c54916233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac71a21d8114b87b1a6d9426f49814d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:50.479481 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-413cf909-6a9c-46e6-8c76-dfe318b3db2b tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 200 len: 1305 microversion: 2.1 time: 0.114287 Nov 03 04:03:50.480073 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1532/2967] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:50 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:50.491786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32351f31-f4f8-49de-af67-4934f5f6ad76 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8f1e310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:50.535838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7cb846e0-44d9-4c74-9ab0-a841f38be9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.929321 Nov 03 04:03:50.537547 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1436/2968] 10.222.0.30 () {62 vars in 1189 bytes} [Thu Nov 3 04:03:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 4931 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:03:50.543229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1ecb9c6c-ad85-4bef-bfa8-471442e5d2bb req-e9393550-98d8-4bbd-958c-6ffdb743c49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245744-2606-41a5-95fb-ac3491d55d4f", "tag": "056f57ba-86b8-418c-bc90-75bf359e2fa9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:50.570224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ecb9c6c-ad85-4bef-bfa8-471442e5d2bb req-e9393550-98d8-4bbd-958c-6ffdb743c49a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.571087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ecb9c6c-ad85-4bef-bfa8-471442e5d2bb req-e9393550-98d8-4bbd-958c-6ffdb743c49a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.571193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ecb9c6c-ad85-4bef-bfa8-471442e5d2bb req-e9393550-98d8-4bbd-958c-6ffdb743c49a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.589450 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1ecb9c6c-ad85-4bef-bfa8-471442e5d2bb req-e9393550-98d8-4bbd-958c-6ffdb743c49a service nova] Creating event network-changed:056f57ba-86b8-418c-bc90-75bf359e2fa9 for instance 1c245744-2606-41a5-95fb-ac3491d55d4f on n-h1-854653-7 Nov 03 04:03:50.596091 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1ecb9c6c-ad85-4bef-bfa8-471442e5d2bb req-e9393550-98d8-4bbd-958c-6ffdb743c49a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057042 Nov 03 04:03:50.597262 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1437/2969] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:50.601821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:50.602811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:50.614733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.614733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.614733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.614733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:50.614733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:50.614733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:50.703513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-32351f31-f4f8-49de-af67-4934f5f6ad76 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use.", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:03:50.704507 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-32351f31-f4f8-49de-af67-4934f5f6ad76 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use. Nov 03 04:03:50.704507 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-253cbbbc-2259-447b-9a72-babebd0e292c'] Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32351f31-f4f8-49de-af67-4934f5f6ad76 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72 HTTP/1.1 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: exception: Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use. Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-253cbbbc-2259-447b-9a72-babebd0e292c'] Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e1f8f8c4-56b0-498a-90b1-f041c31eea72'} Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:03:50.706403 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use. Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-253cbbbc-2259-447b-9a72-babebd0e292c'] Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use. Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-253cbbbc-2259-447b-9a72-babebd0e292c'] Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use. Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-253cbbbc-2259-447b-9a72-babebd0e292c'] Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use. Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-253cbbbc-2259-447b-9a72-babebd0e292c'] Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32351f31-f4f8-49de-af67-4934f5f6ad76 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 400 to user: Security Group e1f8f8c4-56b0-498a-90b1-f041c31eea72 in use. Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-253cbbbc-2259-447b-9a72-babebd0e292c'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-32351f31-f4f8-49de-af67-4934f5f6ad76 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72" status: 400 len: 185 microversion: 2.1 time: 0.221396 Nov 03 04:03:50.714701 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1533/2970] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:03:50 2022] DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72 => generated 185 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:50.943666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c26167de-3d32-4ce3-a358-9d4087b20d65 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:50.956032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:50.957884 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c26167de-3d32-4ce3-a358-9d4087b20d65 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.243050 Nov 03 04:03:50.959354 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1534/2971] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:50.964668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0be40b84-ae96-4791-8209-92e8c9cdca08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:50.965646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0be40b84-ae96-4791-8209-92e8c9cdca08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:50.972490 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90e89445-b110-479d-bd13-6917231fbc5d tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.374687 Nov 03 04:03:50.980534 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1438/2972] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:50 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:50.993156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:50.997163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:51.005264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.006310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.007212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.008107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.009037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.009672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.044092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0be40b84-ae96-4791-8209-92e8c9cdca08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.060514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0be40b84-ae96-4791-8209-92e8c9cdca08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.063806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0be40b84-ae96-4791-8209-92e8c9cdca08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.065854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0be40b84-ae96-4791-8209-92e8c9cdca08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1285 microversion: 2.42 time: 0.105240 Nov 03 04:03:51.085368 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1535/2973] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:50 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:51.094434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1dd1a13c-5391-4fc2-bbf9-8dd24b364676 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.123111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1dd1a13c-5391-4fc2-bbf9-8dd24b364676 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.034878 Nov 03 04:03:51.123914 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1536/2974] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:51.140385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1070e742-d555-4fe0-90b8-745740cb92fe tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.151354 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1070e742-d555-4fe0-90b8-745740cb92fe tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014915 Nov 03 04:03:51.153389 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1537/2975] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:03:51.177786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3883e58-6ebc-4abd-91cc-db8120245319 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.190988 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3883e58-6ebc-4abd-91cc-db8120245319 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016337 Nov 03 04:03:51.200036 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1538/2976] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:51.210361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.210361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:51.215293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.215778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.216617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.217510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.218313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.218908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.265327 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f88f4358-1b09-47aa-b8b7-9d7d3329523b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f/action" status: 202 len: 0 microversion: 2.1 time: 0.283261 Nov 03 04:03:51.269783 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1439/2977] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:03:50 2022] POST /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:51.276342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fb7ca08e-716f-4896-8a89-bfcab0294de9 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.337942 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fb7ca08e-716f-4896-8a89-bfcab0294de9 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.063861 Nov 03 04:03:51.339603 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1440/2978] 10.222.0.30 () {58 vars in 1165 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:51.345353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.347661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:51.352798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:51.354799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.355504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.356089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.357049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.357608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.358372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.406056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.421913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-228693f4-f5e2-48fe-9d46-8d7824733469 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.220490 Nov 03 04:03:51.431193 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1539/2979] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:51.438119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.438119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:51.444501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.444948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.448113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.448951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.449327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.453153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.577662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.581161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:51.586630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.588791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.594345 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0bdad5b9-d0e8-4c61-9f04-fab449c393a9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1410 microversion: 2.75 time: 0.170831 Nov 03 04:03:51.594916 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1540/2980] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1410 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:51.599446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f4a7f95-5950-407e-9902-498b2b4990e4 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.607990 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f4a7f95-5950-407e-9902-498b2b4990e4 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012095 Nov 03 04:03:51.608599 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1541/2981] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:51.622107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.622727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] [instance: 391f4a76-bd33-4408-87e5-ee259b51b788] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:51.631763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.632248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.632679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.633401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:51.633850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:51.634342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:51.648375 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] HTTP exception thrown: Instance 391f4a76-bd33-4408-87e5-ee259b51b788 could not be found. Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Request method failure captured: Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 HTTP/1.1 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz2LSNXviN8XSyGAxwSnPTJl3FExLmufGUwU0Jupg9NQ55Z95Pqr-iKGPItDhYXgxtZ8DkT9on4t117nfLp0v7fi-20uJOD-R2hTz9uU7gKgSozvkPsgkiCqn0OJoJQzGYEhWDs1qC3vv1eKamp2jShSrvkojazyqPnHfR--SLrGU0A Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cac71a21d8114b87b1a6d9426f49814d Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerPasswordTestJSON-1411032463 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cac71a21d8114b87b1a6d9426f49814d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cac71a21d8114b87b1a6d9426f49814d", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cac71a21d8114b87b1a6d9426f49814d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cac71a21d8114b87b1a6d9426f49814d"}]}] Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerPasswordTestJSON-1411032463 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cac71a21d8114b87b1a6d9426f49814d Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1411032463 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerPasswordTestJSON-1411032463-project Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 882370b1b9ca4e5397fed35c54916233 Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerPasswordTestJSON-1411032463-project Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 391f4a76-bd33-4408-87e5-ee259b51b788 could not be found. Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '391f4a76-bd33-4408-87e5-ee259b51b788'} Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391f4a76-bd33-4408-87e5-ee259b51b788 could not be found. Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391f4a76-bd33-4408-87e5-ee259b51b788 could not be found. Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:51.649952 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391f4a76-bd33-4408-87e5-ee259b51b788 could not be found. Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] Returning 404 to user: Instance 391f4a76-bd33-4408-87e5-ee259b51b788 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-24e4b9c4-ee6c-4014-8093-cacb60d99c10 tempest-ServerPasswordTestJSON-1411032463 tempest-ServerPasswordTestJSON-1411032463-project] 10.222.0.30 "GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788" status: 404 len: 111 microversion: 2.1 time: 0.041710 Nov 03 04:03:51.654769 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1542/2982] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/servers/391f4a76-bd33-4408-87e5-ee259b51b788 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:03:51.656310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-70f63b09-51f8-4aba-8518-831ca8987806 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.686319 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-70f63b09-51f8-4aba-8518-831ca8987806 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033356 Nov 03 04:03:51.687219 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1543/2983] 10.222.0.30 () {58 vars in 1169 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:51.706771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe869cbb-5d67-4a26-8efe-ab10695381d1 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.724918 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fe869cbb-5d67-4a26-8efe-ab10695381d1 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.022299 Nov 03 04:03:51.733065 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1544/2984] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:03:51.734151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:51.743847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-519c6240-4a8e-4bbc-8a59-f35edad5f770 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.745069 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d54bc09-1a73-453b-9ca4-9f9b70774ffe tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1575 microversion: 2.1 time: 0.402674 Nov 03 04:03:51.746195 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1441/2985] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1575 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:51.754876 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-519c6240-4a8e-4bbc-8a59-f35edad5f770 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015485 Nov 03 04:03:51.755451 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1545/2986] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:51.775473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9a0faa5-cd2a-4d1c-80d0-a18967bd6f1e tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.823151 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c9a0faa5-cd2a-4d1c-80d0-a18967bd6f1e tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.049904 Nov 03 04:03:51.824934 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1442/2987] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:51.840224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bdb10530-2eff-4a25-9834-248fbcf93cf5 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.852821 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bdb10530-2eff-4a25-9834-248fbcf93cf5 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016377 Nov 03 04:03:51.866168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd9a639a-15f6-416b-bb2c-888c6fbdeb37 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.873035 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1546/2988] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:51.886300 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd9a639a-15f6-416b-bb2c-888c6fbdeb37 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.024017 Nov 03 04:03:51.887114 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1443/2989] 10.222.0.30 () {58 vars in 1144 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:51.906509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3064f3be-b7d2-4e8e-b8db-abfb433f42de tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.915425 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3064f3be-b7d2-4e8e-b8db-abfb433f42de tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018093 Nov 03 04:03:51.922694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1547/2990] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:51.928846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e4ffa4f-f796-4950-8e02-52d7df4b65c3 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:51.965997 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e4ffa4f-f796-4950-8e02-52d7df4b65c3 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.040144 Nov 03 04:03:51.967251 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1444/2991] 10.222.0.30 () {58 vars in 1148 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:51.984703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-57d5b1b6-6e35-4490-964d-a52b9363ae0d tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.001332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.002388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:52.011036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.011783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.012512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:52.013575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.014208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.014814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:52.015517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-57d5b1b6-6e35-4490-964d-a52b9363ae0d tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.034722 Nov 03 04:03:52.016701 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1548/2992] 10.222.0.30 () {58 vars in 1140 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:03:52.027166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:52.030895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ca96d21a-b830-4b95-949a-3ab53232665a tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.040178 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ca96d21a-b830-4b95-949a-3ab53232665a tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013081 Nov 03 04:03:52.048717 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1549/2993] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:52.053807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ce38a9e-badd-4f32-b0f7-1942aec0c9cd tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.098779 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ce38a9e-badd-4f32-b0f7-1942aec0c9cd tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.048579 Nov 03 04:03:52.111500 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1550/2994] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:52.124729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08677693-3db0-4475-9902-e883a6ed22e0 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.125679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08677693-3db0-4475-9902-e883a6ed22e0 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:52.140695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:52.252616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08677693-3db0-4475-9902-e883a6ed22e0 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.261540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08677693-3db0-4475-9902-e883a6ed22e0 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.265503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08677693-3db0-4475-9902-e883a6ed22e0 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.266958 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08677693-3db0-4475-9902-e883a6ed22e0 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1285 microversion: 2.42 time: 0.154460 Nov 03 04:03:52.268165 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1551/2995] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:52.274352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0abc5cd5-c965-41d6-931b-de3a7a951076 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.299963 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0abc5cd5-c965-41d6-931b-de3a7a951076 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030355 Nov 03 04:03:52.301669 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1552/2996] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:52.315078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.325050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec5169ea-42d8-44e0-8deb-64b424c8b3e7 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.332127 Nov 03 04:03:52.329228 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1445/2997] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:51 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:52.348816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0579682c-5962-4202-9924-42c39ac3d015 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.360074 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0579682c-5962-4202-9924-42c39ac3d015 tempest-FlavorsV2TestJSON-1851092948 tempest-FlavorsV2TestJSON-1851092948-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032263 Nov 03 04:03:52.366823 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1553/2998] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:52.454286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.454914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:52.464498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.466220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.466677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:52.469243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.470114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.474256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:52.624658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.625547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:52.638592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.643570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.643570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:52.644344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.645108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.645732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:52.742674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.754509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.756231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.765681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:52.771424 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc7d3818-b302-40ae-8a50-8c2c9c8f25ac tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1416 microversion: 2.75 time: 0.148607 Nov 03 04:03:52.781421 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f60fc0e8-a1d4-4d9c-bce4-9baeab344e8f tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.324798 Nov 03 04:03:52.781421 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1446/2999] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:52.781833 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1554/3000] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:52.781929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:52.781929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:52.786581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.787271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.787725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:52.788429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:52.788882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:52.789341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.030366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:53.045838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-56ad72f9-3e20-422c-9db5-8050f9a5c138 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1575 microversion: 2.1 time: 0.269236 Nov 03 04:03:53.046673 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1447/3001] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:52 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:53.298223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:53.298931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:53.320200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.321478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.322118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.325169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.325169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.325169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.356839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:53.357559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:53.371492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.373127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.376669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.376669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.376669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.376669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.438359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:53.461423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:53.466221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:53.470003 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91bcba1b-51f7-4dca-9396-b63eab6604a5 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1527 microversion: 2.42 time: 0.175871 Nov 03 04:03:53.473445 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1555/3002] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:53 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:53.680560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:53.690088 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0f79ea2-ce7b-4d98-9718-4f07752c95ed tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.339279 Nov 03 04:03:53.691714 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1448/3003] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:53 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:03:53.805884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:53.807364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:53.813224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:53.815217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:53.822101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.822844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.823476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.824947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.827188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.827586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.828115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.830694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.856158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:53.858060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:53.861365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:53.861875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.008698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.043470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.047863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.063063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0fccaba2-b9bc-4660-8c6b-1f728bd7774c tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1416 microversion: 2.75 time: 0.259580 Nov 03 04:03:54.064873 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1449/3004] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:53 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1416 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:03:54.072962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:54.084849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:54.090377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.090871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.091311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.093898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.094453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.094973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.113235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.124980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5784aa8c-99ee-45ad-add7-1b7fcc43e610 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1511 microversion: 2.1 time: 0.325937 Nov 03 04:03:54.129506 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1556/3005] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:53 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:54.289546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.300007 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b76d8779-a4f8-43b7-b431-3d6e2c83d46f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1573 microversion: 2.1 time: 0.230965 Nov 03 04:03:54.300822 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1450/3006] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:54 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1573 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:54.326688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-331789991"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:54.327234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:54.336994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.339803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.342028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.344186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.344656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.346172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.498505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:54.499389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:54.546514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.548285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.549262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.555700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.556961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.557851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.625418 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.security_group_api [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Adding security group 00383959-dd44-4e96-b400-219c62995644 to port 056f57ba-86b8-418c-bc90-75bf359e2fa9 Nov 03 04:03:54.763740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.807453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.809527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:54.818257 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5223945b-fe77-47f5-b876-b63351192652 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1575 microversion: 2.42 time: 0.319551 Nov 03 04:03:54.819586 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1451/3007] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:54 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1575 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:03:54.831962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:54.834429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:54.851195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.853827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.854540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:54.858762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:54.859631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:54.861840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.154139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:55.165674 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ea9613f-348c-4ec0-9304-b89c081b3165 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.343689 Nov 03 04:03:55.166774 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1452/3008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:54 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:55.177715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:55.177715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:55.190748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.197143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.198152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.199118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.199927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.200378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.329487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:55.340062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:55.345776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:55.360184 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37e66a39-4d03-4852-b856-71c92a894ff5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1437 microversion: 2.75 time: 0.191529 Nov 03 04:03:55.381672 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1453/3009] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:55 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1437 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:55.402670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:55.403877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:55.410712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.412178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.412851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.414033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.414786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.415460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.580408 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b86cee7b-d5a7-447e-9434-48f0ba2c3007 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f/action" status: 202 len: 0 microversion: 2.1 time: 1.257500 Nov 03 04:03:55.582826 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1557/3010] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:03:54 2022] POST /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f/action => generated 0 bytes in 1261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:03:55.590291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:55.594369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:55.610362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.611675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.613760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.615483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.618125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.620933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.671135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:55.684085 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9fd232af-5308-4b29-b458-7e742e67e2e8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1488 microversion: 2.1 time: 0.296765 Nov 03 04:03:55.684085 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1454/3011] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:55 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1488 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:55.698174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10726eed-86c1-4801-93bf-645cd894efb5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8a2edc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:55.800217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:03:55.800684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:03:55.801411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:03:55.801980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:03:55.802785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:03:55.866796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-10726eed-86c1-4801-93bf-645cd894efb5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 00383959-dd44-4e96-b400-219c62995644 in use.", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:03:55.868087 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-10726eed-86c1-4801-93bf-645cd894efb5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security Group 00383959-dd44-4e96-b400-219c62995644 in use. Nov 03 04:03:55.868087 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-07575df0-e9e1-4447-ad86-d86e8d543d59'] Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10726eed-86c1-4801-93bf-645cd894efb5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644 HTTP/1.1 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: exception: Security Group 00383959-dd44-4e96-b400-219c62995644 in use. Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-07575df0-e9e1-4447-ad86-d86e8d543d59'] Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '00383959-dd44-4e96-b400-219c62995644'} Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:03:55.871543 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 00383959-dd44-4e96-b400-219c62995644 in use. Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07575df0-e9e1-4447-ad86-d86e8d543d59'] Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 00383959-dd44-4e96-b400-219c62995644 in use. Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07575df0-e9e1-4447-ad86-d86e8d543d59'] Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 00383959-dd44-4e96-b400-219c62995644 in use. Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07575df0-e9e1-4447-ad86-d86e8d543d59'] Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 00383959-dd44-4e96-b400-219c62995644 in use. Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07575df0-e9e1-4447-ad86-d86e8d543d59'] Nov 03 04:03:55.875558 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:03:55.879827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10726eed-86c1-4801-93bf-645cd894efb5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 400 to user: Security Group 00383959-dd44-4e96-b400-219c62995644 in use. Nov 03 04:03:55.879827 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-07575df0-e9e1-4447-ad86-d86e8d543d59'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:03:55.881541 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10726eed-86c1-4801-93bf-645cd894efb5 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644" status: 400 len: 185 microversion: 2.1 time: 0.199290 Nov 03 04:03:55.882642 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1455/3012] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:03:55 2022] DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644 => generated 185 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:03:55.893354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4932dd32-13b5-4e93-a06d-5c983aeda760 req-c8f0db8b-315a-40d9-a02e-5ed780534bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245744-2606-41a5-95fb-ac3491d55d4f", "tag": "056f57ba-86b8-418c-bc90-75bf359e2fa9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:55.924950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4932dd32-13b5-4e93-a06d-5c983aeda760 req-c8f0db8b-315a-40d9-a02e-5ed780534bb9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.926588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4932dd32-13b5-4e93-a06d-5c983aeda760 req-c8f0db8b-315a-40d9-a02e-5ed780534bb9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.928763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4932dd32-13b5-4e93-a06d-5c983aeda760 req-c8f0db8b-315a-40d9-a02e-5ed780534bb9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.946373 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4932dd32-13b5-4e93-a06d-5c983aeda760 req-c8f0db8b-315a-40d9-a02e-5ed780534bb9 service nova] Creating event network-changed:056f57ba-86b8-418c-bc90-75bf359e2fa9 for instance 1c245744-2606-41a5-95fb-ac3491d55d4f on n-h1-854653-7 Nov 03 04:03:55.954703 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4932dd32-13b5-4e93-a06d-5c983aeda760 req-c8f0db8b-315a-40d9-a02e-5ed780534bb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069614 Nov 03 04:03:55.955862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1456/3013] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:03:55.966124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1827678390"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:03:55.971276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:55.980364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.980857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.981356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:55.982242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:55.983789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:55.984308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.072930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:56.084748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.086212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.086743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.088359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.088876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.089445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.139943 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-218793e3-b2d4-4823-b53e-3ce26db4fa19 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "PUT /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1061 microversion: 2.1 time: 0.182383 Nov 03 04:03:56.155284 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1457/3014] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:03:55 2022] PUT /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1061 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:56.160863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:56.161850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:56.169619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.170305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.170949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.171889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.172508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.174430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.243891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:56.262461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:56.264118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:56.274327 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c653c149-5271-4221-9d11-96e594e137e4 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "POST /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888/action" status: 202 len: 1494 microversion: 2.75 time: 0.689867 Nov 03 04:03:56.287338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1558/3015] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:03:55 2022] POST /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888/action => generated 1494 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 03 04:03:56.298129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:56.301452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:56.318006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.318006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.318768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.332616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.335581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.335581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.420926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:03:56.629418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:56.644827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:56.649645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:56.654501 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c823861-2934-4ec6-b3d7-a4c365e61147 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1593 microversion: 2.42 time: 0.496468 Nov 03 04:03:56.669165 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1458/3016] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:56 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1593 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:56.669165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:56.669165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:56.683138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.683138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.684883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.685788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.688702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.688702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.843210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45421e5f-d9ef-45ee-8e6c-d5f22e8bb1d0 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 204 len: 0 microversion: 2.1 time: 0.554380 Nov 03 04:03:56.844232 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1559/3017] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:03:56 2022] DELETE /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:03:56.852525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:56.853397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:56.865928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.869990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.878025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:56.878025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:56.878025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:56.878025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.088100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:57.104516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-beaf6e5c-cfbe-419b-9506-cd78e9dcb811 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1488 microversion: 2.1 time: 0.447102 Nov 03 04:03:57.105625 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1459/3018] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:56 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1488 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:57.116656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:57.117607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:57.131003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.133201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.133865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.135406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.136034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.136748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.283772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:57.295441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:57.297984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:57.303800 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fee25ba5-0f4d-4286-a1e2-bc2cc1581dcb tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.196929 Nov 03 04:03:57.304771 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1460/3019] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:57 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:57.310338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:57.311175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:57.330010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.330697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.331315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.332196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.333323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.334097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.353548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:57.369897 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d10fbd40-e7d6-413f-ac41-5ca53c1dba90 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.524258 Nov 03 04:03:57.375202 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1560/3020] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:56 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:57.385781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:57.386669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:57.398730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.399326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.399773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.400551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.401024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.401751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.792759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:57.810302 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-26021a5d-78da-4003-85f2-aaaeee886635 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1488 microversion: 2.1 time: 0.436109 Nov 03 04:03:57.830461 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1561/3021] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:57 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1488 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:57.835355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:57.835979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:57.848426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.849149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.849383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.850129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.853804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.854451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.879456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:57.887542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce20dc8a-1595-4b66-b9ad-64c4ebabf55b tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1647 microversion: 2.1 time: 0.581544 Nov 03 04:03:57.888128 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1461/3022] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:57 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1647 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:57.899191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:57.901820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:57.917151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.918129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.918129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.918781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:57.922137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:57.922860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:57.979608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:03:57.986705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:58.177186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=18 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:58.276928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42214a70-3b41-43c2-b6fc-5e0c62b56095 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 204 len: 0 microversion: 2.1 time: 0.384027 Nov 03 04:03:58.278196 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1462/3023] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:03:57 2022] DELETE /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:03:58.294457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:58.305633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:58.317574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.318844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.319459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.320359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.321084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.322254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.484433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:58.503415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:58.504967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:58.506165 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-292f7ecd-9f85-40f6-ab14-241155dd08f2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1593 microversion: 2.42 time: 0.674886 Nov 03 04:03:58.507068 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1562/3024] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:57 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1593 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:58.515601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:58.526711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:58.533403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.534187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.534814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.537192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.537192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.537192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.675941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:58.701938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:58.703469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:58.716497 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf107f97-183b-4635-b361-c90218031739 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.208304 Nov 03 04:03:58.734232 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1563/3025] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:58 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:03:58.737248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:58.746652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:58.747634 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c57e66ab-7351-4f31-a879-d45ef06a945c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1494 microversion: 2.1 time: 0.464625 Nov 03 04:03:58.750200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:58.755596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1463/3026] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:58 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1494 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:58.757986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.758708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.759970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.760937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.761876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.763080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.918373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:58.918999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:58.929591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:58.931705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.932202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.936507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.941431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:58.942681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:58.943155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:58.982418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:03:59.333823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:59.350196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82a42b5a-4969-417b-851f-5c2999e7ad4e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.614620 Nov 03 04:03:59.353937 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1564/3027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:58 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:59.536062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:59.536704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:59.551801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:59.552511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:59.553343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:59.554299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:59.554972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:59.555630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:59.703842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:03:59.711859 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d6469d2-650c-4730-970f-f98a0658b4a8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1647 microversion: 2.1 time: 0.797588 Nov 03 04:03:59.734684 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1464/3028] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:03:58 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1647 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:03:59.748477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:03:59.749334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:03:59.767270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:59.768023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:59.768629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:59.771071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:03:59.771071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:03:59.771071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:03:59.993699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:00.014361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:00.021374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:00.036264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d186c60-d22a-4e52-a698-ae6472313cf7 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.291942 Nov 03 04:04:00.036855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1465/3029] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:59 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:00.054289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:00.055174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:00.061421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:00.062111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:00.069577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:00.069577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:00.069577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:00.069577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:00.252034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:00.271904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:00.275980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:00.280210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3983320c-b574-4b65-a706-b53415bccc54 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1661 microversion: 2.42 time: 0.748234 Nov 03 04:04:00.281245 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1565/3030] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:03:59 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1661 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:00.379440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:00.380978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:00.391555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:00.392067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:00.392564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:00.393448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:00.393926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:00.394682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:00.419296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:00.471977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:00.491572 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9acdf3ff-a72b-4c65-9584-b9dfb33b4c77 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1494 microversion: 2.1 time: 0.453365 Nov 03 04:04:00.514086 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1466/3031] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:00 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1494 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:00.738401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:00.740160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:00.755940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:00.761480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:00.762515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:00.765980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:00.770836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:00.771774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:01.142466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:01.153455 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-70a2743e-1c62-4bac-ac80-8924e2f54144 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 0.777888 Nov 03 04:04:01.173986 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1566/3032] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:00 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:01.181736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:01.182736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:01.190591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:01.191445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:01.192288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:01.193584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:01.194265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:01.194908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:01.470626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:01.488407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:01.491745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:01.505993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a5908d2b-396d-4177-acca-9829f8fa0d51 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.330417 Nov 03 04:04:01.508521 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1567/3033] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:01 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:01.520259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:01.527474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:01.545201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:01.546170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:01.546721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:01.547933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:01.548654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:01.550484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:01.792706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:01.801865 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df0d7f1e-133b-40a2-bac6-7bb41b28de41 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1647 microversion: 2.1 time: 1.069845 Nov 03 04:04:01.809494 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1467/3034] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:00 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1647 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:01.814798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:01.820595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:01.826097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:01.826775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:01.827397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:01.828276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:01.828908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:01.829522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:02.260145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:02.614206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:02.634747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:02.636729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:02.638397 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d6a8d4a-c250-4713-956e-3c3a2cbbc504 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1755 microversion: 2.42 time: 1.123299 Nov 03 04:04:02.639262 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1568/3035] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:01 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1755 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:02.647541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:02.648395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:02.656434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:02.657216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:02.658319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:02.659384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:02.660019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:02.660476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:03.256490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:03.269722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a5f2d0d5-8dd1-413b-aa96-ad07c74630a1 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1494 microversion: 2.1 time: 1.458744 Nov 03 04:04:03.270386 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1468/3036] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:01 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1494 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:03.281554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:03.284471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:03.297830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:03.299311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:03.301109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:03.302596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:03.306586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:03.310248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:03.586086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:03.613263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:03.617788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:03.625597 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba245ad7-d4bb-4acb-b0cf-065761186bbd tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.353555 Nov 03 04:04:03.626544 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1469/3037] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:03 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:03.652216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:03.659870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:03.687594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:03.688346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:03.706126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:03.712842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:03.715481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:03.715946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:03.768659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:03.782202 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75e5bad6-a448-4416-ba9e-c12c47970d95 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1524 microversion: 2.1 time: 1.141715 Nov 03 04:04:03.783570 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1569/3038] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:02 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1524 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:03.801495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5d1722d2-a468-404e-8cb0-0c2b199aa1ae req-b5816c58-15ab-4fdb-b3e2-ed7127c3da82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d8d747-5e33-4edb-a517-7f9542a8f7b4", "name": "network-vif-deleted", "tag": "d04e1cd4-702e-4d7d-9a42-bd43628210b4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:03.814454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5d1722d2-a468-404e-8cb0-0c2b199aa1ae req-b5816c58-15ab-4fdb-b3e2-ed7127c3da82 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:03.815300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5d1722d2-a468-404e-8cb0-0c2b199aa1ae req-b5816c58-15ab-4fdb-b3e2-ed7127c3da82 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:03.816623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5d1722d2-a468-404e-8cb0-0c2b199aa1ae req-b5816c58-15ab-4fdb-b3e2-ed7127c3da82 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:03.855188 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5d1722d2-a468-404e-8cb0-0c2b199aa1ae req-b5816c58-15ab-4fdb-b3e2-ed7127c3da82 service nova] Creating event network-vif-deleted:d04e1cd4-702e-4d7d-9a42-bd43628210b4 for instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 on n-h1-854653-7 Nov 03 04:04:03.865733 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5d1722d2-a468-404e-8cb0-0c2b199aa1ae req-b5816c58-15ab-4fdb-b3e2-ed7127c3da82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080084 Nov 03 04:04:03.871618 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1570/3039] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:03.884851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:03.885745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:03.895839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:03.896439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:03.897083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:03.898113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:03.898461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:03.900061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.384894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.397531 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df662441-4a34-4790-8012-815c353538e9 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1647 microversion: 2.1 time: 0.759743 Nov 03 04:04:04.398994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1470/3040] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:03 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1647 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:04.431571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:04.434067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:04.441130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:04.441698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:04.442155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.443071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:04.443915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:04.444513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.490964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.509505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:04.509869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.511872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.514561 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc2b88ab-9c6d-4b5a-a392-e59a03c5f0df tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1802 microversion: 2.42 time: 0.637679 Nov 03 04:04:04.515912 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1571/3041] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:03 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1802 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:04.523263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:04.525613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.525613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lazy-loading 'fault' on Instance uuid a8d8d747-5e33-4edb-a517-7f9542a8f7b4 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:04.576753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.588862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93a8b5cd-1524-466b-bd58-4b55286fad2e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 200 len: 1310 microversion: 2.1 time: 0.188715 Nov 03 04:04:04.589505 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1471/3042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:04 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:04.655786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:04.656403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:04.668259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:04.669363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:04.669972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.671112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:04.673509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:04.675348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.808542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:04.809370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:04.820885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:04.827780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:04.828069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.829936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:04.835051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:04.835721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:04.884515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.919084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.944345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:04.955617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bb6b914-e7aa-45d3-9568-3fa6e119b0e3 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.303951 Nov 03 04:04:04.958108 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1572/3043] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:04 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:05.282761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:05.292364 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fddccd41-d9b4-4e24-8f7b-c6cbe9d676fe tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1504 microversion: 2.1 time: 0.488829 Nov 03 04:04:05.327315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e9f6c3c-23e0-410a-9193-bba2fbc15cd0 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'create', calling method: .version_select at 0x7ff7f87cb940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-251052545", "description": "tempest-description-271070662"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:05.329182 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1472/3044] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:04 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:05.427516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:05.428847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:05.437180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:05.437999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:05.438811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:05.439788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:05.440459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:05.441166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:05.485762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:05.486771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:05.487450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:05.487980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lazy-loading 'fault' on Instance uuid 1c245744-2606-41a5-95fb-ac3491d55d4f {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:05.545895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:05.558292 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-228a9737-1ea0-4ff1-acdf-b1a872b25e67 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 200 len: 1305 microversion: 2.1 time: 0.135135 Nov 03 04:04:05.562381 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1473/3045] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:05 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:05.569494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:05.570725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:05.590839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:05.591767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:05.592395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:05.593319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:05.593929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:05.594516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:05.911826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:05.927492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:05.932701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:05.936144 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1b72182a-cd67-413b-ab07-b6ae9aecfa46 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1849 microversion: 2.42 time: 0.370407 Nov 03 04:04:05.936144 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1474/3046] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:05 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1849 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:05.957202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:05.958143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:05.979521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:05.987515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:05.988298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:05.989292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:05.989930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:05.990536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.026551 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 HTTP/1.1 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a8d8d747-5e33-4edb-a517-7f9542a8f7b4'} Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:06.042165 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-654d16d2-4419-4eae-8f4b-b4b2867c16dd tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 404 len: 111 microversion: 2.1 time: 0.110372 Nov 03 04:04:06.051145 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1475/3047] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:05 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:06.190260 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e9f6c3c-23e0-410a-9193-bba2fbc15cd0 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.866375 Nov 03 04:04:06.199988 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1573/3048] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:04:05 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:04:06.199988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e6dfcb44-cdea-4d96-a9f4-bf84a0488a33 req-4adee453-4f07-4080-9436-2b551b3000ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c245744-2606-41a5-95fb-ac3491d55d4f", "name": "network-vif-deleted", "tag": "056f57ba-86b8-418c-bc90-75bf359e2fa9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:06.226954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e6dfcb44-cdea-4d96-a9f4-bf84a0488a33 req-4adee453-4f07-4080-9436-2b551b3000ec service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.227802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e6dfcb44-cdea-4d96-a9f4-bf84a0488a33 req-4adee453-4f07-4080-9436-2b551b3000ec service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.228270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e6dfcb44-cdea-4d96-a9f4-bf84a0488a33 req-4adee453-4f07-4080-9436-2b551b3000ec service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.272786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e6dfcb44-cdea-4d96-a9f4-bf84a0488a33 req-4adee453-4f07-4080-9436-2b551b3000ec service nova] Creating event network-vif-deleted:056f57ba-86b8-418c-bc90-75bf359e2fa9 for instance 1c245744-2606-41a5-95fb-ac3491d55d4f on n-h1-854653-7 Nov 03 04:04:06.273148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-234910795", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": "none"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:06.289378 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e6dfcb44-cdea-4d96-a9f4-bf84a0488a33 req-4adee453-4f07-4080-9436-2b551b3000ec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095154 Nov 03 04:04:06.300739 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1574/3049] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:06.310998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:06.311733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:06.325433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.325937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.326381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.327101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.332846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.333860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.355783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:04:06.356555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:04:06.357003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:04:06.357502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:04:06.364691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:04:06.379349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.379847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.380286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.381040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.389551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.390756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.448905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Getting quotas for project 0af5e9d9f99f42189ae521de705566c1. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:04:06.460012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Getting quotas for user 71b92ee969c14ea2ba015ed3381062aa and project 0af5e9d9f99f42189ae521de705566c1. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:04:06.489427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:06.492345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:06.492936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:04:06.498950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:04:06.507379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:06.514168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:06.524830 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a193cb38-dc7a-42c9-aff4-e1677afd0d7d tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.226060 Nov 03 04:04:06.529456 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1575/3050] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:06 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:06.540940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:06.541880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:06.555319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.556980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.561169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.562193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.562843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.565435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.598013 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 HTTP/1.1 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a8d8d747-5e33-4edb-a517-7f9542a8f7b4'} Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:06.604741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:06.608906 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.614341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:06.615589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d44995cd-54fd-4664-8144-654d12e9bc65 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 404 len: 111 microversion: 2.1 time: 0.084991 Nov 03 04:04:06.619451 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1576/3051] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:06 2022] DELETE /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:06.624659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-251052545"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:06.625475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:06.644783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.657699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.658347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.659218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.659793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.660340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.712811 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c9f8f2aa-c617-47c1-88d9-cbd5f16f85c7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.658494 Nov 03 04:04:06.717877 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1476/3052] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:04:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:04:06.734932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-cc0f84c1-511c-495e-9d9b-2ad141d52146 req-a5e3a100-62e1-4e2b-8938-835f38474236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "62e1cfcf-1c83-430f-9fd5-f159a52d8e46"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:06.768966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc0f84c1-511c-495e-9d9b-2ad141d52146 req-a5e3a100-62e1-4e2b-8938-835f38474236 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.770417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc0f84c1-511c-495e-9d9b-2ad141d52146 req-a5e3a100-62e1-4e2b-8938-835f38474236 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.772054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc0f84c1-511c-495e-9d9b-2ad141d52146 req-a5e3a100-62e1-4e2b-8938-835f38474236 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.794766 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-cc0f84c1-511c-495e-9d9b-2ad141d52146 req-a5e3a100-62e1-4e2b-8938-835f38474236 service nova] Creating event network-changed:62e1cfcf-1c83-430f-9fd5-f159a52d8e46 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:06.813447 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-cc0f84c1-511c-495e-9d9b-2ad141d52146 req-a5e3a100-62e1-4e2b-8938-835f38474236 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092036 Nov 03 04:04:06.814111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1477/3053] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:06.819388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:06.830348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:06.838390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.839096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.840985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.841997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.851355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.852017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.890560 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f HTTP/1.1 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1c245744-2606-41a5-95fb-ac3491d55d4f'} Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:06.900833 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.906995 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:06.906995 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:06.906995 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:06.906995 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:06.906995 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:06.906995 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:06.906995 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:06.909680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:06.915533 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20a90f6d-f04a-410f-9ba3-5c8b270ee59f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 404 len: 111 microversion: 2.1 time: 0.098797 Nov 03 04:04:06.918134 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1478/3054] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:06 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:06.935417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:06.940864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: a8d8d747-5e33-4edb-a517-7f9542a8f7b4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:06.962436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.963448 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.security_group_api [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Adding security group 2c5da284-e680-4430-9820-ccc2f0779130 to port e84aad67-49e8-4efe-8566-d24ab57903bc Nov 03 04:04:06.964135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.966191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:06.967590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:06.971303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:06.972154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:07.008352 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 HTTP/1.1 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a8d8d747-5e33-4edb-a517-7f9542a8f7b4'} Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:07.011646 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:07.016330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:07.016330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:07.016330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:07.016330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:07.016330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:07.016330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. Nov 03 04:04:07.016330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:07.018990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance a8d8d747-5e33-4edb-a517-7f9542a8f7b4 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:07.020223 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89db8a16-17a5-40fd-8dd8-17b6ec7927b6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4" status: 404 len: 111 microversion: 2.1 time: 0.100493 Nov 03 04:04:07.021970 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1479/3055] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:06 2022] GET /compute/v2.1/servers/a8d8d747-5e33-4edb-a517-7f9542a8f7b4 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:07.029889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f72f60be-fb3e-49bf-9605-cc22218485b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:07.031093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f72f60be-fb3e-49bf-9605-cc22218485b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:07.164249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f72f60be-fb3e-49bf-9605-cc22218485b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:07.175366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f72f60be-fb3e-49bf-9605-cc22218485b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:07.180496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f72f60be-fb3e-49bf-9605-cc22218485b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:07.181770 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f72f60be-fb3e-49bf-9605-cc22218485b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b" status: 200 len: 1277 microversion: 2.47 time: 0.156949 Nov 03 04:04:07.182340 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1480/3056] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:07 2022] GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:07.192699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c9d104a-f06d-4e4e-9248-c07b8e0429c4 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8b4d0d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:08.080670 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f8920c2-a5c1-4635-86ae-f45efe5551a5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action" status: 202 len: 0 microversion: 2.1 time: 1.457388 Nov 03 04:04:08.082886 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1577/3057] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:04:06 2022] POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action => generated 0 bytes in 1463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:08.095226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:08.101085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:08.114546 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c9d104a-f06d-4e4e-9248-c07b8e0429c4 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72" status: 202 len: 0 microversion: 2.1 time: 0.926291 Nov 03 04:04:08.116043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1481/3058] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:07 2022] DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72 => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:08.121748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:08.124130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:08.135551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.136330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.139325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:08.140623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.141131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.143675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.144176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.144620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:08.144737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:08.145373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.145829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.146269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:08.190922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 HTTP/1.1 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '50411c90-335b-499c-b7e2-24e5686bb4b0'} Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:08.193564 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5bbb253-c967-48b7-b6e5-bd857ce1bc95 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 404 len: 111 microversion: 2.1 time: 0.078427 Nov 03 04:04:08.203034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1482/3059] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:08 2022] DELETE /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:08.210461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-83189577", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": "none"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:08.367938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:04:08.368824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:04:08.369574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:04:08.376613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:04:08.377684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:04:08.399168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.400516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.401162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:08.407190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.408066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.408665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:08.443024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:08.475171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Getting quotas for project 0af5e9d9f99f42189ae521de705566c1. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:04:08.485104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Getting quotas for user 71b92ee969c14ea2ba015ed3381062aa and project 0af5e9d9f99f42189ae521de705566c1. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:04:08.573173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:04:08.575665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:04:08.814983 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-edd10f64-5991-4822-afc8-d78ceca53f5b tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.613758 Nov 03 04:04:08.836298 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1483/3060] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:04:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:04:08.858224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:08.860832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:08.886640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.888846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.890168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:08.892125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:08.892881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:08.894642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:09.134133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:09.150306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:09.157263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:09.171263 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-291ebe85-bf27-4a40-8db3-24ba4bbc84d1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.333133 Nov 03 04:04:09.171849 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1484/3061] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:08 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:09.191609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-251052545"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:09.192098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:09.205907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:09.206407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:09.209079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:09.221563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:09.222439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:09.223069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:09.691236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.network.security_group_api [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Removing security group 2c5da284-e680-4430-9820-ccc2f0779130 from port e84aad67-49e8-4efe-8566-d24ab57903bc Nov 03 04:04:10.164388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:10.177482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:10.179173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:10.181686 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2b7b5f61-b403-4ee3-b26a-9126874a4216 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1870 microversion: 2.42 time: 2.096018 Nov 03 04:04:10.189153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1578/3062] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:08 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1870 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:10.189153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a9a605c7-1ae2-49bf-ab2b-dbdabf85f26f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f87874c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:10.665047 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52bc95c0-37d7-4ce2-8436-a63e14b93993 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action" status: 202 len: 0 microversion: 2.1 time: 1.490445 Nov 03 04:04:10.670192 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1485/3063] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:04:09 2022] POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action => generated 0 bytes in 1497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:10.675264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:10.675895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 50411c90-335b-499c-b7e2-24e5686bb4b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:10.703601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.704139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.704617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:10.705311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.705774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.706205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:10.731362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 HTTP/1.1 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '50411c90-335b-499c-b7e2-24e5686bb4b0'} Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:10.744258 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:10.748435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:10.748435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:10.748435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:10.748435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:10.748435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:10.748435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. Nov 03 04:04:10.748435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:10.757790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 50411c90-335b-499c-b7e2-24e5686bb4b0 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:10.758952 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-221d6705-920e-4cc4-be0b-3d1518edf062 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0" status: 404 len: 111 microversion: 2.1 time: 0.087474 Nov 03 04:04:10.760203 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1486/3064] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:10 2022] GET /compute/v2.1/servers/50411c90-335b-499c-b7e2-24e5686bb4b0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:10.767077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9ddfced4-c606-40b2-b0f7-e2cc66fc65b1 req-1ea92272-0981-47da-8990-a976d77dc64c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855c9583-d48b-4c48-b59c-8a4096494b67", "tag": "e84aad67-49e8-4efe-8566-d24ab57903bc"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:10.795459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9ddfced4-c606-40b2-b0f7-e2cc66fc65b1 req-1ea92272-0981-47da-8990-a976d77dc64c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.797058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9ddfced4-c606-40b2-b0f7-e2cc66fc65b1 req-1ea92272-0981-47da-8990-a976d77dc64c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.797892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9ddfced4-c606-40b2-b0f7-e2cc66fc65b1 req-1ea92272-0981-47da-8990-a976d77dc64c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:10.826755 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9ddfced4-c606-40b2-b0f7-e2cc66fc65b1 req-1ea92272-0981-47da-8990-a976d77dc64c service nova] Creating event network-changed:e84aad67-49e8-4efe-8566-d24ab57903bc for instance 855c9583-d48b-4c48-b59c-8a4096494b67 on n-h1-854653-7 Nov 03 04:04:10.834873 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9ddfced4-c606-40b2-b0f7-e2cc66fc65b1 req-1ea92272-0981-47da-8990-a976d77dc64c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072957 Nov 03 04:04:10.848436 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1487/3065] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:10.856642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:10.861973 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a9a605c7-1ae2-49bf-ab2b-dbdabf85f26f tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644" status: 202 len: 0 microversion: 2.1 time: 0.677911 Nov 03 04:04:10.862568 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1579/3066] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:10 2022] DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:10.863855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:10.883543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b95b54d7-8d9a-4aa8-8f7e-da8d7b30aa3c req-29df66e4-1372-4af0-ba29-7d08fee3971d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "003860eb-1280-48b6-9513-ea8500694f1b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:10.898322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b95b54d7-8d9a-4aa8-8f7e-da8d7b30aa3c req-29df66e4-1372-4af0-ba29-7d08fee3971d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.899827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b95b54d7-8d9a-4aa8-8f7e-da8d7b30aa3c req-29df66e4-1372-4af0-ba29-7d08fee3971d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.900786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b95b54d7-8d9a-4aa8-8f7e-da8d7b30aa3c req-29df66e4-1372-4af0-ba29-7d08fee3971d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:10.919344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.921723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.922499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:10.923984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.933662 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b95b54d7-8d9a-4aa8-8f7e-da8d7b30aa3c req-29df66e4-1372-4af0-ba29-7d08fee3971d service nova] Creating event network-changed:003860eb-1280-48b6-9513-ea8500694f1b for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:10.945536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.946457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:10.953806 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b95b54d7-8d9a-4aa8-8f7e-da8d7b30aa3c req-29df66e4-1372-4af0-ba29-7d08fee3971d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083559 Nov 03 04:04:10.955401 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1580/3067] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:10.970083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:10.972161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:10.992089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.994177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.994802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:10.995710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:10.996349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:10.996975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:11.050537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e99be4c0-461e-4c57-b46c-06fba10881ca tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "PUT /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 990 microversion: 2.47 time: 0.208460 Nov 03 04:04:11.063311 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1488/3068] 10.222.0.30 () {62 vars in 1297 bytes} [Thu Nov 3 04:04:10 2022] PUT /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 990 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:04:11.074318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b06c5aaa-eb46-4f83-9104-844e53bb8154 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'create', calling method: .version_select at 0x7ff7f89ce3a0>, body: {"pool": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:11.173686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:11.193537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:11.195295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:11.211037 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4588d81b-f339-406f-857a-895404f75fe8 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.254211 Nov 03 04:04:11.212452 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1581/3069] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:10 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:11.234161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:11.234670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:11.266765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:11.267307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:11.267754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:11.268507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:11.268959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:11.269585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:11.299273 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 HTTP/1.1 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4c26a321-3d19-44d6-bb6e-c842c452d1f4'} Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:11.304444 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:11.308815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:11.312231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:11.313359 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fba5bed7-f779-4ddd-9074-70e337408914 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 404 len: 111 microversion: 2.1 time: 0.096694 Nov 03 04:04:11.317935 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1582/3070] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:11 2022] DELETE /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:11.329443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ced7baa-c7d5-4d61-8ccf-6c68518988b8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'create', calling method: .version_select at 0x7ff7f882e940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-868326223", "description": "tempest-description-1210183195"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:12.013335 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ced7baa-c7d5-4d61-8ccf-6c68518988b8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.693777 Nov 03 04:04:12.014493 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1583/3071] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:04:11 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:12.020441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:12.021246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:12.036411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:12.037893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:12.040586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:12.041706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:12.043067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:12.044749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:12.153276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:12.164784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:12.166581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:12.167995 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71d943d8-e0c1-42f0-b791-f9e450c53c66 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1272 microversion: 2.47 time: 0.152467 Nov 03 04:04:12.181719 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1584/3072] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:12 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:12.193837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:12.195051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:12.202503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:12.203361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:12.204136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:12.205094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:12.205789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:12.206936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:12.502776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:12.517593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:12.519638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:12.521517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1cee25d0-8169-4e9f-9c71-6b10ddb65421 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1891 microversion: 2.42 time: 0.337789 Nov 03 04:04:12.534278 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1585/3073] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:12 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1891 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:12.549438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:12.550095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 4c26a321-3d19-44d6-bb6e-c842c452d1f4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:12.559753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:12.561427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:12.562118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:12.563156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:12.563836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:12.564463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:12.604204 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 HTTP/1.1 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4c26a321-3d19-44d6-bb6e-c842c452d1f4'} Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:12.607997 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 4c26a321-3d19-44d6-bb6e-c842c452d1f4 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf7856a7-17ae-4922-8678-c904eb181e70 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4" status: 404 len: 111 microversion: 2.1 time: 0.073178 Nov 03 04:04:12.615340 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1586/3074] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:12 2022] GET /compute/v2.1/servers/4c26a321-3d19-44d6-bb6e-c842c452d1f4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:12.618756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87654320-48c5-4c55-801c-8fcb87c88729 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Action: 'update', calling method: .version_select at 0x7ff7f882e0d0>, body: {"security_group": {"name": "tempest-sg-hth-1082385731", "description": "tempest-description-hth-20468309"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:13.229597 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87654320-48c5-4c55-801c-8fcb87c88729 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/22616a0d-5122-4cb9-b5bb-622831aee64a" status: 200 len: 216 microversion: 2.1 time: 0.614102 Nov 03 04:04:13.231608 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1587/3075] 10.222.0.30 () {60 vars in 1290 bytes} [Thu Nov 3 04:04:12 2022] PUT /compute/v2.1/os-security-groups/22616a0d-5122-4cb9-b5bb-622831aee64a => generated 216 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:13.329801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-623b52d7-a96b-47c5-8a77-061582c184c5 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Action: 'create', calling method: .version_select at 0x7ff7f8781c10>, body: {"pool": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:15.043797 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b06c5aaa-eb46-4f83-9104-844e53bb8154 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.978084 Nov 03 04:04:15.052005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1489/3076] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 04:04:11 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:15.052005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:15.052005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:15.060254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.061605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.062167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.063000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.064363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.064909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.167306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:15.183329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:15.185328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:15.199670 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e091d80-8779-4081-9521-1a1f9f0dade1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.153255 Nov 03 04:04:15.200280 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1490/3077] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:15 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:15.211942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:15.212460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:15.220271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.221051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.221481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.222241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.222833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.223135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.248169 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 HTTP/1.1 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '3177696f-f3bd-4b41-bc6f-56a7fc3d94e2'} Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:15.257099 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abd8f811-a25c-4164-a0e2-9c69aed5063e tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 404 len: 111 microversion: 2.1 time: 0.060849 Nov 03 04:04:15.270407 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1491/3078] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:15 2022] DELETE /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:15.272579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-dc3ac235-fc75-46c3-af4c-9325e7844f40 req-f2bbff1a-1856-4959-a05c-655e8bd9ff5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855c9583-d48b-4c48-b59c-8a4096494b67", "tag": "e84aad67-49e8-4efe-8566-d24ab57903bc"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:15.296050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dc3ac235-fc75-46c3-af4c-9325e7844f40 req-f2bbff1a-1856-4959-a05c-655e8bd9ff5e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.296545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dc3ac235-fc75-46c3-af4c-9325e7844f40 req-f2bbff1a-1856-4959-a05c-655e8bd9ff5e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.296997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dc3ac235-fc75-46c3-af4c-9325e7844f40 req-f2bbff1a-1856-4959-a05c-655e8bd9ff5e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.338920 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-dc3ac235-fc75-46c3-af4c-9325e7844f40 req-f2bbff1a-1856-4959-a05c-655e8bd9ff5e service nova] Creating event network-changed:e84aad67-49e8-4efe-8566-d24ab57903bc for instance 855c9583-d48b-4c48-b59c-8a4096494b67 on n-h1-854653-7 Nov 03 04:04:15.349853 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-dc3ac235-fc75-46c3-af4c-9325e7844f40 req-f2bbff1a-1856-4959-a05c-655e8bd9ff5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082510 Nov 03 04:04:15.351282 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1492/3079] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:15.359379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "72a0b145-87de-4be0-9f7f-ac127448f825"}, {"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "eedff35b-d301-494c-bd23-ff6295754bea"}, {"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "d57f7b42-2265-4a50-9d27-23ee5674ab49"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:15.377782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.378706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.379520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.408540 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] Creating event network-changed:72a0b145-87de-4be0-9f7f-ac127448f825 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:15.412079 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] Creating event network-changed:eedff35b-d301-494c-bd23-ff6295754bea for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:15.412927 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] Creating event network-changed:d57f7b42-2265-4a50-9d27-23ee5674ab49 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:15.425092 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c675693e-b2da-4f7d-aa4d-0db4ff35b4e3 req-874a55e6-ee28-4ad4-bd18-dd6b3f110db0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.072048 Nov 03 04:04:15.427124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1493/3080] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:15.442836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:15.447323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:15.465953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.466745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.468358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.470671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.471413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.473389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.609158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:15.624337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:15.628745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:15.631833 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1974dd14-9b65-47be-9d40-7662bead29c6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1334 microversion: 2.47 time: 0.200183 Nov 03 04:04:15.632504 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1494/3081] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:15 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1334 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:15.645226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a65c820e-2874-42da-bf46-5d722a82da50 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f89cee50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:15.880220 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a65c820e-2874-42da-bf46-5d722a82da50 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/22616a0d-5122-4cb9-b5bb-622831aee64a" status: 200 len: 216 microversion: 2.1 time: 0.246641 Nov 03 04:04:15.889713 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1495/3082] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:04:15 2022] GET /compute/v2.1/os-security-groups/22616a0d-5122-4cb9-b5bb-622831aee64a => generated 216 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:15.922030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:15.924392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:15.936133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.939066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.939507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:15.940246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:15.940716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:15.941173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:16.229169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:16.239420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:16.241108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:16.242316 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-117db515-79fb-4244-861b-888b5af918cf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1891 microversion: 2.42 time: 0.351094 Nov 03 04:04:16.261040 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1496/3083] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:15 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1891 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:16.261040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.8.68"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:16.261040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:16.263846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:16.264963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:16.265501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:16.266249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:16.266713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:16.267143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:16.303615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "refresh_cache-855c9583-d48b-4c48-b59c-8a4096494b67" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 04:04:16.304021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquired lock "refresh_cache-855c9583-d48b-4c48-b59c-8a4096494b67" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 04:04:16.584146 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-623b52d7-a96b-47c5-8a77-061582c184c5 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.349791 Nov 03 04:04:16.585904 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1588/3084] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 04:04:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:16.592479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:16.593470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:16.604639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:16.606130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:16.607787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:16.608745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:16.610001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:16.611052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:16.635215 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 HTTP/1.1 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '3177696f-f3bd-4b41-bc6f-56a7fc3d94e2'} Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:16.636794 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:16.640601 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-88d99db9-65f8-4b99-b429-98e665571f56 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2" status: 404 len: 111 microversion: 2.1 time: 0.052349 Nov 03 04:04:16.643367 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1589/3085] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:16 2022] GET /compute/v2.1/servers/3177696f-f3bd-4b41-bc6f-56a7fc3d94e2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:16.648525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1da302b-2555-4106-9ded-e60f197ad9cd tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f87fc550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:17.204840 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1da302b-2555-4106-9ded-e60f197ad9cd tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/22616a0d-5122-4cb9-b5bb-622831aee64a" status: 202 len: 0 microversion: 2.1 time: 0.559796 Nov 03 04:04:17.210908 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1590/3086] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:16 2022] DELETE /compute/v2.1/os-security-groups/22616a0d-5122-4cb9-b5bb-622831aee64a => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:17.222907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:17.226569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:17.239059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:17.239749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:17.241471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:17.243188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:17.243954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:17.245379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:17.324535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:17.340462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:17.346601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:17.362865 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-afc114e2-a234-4382-be70-2ea4eea4ffb2 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.149454 Nov 03 04:04:17.366251 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1591/3087] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:17 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:17.383105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c510068d-bfa9-4ac0-afc7-ab6f8f059362 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Action: 'create', calling method: .version_select at 0x7ff7f879b820>, body: {"pool": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:18.441359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:18.556065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:18.880272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Building network info cache for instance {{(pid=127593) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 04:04:19.900139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Updating instance_info_cache with network_info: [{"id": "e84aad67-49e8-4efe-8566-d24ab57903bc", "address": "fa:16:3e:e1:8c:25", "network": {"id": "07bf4346-3dcb-476a-95fa-07d33215036b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-728743220-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.8.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "07fb4ed51df846749adb393bcff2d621", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape84aad67-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127593) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 04:04:19.910899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Releasing lock "refresh_cache-855c9583-d48b-4c48-b59c-8a4096494b67" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 04:04:19.915068 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82f7750a-8c81-4c3a-a64f-39b0586ac67e tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action" status: 202 len: 0 microversion: 2.1 time: 3.666414 Nov 03 04:04:19.915068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1497/3088] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:04:16 2022] POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action => generated 0 bytes in 3667 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 04:04:19.922150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:19.922674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:19.930312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:19.931019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:19.931523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:19.932244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:19.932704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:19.933343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:19.952788 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a HTTP/1.1 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e8f150d9-b90b-47b7-b37a-ea408fb5ca3a'} Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:19.954585 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2ee52bc-7ffc-48ea-ad50-64a1c5d51c9c tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 404 len: 111 microversion: 2.1 time: 0.042689 Nov 03 04:04:19.958802 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1498/3089] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:19 2022] DELETE /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:19.967966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:19.968600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:19.975645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:19.976190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:19.977631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:19.978483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:19.979379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:19.979379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.067833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.101700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.104062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.105826 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c022660-c449-4ad5-ae53-a423c4534710 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1355 microversion: 2.47 time: 0.148175 Nov 03 04:04:20.106678 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1499/3090] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:19 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1355 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:20.111716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:20.112430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.119687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.120397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.121496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.121730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.122189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.122612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.138309 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f HTTP/1.1 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1c245744-2606-41a5-95fb-ac3491d55d4f'} Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:20.146454 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-353e0b7b-c9e1-4ece-bd23-6fd177dbaa57 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 404 len: 111 microversion: 2.1 time: 0.034082 Nov 03 04:04:20.150993 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1500/3091] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:20 2022] DELETE /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:20.153234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:20.154069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.160980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.161748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.162387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.163351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.164036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.164775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.454842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.464956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.466588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.467869 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e587046-a2c4-4577-98c6-b6467481e2c2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1891 microversion: 2.42 time: 0.324610 Nov 03 04:04:20.468509 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1501/3092] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:20 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1891 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:20.473513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2faca32d-cc4b-432f-a2f6-c8c78cbcc574 req-499feffb-5063-4340-a797-d1836e3b0e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "d8cd675f-fa80-4884-90b6-51a8b0db55fe"}, {"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "e2124eb9-5b67-4fcf-b22c-8fd60bdb7205"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:20.484075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2faca32d-cc4b-432f-a2f6-c8c78cbcc574 req-499feffb-5063-4340-a797-d1836e3b0e89 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.484608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2faca32d-cc4b-432f-a2f6-c8c78cbcc574 req-499feffb-5063-4340-a797-d1836e3b0e89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.485062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2faca32d-cc4b-432f-a2f6-c8c78cbcc574 req-499feffb-5063-4340-a797-d1836e3b0e89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.497070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2faca32d-cc4b-432f-a2f6-c8c78cbcc574 req-499feffb-5063-4340-a797-d1836e3b0e89 service nova] Creating event network-changed:d8cd675f-fa80-4884-90b6-51a8b0db55fe for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:20.502275 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2faca32d-cc4b-432f-a2f6-c8c78cbcc574 req-499feffb-5063-4340-a797-d1836e3b0e89 service nova] Creating event network-changed:e2124eb9-5b67-4fcf-b22c-8fd60bdb7205 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:20.503266 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2faca32d-cc4b-432f-a2f6-c8c78cbcc574 req-499feffb-5063-4340-a797-d1836e3b0e89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033454 Nov 03 04:04:20.503868 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1502/3093] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:20.509519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:20.510221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.516302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.516791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.517268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.518076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.518580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.519017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.580820 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c510068d-bfa9-4ac0-afc7-ab6f8f059362 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.212863 Nov 03 04:04:20.582532 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1592/3094] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 04:04:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:20.592917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6b23bc39-2a08-4305-ba00-d7d44d97f10f req-da724145-9616-4598-a693-d62ca1110f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855c9583-d48b-4c48-b59c-8a4096494b67", "tag": "e84aad67-49e8-4efe-8566-d24ab57903bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:20.598117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.603391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b23bc39-2a08-4305-ba00-d7d44d97f10f req-da724145-9616-4598-a693-d62ca1110f15 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.603866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b23bc39-2a08-4305-ba00-d7d44d97f10f req-da724145-9616-4598-a693-d62ca1110f15 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.604304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b23bc39-2a08-4305-ba00-d7d44d97f10f req-da724145-9616-4598-a693-d62ca1110f15 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.607732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.609465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:20.615206 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b429ed54-633e-405b-a1ee-0b4185f79379 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1446 microversion: 2.75 time: 0.110010 Nov 03 04:04:20.615821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1503/3095] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:20 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1446 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:20.616011 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6b23bc39-2a08-4305-ba00-d7d44d97f10f req-da724145-9616-4598-a693-d62ca1110f15 service nova] Creating event network-changed:e84aad67-49e8-4efe-8566-d24ab57903bc for instance 855c9583-d48b-4c48-b59c-8a4096494b67 on n-h1-854653-7 Nov 03 04:04:20.621771 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6b23bc39-2a08-4305-ba00-d7d44d97f10f req-da724145-9616-4598-a693-d62ca1110f15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038536 Nov 03 04:04:20.622448 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1593/3096] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:20.622634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.8.68"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:20.627825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:20.628804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: e8f150d9-b90b-47b7-b37a-ea408fb5ca3a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.645063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.651507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.651507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.651507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.651507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.651507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.662324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a HTTP/1.1 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e8f150d9-b90b-47b7-b37a-ea408fb5ca3a'} Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:20.664036 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance e8f150d9-b90b-47b7-b37a-ea408fb5ca3a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb339dcf-ddcb-435e-8e6a-b56c787c3e21 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a" status: 404 len: 111 microversion: 2.1 time: 0.042386 Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1594/3097] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:20 2022] GET /compute/v2.1/servers/e8f150d9-b90b-47b7-b37a-ea408fb5ca3a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:20.672678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:20.675533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.676340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:20.681104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.681616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.682054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.682766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.683214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.683635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.769368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:04:20.771731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:04:20.771731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:04:20.771731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:04:20.771731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:04:20.794816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:20.850394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.859642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.860222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.861079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.863470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.863470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.863470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.924873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.932679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.933543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.934146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.935138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.935994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.936655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.971517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03db11ac-eadf-49e6-9a3f-dfdd02f88b33 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "POST /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a/action" status: 202 len: 1077 microversion: 2.47 time: 0.303364 Nov 03 04:04:20.972139 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1595/3098] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:04:20 2022] POST /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a/action => generated 1077 bytes in 305 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 03 04:04:20.977694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:20.978549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: 1c245744-2606-41a5-95fb-ac3491d55d4f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:20.985836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.986699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.987347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:20.988387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:20.989210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:20.989858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:21.009111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f HTTP/1.1 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '1c245744-2606-41a5-95fb-ac3491d55d4f'} Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:21.012129 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Instance 1c245744-2606-41a5-95fb-ac3491d55d4f could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:21.017143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a97e4519-3fbe-4790-b1ca-72d0a691b21c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f" status: 404 len: 111 microversion: 2.1 time: 0.040097 Nov 03 04:04:21.021099 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1596/3099] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:20 2022] GET /compute/v2.1/servers/1c245744-2606-41a5-95fb-ac3491d55d4f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:21.022040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd49cf95-92ec-49dc-9396-8f24108a3a93 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Action: 'create', calling method: .version_select at 0x7ff7f87e2940>, body: {"pool": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:21.322538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "refresh_cache-855c9583-d48b-4c48-b59c-8a4096494b67" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 03 04:04:21.328575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquired lock "refresh_cache-855c9583-d48b-4c48-b59c-8a4096494b67" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 03 04:04:22.857291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Building network info cache for instance {{(pid=127593) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Nov 03 04:04:23.689999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Updating instance_info_cache with network_info: [{"id": "e84aad67-49e8-4efe-8566-d24ab57903bc", "address": "fa:16:3e:e1:8c:25", "network": {"id": "07bf4346-3dcb-476a-95fa-07d33215036b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-728743220-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "07fb4ed51df846749adb393bcff2d621", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape84aad67-49", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=127593) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 04:04:23.806790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Releasing lock "refresh_cache-855c9583-d48b-4c48-b59c-8a4096494b67" {{(pid=127593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 03 04:04:23.807697 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-58e6a6a6-a3c8-442d-a00f-22095fc0743f tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action" status: 202 len: 0 microversion: 2.1 time: 3.190549 Nov 03 04:04:23.809067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1504/3100] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:04:20 2022] POST /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67/action => generated 0 bytes in 3192 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Nov 03 04:04:23.809936 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd49cf95-92ec-49dc-9396-8f24108a3a93 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.791578 Nov 03 04:04:23.815910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:23.816476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:23.820536 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1597/3101] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 04:04:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:23.823113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:23.823609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.824068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:23.824193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.824516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:23.828465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.828988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.829471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:23.832433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.833075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.833655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:23.834470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.835164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.835814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:23.843885 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 HTTP/1.1 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f59785d6-020a-45d0-ae18-48edbc2fc755'} Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:23.845835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da72c56e-9993-41ff-9aee-4dbaa7bc9b29 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 404 len: 111 microversion: 2.1 time: 0.037095 Nov 03 04:04:23.855063 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1505/3102] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:23 2022] DELETE /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:23.859439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-358efbd8-e592-4a72-920f-a63691791041 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f89f7b80>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-358efbd8-e592-4a72-920f-a63691791041 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 00383959-dd44-4e96-b400-219c62995644 does not exist", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.security_group_api [None req-358efbd8-e592-4a72-920f-a63691791041 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group 00383959-dd44-4e96-b400-219c62995644 not found {{(pid=127593) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-358efbd8-e592-4a72-920f-a63691791041 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group 00383959-dd44-4e96-b400-219c62995644 does not exist Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-66165f94-5779-48ea-af6e-40293e989f97'] Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-358efbd8-e592-4a72-920f-a63691791041 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644 HTTP/1.1 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group 00383959-dd44-4e96-b400-219c62995644 does not exist Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-66165f94-5779-48ea-af6e-40293e989f97'] Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '00383959-dd44-4e96-b400-219c62995644'} Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:04:23.901049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 00383959-dd44-4e96-b400-219c62995644 does not exist Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66165f94-5779-48ea-af6e-40293e989f97'] Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 00383959-dd44-4e96-b400-219c62995644 does not exist Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66165f94-5779-48ea-af6e-40293e989f97'] Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 00383959-dd44-4e96-b400-219c62995644 does not exist Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66165f94-5779-48ea-af6e-40293e989f97'] Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 00383959-dd44-4e96-b400-219c62995644 does not exist Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-66165f94-5779-48ea-af6e-40293e989f97'] Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-358efbd8-e592-4a72-920f-a63691791041 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group 00383959-dd44-4e96-b400-219c62995644 does not exist Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-66165f94-5779-48ea-af6e-40293e989f97'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-358efbd8-e592-4a72-920f-a63691791041 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644" status: 404 len: 194 microversion: 2.1 time: 0.051126 Nov 03 04:04:23.907844 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1506/3103] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:23 2022] DELETE /compute/v2.1/os-security-groups/00383959-dd44-4e96-b400-219c62995644 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:23.913981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:23.913981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:23.914836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:23.915757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.916251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.916688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:23.917591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.918229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.918661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:23.923719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:23.925226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:23.931093 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-70c7d7bd-1ddb-48cf-aef6-cb7d1fdc59e7 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.112526 Nov 03 04:04:23.931674 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1598/3104] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:23 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:23.937563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:23.938240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:23.948591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.949743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.950289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:23.951116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:23.951671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:23.952195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:24.032400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:24.041418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:24.042893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:24.047904 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fe8f6854-4b2b-4b7c-a6dc-93ff1318ce4b tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1452 microversion: 2.75 time: 0.114452 Nov 03 04:04:24.048614 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1599/3105] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:23 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:24.053380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5dd1d577-e243-4afc-8fb4-62c52eb63236 req-edd36886-dcf3-4e9c-8f26-a7df39b24442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "855c9583-d48b-4c48-b59c-8a4096494b67", "tag": "e84aad67-49e8-4efe-8566-d24ab57903bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:24.063889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5dd1d577-e243-4afc-8fb4-62c52eb63236 req-edd36886-dcf3-4e9c-8f26-a7df39b24442 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:24.064596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5dd1d577-e243-4afc-8fb4-62c52eb63236 req-edd36886-dcf3-4e9c-8f26-a7df39b24442 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:24.065408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5dd1d577-e243-4afc-8fb4-62c52eb63236 req-edd36886-dcf3-4e9c-8f26-a7df39b24442 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:24.076865 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5dd1d577-e243-4afc-8fb4-62c52eb63236 req-edd36886-dcf3-4e9c-8f26-a7df39b24442 service nova] Creating event network-changed:e84aad67-49e8-4efe-8566-d24ab57903bc for instance 855c9583-d48b-4c48-b59c-8a4096494b67 on n-h1-854653-7 Nov 03 04:04:24.081815 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5dd1d577-e243-4afc-8fb4-62c52eb63236 req-edd36886-dcf3-4e9c-8f26-a7df39b24442 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031749 Nov 03 04:04:24.082414 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1600/3106] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:24.087958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8aaca827-c7e9-4f72-bfbe-36bc119b22bd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '.version_select at 0x7ff7f8781670>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:24.291605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:24.305832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:24.307953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:24.309292 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83d26794-f8c4-4202-b7b0-9f100cab3b8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.406728 Nov 03 04:04:24.309936 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1507/3107] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:23 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:24.314743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0c72bdab-b487-4f89-aaf0-a30bedb3f8a9 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Action: 'create', calling method: .version_select at 0x7ff7f89e78b0>, body: {"pool": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:25.677712 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8aaca827-c7e9-4f72-bfbe-36bc119b22bd tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/1fad8756-5b12-42c1-9ce1-41591a379550" status: 202 len: 0 microversion: 2.1 time: 1.593700 Nov 03 04:04:25.678384 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1601/3108] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:04:24 2022] DELETE /compute/v2.1/os-floating-ips/1fad8756-5b12-42c1-9ce1-41591a379550 => generated 0 bytes in 1595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:25.683301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:25.684049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: f59785d6-020a-45d0-ae18-48edbc2fc755] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:25.691320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.691815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.692290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:25.692998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.693482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.693919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:25.707455 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 HTTP/1.1 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f59785d6-020a-45d0-ae18-48edbc2fc755'} Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:25.709159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance f59785d6-020a-45d0-ae18-48edbc2fc755 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d32f6df8-4e3b-4811-baea-64f56cfe4f59 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755" status: 404 len: 111 microversion: 2.1 time: 0.031355 Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1602/3109] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:25 2022] GET /compute/v2.1/servers/f59785d6-020a-45d0-ae18-48edbc2fc755 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:25.719114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d81aa76-baf2-4be0-ba8b-943e598a6d3c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f87810d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:25.744229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-7d81aa76-baf2-4be0-ba8b-943e598a6d3c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:04:25.744844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-7d81aa76-baf2-4be0-ba8b-943e598a6d3c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:04:25.745412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7d81aa76-baf2-4be0-ba8b-943e598a6d3c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist Nov 03 04:04:25.745412 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-2d68f9dc-d87d-49be-8b79-40cb2a0539fc'] Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d81aa76-baf2-4be0-ba8b-943e598a6d3c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72 HTTP/1.1 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-2d68f9dc-d87d-49be-8b79-40cb2a0539fc'] Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e1f8f8c4-56b0-498a-90b1-f041c31eea72'} Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:04:25.747302 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d68f9dc-d87d-49be-8b79-40cb2a0539fc'] Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d68f9dc-d87d-49be-8b79-40cb2a0539fc'] Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d68f9dc-d87d-49be-8b79-40cb2a0539fc'] Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d68f9dc-d87d-49be-8b79-40cb2a0539fc'] Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d81aa76-baf2-4be0-ba8b-943e598a6d3c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group e1f8f8c4-56b0-498a-90b1-f041c31eea72 does not exist Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-2d68f9dc-d87d-49be-8b79-40cb2a0539fc'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d81aa76-baf2-4be0-ba8b-943e598a6d3c tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72" status: 404 len: 194 microversion: 2.1 time: 0.036082 Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1603/3110] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:25 2022] DELETE /compute/v2.1/os-security-groups/e1f8f8c4-56b0-498a-90b1-f041c31eea72 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:25.755332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:25.761837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.762332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.762781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:25.763487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.763949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.764384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:25.828270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:25.837109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:25.838684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:25.839857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b03b8c7-1adb-4a51-8bbb-38336d09eb80 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.089714 Nov 03 04:04:25.840419 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1604/3111] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:25 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:25.845160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:25.845785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:25.852968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.853500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.853942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:25.854709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.855171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.855692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:25.938888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:25.947404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:25.949324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:25.954621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2d534c7-8a72-49fd-94fa-9420a0162f37 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1452 microversion: 2.75 time: 0.113164 Nov 03 04:04:25.955183 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1605/3112] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:25 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:25.959722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:25.960324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:25.967386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.967926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.968372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:25.969100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:25.969576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:25.970232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:26.503940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:26.513245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:26.514700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:26.515850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dca6934e-6501-43d7-a4a9-f187aef7cd45 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.559747 Nov 03 04:04:26.516443 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1606/3113] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:25 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:26.520820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4da4ff5-7922-4cfc-b90b-6ee9cded4274 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '.version_select at 0x7ff7f87e2af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:26.873840 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e4da4ff5-7922-4cfc-b90b-6ee9cded4274 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2c5da284-e680-4430-9820-ccc2f0779130" status: 202 len: 0 microversion: 2.1 time: 0.356328 Nov 03 04:04:26.874445 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1607/3114] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:26 2022] DELETE /compute/v2.1/os-security-groups/2c5da284-e680-4430-9820-ccc2f0779130 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:26.883901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-774be52c-9d68-4192-bd4c-a0e5c086242a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:26.883901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-774be52c-9d68-4192-bd4c-a0e5c086242a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 0cbb3679-8e5d-4dc9-a633-c0723672b1f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:26.885890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-774be52c-9d68-4192-bd4c-a0e5c086242a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-774be52c-9d68-4192-bd4c-a0e5c086242a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0 HTTP/1.1 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0cbb3679-8e5d-4dc9-a633-c0723672b1f0'} Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:26.887406 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-774be52c-9d68-4192-bd4c-a0e5c086242a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-774be52c-9d68-4192-bd4c-a0e5c086242a tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0" status: 404 len: 111 microversion: 2.1 time: 0.013459 Nov 03 04:04:26.891946 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1608/3115] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:26 2022] DELETE /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:26.893911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03a84d1a-ee11-4721-9a23-8fab4bc9a717 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f882e4c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:26.931828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-03a84d1a-ee11-4721-9a23-8fab4bc9a717 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:04:26.932439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-03a84d1a-ee11-4721-9a23-8fab4bc9a717 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:04:26.933984 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-03a84d1a-ee11-4721-9a23-8fab4bc9a717 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:04:26.933984 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-e041d936-33fd-4632-96fd-d1616c19fcff'] Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03a84d1a-ee11-4721-9a23-8fab4bc9a717 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995 HTTP/1.1 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-e041d936-33fd-4632-96fd-d1616c19fcff'] Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'c2d33aa0-0e3c-429b-91b2-4a1f961eb995'} Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:04:26.935946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e041d936-33fd-4632-96fd-d1616c19fcff'] Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e041d936-33fd-4632-96fd-d1616c19fcff'] Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e041d936-33fd-4632-96fd-d1616c19fcff'] Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e041d936-33fd-4632-96fd-d1616c19fcff'] Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03a84d1a-ee11-4721-9a23-8fab4bc9a717 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group c2d33aa0-0e3c-429b-91b2-4a1f961eb995 does not exist Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-e041d936-33fd-4632-96fd-d1616c19fcff'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03a84d1a-ee11-4721-9a23-8fab4bc9a717 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995" status: 404 len: 194 microversion: 2.1 time: 0.047110 Nov 03 04:04:26.939716 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1609/3116] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:26 2022] DELETE /compute/v2.1/os-security-groups/c2d33aa0-0e3c-429b-91b2-4a1f961eb995 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:26.952596 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0c72bdab-b487-4f89-aaf0-a30bedb3f8a9 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.632399 Nov 03 04:04:26.952596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1508/3117] 10.222.0.30 () {60 vars in 1170 bytes} [Thu Nov 3 04:04:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:26.953540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:26.953540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:26.953824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:26.953824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:26.954092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:26.954092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:26.954457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:26.954875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:26.955507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:26.955913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:26.958252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:26.958823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:26.959375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:26.960155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:26.960725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:26.961884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:26.988041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:04:26.991026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:27.020134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:27.029103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:27.030539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:27.031743 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f8ca84b-13ee-421e-b586-fe7c428fc67c tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.092743 Nov 03 04:04:27.032298 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1610/3118] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:26 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:27.036893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa263fed-516e-4ebc-aebd-6560243368bf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.037530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa263fed-516e-4ebc-aebd-6560243368bf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: 0cbb3679-8e5d-4dc9-a633-c0723672b1f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:27.042922 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-aa263fed-516e-4ebc-aebd-6560243368bf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa263fed-516e-4ebc-aebd-6560243368bf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0 HTTP/1.1 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0cbb3679-8e5d-4dc9-a633-c0723672b1f0'} Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.044472 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa263fed-516e-4ebc-aebd-6560243368bf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance 0cbb3679-8e5d-4dc9-a633-c0723672b1f0 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa263fed-516e-4ebc-aebd-6560243368bf tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0" status: 404 len: 111 microversion: 2.1 time: 0.012627 Nov 03 04:04:27.048679 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1611/3119] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:27 2022] GET /compute/v2.1/servers/0cbb3679-8e5d-4dc9-a633-c0723672b1f0 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:27.051138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c47762d6-d7f0-4057-91e7-d7b92470deb3 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f87e2160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.077790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-c47762d6-d7f0-4057-91e7-d7b92470deb3 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:04:27.078446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-c47762d6-d7f0-4057-91e7-d7b92470deb3 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group 2fbd9375-4110-412f-89e0-ffcf5b93625e not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:04:27.078968 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c47762d6-d7f0-4057-91e7-d7b92470deb3 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:04:27.078968 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-ac0ac591-ff9c-4e3f-ae48-7f86412fa0e5'] Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c47762d6-d7f0-4057-91e7-d7b92470deb3 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e HTTP/1.1 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-ac0ac591-ff9c-4e3f-ae48-7f86412fa0e5'] Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '2fbd9375-4110-412f-89e0-ffcf5b93625e'} Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:04:27.080932 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0ac591-ff9c-4e3f-ae48-7f86412fa0e5'] Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0ac591-ff9c-4e3f-ae48-7f86412fa0e5'] Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0ac591-ff9c-4e3f-ae48-7f86412fa0e5'] Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0ac591-ff9c-4e3f-ae48-7f86412fa0e5'] Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c47762d6-d7f0-4057-91e7-d7b92470deb3 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group 2fbd9375-4110-412f-89e0-ffcf5b93625e does not exist Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-ac0ac591-ff9c-4e3f-ae48-7f86412fa0e5'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c47762d6-d7f0-4057-91e7-d7b92470deb3 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e" status: 404 len: 194 microversion: 2.1 time: 0.035200 Nov 03 04:04:27.088394 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1612/3120] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:27 2022] DELETE /compute/v2.1/os-security-groups/2fbd9375-4110-412f-89e0-ffcf5b93625e => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:27.091961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fff8f5e5-76df-498d-a89c-3a4d4a8697f0 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Calling method '.version_select at 0x7ff7f92cd160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.236655 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fdd34dd9-0f12-4f0b-9add-923305107405 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "DELETE /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 204 len: 0 microversion: 2.1 time: 0.290115 Nov 03 04:04:27.240955 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1509/3121] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:26 2022] DELETE /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:04:27.244946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.248021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:27.251879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.252369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.252821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.253550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.254092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.254518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.265348 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fff8f5e5-76df-498d-a89c-3a4d4a8697f0 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/5a5e6455-9db4-4d82-a17f-d46f6370b5ef" status: 200 len: 142 microversion: 2.1 time: 0.181048 Nov 03 04:04:27.265706 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1613/3122] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 04:04:27 2022] GET /compute/v2.1/os-floating-ips/5a5e6455-9db4-4d82-a17f-d46f6370b5ef => generated 142 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:27.271668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.272173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:27.279211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.279706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.280297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.284468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.284979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.285653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.312588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:04:27.338984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:27.348197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:27.349710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:27.355005 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c0a4fbc-b3c2-4dfe-bc7c-5fcf41cb1cf1 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1437 microversion: 2.75 time: 0.115586 Nov 03 04:04:27.355576 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1510/3123] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:27 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1437 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:27.361148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4e96a99-88a2-4b9f-90e6-d59ab583f686 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8a1cd30>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.388089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-a4e96a99-88a2-4b9f-90e6-d59ab583f686 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:04:27.388720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.security_group_api [None req-a4e96a99-88a2-4b9f-90e6-d59ab583f686 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group 95d3469b-8f80-46ea-8809-bdc37e3732de not found {{(pid=127593) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:04:27.389335 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a4e96a99-88a2-4b9f-90e6-d59ab583f686 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:04:27.389335 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-978e8b02-5d15-43f7-82b4-14cf80871d5e'] Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4e96a99-88a2-4b9f-90e6-d59ab583f686 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de HTTP/1.1 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-978e8b02-5d15-43f7-82b4-14cf80871d5e'] Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '95d3469b-8f80-46ea-8809-bdc37e3732de'} Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:04:27.391405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978e8b02-5d15-43f7-82b4-14cf80871d5e'] Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978e8b02-5d15-43f7-82b4-14cf80871d5e'] Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978e8b02-5d15-43f7-82b4-14cf80871d5e'] Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-978e8b02-5d15-43f7-82b4-14cf80871d5e'] Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4e96a99-88a2-4b9f-90e6-d59ab583f686 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group 95d3469b-8f80-46ea-8809-bdc37e3732de does not exist Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-978e8b02-5d15-43f7-82b4-14cf80871d5e'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a4e96a99-88a2-4b9f-90e6-d59ab583f686 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de" status: 404 len: 194 microversion: 2.1 time: 0.036300 Nov 03 04:04:27.395817 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1511/3124] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:27 2022] DELETE /compute/v2.1/os-security-groups/95d3469b-8f80-46ea-8809-bdc37e3732de => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:27.401663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.401663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:27.406057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.406628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.407142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.407913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.408448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.408951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.548624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:27.556620 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f6091da-80b1-4baa-89cb-a286591ef2fa tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1510 microversion: 2.1 time: 0.162162 Nov 03 04:04:27.560409 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1512/3125] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:27 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:27.561545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c06b6c5-157e-4938-81b8-d4be1d831a36 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Calling method '.version_select at 0x7ff7f89a01f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:27.590786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef6fa81d-3202-47e5-8a9f-353b87ced4c8 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 204 len: 0 microversion: 2.1 time: 0.322673 Nov 03 04:04:27.592010 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1614/3126] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:27 2022] DELETE /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:04:27.709259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:27.712824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:27.719522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.720009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.720439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.721158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:27.721609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:27.722029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:27.829199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:04:27.829621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:04:27.830100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:04:27.830648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:04:27.831069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:04:27.989253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:27.995627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.002354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.002354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.002354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.002354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.002354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.097204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:28.116982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ff47185-2938-4974-81f0-abc12cad20dd tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888/action" status: 202 len: 1940 microversion: 2.75 time: 0.523057 Nov 03 04:04:28.117647 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1615/3127] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:04:27 2022] POST /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888/action => generated 1940 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 03 04:04:28.122493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-846176c2-f1ca-43e9-a9a7-38ac6d40a35d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f882e040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.155188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-846176c2-f1ca-43e9-a9a7-38ac6d40a35d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:04:28.155816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-846176c2-f1ca-43e9-a9a7-38ac6d40a35d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Neutron security group a79ef0e8-07da-4bf5-bd46-f400e88e345a not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:04:28.156670 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-846176c2-f1ca-43e9-a9a7-38ac6d40a35d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:04:28.156670 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-be1ee4f1-c5a6-4c1b-9b29-5d62dd357668'] Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-846176c2-f1ca-43e9-a9a7-38ac6d40a35d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a HTTP/1.1 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-be1ee4f1-c5a6-4c1b-9b29-5d62dd357668'] Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a79ef0e8-07da-4bf5-bd46-f400e88e345a'} Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:04:28.158440 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be1ee4f1-c5a6-4c1b-9b29-5d62dd357668'] Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be1ee4f1-c5a6-4c1b-9b29-5d62dd357668'] Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be1ee4f1-c5a6-4c1b-9b29-5d62dd357668'] Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-be1ee4f1-c5a6-4c1b-9b29-5d62dd357668'] Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-846176c2-f1ca-43e9-a9a7-38ac6d40a35d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Security group a79ef0e8-07da-4bf5-bd46-f400e88e345a does not exist Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-be1ee4f1-c5a6-4c1b-9b29-5d62dd357668'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-846176c2-f1ca-43e9-a9a7-38ac6d40a35d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a" status: 404 len: 194 microversion: 2.1 time: 0.041255 Nov 03 04:04:28.163947 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1616/3128] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:28 2022] DELETE /compute/v2.1/os-security-groups/a79ef0e8-07da-4bf5-bd46-f400e88e345a => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:28.169960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.169960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:28.176063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.179963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.179963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.179963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.179963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.179963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.523250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:28.534202 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c06b6c5-157e-4938-81b8-d4be1d831a36 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/5a5e6455-9db4-4d82-a17f-d46f6370b5ef" status: 202 len: 0 microversion: 2.1 time: 0.973787 Nov 03 04:04:28.534202 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1513/3129] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:04:27 2022] DELETE /compute/v2.1/os-floating-ips/5a5e6455-9db4-4d82-a17f-d46f6370b5ef => generated 0 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:28.534810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:28.535136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:28.537112 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6619ae53-986a-4739-ab0c-3501aeba3fb6 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.375654 Nov 03 04:04:28.537663 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1617/3130] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:28 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:28.538846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.539467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:28.542293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.543156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:28.549267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.549763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.550215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.551930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.551930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.551930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.554142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.555591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.556046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.556798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.557298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.557739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.645322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:28.649578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:28.654737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:28.656184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:28.657374 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-76bd769d-98f6-47b4-9459-e4e40ecca0bc tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.118594 Nov 03 04:04:28.657933 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1618/3131] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:28 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:28.662218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.662830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:28.672317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.672875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.673361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.674105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.674573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.675008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.718793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:28.727797 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e748be04-49f8-414e-89d9-3f8418000956 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1479 microversion: 2.1 time: 0.193347 Nov 03 04:04:28.744609 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1514/3132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:28 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1479 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:28.744609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.744609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:28.744609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.745170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.745272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.746118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:28.746807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:28.747411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:28.760653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:28.778050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:04:28.779685 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1959b38f-e2d3-423e-9ab5-11e7a5c56e96 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.120718 Nov 03 04:04:28.780348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1619/3133] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:28 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:28.784922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5100169-a0a8-4e16-925d-3f2011be714b tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Calling method '.version_select at 0x7ff7f901baf0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.967407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:28.977066 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b5100169-a0a8-4e16-925d-3f2011be714b tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.195300 Nov 03 04:04:28.991881 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1620/3134] 10.222.0.30 () {58 vars in 1164 bytes} [Thu Nov 3 04:04:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:04:28.995901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:28.996513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:29.002606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.003086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.003574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:29.004255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.004705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.005158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:29.075395 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7a0c5f1-a06a-4661-9077-5826a8a25bdf tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 204 len: 0 microversion: 2.1 time: 0.344840 Nov 03 04:04:29.076184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1515/3135] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:04:28 2022] DELETE /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:04:29.081447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b90931b-6d63-4c2a-a602-21f6f2cf0424 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Calling method '.version_select at 0x7ff7f89f7dc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:29.207305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:29.216618 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f503b1d-77d3-4670-8a49-3d4542ac1aa5 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1510 microversion: 2.1 time: 0.225565 Nov 03 04:04:29.217269 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1621/3136] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:28 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:29.222577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:29.223196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:29.229257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.229676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.230115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:29.230812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.231275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.231742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:29.317714 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b90931b-6d63-4c2a-a602-21f6f2cf0424 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.240348 Nov 03 04:04:29.318417 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1516/3137] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 04:04:29 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:29.332790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c130e5c3-21a5-4eb6-9e6b-6747b23e8340 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Calling method '.version_select at 0x7ff7f89e78b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:29.508592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:29.518279 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e16e0919-324e-4aeb-bfb4-4a42141b1a92 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1647 microversion: 2.1 time: 0.299371 Nov 03 04:04:29.534358 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1622/3138] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:29 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1647 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:29.563195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:29.563813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:29.570371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.571057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.571846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:29.572200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.572664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.573120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:29.881298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:29.891101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:29.892573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:29.893766 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b48451cf-2d7b-4063-b4da-f513ad168c6b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.334610 Nov 03 04:04:29.894328 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1623/3139] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:29 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:29.899449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:29.900066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:29.905801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.906296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.906742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:29.907447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:29.907918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:29.908351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.196538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:30.200666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:30.202153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:30.203323 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e352e102-8f0b-4f26-abc4-8e7edecd7414 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.308079 Nov 03 04:04:30.203885 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1624/3140] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:29 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:30.222176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:30.222290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:30.233073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.233550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.233999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.234715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.235175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.236189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.316785 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c130e5c3-21a5-4eb6-9e6b-6747b23e8340 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/955e3c81-14f5-4cb9-97ff-3a88f5d7d423" status: 202 len: 0 microversion: 2.1 time: 0.982781 Nov 03 04:04:30.316785 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1517/3141] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:04:29 2022] DELETE /compute/v2.1/os-floating-ips/955e3c81-14f5-4cb9-97ff-3a88f5d7d423 => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:04:30.317378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:30.317998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:30.324023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.324519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.324964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.325730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.326195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.326629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.408538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:30.411668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:30.417135 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fc9d6e5d-8b2b-4eab-8f26-3a5a58d70c01 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1479 microversion: 2.1 time: 0.212251 Nov 03 04:04:30.417696 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1625/3142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:30 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1479 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:30.422217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:30.423007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:30.428688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.429214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.429442 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47b1bf08-2c47-4bda-944e-5a7389c1f1f0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.115845 Nov 03 04:04:30.429852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.430036 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1518/3143] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:30 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:30.430900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.431622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.432199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.434649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9dc4efc8-06fc-4248-a9e9-c73a67424d29 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Calling method '.version_select at 0x7ff7f89c4310>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:30.666983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:30.675579 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ba80e00b-24cb-4523-807c-3f643cca8118 tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1510 microversion: 2.1 time: 0.256882 Nov 03 04:04:30.676152 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1626/3144] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:30 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:30.680865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:30.681927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:30.687886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.688590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.689243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:30.690143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:30.690757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:30.692196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:31.412604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b69b997a6644698103e40fe23bcebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2509709ccbc04cb0a157454541ddd369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:31.424680 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41e3fe9b-f3da-42c5-8efd-6f0152b3677d tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 200 len: 1647 microversion: 2.1 time: 0.747292 Nov 03 04:04:31.427389 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1627/3145] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:30 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 1647 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:31.435715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:31.436644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:31.444296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:31.444955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:31.446079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:31.446889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:31.447470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:31.448002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.042009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.052742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.054273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.056050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02b6138d-ba5c-4b50-bd2b-0452d2f8c178 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.625739 Nov 03 04:04:32.056745 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1628/3146] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:31 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:32.080828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-bb7cde01-244e-43c4-ac0b-0059ad69fab0 req-e9e4109f-af03-4475-9d7f-6d51298d0550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19fb334-80cd-46cc-b646-44482c5992e5", "name": "network-vif-deleted", "tag": "2fe8dc5e-e383-431e-b1b9-44756d315b6c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:32.091079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bb7cde01-244e-43c4-ac0b-0059ad69fab0 req-e9e4109f-af03-4475-9d7f-6d51298d0550 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.091601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bb7cde01-244e-43c4-ac0b-0059ad69fab0 req-e9e4109f-af03-4475-9d7f-6d51298d0550 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.092043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bb7cde01-244e-43c4-ac0b-0059ad69fab0 req-e9e4109f-af03-4475-9d7f-6d51298d0550 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.103974 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-bb7cde01-244e-43c4-ac0b-0059ad69fab0 req-e9e4109f-af03-4475-9d7f-6d51298d0550 service nova] Creating event network-vif-deleted:2fe8dc5e-e383-431e-b1b9-44756d315b6c for instance e19fb334-80cd-46cc-b646-44482c5992e5 on n-h2-854653-7 Nov 03 04:04:32.108911 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-bb7cde01-244e-43c4-ac0b-0059ad69fab0 req-e9e4109f-af03-4475-9d7f-6d51298d0550 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039878 Nov 03 04:04:32.109521 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1629/3147] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:32.118133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:32.118835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:32.125628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.125792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.126515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.126936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.127391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.127820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.230934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.239817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.241383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.242600 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dbd5f44e-bd33-490b-85ec-c57233d62b29 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.128915 Nov 03 04:04:32.243231 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1630/3148] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:32 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:32.257460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:32.258591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:32.264507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.264987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.265451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.266142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.266646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.267066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.617508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9dc4efc8-06fc-4248-a9e9-c73a67424d29 tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/23c0d03b-da58-4a72-8cef-0e864c84cc32" status: 202 len: 0 microversion: 2.1 time: 2.186364 Nov 03 04:04:32.619513 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1519/3149] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:04:30 2022] DELETE /compute/v2.1/os-floating-ips/23c0d03b-da58-4a72-8cef-0e864c84cc32 => generated 0 bytes in 2189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:32.627577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:32.628819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:32.636029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.646565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.647087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.647533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.648769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.649261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.649690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.652084 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d43321d7-7d00-4e58-bfcb-90c4ff19f5e6 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1479 microversion: 2.1 time: 0.407740 Nov 03 04:04:32.653595 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1631/3150] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:32 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1479 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:32.665700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:32.666585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:32.682345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.683356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.683356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.684037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.685523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.686449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.806632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c97199542b1245c78c7216160aa50af2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07fb4ed51df846749adb393bcff2d621', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:32.809053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:32.822026 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc07bbe7-c34c-42c9-b336-a5d276c842ac tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 200 len: 1468 microversion: 2.1 time: 0.166306 Nov 03 04:04:32.822926 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1632/3151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:32 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 1468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:32.828045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:32.828775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] [instance: e19fb334-80cd-46cc-b646-44482c5992e5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:32.834525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f83d8089-79e0-4202-b4e7-1ce626311f99 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.213875 Nov 03 04:04:32.834898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.835501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.836160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.836353 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1520/3152] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:32 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:32.836925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.837512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.838328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.841844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fea71bf1-67cd-4038-9859-17db27e7c9ae tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] Calling method '.version_select at 0x7ff7f8a1c430>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:32.853278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] HTTP exception thrown: Instance e19fb334-80cd-46cc-b646-44482c5992e5 could not be found. Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Request method failure captured: Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 HTTP/1.1 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1W6q5EoKBI91PqciV10ags4J9lNgGeKC7Z-Ahdv2ZRAWoB-LOQxZ4UbKR7oQExnBofgEAGZqRyfSeRRUIx8_jAK61ceK-iONzMwz8jsqR8INQ4VqB8o8bU5GQxESBnth270uMDEjRPFw6jMQuMP3mv7070gVJ-ZKPY5ystMXQJnsk Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2509709ccbc04cb0a157454541ddd369", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2509709ccbc04cb0a157454541ddd369"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2509709ccbc04cb0a157454541ddd369"}]}] Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 2509709ccbc04cb0a157454541ddd369 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-632647758 Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 98b69b997a6644698103e40fe23bcebf Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsTestJSON-632647758-project Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e19fb334-80cd-46cc-b646-44482c5992e5 could not be found. Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e19fb334-80cd-46cc-b646-44482c5992e5'} Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19fb334-80cd-46cc-b646-44482c5992e5 could not be found. Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19fb334-80cd-46cc-b646-44482c5992e5 could not be found. Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:32.855042 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19fb334-80cd-46cc-b646-44482c5992e5 could not be found. Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Returning 404 to user: Instance e19fb334-80cd-46cc-b646-44482c5992e5 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85b3dd84-8dbe-45f4-928d-2accfa791e81 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5" status: 404 len: 111 microversion: 2.1 time: 0.032230 Nov 03 04:04:32.859674 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1633/3153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:32 2022] GET /compute/v2.1/servers/e19fb334-80cd-46cc-b646-44482c5992e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:32.864228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3ddb1e8b-7412-45cd-9ca7-be2c904f7a0d req-d4843b7e-66a2-47e0-9f17-c78271b13be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "855c9583-d48b-4c48-b59c-8a4096494b67", "name": "network-vif-deleted", "tag": "e84aad67-49e8-4efe-8566-d24ab57903bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:32.872068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3ddb1e8b-7412-45cd-9ca7-be2c904f7a0d req-d4843b7e-66a2-47e0-9f17-c78271b13be6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:32.872567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3ddb1e8b-7412-45cd-9ca7-be2c904f7a0d req-d4843b7e-66a2-47e0-9f17-c78271b13be6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:32.872997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3ddb1e8b-7412-45cd-9ca7-be2c904f7a0d req-d4843b7e-66a2-47e0-9f17-c78271b13be6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:32.884982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3ddb1e8b-7412-45cd-9ca7-be2c904f7a0d req-d4843b7e-66a2-47e0-9f17-c78271b13be6 service nova] Creating event network-vif-deleted:e84aad67-49e8-4efe-8566-d24ab57903bc for instance 855c9583-d48b-4c48-b59c-8a4096494b67 on n-h1-854653-7 Nov 03 04:04:32.889551 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3ddb1e8b-7412-45cd-9ca7-be2c904f7a0d req-d4843b7e-66a2-47e0-9f17-c78271b13be6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Nov 03 04:04:32.890473 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1634/3154] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:32.895487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-314b1a3a-e25f-488e-817f-c84f1ebad5c2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f8766e50>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:33.399166 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-314b1a3a-e25f-488e-817f-c84f1ebad5c2 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/8b8c2178-484b-4edf-a027-a0429fa8330e" status: 202 len: 0 microversion: 2.1 time: 0.506841 Nov 03 04:04:33.399853 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1635/3155] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:32 2022] DELETE /compute/v2.1/os-security-groups/8b8c2178-484b-4edf-a027-a0429fa8330e => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:33.404723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:33.405589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:33.412047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:33.412615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:33.413149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:33.414476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:33.415067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:33.415559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:33.706249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:33.716991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:33.718738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:33.723856 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-25bec601-ac13-4b79-89dc-dc560bb645f4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.319186 Nov 03 04:04:33.723856 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1636/3156] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:33 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:33.731970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:33.732775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:33.740696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:33.741249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:33.742447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:33.743365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:33.743984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:33.744571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:33.818240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:33.827727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:33.829775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:33.830473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-214c044f-67bb-49df-a476-4130d4cfe222 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.108956 Nov 03 04:04:33.831012 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1637/3157] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:33 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:33.835568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21a967e8-ba26-4471-918d-2b5c0731a0f8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] Calling method '.version_select at 0x7ff7f882ec10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:34.013973 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fea71bf1-67cd-4038-9859-17db27e7c9ae tempest-FloatingIPDetailsTestJSON-1825632716 tempest-FloatingIPDetailsTestJSON-1825632716-project] 10.222.0.30 "DELETE /compute/v2.1/os-floating-ips/9b24b41f-d21c-4fbf-bce9-4593f08bf927" status: 202 len: 0 microversion: 2.1 time: 1.176129 Nov 03 04:04:34.014587 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1521/3158] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:04:32 2022] DELETE /compute/v2.1/os-floating-ips/9b24b41f-d21c-4fbf-bce9-4593f08bf927 => generated 0 bytes in 1177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:34.019192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:34.019841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:34.027066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.027559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.028177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.028891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.029384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.029813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.064370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.064873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.065351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.065808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lazy-loading 'fault' on Instance uuid ac272146-9a22-4d57-b195-66af7e425fc3 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:34.124707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf58b2529baa41099821b8b2b0970d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '433d2397269f416eadd793a38002a763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:34.133230 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-993c385a-9f1c-4d0a-9bb7-fa5a2153ab58 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 200 len: 1282 microversion: 2.1 time: 0.117584 Nov 03 04:04:34.133808 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1522/3159] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:34 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 1282 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:04:34.138615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:34.139231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] [instance: 855c9583-d48b-4c48-b59c-8a4096494b67] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:34.144925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.145509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.146131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.146995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.147623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.148756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.229833 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21a967e8-ba26-4471-918d-2b5c0731a0f8 tempest-SecurityGroupsTestJSON-632647758 tempest-SecurityGroupsTestJSON-632647758-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/074c101d-5fd7-4d7f-86bd-922c198cdce8" status: 202 len: 0 microversion: 2.1 time: 0.397699 Nov 03 04:04:34.234622 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1638/3160] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:04:33 2022] DELETE /compute/v2.1/os-security-groups/074c101d-5fd7-4d7f-86bd-922c198cdce8 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:04:34.241080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:34.242525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:34.250971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.251784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.252422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.253392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.254193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.255009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.383471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:34.388064 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] HTTP exception thrown: Instance 855c9583-d48b-4c48-b59c-8a4096494b67 could not be found. Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Request method failure captured: Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 HTTP/1.1 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz199JwK1B6mX9isfE-dP89JLMWN-ExCgw4hsC61WJBi9QxwuK4EyPYuaJsGHlYsAao4inOBPoQ4rE1zQCHcIbGrEPzR03CLEc1f3Ts7Oa602W2jD_tILQOZEb0ZAh1hX_zdXh6SYbcikgxE-Gm2AY53T26QhcopI13Rn9yC4on_BJk Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 07fb4ed51df846749adb393bcff2d621 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-571888448 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07fb4ed51df846749adb393bcff2d621"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_07fb4ed51df846749adb393bcff2d621", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/07fb4ed51df846749adb393bcff2d621"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/07fb4ed51df846749adb393bcff2d621"}]}] Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-571888448 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 07fb4ed51df846749adb393bcff2d621 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-571888448 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueTestJSONUnderV235-571888448-project Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: c97199542b1245c78c7216160aa50af2 Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-571888448-project Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 855c9583-d48b-4c48-b59c-8a4096494b67 could not be found. Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '855c9583-d48b-4c48-b59c-8a4096494b67'} Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 855c9583-d48b-4c48-b59c-8a4096494b67 could not be found. Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 855c9583-d48b-4c48-b59c-8a4096494b67 could not be found. Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:34.390909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 855c9583-d48b-4c48-b59c-8a4096494b67 could not be found. Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] Returning 404 to user: Instance 855c9583-d48b-4c48-b59c-8a4096494b67 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:34.397159 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3cc49ccc-49a8-4cf4-914d-7b17f6dc59ad tempest-ServerRescueTestJSONUnderV235-571888448 tempest-ServerRescueTestJSONUnderV235-571888448-project] 10.222.0.30 "GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67" status: 404 len: 111 microversion: 2.1 time: 0.256299 Nov 03 04:04:34.397984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:34.398120 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1523/3161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:34 2022] GET /compute/v2.1/servers/855c9583-d48b-4c48-b59c-8a4096494b67 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:34.420231 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e087194-6d7b-44b9-bdd6-39ae2690d249 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.183640 Nov 03 04:04:34.421153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1639/3162] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:34 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:34.749623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:34.750532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:34.758062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.758811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.759515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.760679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.761526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.762435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.862156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:34.865108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:34.877239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.877239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.877239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:34.877971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:34.878894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:34.879755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:35.023159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:35.036427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:35.041694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:35.044972 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a07018d1-0951-42d1-93cb-1004014b4812 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.190153 Nov 03 04:04:35.048128 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1640/3163] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:34 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:35.053927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e82e938b-9816-4224-bb66-1190e46378b9 req-7da84cdc-f555-45e6-8e39-b7318b4730a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac272146-9a22-4d57-b195-66af7e425fc3", "name": "network-vif-deleted", "tag": "0fdca9ea-826d-4f5e-9a2f-8595dd279169"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:35.067673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e82e938b-9816-4224-bb66-1190e46378b9 req-7da84cdc-f555-45e6-8e39-b7318b4730a0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:35.068460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e82e938b-9816-4224-bb66-1190e46378b9 req-7da84cdc-f555-45e6-8e39-b7318b4730a0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:35.068912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e82e938b-9816-4224-bb66-1190e46378b9 req-7da84cdc-f555-45e6-8e39-b7318b4730a0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:35.088520 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e82e938b-9816-4224-bb66-1190e46378b9 req-7da84cdc-f555-45e6-8e39-b7318b4730a0 service nova] Creating event network-vif-deleted:0fdca9ea-826d-4f5e-9a2f-8595dd279169 for instance ac272146-9a22-4d57-b195-66af7e425fc3 on n-h1-854653-7 Nov 03 04:04:35.100886 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e82e938b-9816-4224-bb66-1190e46378b9 req-7da84cdc-f555-45e6-8e39-b7318b4730a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050261 Nov 03 04:04:35.103248 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1641/3164] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:35.104091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:35.117878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:35.119616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:35.121045 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ea9f0ab0-aa95-470d-b290-d43cabe36920 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.375599 Nov 03 04:04:35.129925 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1524/3165] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:34 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:35.157209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:35.158393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] [instance: ac272146-9a22-4d57-b195-66af7e425fc3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:35.168533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:35.169305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:35.169937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:35.170844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:35.171462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:35.172049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:35.192412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] HTTP exception thrown: Instance ac272146-9a22-4d57-b195-66af7e425fc3 could not be found. Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Request method failure captured: Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 HTTP/1.1 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzyru6kjup5CTW8aqN_asA2a1FueKvyRweMNYBQYFbIYy5CAbJhaqpzjG-6j2nV02P3ogHDvk4OLWx67Qhv4q91YOZJNjPOIgn-dkejPePS2DUO7cMqro-4gRCkqTDnYsfzYksVu9yu8Jy0qaGWwpkgzytDNIMVjuRuOuAHRjKzKyO0 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_433d2397269f416eadd793a38002a763", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/433d2397269f416eadd793a38002a763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/433d2397269f416eadd793a38002a763"}]}] Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-1039194078 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 433d2397269f416eadd793a38002a763 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-1039194078 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: cf58b2529baa41099821b8b2b0970d61 Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-1039194078-project Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ac272146-9a22-4d57-b195-66af7e425fc3 could not be found. Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ac272146-9a22-4d57-b195-66af7e425fc3'} Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac272146-9a22-4d57-b195-66af7e425fc3 could not be found. Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac272146-9a22-4d57-b195-66af7e425fc3 could not be found. Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:35.194454 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac272146-9a22-4d57-b195-66af7e425fc3 could not be found. Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] Returning 404 to user: Instance ac272146-9a22-4d57-b195-66af7e425fc3 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:35.203125 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f852886-f314-4627-895d-28389f0f0896 tempest-ServersTestJSON-1039194078 tempest-ServersTestJSON-1039194078-project] 10.222.0.30 "GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3" status: 404 len: 111 microversion: 2.1 time: 0.046699 Nov 03 04:04:35.204023 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1642/3166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:04:35 2022] GET /compute/v2.1/servers/ac272146-9a22-4d57-b195-66af7e425fc3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:04:35.449975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:35.450980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:35.472006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:35.475741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:35.477475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:35.479057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:35.481465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:35.482079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:35.650869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:35.689263 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f8b3642-cf74-4788-b5bd-3bdd9872245a tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.241065 Nov 03 04:04:35.692099 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1525/3167] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:35 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:36.072144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:36.073411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:36.080128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:36.080828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:36.081474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:36.082392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:36.082870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:36.083290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:36.151209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:36.152996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:36.168309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:36.168912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:36.169443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:36.170233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:36.170695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:36.171125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:36.177928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:36.189804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:36.197039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:36.198272 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cd013360-f922-4703-857e-f8dc09630058 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.130284 Nov 03 04:04:36.198831 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1643/3168] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:36 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:36.719336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:36.720020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:36.730643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:36.733700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:36.736595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:36.737275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:36.739829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:36.739829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:36.739829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:36.862807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:36.869696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:36.879768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:36.882894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:36.884365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-db736930-c553-4fc3-91c9-f080e4a26e73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.737784 Nov 03 04:04:36.895473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4011ad21-65b3-425c-bd82-c1e525e48af4 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.172430 Nov 03 04:04:36.895473 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1644/3169] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:36 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:36.895989 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1526/3170] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:36 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:37.225768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:37.227504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:37.234617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:37.235107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:37.235810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:37.236513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:37.236969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:37.237424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:37.356355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:37.373866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:37.375620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:37.377123 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77dd26a3-8bba-4b49-b509-681ccc41a7e4 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.155361 Nov 03 04:04:37.378248 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1645/3171] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:37 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:37.918901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:37.919245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:37.921265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:37.922376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:37.932856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:37.933740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:37.934021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:37.934991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:37.935374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:37.935462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:37.935809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:37.935983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:37.936525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:37.937002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:37.937445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:37.940708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:38.073585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:38.104692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2dd60d7c-f877-42fa-9c1a-64c68e01e4fc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.190040 Nov 03 04:04:38.105902 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1646/3172] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:37 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:38.226985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:38.237451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:38.238484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:38.239942 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec07f5fc-a351-403b-912c-d3b33eda1cf4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.332103 Nov 03 04:04:38.241080 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1527/3173] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:37 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:38.407360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:38.407982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:38.415230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:38.415724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:38.416160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:38.416870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:38.417347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:38.417770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:38.496444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:38.506458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:38.507959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:38.510627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04dc04ac-852a-4d60-bfc6-0dcce10293e5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.107236 Nov 03 04:04:38.511892 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1647/3174] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:38 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:39.137331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:39.137955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:39.146454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:39.151818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:39.152493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:39.154128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:39.159686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:39.160362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:39.191403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:39.258810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:39.269815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:39.270786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:39.279885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:39.281334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:39.284370 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-edb53a73-454d-4ecf-943e-c2dbbfc76fdc tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.152765 Nov 03 04:04:39.285555 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1528/3175] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:39 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:39.286218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:39.287382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:39.288066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:39.290064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:39.540026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:39.540885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:39.558729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:39.559626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:39.560285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:39.563423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:39.564227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:39.564940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:39.771022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:39.802129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:39.804960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:39.806498 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42a0d7e3-21d7-493c-ad97-468ebc1573c8 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.270925 Nov 03 04:04:39.807163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:39.810026 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1529/3176] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:39 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:39.824326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:39.826135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:39.827566 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a1786f7-a47a-4f0f-b128-7071756a1a8e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.561741 Nov 03 04:04:39.837853 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1648/3177] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:39 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:40.313090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:40.313711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:40.324513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:40.325046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:40.325487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:40.326201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:40.326664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:40.327093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:40.449572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:40.468544 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccda9ef4-86b4-4075-8a83-2f0a0380705b tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.159185 Nov 03 04:04:40.469468 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1530/3178] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:40 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:40.847821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:40.848448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:40.862950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:40.862950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:40.862950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:40.862950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:40.862950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:40.862950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:40.876946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:40.877604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:40.886664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:40.887145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:40.887600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:40.893186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:40.893855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:40.894323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:41.019175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:41.036304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:41.040864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:41.042853 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14616f2e-6bc6-4135-b598-31225ecde691 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.199039 Nov 03 04:04:41.044441 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1649/3179] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:40 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:41.275487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:41.298014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:41.301863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:41.306004 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-391feb42-cf24-491d-a423-95f2df35e341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.432836 Nov 03 04:04:41.309865 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1531/3180] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:40 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:41.498178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:41.499031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:41.510503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:41.511017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:41.511465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:41.512246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:41.512703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:41.525815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:41.652459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:41.697617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40f04fc5-c1b6-425d-8066-6967e330618d tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.203222 Nov 03 04:04:41.702446 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1650/3181] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:41 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:42.083829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:42.083829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:42.087248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:42.087676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:42.088116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:42.088827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:42.097458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:42.098170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:42.244737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:42.254847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:42.261221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:42.267731 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d920c84a-0712-49a2-983d-bf8f8a4ca136 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.195880 Nov 03 04:04:42.281285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1532/3182] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:42 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:42.340683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:42.341388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:42.356399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:42.356821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:42.362468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:42.363424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:42.364053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:42.366099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:42.729218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:42.730198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:42.738976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:42.739671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:42.741530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:42.743297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:42.746221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:42.746990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:42.809641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:42.831864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:42.831864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:42.832132 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb43c469-6baa-418a-9350-78286328e8db tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.496584 Nov 03 04:04:42.832644 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1651/3183] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:42 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:42.896310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:42.918688 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf9518ff-6fcd-4644-88e0-d69ed3e5c814 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.193527 Nov 03 04:04:42.919601 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1533/3184] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:42 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:43.295076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:43.295699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:43.303564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:43.307999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:43.308724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:43.315146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:43.318428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:43.320232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:43.523866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:43.543518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:43.546699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:43.550079 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d893f133-1b41-4111-8033-8dc6c93610b5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.259059 Nov 03 04:04:43.565041 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1652/3185] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:43 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:43.860104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:43.861255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:43.870051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:43.871914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:43.871914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:43.871914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:43.872153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:43.872580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:43.948603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:43.950285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:43.957198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:43.957921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:43.958666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:43.959540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:43.960719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:43.961409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:44.119096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:44.148332 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d1fb0a1-2920-4f10-b64c-9cf5f430c135 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.204444 Nov 03 04:04:44.149435 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1653/3186] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:43 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:44.208651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:44.222514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:44.224629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:44.230730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b6d17962-c5eb-4dbe-b814-8ad657c5c5ce tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.371435 Nov 03 04:04:44.230730 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1534/3187] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:43 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:44.583081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:44.584426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:44.598754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:44.599277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:44.599706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:44.600418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:44.604167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:44.604619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:44.777502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:44.792638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:44.794721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:44.796772 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-656b8a19-e35d-40fc-a80f-a0d21c008f00 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.217486 Nov 03 04:04:44.809498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1654/3188] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:44 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:45.182083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:45.183547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:45.191972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:45.192698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:45.193544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:45.193798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:45.194253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:45.195409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:45.255025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:45.256073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:45.268486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:45.269085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:45.269632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:45.271327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:45.274532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:45.275184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:45.303655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:45.337373 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ab06754-3022-4e74-9b6d-89624fb46daa tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.162933 Nov 03 04:04:45.342132 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1535/3189] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:45 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:45.525245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:45.537949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:45.539636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:45.541206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02d4bcd6-cb4c-47d4-bcc2-b82719697d08 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.289932 Nov 03 04:04:45.541798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1655/3190] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:45 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:45.837980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:45.838682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:45.848698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:45.848698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:45.848698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:45.848698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:45.849184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:45.849609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:45.924778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:45.935243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:45.940571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:45.940571 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9e58dc3-8117-47ef-bde0-455c91a9b61a tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.107710 Nov 03 04:04:45.940571 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1536/3191] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:45 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:46.378153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:46.379262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:46.389426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:46.391607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:46.392077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:46.392810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:46.393747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:46.393747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:46.440127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:46.501768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:46.519865 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d4323ea-0c5e-4197-a1c3-a39c37371d36 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.146362 Nov 03 04:04:46.520490 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1656/3192] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:46 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:46.577219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:46.579159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:46.595263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:46.597616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:46.599265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:46.600815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:46.602385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:46.603143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:46.966712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:46.968011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:46.968833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:46.979473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:46.980197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:46.981405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:46.982280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:46.982927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:46.983512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:46.984103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:46.988404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:46.992302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5f14584-395d-469f-aa97-f68b39ca812c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.422900 Nov 03 04:04:46.994747 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1537/3193] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:46 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:47.076342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:47.085833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:47.087300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:47.088696 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e136f0e8-220f-4174-8e87-b599db674c12 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.127111 Nov 03 04:04:47.101530 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1657/3194] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:46 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:47.403548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1286085729", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": "none"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:47.459187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:04:47.459615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:04:47.460640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:04:47.461066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:04:47.461481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:04:47.470106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:47.470630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:47.471065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:47.471797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:47.472263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:47.472679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:47.490277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Getting quotas for project 3d2a9ec956fb4f719c17e0ef66aadd06. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:04:47.495867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Getting quotas for user d75133f6989c4e9698aec81441432d95 and project 3d2a9ec956fb4f719c17e0ef66aadd06. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:04:47.508882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:04:47.511201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:04:47.548020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:47.553249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:47.555862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:47.556357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:47.556806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:47.557603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:47.558003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:47.558433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:47.636678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:47.655021 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-62c6f6a1-b6df-4a4b-83dd-e6b5d717da7c tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.110734 Nov 03 04:04:47.655839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1658/3195] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:47 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:47.710432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8edffaa4-7ecc-4969-bee8-65ebc328576a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.422897 Nov 03 04:04:47.711425 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1538/3196] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 03 04:04:47.734987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05d79061-1f5a-4b5d-b161-7116369f7e1d tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:47.738591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05d79061-1f5a-4b5d-b161-7116369f7e1d tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:47.798511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05d79061-1f5a-4b5d-b161-7116369f7e1d tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:47.807030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05d79061-1f5a-4b5d-b161-7116369f7e1d tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:47.808495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05d79061-1f5a-4b5d-b161-7116369f7e1d tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:47.810087 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05d79061-1f5a-4b5d-b161-7116369f7e1d tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1278 microversion: 2.57 time: 0.078938 Nov 03 04:04:47.811181 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1659/3197] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:47 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:48.021334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:48.022032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:48.029450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:48.029937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:48.030379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:48.031117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:48.031579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:48.032008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:48.119853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:48.120996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:48.128503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:48.130781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:48.133192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:48.135911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:48.136627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:48.137101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:48.793169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:48.837296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:48.852086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:48.852086 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d71c5181-ebea-4e9f-a8e2-069a8f28d924 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1364 microversion: 2.47 time: 0.737820 Nov 03 04:04:48.852086 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1660/3198] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:48 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1364 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:48.868968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:48.870094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:48.878161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:48.878969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:48.880157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:48.881162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:48.882129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:48.882762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:48.974301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:49.001974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:49.009159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:49.012487 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e4a2d621-9688-4e71-b136-6a9392710635 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.995227 Nov 03 04:04:49.016007 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1539/3199] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:48 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:49.032327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:49.035873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71f47506-6870-4f33-9754-56ae2df1221b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:49.038102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71f47506-6870-4f33-9754-56ae2df1221b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:49.078564 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f4b5be0-4d5b-4490-ac42-ca8d62283e15 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.222528 Nov 03 04:04:49.079839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1661/3200] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:48 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:49.204326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71f47506-6870-4f33-9754-56ae2df1221b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:49.215033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71f47506-6870-4f33-9754-56ae2df1221b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:49.218199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71f47506-6870-4f33-9754-56ae2df1221b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:49.224038 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71f47506-6870-4f33-9754-56ae2df1221b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1278 microversion: 2.57 time: 0.204255 Nov 03 04:04:49.224803 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1540/3201] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:49 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:49.877607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:49.878246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:49.886888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:49.887681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:49.888922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:49.889930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:49.890620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:49.891902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:50.024502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.039115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.042373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.043864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:50.044493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:50.049540 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-52f7e438-1beb-4886-a3dd-e78110bc8791 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1370 microversion: 2.47 time: 0.170343 Nov 03 04:04:50.052421 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1662/3202] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:49 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:50.063358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:50.063871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:50.072859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:50.073665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:50.074170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:50.074710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:50.109689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:50.110373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:50.122112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:50.122771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:50.124208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:50.127596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:50.128291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:50.129001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:50.313947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:50.371307 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b1f8856-e303-4ac2-95b4-6942490e27cb tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.265905 Nov 03 04:04:50.372648 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1663/3203] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:50 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:50.380630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:50.381578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:50.406419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:50.407236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:50.407950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:50.408868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:50.409642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:50.410234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:50.551647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.580782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.586705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.587736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4fbddaa0-fd3f-47a5-80b8-901b12def53a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1282 microversion: 2.57 time: 0.213821 Nov 03 04:04:50.592633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.618103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.618328 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1664/3204] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:50 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:50.619848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:50.622763 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3f4a202-372a-4ec6-9d88-0f8675b73836 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.582739 Nov 03 04:04:50.655224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1541/3205] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:50 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:51.079812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:51.080429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:51.106610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.107109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.107754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.109822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.110746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.111538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.337443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:51.352736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:51.360080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:51.363230 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36e882f3-3a08-4331-8e30-a0e5f2d481d2 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1370 microversion: 2.47 time: 0.287356 Nov 03 04:04:51.375974 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1665/3206] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:51 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:51.405122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:51.405894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:51.420913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.421451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.421893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.422611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.423073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.436847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.621141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:51.621844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:51.634872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.635671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.636296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.640084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.640818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.641479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.678723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:51.725768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ffbfa2e6-e91d-41d8-8a9e-db56212c6072 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.325250 Nov 03 04:04:51.732688 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1542/3207] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:51 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:51.742085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:51.746077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:51.760568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.763414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.763952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.764714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:51.768358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:51.768893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:51.802885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:51.821206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:51.826010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:51.828312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c5870b42-8570-45ef-8fc8-bbf6f2980946 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1274 microversion: 2.57 time: 0.212252 Nov 03 04:04:51.832694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1666/3208] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:51 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1274 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:52.407958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:52.413333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:52.413333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:52.432870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:52.434429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:52.435584 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da091bfa-2265-4083-9b36-4f0ccd1c3e37 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.701738 Nov 03 04:04:52.442768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1543/3209] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:51 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:52.457783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:52.460402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:52.478657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:52.487013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:52.487013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:52.487013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:52.684189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:52.706579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:52.708295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:52.709560 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35e4dc9d-13de-4839-acb7-28b1da519ff5 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1370 microversion: 2.47 time: 0.317417 Nov 03 04:04:52.721449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1667/3210] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:52 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:52.761913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:52.762774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:52.777352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:52.777879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:52.783454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:52.784260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:52.784756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:52.785240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:52.864863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:52.865557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:52.883966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:52.886885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:52.887560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:52.888483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:52.890981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:52.891775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:53.230527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:53.240797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:53.242872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:53.245961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:53.250994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:53.254690 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10d6f246-af96-410a-af79-f11d275c659e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1330 microversion: 2.57 time: 0.384985 Nov 03 04:04:53.270699 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1668/3211] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:52 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1330 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:53.288846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c401ae10-ed71-45a0-b1e7-b5201efaefb3 req-cb271f1e-c2a4-43ae-a639-3423df7c8180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-plugged", "status": "completed", "tag": "d57f7b42-2265-4a50-9d27-23ee5674ab49"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:53.294120 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ec66cd6-c34b-46f7-9e7b-7cee29515297 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.536933 Nov 03 04:04:53.298165 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1544/3212] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:52 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:53.309499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c401ae10-ed71-45a0-b1e7-b5201efaefb3 req-cb271f1e-c2a4-43ae-a639-3423df7c8180 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:53.312269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c401ae10-ed71-45a0-b1e7-b5201efaefb3 req-cb271f1e-c2a4-43ae-a639-3423df7c8180 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:53.312269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c401ae10-ed71-45a0-b1e7-b5201efaefb3 req-cb271f1e-c2a4-43ae-a639-3423df7c8180 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:53.342658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c401ae10-ed71-45a0-b1e7-b5201efaefb3 req-cb271f1e-c2a4-43ae-a639-3423df7c8180 service nova] Creating event network-vif-plugged:d57f7b42-2265-4a50-9d27-23ee5674ab49 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:53.355655 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c401ae10-ed71-45a0-b1e7-b5201efaefb3 req-cb271f1e-c2a4-43ae-a639-3423df7c8180 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083707 Nov 03 04:04:53.358928 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1669/3213] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:53.475993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:53.482754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:53.497297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:53.506784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:53.510497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:53.510497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:53.510497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:53.510497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:53.742183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:53.742824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:53.755648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:53.757558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:53.758645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:53.773485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:53.774326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:53.776129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:54.351296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.363986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.370387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.375004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dba3a96d-bc78-42a7-bd12-2a889c669b11 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1355 microversion: 2.47 time: 0.638667 Nov 03 04:04:54.393667 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1670/3214] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:53 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1355 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:54.402848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:54.403855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:54.417742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:54.421083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:54.421815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:54.422829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:54.424028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:54.427040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:54.643812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.662959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.667308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.669143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb7a8c72-92f4-4a91-95ef-0fa9b8d842d2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1336 microversion: 2.57 time: 0.276644 Nov 03 04:04:54.669143 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1671/3215] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:54 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1336 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:54.687370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:54.688239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:54.701213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:54.702155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:54.702886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:54.704687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:54.705221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:54.705672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:54.957303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.965951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:54.972692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.974410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.979008 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-237c5eb7-729b-4222-a40a-5be8d8fdd609 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 1.507729 Nov 03 04:04:54.980178 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1545/3216] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:53 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:54.988321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:54.994452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:54.998099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Searching by: {'deleted': False, 'project_id': '0af5e9d9f99f42189ae521de705566c1'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:04:55.015387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.019845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.020643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:55.021687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.024131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.024785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:55.048517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21e2971a-3eb6-4a88-a036-8cae48b1e8a0 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.374169 Nov 03 04:04:55.066432 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1672/3217] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:54 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:55.292553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:04:55.387975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a8703d33-7247-49d2-83cd-09f4810c2f03 req-8496f4e5-c7ac-4df7-b1d2-c892f894e8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-plugged", "status": "completed", "tag": "d8cd675f-fa80-4884-90b6-51a8b0db55fe"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:55.412309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8703d33-7247-49d2-83cd-09f4810c2f03 req-8496f4e5-c7ac-4df7-b1d2-c892f894e8e5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.418947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8703d33-7247-49d2-83cd-09f4810c2f03 req-8496f4e5-c7ac-4df7-b1d2-c892f894e8e5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.421910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a8703d33-7247-49d2-83cd-09f4810c2f03 req-8496f4e5-c7ac-4df7-b1d2-c892f894e8e5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:55.429661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:55.442364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.442364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.442364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:55.443695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:55.453394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:55.455639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:55.476694 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a8703d33-7247-49d2-83cd-09f4810c2f03 req-8496f4e5-c7ac-4df7-b1d2-c892f894e8e5 service nova] Creating event network-vif-plugged:d8cd675f-fa80-4884-90b6-51a8b0db55fe for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:55.484320 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a8703d33-7247-49d2-83cd-09f4810c2f03 req-8496f4e5-c7ac-4df7-b1d2-c892f894e8e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099354 Nov 03 04:04:55.486406 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1673/3218] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:55.573210 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9a497613-d8d1-41eb-955b-f7b30ee8429e tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.591518 Nov 03 04:04:55.574349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1546/3219] 10.222.0.30 () {60 vars in 1187 bytes} [Thu Nov 3 04:04:54 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:55.614093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:55.615530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:55.624991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.629860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.630663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:55.632119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.637775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.637775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:55.673977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:04:55.717144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1819e95b-a721-4f20-8b6e-6de79fb7c481 tempest-FloatingIPDetailsNegativeTestJSON-1043781939 tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project] Calling method '.version_select at 0x7ff7f8945dc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:55.805191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-1819e95b-a721-4f20-8b6e-6de79fb7c481 tempest-FloatingIPDetailsNegativeTestJSON-1043781939 tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 026332b6-2da9-481b-a689-df20126e1d57 could not be found", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:04:55.806197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-1819e95b-a721-4f20-8b6e-6de79fb7c481 tempest-FloatingIPDetailsNegativeTestJSON-1043781939 tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project] HTTP exception thrown: Floating IP not found for ID 026332b6-2da9-481b-a689-df20126e1d57 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1819e95b-a721-4f20-8b6e-6de79fb7c481 tempest-FloatingIPDetailsNegativeTestJSON-1043781939 tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project] Request method failure captured: Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-floating-ips/026332b6-2da9-481b-a689-df20126e1d57 HTTP/1.1 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz3nypz4UFYXukKyA_viutyZauVOtMiCYcOrALUj60roI2sK2hoI8Yl3Y1ZE8SUB-9xGWEL10CkbZ0nR7Y8x5TYvAgKcETQGmYFVsXX1M9EMRCqKyuDbl6NdS9nSNUmXTswFdtgo7nEOGSncVIJ-aF6NFKgXu9RUhDfhXHbOfPvC358 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: c5cf89169509459badcfd63d1dcf4ccb Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1043781939 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5cf89169509459badcfd63d1dcf4ccb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5cf89169509459badcfd63d1dcf4ccb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5cf89169509459badcfd63d1dcf4ccb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5cf89169509459badcfd63d1dcf4ccb"}]}] Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1043781939 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: c5cf89169509459badcfd63d1dcf4ccb Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1043781939 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3b615d44b2374845b723a33938fc6c94 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: exception: Floating IP not found for ID 026332b6-2da9-481b-a689-df20126e1d57 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '026332b6-2da9-481b-a689-df20126e1d57'} Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:04:55.808569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 026332b6-2da9-481b-a689-df20126e1d57 could not be found Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0d7bc1ab-1f90-48ba-a273-75550578bd13'] Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 026332b6-2da9-481b-a689-df20126e1d57. Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 026332b6-2da9-481b-a689-df20126e1d57 Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 026332b6-2da9-481b-a689-df20126e1d57 Nov 03 04:04:55.813048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:04:55.818246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1819e95b-a721-4f20-8b6e-6de79fb7c481 tempest-FloatingIPDetailsNegativeTestJSON-1043781939 tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project] Returning 404 to user: Floating IP not found for ID 026332b6-2da9-481b-a689-df20126e1d57 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:04:55.820009 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1819e95b-a721-4f20-8b6e-6de79fb7c481 tempest-FloatingIPDetailsNegativeTestJSON-1043781939 tempest-FloatingIPDetailsNegativeTestJSON-1043781939-project] 10.222.0.30 "GET /compute/v2.1/os-floating-ips/026332b6-2da9-481b-a689-df20126e1d57" status: 404 len: 111 microversion: 2.1 time: 0.169671 Nov 03 04:04:55.821096 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1547/3220] 10.222.0.30 () {58 vars in 1260 bytes} [Thu Nov 3 04:04:55 2022] GET /compute/v2.1/os-floating-ips/026332b6-2da9-481b-a689-df20126e1d57 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:04:55.835963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:55.838750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:55.851230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.851737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.852190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:55.852909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:55.853575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:55.854176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:56.045816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.047318 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-11966312-3cdc-4fbd-aa23-eebe4e5ddece tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 204 len: 0 microversion: 2.47 time: 0.438410 Nov 03 04:04:56.051950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1674/3221] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:04:55 2022] DELETE /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:04:56.059494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:56.060212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:56.066141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.067609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.068760 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-764f2742-4bba-4cc4-a5e1-78e0d8422ce7 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1336 microversion: 2.57 time: 0.246380 Nov 03 04:04:56.087723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1548/3222] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:55 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1336 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:56.110965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:56.111283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:56.112319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:56.115139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:56.116339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:56.117601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:56.119360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:56.120487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:56.131788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:56.134082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:56.134598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:56.135755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:56.135907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:56.136364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:56.136827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:56.363792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.380685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.382726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.383968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3221a082-18de-4ec9-9ec1-b862f85dbcde tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1361 microversion: 2.47 time: 0.287419 Nov 03 04:04:56.384539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1549/3223] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:56 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:56.416246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:56.417105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:56.426707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:56.427463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:56.428106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:56.429039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:56.429674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:56.430274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:56.717009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:56.763279 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39d0d5b7-1f20-4003-a34b-ace8edc55495 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.354319 Nov 03 04:04:56.764053 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1550/3224] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:56 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:56.867433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.888373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.888373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:56.888373 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c720350-d7c2-440e-b817-d8da4acea9fd tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.835678 Nov 03 04:04:56.888373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1675/3225] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:56 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:57.117531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:57.118304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:57.125405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.126336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.127126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.128057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.128718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.129455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.412699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:57.415116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:57.421972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.427216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.428091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.430198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.430936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.433286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.501610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:57.527090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:57.527090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:57.527090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0db554a-fa08-4728-ae77-c6ed3e3a95bb tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1336 microversion: 2.57 time: 0.410348 Nov 03 04:04:57.537620 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1551/3226] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:57 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1336 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:57.556022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-cc5feb32-668b-40ec-bd75-a35ac7c5b555 req-70b480a5-bde8-43d2-9974-537d9cb90460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-plugged", "status": "completed", "tag": "eedff35b-d301-494c-bd23-ff6295754bea"}, {"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-plugged", "status": "completed", "tag": "72a0b145-87de-4be0-9f7f-ac127448f825"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:57.578409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc5feb32-668b-40ec-bd75-a35ac7c5b555 req-70b480a5-bde8-43d2-9974-537d9cb90460 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.579627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc5feb32-668b-40ec-bd75-a35ac7c5b555 req-70b480a5-bde8-43d2-9974-537d9cb90460 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.581784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cc5feb32-668b-40ec-bd75-a35ac7c5b555 req-70b480a5-bde8-43d2-9974-537d9cb90460 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.615654 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-cc5feb32-668b-40ec-bd75-a35ac7c5b555 req-70b480a5-bde8-43d2-9974-537d9cb90460 service nova] Creating event network-vif-plugged:eedff35b-d301-494c-bd23-ff6295754bea for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:57.616537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-cc5feb32-668b-40ec-bd75-a35ac7c5b555 req-70b480a5-bde8-43d2-9974-537d9cb90460 service nova] Creating event network-vif-plugged:72a0b145-87de-4be0-9f7f-ac127448f825 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:57.632422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-cc5feb32-668b-40ec-bd75-a35ac7c5b555 req-70b480a5-bde8-43d2-9974-537d9cb90460 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073567 Nov 03 04:04:57.633813 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1552/3227] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:04:57.683656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:57.697309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:57.698890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:57.702183 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e85dccf-bae2-4499-ae94-cd083b074ee6 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1361 microversion: 2.47 time: 0.295060 Nov 03 04:04:57.705724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1676/3228] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:57 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:57.795323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:57.796024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:57.808279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.809728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.809728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.811741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.818123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.819263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.917744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:57.918276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:57.925565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:04:57.927376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.928042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.929226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:57.935822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:57.935822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:57.935822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:58.284009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:58.316967 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48ec364e-1ff7-4cb7-9b7d-a3ced9420907 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.526187 Nov 03 04:04:58.331539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1553/3229] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:57 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:04:58.550294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:58.551270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:58.563087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:58.567118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:58.569820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:58.571072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:58.571784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:58.573297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:58.881928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:58.903163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:58.906707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:58.908173 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d68315b-f902-4728-8cc8-c4f31207457b tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1336 microversion: 2.57 time: 0.362594 Nov 03 04:04:58.927627 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1554/3230] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:58 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1336 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:58.936124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:58.937811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:58.944686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:58.945598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:58.946295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:58.947499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:58.948138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:58.949305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:59.108403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:59.127193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:59.138147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:59.139746 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0406712-8cb4-4f2b-afc2-f9bdf746a62d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 1.226218 Nov 03 04:04:59.157043 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1677/3231] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:57 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:59.245858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:59.258729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:59.265046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:04:59.266437 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a5c1ec2-2235-498e-a2c3-d01afd76e6d0 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1361 microversion: 2.47 time: 0.337383 Nov 03 04:04:59.273337 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1555/3232] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:58 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:59.374291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:59.375085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:59.390438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:59.391114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:59.391689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:59.393471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:59.395800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:59.398030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:59.618276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:04:59.673079 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b11909c-e4b0-41e8-b934-4e03d9d9c540 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1927 microversion: 2.75 time: 0.329529 Nov 03 04:04:59.676296 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1678/3233] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:59 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1927 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:04:59.778102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1638782a-87f4-4c66-ad95-0bc1d84915e4 req-5af8f45a-37e2-41a3-aac3-c86cf77f9c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-plugged", "status": "completed", "tag": "e2124eb9-5b67-4fcf-b22c-8fd60bdb7205"}, {"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-plugged", "status": "completed", "tag": "62e1cfcf-1c83-430f-9fd5-f159a52d8e46"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:04:59.797033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1638782a-87f4-4c66-ad95-0bc1d84915e4 req-5af8f45a-37e2-41a3-aac3-c86cf77f9c95 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:59.798727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1638782a-87f4-4c66-ad95-0bc1d84915e4 req-5af8f45a-37e2-41a3-aac3-c86cf77f9c95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:59.804441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1638782a-87f4-4c66-ad95-0bc1d84915e4 req-5af8f45a-37e2-41a3-aac3-c86cf77f9c95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:59.822999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1638782a-87f4-4c66-ad95-0bc1d84915e4 req-5af8f45a-37e2-41a3-aac3-c86cf77f9c95 service nova] Creating event network-vif-plugged:e2124eb9-5b67-4fcf-b22c-8fd60bdb7205 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:59.823788 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1638782a-87f4-4c66-ad95-0bc1d84915e4 req-5af8f45a-37e2-41a3-aac3-c86cf77f9c95 service nova] Creating event network-vif-plugged:62e1cfcf-1c83-430f-9fd5-f159a52d8e46 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:04:59.831425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1638782a-87f4-4c66-ad95-0bc1d84915e4 req-5af8f45a-37e2-41a3-aac3-c86cf77f9c95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056891 Nov 03 04:04:59.832870 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1556/3234] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:04:59.941738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:04:59.942750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:04:59.960296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:59.961147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:59.963684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:04:59.966352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:04:59.967117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:04:59.969445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.172832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:00.174164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:00.195868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.199231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.201006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.204784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.205557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.208752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.290215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.315149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.317269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.327476 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-090b23d8-7169-40dc-a5ec-f48a01baf21f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1357 microversion: 2.57 time: 0.386539 Nov 03 04:05:00.352237 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1679/3235] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:04:59 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1357 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:00.370499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:00.371520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:00.385197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:00.386865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.387655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.390557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.391011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.392668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.393845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.524694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.528019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.528611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.531569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lazy-loading 'fault' on Instance uuid f3e64d80-9ade-467d-be7c-460902f2eb4a {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:05:00.667775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.676179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.681117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.698503 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bcee8b4c-2f6b-499e-b79e-20d852525450 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 200 len: 1366 microversion: 2.47 time: 0.344530 Nov 03 04:05:00.704767 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1680/3236] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:00 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:00.722407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:00.725655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:00.737646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.738207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.738657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.743956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.744558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.744903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.794933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.817311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.824193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:00.826535 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba41013b-ad9a-40d4-becf-1d20d35b6ddf tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.658381 Nov 03 04:05:00.829491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1557/3237] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:00 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:00.844884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:00.847961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:00.857325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.858246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.859044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.859954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:00.860882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:00.861567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:00.961592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:00.962424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:00.963755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:00.964540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:00.965164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:01.164802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:05:01.199370 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1048407-8a35-4246-b543-e9eab064f695 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1933 microversion: 2.75 time: 0.368768 Nov 03 04:05:01.205649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1558/3238] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:00 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1933 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:01.227738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:01.236147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.236884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.241687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.242711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.244411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.245212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.316850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3146582-fae7-484a-a128-08e0aafe7b08 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "POST /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250/action" status: 202 len: 1138 microversion: 2.57 time: 0.608532 Nov 03 04:05:01.324851 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1681/3239] 10.222.0.30 () {62 vars in 1320 bytes} [Thu Nov 3 04:05:00 2022] POST /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250/action => generated 1138 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 03 04:05:01.347078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:01.347761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:01.355231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.355732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.356641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.357401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.362328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.363010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.563663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:01.576765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:01.578567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:01.580025 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-639963a5-ff4a-4437-b29b-aebecf4ae160 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.242599 Nov 03 04:05:01.601598 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1559/3240] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:01 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:01.728941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:01.729716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: f3e64d80-9ade-467d-be7c-460902f2eb4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:01.742307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.742738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.743189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.743918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.744378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.744814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.779313 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] HTTP exception thrown: Instance f3e64d80-9ade-467d-be7c-460902f2eb4a could not be found. Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Request method failure captured: Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a HTTP/1.1 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz21Y0ySPAvgEKTRVhn2TeRA9_vEoRCN1uoljGH-LnCapGT8rXkZl_wV6peYvrcxJLXDbCWOhGUL_dkEaZjLhPS25csMfbGSusu92GvKRY3rNkxeueV0crt3wv9mL1DMn1g8Vcy9ZPhS3orfPJ_a9MjdCgqGCa_hKWgHJKIG4cbxsTc Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.47 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0af5e9d9f99f42189ae521de705566c1 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerShowV247Test-590092193 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0af5e9d9f99f42189ae521de705566c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0af5e9d9f99f42189ae521de705566c1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0af5e9d9f99f42189ae521de705566c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0af5e9d9f99f42189ae521de705566c1"}]}] Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerShowV247Test-590092193 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0af5e9d9f99f42189ae521de705566c1 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerShowV247Test-590092193 Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerShowV247Test-590092193-project Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 71b92ee969c14ea2ba015ed3381062aa Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerShowV247Test-590092193-project Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f3e64d80-9ade-467d-be7c-460902f2eb4a could not be found. Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f3e64d80-9ade-467d-be7c-460902f2eb4a'} Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e64d80-9ade-467d-be7c-460902f2eb4a could not be found. Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e64d80-9ade-467d-be7c-460902f2eb4a could not be found. Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:01.786385 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e64d80-9ade-467d-be7c-460902f2eb4a could not be found. Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Returning 404 to user: Instance f3e64d80-9ade-467d-be7c-460902f2eb4a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:01.799959 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-945f36e9-de8f-4ee3-a5fa-d7d0aaf4ec88 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a" status: 404 len: 111 microversion: 2.47 time: 0.067024 Nov 03 04:05:01.809656 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1682/3241] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:01 2022] GET /compute/v2.1/servers/f3e64d80-9ade-467d-be7c-460902f2eb4a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:05:01.826438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:01.827085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:01.840665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.841190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.841633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.842351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.842811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.843233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.857472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:01.858097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:01.875717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.876216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.876659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.877407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:01.877866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:01.878298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:01.920684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:05:02.097769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:02.280109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19f43155-cc40-4f56-bcde-64cce5b7fc69 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b" status: 204 len: 0 microversion: 2.47 time: 0.465195 Nov 03 04:05:02.285629 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1560/3242] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:05:01 2022] DELETE /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:05:02.304708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1cfa943c-d633-4f94-83f2-d1bf3a1e14e9 req-47e5f81d-2ed0-41a0-a1b7-499a4db85698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-plugged", "status": "completed", "tag": "003860eb-1280-48b6-9513-ea8500694f1b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:02.318506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1cfa943c-d633-4f94-83f2-d1bf3a1e14e9 req-47e5f81d-2ed0-41a0-a1b7-499a4db85698 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:02.319681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1cfa943c-d633-4f94-83f2-d1bf3a1e14e9 req-47e5f81d-2ed0-41a0-a1b7-499a4db85698 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:02.320225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1cfa943c-d633-4f94-83f2-d1bf3a1e14e9 req-47e5f81d-2ed0-41a0-a1b7-499a4db85698 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:02.336365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1cfa943c-d633-4f94-83f2-d1bf3a1e14e9 req-47e5f81d-2ed0-41a0-a1b7-499a4db85698 service nova] Creating event network-vif-plugged:003860eb-1280-48b6-9513-ea8500694f1b for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:05:02.346093 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1cfa943c-d633-4f94-83f2-d1bf3a1e14e9 req-47e5f81d-2ed0-41a0-a1b7-499a4db85698 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050671 Nov 03 04:05:02.347261 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1561/3243] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:02.353523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:02.354613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:02.362913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:02.363750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:02.364469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:02.365522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:02.366212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:02.366867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:02.486292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:02.513661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:02.524966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:02.527736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aebd1e76-a7c2-42aa-99e7-7458d031f731 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.673542 Nov 03 04:05:02.532290 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1683/3244] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:01 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:02.536461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:02.538019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:02.546284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:02.547143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:02.547767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:02.548694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:02.549657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:02.550257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:02.685327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:05:02.734150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a2cd7879-f329-4ae1-a941-ea0d555ad750 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1933 microversion: 2.75 time: 0.384924 Nov 03 04:05:02.751661 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1562/3245] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:02 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1933 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:02.768512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:02.769366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:02.777799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:02.778655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:02.779309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:02.780686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:02.781397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:02.782046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:02.802051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:02.822147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:02.824233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:02.825687 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cbed6ad-a037-409a-96f4-dfcc1fa8bb30 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b" status: 200 len: 1362 microversion: 2.47 time: 0.296114 Nov 03 04:05:02.830402 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1684/3246] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:02 2022] GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:03.028725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:03.041305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:03.043212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:03.059643 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cac313ea-6781-46c4-b6b1-9f48327b0b75 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.291872 Nov 03 04:05:03.059643 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1563/3247] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:02 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:03.120292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c1edbfa-6b83-48c6-a165-6b0aafb610bf tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Calling method '.version_select at 0x7ff7f887a4c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:03.212013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-4c1edbfa-6b83-48c6-a165-6b0aafb610bf tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:05:03.213040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-4c1edbfa-6b83-48c6-a165-6b0aafb610bf tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Neutron security group 32f133a2-c887-4b45-962f-50937fbec660 not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:05:03.214359 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4c1edbfa-6b83-48c6-a165-6b0aafb610bf tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] HTTP exception thrown: Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist Nov 03 04:05:03.214359 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f49ed6fc-e66a-41c2-81fc-671f0840108c'] Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c1edbfa-6b83-48c6-a165-6b0aafb610bf tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Request method failure captured: Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-security-groups/32f133a2-c887-4b45-962f-50937fbec660 HTTP/1.1 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3u53VQAxOmB_rKHKxtqvG7lvrifgiqoi6Yuf44Ffs6DDqxpej7xbwH5VGFDCFw1BL2xXcXkCroZWGu1VBLl3G8ZBgRp9fQlOv1GmIxPcUQjX4bGof10VKceBtA40msB6xubDvdZk8ImjEjYazaw1OyPaMRah6Z_3p9viRmI6cOgHg Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6281dca951a7452aad3498fff4055766", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6281dca951a7452aad3498fff4055766"}]}] Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c2d180108be5449d82cd3c8b8f8a83b0 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f49ed6fc-e66a-41c2-81fc-671f0840108c'] Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '32f133a2-c887-4b45-962f-50937fbec660'} Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:05:03.216315 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49ed6fc-e66a-41c2-81fc-671f0840108c'] Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49ed6fc-e66a-41c2-81fc-671f0840108c'] Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49ed6fc-e66a-41c2-81fc-671f0840108c'] Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f49ed6fc-e66a-41c2-81fc-671f0840108c'] Nov 03 04:05:03.221972 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:03.232887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c1edbfa-6b83-48c6-a165-6b0aafb610bf tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Returning 404 to user: Security group 32f133a2-c887-4b45-962f-50937fbec660 does not exist Nov 03 04:05:03.232887 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f49ed6fc-e66a-41c2-81fc-671f0840108c'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:03.234499 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c1edbfa-6b83-48c6-a165-6b0aafb610bf tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/32f133a2-c887-4b45-962f-50937fbec660" status: 404 len: 194 microversion: 2.1 time: 0.208035 Nov 03 04:05:03.235326 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1685/3248] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:05:03 2022] DELETE /compute/v2.1/os-security-groups/32f133a2-c887-4b45-962f-50937fbec660 => generated 194 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:05:03.245957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c5e42ba5-4a15-4d05-99e9-7d2498566928 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004278 Nov 03 04:05:03.250444 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1564/3249] 10.222.0.30 () {58 vars in 1164 bytes} [Thu Nov 3 04:05:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 03 04:05:03.257076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5eef7689-c865-4755-8c28-ef5dd95bdfa4 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Calling method '.version_select at 0x7ff7f87fc310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:03.557329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:03.557978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:03.564398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:03.564901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:03.565369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:03.566078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:03.566536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:03.566965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:03.605672 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5eef7689-c865-4755-8c28-ef5dd95bdfa4 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.353448 Nov 03 04:05:03.606900 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1686/3250] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 04:05:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:03.626466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98ca1ef7-ec08-454a-b224-e041f65f7bc1 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Calling method '.version_select at 0x7ff7f882f940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:04.080511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.094337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.097175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.098785 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b441fb74-d844-4acf-9613-854f6307cc9d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1879 microversion: 2.42 time: 0.545649 Nov 03 04:05:04.100031 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1565/3251] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:03 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1879 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:04.105535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:04.106875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:04.118419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.119372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.120056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.120996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.121723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.122380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.165567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-98ca1ef7-ec08-454a-b224-e041f65f7bc1 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:05:04.166578 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-98ca1ef7-ec08-454a-b224-e041f65f7bc1 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 03 04:05:04.166578 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f7ab2412-6294-46f1-92b6-33f9ac7c7430'] Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98ca1ef7-ec08-454a-b224-e041f65f7bc1 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Request method failure captured: Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-security-groups/4d598404-f100-469a-96b7-77e312c2f545 HTTP/1.1 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3u53VQAxOmB_rKHKxtqvG7lvrifgiqoi6Yuf44Ffs6DDqxpej7xbwH5VGFDCFw1BL2xXcXkCroZWGu1VBLl3G8ZBgRp9fQlOv1GmIxPcUQjX4bGof10VKceBtA40msB6xubDvdZk8ImjEjYazaw1OyPaMRah6Z_3p9viRmI6cOgHg Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6281dca951a7452aad3498fff4055766", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6281dca951a7452aad3498fff4055766"}]}] Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c2d180108be5449d82cd3c8b8f8a83b0 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: exception: Insufficient rights for removing default security group. Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f7ab2412-6294-46f1-92b6-33f9ac7c7430'] Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4d598404-f100-469a-96b7-77e312c2f545'} Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:05:04.169480 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7ab2412-6294-46f1-92b6-33f9ac7c7430'] Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7ab2412-6294-46f1-92b6-33f9ac7c7430'] Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7ab2412-6294-46f1-92b6-33f9ac7c7430'] Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7ab2412-6294-46f1-92b6-33f9ac7c7430'] Nov 03 04:05:04.174113 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.181683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98ca1ef7-ec08-454a-b224-e041f65f7bc1 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 03 04:05:04.181683 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f7ab2412-6294-46f1-92b6-33f9ac7c7430'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:04.183456 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98ca1ef7-ec08-454a-b224-e041f65f7bc1 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/4d598404-f100-469a-96b7-77e312c2f545" status: 400 len: 182 microversion: 2.1 time: 0.564101 Nov 03 04:05:04.186745 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1687/3252] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:05:03 2022] DELETE /compute/v2.1/os-security-groups/4d598404-f100-469a-96b7-77e312c2f545 => generated 182 bytes in 568 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:05:04.196722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:04.196722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:04.206127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.206632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.207081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.207808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.208373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.209300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.246501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] Lazy-loading 'services' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:05:04.268449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e162825-caa2-4208-9ed1-aeefc04145a9 tempest-ServersAdmin275Test-475292412 tempest-ServersAdmin275Test-475292412-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1918 microversion: 2.75 time: 0.167017 Nov 03 04:05:04.269164 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1566/3253] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:04 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1918 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:04.274185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:04.274997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:04.294250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.295240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.299557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.301278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.302473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.303706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.754985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.769183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.773073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.773073 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42008655-a877-43d7-8cbe-859b1dfebf94 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b" status: 200 len: 1362 microversion: 2.47 time: 0.584817 Nov 03 04:05:04.774204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1688/3254] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:04 2022] GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b => generated 1362 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:04.790690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.805824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.807759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:04.808058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6534cd3b-2980-4155-bae6-81cab7f55c47 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Calling method '.version_select at 0x7ff7f879b820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:04.814627 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da6e7d4f-7f1d-4d73-8bb3-50b5883178bf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.543957 Nov 03 04:05:04.816634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1567/3255] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:04 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:04.827294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:04.827294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:04.862420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.865499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.866026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.866789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:04.867358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:04.867994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:04.885553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-6534cd3b-2980-4155-bae6-81cab7f55c47 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:05:04.886171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-6534cd3b-2980-4155-bae6-81cab7f55c47 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Neutron security group dc5424c7-98e9-458b-ac9f-38149a70778d not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:05:04.886706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6534cd3b-2980-4155-bae6-81cab7f55c47 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] HTTP exception thrown: Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist Nov 03 04:05:04.886706 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-384c4201-0ce7-48dd-9403-f54efd9434c4'] Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6534cd3b-2980-4155-bae6-81cab7f55c47 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Request method failure captured: Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-security-groups/dc5424c7-98e9-458b-ac9f-38149a70778d HTTP/1.1 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3u53VQAxOmB_rKHKxtqvG7lvrifgiqoi6Yuf44Ffs6DDqxpej7xbwH5VGFDCFw1BL2xXcXkCroZWGu1VBLl3G8ZBgRp9fQlOv1GmIxPcUQjX4bGof10VKceBtA40msB6xubDvdZk8ImjEjYazaw1OyPaMRah6Z_3p9viRmI6cOgHg Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6281dca951a7452aad3498fff4055766", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6281dca951a7452aad3498fff4055766"}]}] Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c2d180108be5449d82cd3c8b8f8a83b0 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-384c4201-0ce7-48dd-9403-f54efd9434c4'] Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'dc5424c7-98e9-458b-ac9f-38149a70778d'} Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:05:04.888718 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384c4201-0ce7-48dd-9403-f54efd9434c4'] Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384c4201-0ce7-48dd-9403-f54efd9434c4'] Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384c4201-0ce7-48dd-9403-f54efd9434c4'] Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-384c4201-0ce7-48dd-9403-f54efd9434c4'] Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6534cd3b-2980-4155-bae6-81cab7f55c47 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Returning 404 to user: Security group dc5424c7-98e9-458b-ac9f-38149a70778d does not exist Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-384c4201-0ce7-48dd-9403-f54efd9434c4'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6534cd3b-2980-4155-bae6-81cab7f55c47 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] 10.222.0.30 "GET /compute/v2.1/os-security-groups/dc5424c7-98e9-458b-ac9f-38149a70778d" status: 404 len: 194 microversion: 2.1 time: 0.089687 Nov 03 04:05:04.892901 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1689/3256] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:05:04 2022] GET /compute/v2.1/os-security-groups/dc5424c7-98e9-458b-ac9f-38149a70778d => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:05:04.916410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82a1d668-6fd7-41f5-a40e-9faa7bdab5d2 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Action: 'update', calling method: .version_select at 0x7ff7f87feb80>, body: {"security_group": {"name": "tempest-sg-1958181134", "description": "tempest-description-741324861"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:04.941522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:05:04.965601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG neutronclient.v2_0.client [None req-82a1d668-6fd7-41f5-a40e-9faa7bdab5d2 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist", "detail": ""}} {{(pid=127594) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:05:04.966422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-82a1d668-6fd7-41f5-a40e-9faa7bdab5d2 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Neutron security group d6af6551-8d5a-48c1-8159-f1209b5a3550 not found {{(pid=127594) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:05:04.967117 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-82a1d668-6fd7-41f5-a40e-9faa7bdab5d2 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] HTTP exception thrown: Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist Nov 03 04:05:04.967117 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f9b96edb-b57a-40e6-979b-15f2907f2e70'] Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82a1d668-6fd7-41f5-a40e-9faa7bdab5d2 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Request method failure captured: Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/os-security-groups/d6af6551-8d5a-48c1-8159-f1209b5a3550 HTTP/1.1 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 101 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3u53VQAxOmB_rKHKxtqvG7lvrifgiqoi6Yuf44Ffs6DDqxpej7xbwH5VGFDCFw1BL2xXcXkCroZWGu1VBLl3G8ZBgRp9fQlOv1GmIxPcUQjX4bGof10VKceBtA40msB6xubDvdZk8ImjEjYazaw1OyPaMRah6Z_3p9viRmI6cOgHg Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6281dca951a7452aad3498fff4055766", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6281dca951a7452aad3498fff4055766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6281dca951a7452aad3498fff4055766"}]}] Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 6281dca951a7452aad3498fff4055766 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-493513047 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: c2d180108be5449d82cd3c8b8f8a83b0 Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-493513047-project Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: {"security_group": {"name": "tempest-sg-1958181134", "description": "tempest-description-741324861"}} Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: exception: Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f9b96edb-b57a-40e6-979b-15f2907f2e70'] Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'd6af6551-8d5a-48c1-8159-f1209b5a3550', 'body': {'security_group': {'name': 'tempest-sg-1958181134', 'description': 'tempest-description-741324861'}}} Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:05:04.970368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b96edb-b57a-40e6-979b-15f2907f2e70'] Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b96edb-b57a-40e6-979b-15f2907f2e70'] Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b96edb-b57a-40e6-979b-15f2907f2e70'] Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f9b96edb-b57a-40e6-979b-15f2907f2e70'] Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82a1d668-6fd7-41f5-a40e-9faa7bdab5d2 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] Returning 404 to user: Security group d6af6551-8d5a-48c1-8159-f1209b5a3550 does not exist Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: Neutron server returns request_ids: ['req-f9b96edb-b57a-40e6-979b-15f2907f2e70'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82a1d668-6fd7-41f5-a40e-9faa7bdab5d2 tempest-SecurityGroupsNegativeTestJSON-493513047 tempest-SecurityGroupsNegativeTestJSON-493513047-project] 10.222.0.30 "PUT /compute/v2.1/os-security-groups/d6af6551-8d5a-48c1-8159-f1209b5a3550" status: 404 len: 194 microversion: 2.1 time: 0.072825 Nov 03 04:05:04.975473 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1690/3257] 10.222.0.30 () {60 vars in 1290 bytes} [Thu Nov 3 04:05:04 2022] PUT /compute/v2.1/os-security-groups/d6af6551-8d5a-48c1-8159-f1209b5a3550 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:05:05.129049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:05.135789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:05.144372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.144897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.145381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.147482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.147965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.148463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.149913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:05.314957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1fcba279-5dc4-4a88-a321-4d6dc5709f22 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "DELETE /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 204 len: 0 microversion: 2.75 time: 0.496996 Nov 03 04:05:05.315553 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1568/3258] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:05:04 2022] DELETE /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:05:05.326551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:05.327595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:05.336158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.336968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.337438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.338155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.338608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.339048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.425800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:05.619807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:05.636622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:05.640457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:05.647747 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68f0d7ee-a87c-4892-9a6c-fbdf6aceacd9 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1443 microversion: 2.75 time: 0.325490 Nov 03 04:05:05.661708 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1569/3259] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:05 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1443 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:05.766617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:05.775373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:05.786648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:05.790751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:05.791012 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b11065a3-d3df-48a7-a7b4-e2de78d16d98 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2835 microversion: 2.42 time: 0.666603 Nov 03 04:05:05.793888 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1691/3260] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:05 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2835 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:05.816632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:05.817495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:05.831712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:05.832998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:05.835861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.837702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.839811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.842614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.844749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.845242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.848992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.855122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.855776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.856641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.857257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.857801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.941500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:05.943277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:05.945826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:05.946492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lazy-loading 'fault' on Instance uuid a13a7e5b-54f8-4477-9548-93ead3c7e18b {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:05:06.150786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:06.166063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:06.167516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '71b92ee969c14ea2ba015ed3381062aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af5e9d9f99f42189ae521de705566c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:06.168715 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27282ed9-95a6-456b-bb2f-c12a2e23d930 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b" status: 200 len: 1367 microversion: 2.47 time: 0.362293 Nov 03 04:05:06.169323 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1570/3261] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:05 2022] GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:06.194192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:06.194897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:06.210986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:06.211443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:06.211777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:06.212495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:06.212989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:06.217670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:06.287656 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9454da39-b7b4-4f67-bfe9-55386a6662d4 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.464368 Nov 03 04:05:06.291722 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1692/3262] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 04:05:05 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b/os-interface => generated 1831 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:06.411438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:06.425459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:06.427276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:06.435293 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d95b264-75ec-4e70-a702-0bde519ae0dc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.264915 Nov 03 04:05:06.438720 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1571/3263] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:06 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:06.631168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-244899531", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:06.685742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:06.691315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:06.714027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:06.715525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:06.716637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:06.717651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:06.718745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:06.723094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:06.744218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] validate_networks() for [('b19c6d7b-66aa-40da-9138-0de93bfa4b0a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:06.989359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:07.001286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:07.002866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:07.009992 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96ec5ca0-0ca7-4ba0-afef-b2d81f82e0b5 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1443 microversion: 2.75 time: 0.330679 Nov 03 04:05:07.011333 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1572/3264] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:06 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1443 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:07.163908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:07.166290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:07.168187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:07.168664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:07.169504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:07.170063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:07.170507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:07.204205 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a4d0154-7878-4006-b0ff-e8077ddcb05a tempest-AZV2TestJSON-1082374121 tempest-AZV2TestJSON-1082374121-project] 10.222.0.30 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.191359 Nov 03 04:05:07.215130 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1573/3265] 10.222.0.30 () {58 vars in 1164 bytes} [Thu Nov 3 04:05:07 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:05:07.223547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:07.224606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] [instance: a13a7e5b-54f8-4477-9548-93ead3c7e18b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:07.241692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:07.242188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:07.242618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:07.245598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:07.249113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:07.251160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:07.290493 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] HTTP exception thrown: Instance a13a7e5b-54f8-4477-9548-93ead3c7e18b could not be found. Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Request method failure captured: Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b HTTP/1.1 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz21Y0ySPAvgEKTRVhn2TeRA9_vEoRCN1uoljGH-LnCapGT8rXkZl_wV6peYvrcxJLXDbCWOhGUL_dkEaZjLhPS25csMfbGSusu92GvKRY3rNkxeueV0crt3wv9mL1DMn1g8Vcy9ZPhS3orfPJ_a9MjdCgqGCa_hKWgHJKIG4cbxsTc Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.47 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0af5e9d9f99f42189ae521de705566c1 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerShowV247Test-590092193 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0af5e9d9f99f42189ae521de705566c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0af5e9d9f99f42189ae521de705566c1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0af5e9d9f99f42189ae521de705566c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0af5e9d9f99f42189ae521de705566c1"}]}] Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerShowV247Test-590092193 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0af5e9d9f99f42189ae521de705566c1 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerShowV247Test-590092193 Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerShowV247Test-590092193-project Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 71b92ee969c14ea2ba015ed3381062aa Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerShowV247Test-590092193-project Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a13a7e5b-54f8-4477-9548-93ead3c7e18b could not be found. Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a13a7e5b-54f8-4477-9548-93ead3c7e18b'} Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13a7e5b-54f8-4477-9548-93ead3c7e18b could not be found. Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13a7e5b-54f8-4477-9548-93ead3c7e18b could not be found. Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:07.292324 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13a7e5b-54f8-4477-9548-93ead3c7e18b could not be found. Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:07.297257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] Returning 404 to user: Instance a13a7e5b-54f8-4477-9548-93ead3c7e18b could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:07.299634 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27789537-1ff2-4e06-a997-3a6f0eab6d79 tempest-ServerShowV247Test-590092193 tempest-ServerShowV247Test-590092193-project] 10.222.0.30 "GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b" status: 404 len: 111 microversion: 2.47 time: 0.080014 Nov 03 04:05:07.300636 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1574/3266] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:07 2022] GET /compute/v2.1/servers/a13a7e5b-54f8-4477-9548-93ead3c7e18b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:05:07.465519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:07.466486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:07.473781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:07.475233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:07.478863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:07.479743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:07.485868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:07.486592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:07.814305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:07.827786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:07.836430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:07.842239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7e966c29-b629-49b5-9c3f-e4f9b3321efc tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.380886 Nov 03 04:05:07.845740 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1575/3267] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:07 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:08.048345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:08.049202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:08.064833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:08.067216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:08.068279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:08.069716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:08.073196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:08.075490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:08.160903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:08.162035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:08.162925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:08.163615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:08.164223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:08.186523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:08.186989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:08.188696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:08.189419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:08.190131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lazy-loading 'fault' on Instance uuid 168b4edc-798d-4a5e-8866-5c0b244b2888 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:05:08.190887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:08.195402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:08.198788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:08.198788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:08.198788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:08.228365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:08.236032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for user eef8a5af3a6147e286ecc23d3aa0751e and project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:08.257883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:08.261826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:08.365817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:08.382486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:08.384205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a2035f1312c48df80044eb5ed36551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f69d2a2ad5c4f56b93b149758ab9ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:08.442820 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-012576be-0bda-478d-912f-81583938943e tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 200 len: 1448 microversion: 2.75 time: 0.399251 Nov 03 04:05:08.446898 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1576/3268] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:08 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 1448 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:08.453267 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d64ad60f-5546-494f-b456-eece312c29be tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.151651 Nov 03 04:05:08.454248 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1693/3269] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:05:08.468369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e4ce85dc-6369-4875-8d93-c78aed3ce0f2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:08.469233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e4ce85dc-6369-4875-8d93-c78aed3ce0f2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:08.568789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e4ce85dc-6369-4875-8d93-c78aed3ce0f2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:08.582985 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e4ce85dc-6369-4875-8d93-c78aed3ce0f2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1221 microversion: 2.1 time: 0.119867 Nov 03 04:05:08.583587 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1577/3270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:08 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:08.786458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-350441046", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:08.876497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:08.877200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:08.908001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:08.909242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:08.909911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:08.914006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:08.914540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:08.916317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:08.929338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:08.945606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] validate_networks() for [('b19c6d7b-66aa-40da-9138-0de93bfa4b0a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:09.182229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:09.198236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:09.200668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:09.207755 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ad64e41-49cc-46b7-8b90-1f94ab840c20 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.337224 Nov 03 04:05:09.227608 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1578/3271] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:08 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:09.483568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:09.484221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] [instance: 168b4edc-798d-4a5e-8866-5c0b244b2888] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:09.497235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:09.497235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:09.497235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:09.497235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:09.497235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:09.497235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:09.543106 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] HTTP exception thrown: Instance 168b4edc-798d-4a5e-8866-5c0b244b2888 could not be found. Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Request method failure captured: Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 HTTP/1.1 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz2i7MaddEs8mjSNHXaqxKB_YpvKVRK1FkLXUe8ooQPTq43RXIBKPEW5V1Tv_6iEW3FmSvL20SjuhtV8LeOBP2aIiBa8ynyacs9JqjxNMJfOmN5c9VvWKXofvS4dBRbUcqfp9uHEvED6LesDgBKSuKzD-Htqh3STWbM_cgO6myMQBYo Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.75 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 6f69d2a2ad5c4f56b93b149758ab9ca7 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdmin275Test-315141912 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6f69d2a2ad5c4f56b93b149758ab9ca7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6f69d2a2ad5c4f56b93b149758ab9ca7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6f69d2a2ad5c4f56b93b149758ab9ca7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6f69d2a2ad5c4f56b93b149758ab9ca7"}]}] Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdmin275Test-315141912 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 6f69d2a2ad5c4f56b93b149758ab9ca7 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdmin275Test-315141912 Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdmin275Test-315141912-project Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 1a2035f1312c48df80044eb5ed36551e Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdmin275Test-315141912-project Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 168b4edc-798d-4a5e-8866-5c0b244b2888 could not be found. Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '168b4edc-798d-4a5e-8866-5c0b244b2888'} Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168b4edc-798d-4a5e-8866-5c0b244b2888 could not be found. Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168b4edc-798d-4a5e-8866-5c0b244b2888 could not be found. Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:09.548171 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168b4edc-798d-4a5e-8866-5c0b244b2888 could not be found. Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] Returning 404 to user: Instance 168b4edc-798d-4a5e-8866-5c0b244b2888 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:09.552449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cdc888c7-ce84-412f-afd3-624c45c9aa57 tempest-ServersAdmin275Test-315141912 tempest-ServersAdmin275Test-315141912-project] 10.222.0.30 "GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888" status: 404 len: 111 microversion: 2.75 time: 0.067421 Nov 03 04:05:09.564836 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1579/3272] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:09 2022] GET /compute/v2.1/servers/168b4edc-798d-4a5e-8866-5c0b244b2888 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 03 04:05:09.582481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-15d12a47-71b2-426f-9f4a-cce5c3614689 req-e18f2522-f25f-4049-a968-d6f98b054e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "tag": "62e1cfcf-1c83-430f-9fd5-f159a52d8e46"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:09.604027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-15d12a47-71b2-426f-9f4a-cce5c3614689 req-e18f2522-f25f-4049-a968-d6f98b054e59 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:09.610817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-15d12a47-71b2-426f-9f4a-cce5c3614689 req-e18f2522-f25f-4049-a968-d6f98b054e59 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:09.616023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-15d12a47-71b2-426f-9f4a-cce5c3614689 req-e18f2522-f25f-4049-a968-d6f98b054e59 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:09.653237 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-15d12a47-71b2-426f-9f4a-cce5c3614689 req-e18f2522-f25f-4049-a968-d6f98b054e59 service nova] Creating event network-changed:62e1cfcf-1c83-430f-9fd5-f159a52d8e46 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:05:09.666368 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-15d12a47-71b2-426f-9f4a-cce5c3614689 req-e18f2522-f25f-4049-a968-d6f98b054e59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096658 Nov 03 04:05:09.670619 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1580/3273] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:10.115594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:10.119136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:10.122997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:10.122997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:10.122997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:10.142946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:10.143406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:10.143848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:10.149498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:10.154429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:10.155147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:10.229706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:10.237502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:10.239217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:10.248915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for user eef8a5af3a6147e286ecc23d3aa0751e and project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:10.250651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:10.251830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:10.253602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:10.254514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:10.257262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:10.257918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:10.282084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:10.288067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:10.437364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:10.447581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:10.455719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:10.457485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f7934a6-e13d-463d-a2a1-1858a2604c7c tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.225384 Nov 03 04:05:10.473436 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-43e9101b-a93d-4605-8097-3d2256876c8f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.693380 Nov 03 04:05:10.479184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1581/3274] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:10 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:10.484198 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1694/3275] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:05:10.487317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-235971fa-e758-4996-87a8-f31d858375e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:10.508787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-235971fa-e758-4996-87a8-f31d858375e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:10.524041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:10.619067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-235971fa-e758-4996-87a8-f31d858375e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:10.643459 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-235971fa-e758-4996-87a8-f31d858375e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1221 microversion: 2.1 time: 0.156605 Nov 03 04:05:10.647674 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1582/3276] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:10 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1221 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:11.495718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:11.497705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:11.512979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:11.519700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:11.519700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:11.519700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:11.519700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:11.519700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:11.647634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:11.662500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:11.665950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:11.668075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc03fd84-b10b-4a92-8b06-ab1a4e25acf0 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.185301 Nov 03 04:05:11.669971 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1695/3277] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:11 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:11.679080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ae7a011-e38a-4ce9-a55f-1598ea2780dc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:11.681167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ae7a011-e38a-4ce9-a55f-1598ea2780dc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:11.797498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ae7a011-e38a-4ce9-a55f-1598ea2780dc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:11.809906 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ae7a011-e38a-4ce9-a55f-1598ea2780dc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1221 microversion: 2.1 time: 0.135335 Nov 03 04:05:11.821218 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1583/3278] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:11 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1221 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:12.700548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:12.701626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:12.721809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:12.722306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:12.722846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:12.723497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:12.723951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:12.724629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:12.837206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:12.838705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:12.855306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:12.866735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:12.868984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:12.872472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:12.873034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:12.873745 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a23527f-5a93-4842-94a5-55a7b13c93ee tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.178729 Nov 03 04:05:12.875356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:12.876781 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1696/3279] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:12 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:12.878652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:12.880676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:12.881186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:13.029501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:13.045587 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f386c41-6b23-4a98-9f2a-ccbe5e0cc7cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1273 microversion: 2.1 time: 0.215882 Nov 03 04:05:13.063056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1584/3280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:12 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:13.903409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:13.904028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:13.915392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:13.915885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:13.916327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:13.917057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:13.921778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:13.922705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:14.074351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:14.075026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:14.097438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:14.117926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:14.117926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:14.117926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:14.117926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:14.117926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:14.625566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:14.637183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:14.639311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:14.641309 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2069f937-6953-4771-a70f-dcb9c39423f6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.741836 Nov 03 04:05:14.642038 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1697/3281] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:13 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:14.748798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:14.761355 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15204bfb-e330-4d40-9b6a-570acf362605 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1291 microversion: 2.1 time: 0.695420 Nov 03 04:05:14.764755 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1585/3282] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:14 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1291 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:15.671341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:15.671799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:15.705553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:15.706806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:15.707491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:15.710817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:15.711549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:15.712414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:15.787389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:15.789406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:15.811074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:15.812680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:15.814360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:15.816828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:15.819310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:15.819994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:15.832025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:15.846141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:15.849963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:15.852025 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0cc9c45c-973f-40fd-9220-2ab7a4a3bb14 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.187627 Nov 03 04:05:15.853687 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1698/3283] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:15 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:16.011005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:16.038198 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3479b175-bceb-4c52-849b-fe1078ba4bdf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1279 microversion: 2.1 time: 0.256832 Nov 03 04:05:16.042065 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1586/3284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:15 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1279 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:16.490704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6b4fc550-1e8a-43b9-892b-bcb2b5c249b2 req-6e824987-ea01-4f18-873b-2839939be92f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee668004-ab0e-4715-b036-b468dd887743", "tag": "ddb1c8db-77d4-4d1f-a953-0b70570f0efc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:16.512053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b4fc550-1e8a-43b9-892b-bcb2b5c249b2 req-6e824987-ea01-4f18-873b-2839939be92f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:16.516030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b4fc550-1e8a-43b9-892b-bcb2b5c249b2 req-6e824987-ea01-4f18-873b-2839939be92f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:16.516715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6b4fc550-1e8a-43b9-892b-bcb2b5c249b2 req-6e824987-ea01-4f18-873b-2839939be92f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:16.556141 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6b4fc550-1e8a-43b9-892b-bcb2b5c249b2 req-6e824987-ea01-4f18-873b-2839939be92f service nova] Creating event network-changed:ddb1c8db-77d4-4d1f-a953-0b70570f0efc for instance ee668004-ab0e-4715-b036-b468dd887743 on n-h1-854653-7 Nov 03 04:05:16.593289 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6b4fc550-1e8a-43b9-892b-bcb2b5c249b2 req-6e824987-ea01-4f18-873b-2839939be92f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103613 Nov 03 04:05:16.593289 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1699/3285] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:16.879589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:16.880335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:16.893672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:16.903872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:16.904635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:16.905972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:16.906560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:16.907231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:17.041608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1138367915", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:17.116189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:17.183912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:17.189122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:17.199785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:17.201298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:17.214737 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0091686e-5f9a-48b2-bae6-c8a5c3f26048 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.336417 Nov 03 04:05:17.214737 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1700/3286] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:16 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:17.226723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:17.227503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:17.237620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:17.238203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:17.242800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:17.242800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:17.243651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:17.244235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:17.996014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:18.008200 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-34beadef-1bc7-40be-9832-6435240072f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.794659 Nov 03 04:05:18.009216 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1701/3287] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:17 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:18.135121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:18.136154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:18.137197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:18.137768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:18.138466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:18.164369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:18.165163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:18.166559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:18.167504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:18.168145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:18.169810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:18.195306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Getting quotas for project db56e83192e0475995e6b9e373767b33. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:18.202461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Getting quotas for user 0bac75844a9f439cb9370230e50fc99d and project db56e83192e0475995e6b9e373767b33. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:18.224968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:18.229274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:18.248998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:18.250218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:18.262622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:18.263129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:18.263578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:18.264300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:18.267236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:18.267741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:18.331214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f5968b2-46fe-4791-8a2f-84453225a31a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.782353 Nov 03 04:05:18.343433 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1587/3288] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:05:18.491612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:18.508708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:18.508708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:18.509303 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f57a21c1-1ff9-4e6b-a7e8-83c653c9e257 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.270852 Nov 03 04:05:18.520811 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1702/3289] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:18 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:18.619603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-197322824", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:18.690896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:19.031345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:19.040793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:19.058546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:19.062555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:19.062555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:19.062555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:19.062555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:19.063487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:19.742118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:19.743225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:19.744154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:19.744634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:19.745171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:19.764484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:19.766206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:19.766762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:19.767732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:19.771629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:19.772308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:20.011706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Getting quotas for project db56e83192e0475995e6b9e373767b33. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:20.011706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Getting quotas for user 0bac75844a9f439cb9370230e50fc99d and project db56e83192e0475995e6b9e373767b33. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:20.011706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:20.011706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e39c248-c6a9-427b-ace2-573cfb54cffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.895985 Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1703/3290] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:19 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:20.015816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:20.061256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:20.072221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:20.074043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:20.075558 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0f2931f-4940-4c2a-b544-6a42b23a4ddf tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.142095 Nov 03 04:05:20.076760 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1704/3291] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:19 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:20.337080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-43557ebc-260b-45f9-988b-bc5db787b165 req-2bc75c3c-9b2e-41a4-a5a0-08977b7d191a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82465cf7-49c1-487c-abec-d774435ab248", "tag": "eed0ed2e-a58a-4dd6-a2d9-fc3c237abfee"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:20.344602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:20.349908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:20.350111 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b779acee-7ed2-4cac-b88c-95bf33610162 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733643 Nov 03 04:05:20.356936 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1588/3292] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:05:20.359649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-43557ebc-260b-45f9-988b-bc5db787b165 req-2bc75c3c-9b2e-41a4-a5a0-08977b7d191a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:20.360351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-43557ebc-260b-45f9-988b-bc5db787b165 req-2bc75c3c-9b2e-41a4-a5a0-08977b7d191a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:20.361517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-43557ebc-260b-45f9-988b-bc5db787b165 req-2bc75c3c-9b2e-41a4-a5a0-08977b7d191a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:20.362265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68934b92-8f69-4754-b0e8-24b8a8f6ba02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:20.362895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-68934b92-8f69-4754-b0e8-24b8a8f6ba02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:20.379540 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-43557ebc-260b-45f9-988b-bc5db787b165 req-2bc75c3c-9b2e-41a4-a5a0-08977b7d191a service nova] Creating event network-changed:eed0ed2e-a58a-4dd6-a2d9-fc3c237abfee for instance 82465cf7-49c1-487c-abec-d774435ab248 on n-h1-854653-7 Nov 03 04:05:20.388453 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-43557ebc-260b-45f9-988b-bc5db787b165 req-2bc75c3c-9b2e-41a4-a5a0-08977b7d191a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068429 Nov 03 04:05:20.389851 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1705/3293] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:20.687145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68934b92-8f69-4754-b0e8-24b8a8f6ba02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:20.709624 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68934b92-8f69-4754-b0e8-24b8a8f6ba02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1213 microversion: 2.1 time: 0.348525 Nov 03 04:05:20.712472 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1589/3294] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:20 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1213 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:20.953046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:20.954546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:20.966262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:20.995978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:20.999401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:21.002585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:21.003419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:21.004697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:21.126993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:21.128711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:21.139847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:21.143071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:21.143071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:21.143071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:21.144343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:21.144969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:21.461549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:21.482245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:21.485880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:21.488516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec7279ca-9be8-402c-90cb-70aa8171963e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.366505 Nov 03 04:05:21.504828 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1590/3295] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:21 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:21.743144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:21.743822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:21.765853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:21.766394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:21.766919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:21.769989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:21.781744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:21.782586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:21.934492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:21.951609 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11c57e6c-4f2c-495c-b9a9-fc72e7459767 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1217 microversion: 2.1 time: 0.216024 Nov 03 04:05:21.954457 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1591/3296] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:21 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1217 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:22.042621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:22.060840 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e6f4b67-ca22-4a27-a443-eec23385e702 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 1.104759 Nov 03 04:05:22.073044 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1706/3297] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:20 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:22.539278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:22.540878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:22.557109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:22.557984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:22.559271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:22.561884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:22.562573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:22.563784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:22.983806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:22.984864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:22.994105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:22.994982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:22.995702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:22.996765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:22.998288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:22.999844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:23.058840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:23.070267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:23.072422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:23.073923 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a806c5a-a5d0-408b-8e48-ad253a717a54 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.541292 Nov 03 04:05:23.076980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1592/3298] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:22 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:23.090464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:23.092914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:23.114195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:23.115467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:23.116083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:23.117236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:23.117927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:23.118552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:23.187625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:23.200804 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e72a23ee-18e7-4239-8fe2-315c3a65e80d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1265 microversion: 2.1 time: 0.222959 Nov 03 04:05:23.207338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1707/3299] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:22 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:23.998907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:24.008756 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83284241-34ce-4afc-ab0a-2987cebab464 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.924625 Nov 03 04:05:24.015225 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1593/3300] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:23 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:24.105735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:24.107086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:24.119056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:24.120404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:24.121121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:24.122342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:24.123059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:24.123756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:24.227824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:24.228304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:24.240683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:24.241214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:24.241659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:24.242370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:24.249965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:24.250777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:24.383306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:24.417150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:24.436840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:24.436840 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73dea785-0509-44b5-8d51-6bd2c73d9ce1 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.322778 Nov 03 04:05:24.436840 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1708/3301] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:24 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:24.444780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-48e6de16-cadf-425c-97f6-96557f45c953 req-388e1e82-042e-4160-9b98-4fec72b02818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee668004-ab0e-4715-b036-b468dd887743", "name": "network-vif-plugged", "status": "completed", "tag": "ddb1c8db-77d4-4d1f-a953-0b70570f0efc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:24.488535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48e6de16-cadf-425c-97f6-96557f45c953 req-388e1e82-042e-4160-9b98-4fec72b02818 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:24.489104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48e6de16-cadf-425c-97f6-96557f45c953 req-388e1e82-042e-4160-9b98-4fec72b02818 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:24.490611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48e6de16-cadf-425c-97f6-96557f45c953 req-388e1e82-042e-4160-9b98-4fec72b02818 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:24.495579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:24.511344 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-48e6de16-cadf-425c-97f6-96557f45c953 req-388e1e82-042e-4160-9b98-4fec72b02818 service nova] Creating event network-vif-plugged:ddb1c8db-77d4-4d1f-a953-0b70570f0efc for instance ee668004-ab0e-4715-b036-b468dd887743 on n-h1-854653-7 Nov 03 04:05:24.511559 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0add2766-72ce-4c0e-bac3-ef0fa89e0c0a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1271 microversion: 2.1 time: 0.286407 Nov 03 04:05:24.511559 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1594/3302] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:24 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1271 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:24.526157 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-48e6de16-cadf-425c-97f6-96557f45c953 req-388e1e82-042e-4160-9b98-4fec72b02818 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091361 Nov 03 04:05:24.527140 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1709/3303] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:25.041703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:25.042474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:25.050951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:25.051743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:25.052926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:25.054140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:25.054949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:25.055645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:25.462355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:25.463884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:25.494415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:25.496011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:25.496708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:25.497659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:25.498420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:25.502627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:25.580696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:25.590522 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15fbc9ac-c857-421f-ad3c-296a02df0cdc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.552788 Nov 03 04:05:25.612927 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1595/3304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:25 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:25.625499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:25.625828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:25.632886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:25.633632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:25.634273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:25.635246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:25.635862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:25.636526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:25.773984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:25.784226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:25.786080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:25.788211 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e6bc5163-a58e-4c67-ab53-5efaede6198f tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.338587 Nov 03 04:05:25.800051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:25.801160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1710/3305] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:25 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:25.811650 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2165f0c-a9b2-47ce-ad2e-8b50efa5b90d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1271 microversion: 2.1 time: 0.193775 Nov 03 04:05:25.814757 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1596/3306] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:25 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1271 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:26.622275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:26.626223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:26.648151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:26.648949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:26.655124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:26.655124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:26.655124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:26.655124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:26.820526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:26.821334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:26.829627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:26.831380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:26.831380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:26.831964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:26.832668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:26.833383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:27.216613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:27.234050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:27.236010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:27.237449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0d148165-ec59-4a09-b369-787d60c86b44 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.421198 Nov 03 04:05:27.238198 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1597/3307] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:26 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:27.243721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:27.244341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:27.266633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:27.267430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:27.268056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:27.268947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:27.269595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:27.270306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:27.612614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:27.623465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28c4b801-bd22-4679-8abe-13a50a70daec tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 1.008003 Nov 03 04:05:27.632606 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1711/3308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:26 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:27.812202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:27.827236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0dee3d4e-a2e9-4135-b8e2-ed3969c1f2a6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.585139 Nov 03 04:05:27.857845 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1598/3309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:27 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:28.270308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:28.270308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:28.291232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:28.291944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:28.292509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:28.293389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:28.294534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:28.303860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:28.314819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:28.491564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:28.510428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:28.513927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:28.515566 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2734c31c-7dad-42ab-b21a-acaac33f1e71 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1366 microversion: 2.57 time: 0.252769 Nov 03 04:05:28.517587 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1712/3310] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:28 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:28.657932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:28.658776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:28.669049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:28.670376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:28.671694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:28.672707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:28.673448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:28.675821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:28.877585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:28.877585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:28.896768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:28.900316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:28.900867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:28.902104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:28.902588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:28.903026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:28.977806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:29.003427 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-654f5f7b-1279-4f67-9135-6a0500408ff7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.350239 Nov 03 04:05:29.019280 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1599/3311] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:28 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:29.157049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:29.170101 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e56b0505-a81e-4668-b5ec-af3bb5dc639a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.306826 Nov 03 04:05:29.170776 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1713/3312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:28 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:29.547054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:29.547701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:29.559704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:29.565991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:29.565991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:29.565991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:29.565991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:29.565991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:29.614930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:29.778403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:29.806200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:29.817004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:29.821070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed926b5e-3fff-47f4-9d83-b00de7e145f2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1372 microversion: 2.57 time: 0.278106 Nov 03 04:05:29.822226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1600/3313] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:29 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1372 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:30.043414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:30.044308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:30.046859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:30.065095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:30.068373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:30.069301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:30.071840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:30.072334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:30.072773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:30.122434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47cce10e-d437-49be-9793-0e107fb620ff tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Action: 'create', calling method: .version_select at 0x7ff7f91654c0>, body: {"keypair": {"name": "tempest-keypair-1781604752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9IPYMNo3OK6FMGt0AR1309qe4ctwGfkI0ZCxGp6QyuQ0+sRox6C8eFlO7cicJfbg7eL4YQV7chi2X7afv9Ru4LCQWcXyVMWcu/cqqoPiYtge4ZjxG8x0j0Pf8Ktcaasw=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:30.187375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-47cce10e-d437-49be-9793-0e107fb620ff tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Getting quotas for project e2b343e183d648cc8d845666db0e6a72. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:30.199985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-47cce10e-d437-49be-9793-0e107fb620ff tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Getting quotas for user d0d85da409e14b308b1540ae501f8297 and project e2b343e183d648cc8d845666db0e6a72. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:30.247066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:30.357813 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-47cce10e-d437-49be-9793-0e107fb620ff tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.655970 Nov 03 04:05:30.369558 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1714/3314] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:05:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:30.377458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:30.380179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:30.397873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:30.398608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:30.399242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:30.400503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:30.401477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:30.404000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:30.430584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:30.480025 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c3cbd607-8c25-47ea-ba55-a9af26c388e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.423868 Nov 03 04:05:30.484780 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1601/3315] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:30 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:30.506905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-101ecca1-ae28-44ba-84e2-126c7a634c07 req-88d0f906-dc1f-480a-8ef8-bc3117068783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b61b13-d16f-45b6-aff0-c56fac27466e", "tag": "3902d028-7167-4c1a-9a7b-fe465f176b4b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:30.531924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-101ecca1-ae28-44ba-84e2-126c7a634c07 req-88d0f906-dc1f-480a-8ef8-bc3117068783 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:30.552057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-101ecca1-ae28-44ba-84e2-126c7a634c07 req-88d0f906-dc1f-480a-8ef8-bc3117068783 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:30.553199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-101ecca1-ae28-44ba-84e2-126c7a634c07 req-88d0f906-dc1f-480a-8ef8-bc3117068783 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:30.599096 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-101ecca1-ae28-44ba-84e2-126c7a634c07 req-88d0f906-dc1f-480a-8ef8-bc3117068783 service nova] Creating event network-changed:3902d028-7167-4c1a-9a7b-fe465f176b4b for instance d6b61b13-d16f-45b6-aff0-c56fac27466e on n-h2-854653-7 Nov 03 04:05:30.605900 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-101ecca1-ae28-44ba-84e2-126c7a634c07 req-88d0f906-dc1f-480a-8ef8-bc3117068783 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116664 Nov 03 04:05:30.608415 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1602/3316] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:30.808326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:30.823189 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92b9ccca-7a27-437d-b1e9-dfef4bf83073 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.449579 Nov 03 04:05:30.824834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1715/3317] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:30 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:30.853937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=20 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:30.860071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:30.861560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:30.882224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:30.882762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:30.883314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:30.884064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:30.884541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:30.884984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:30.999880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:31.016338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:31.020961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:31.028038 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-892607c3-cc2d-4139-9f6d-a2dcde578fc6 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1372 microversion: 2.57 time: 0.172966 Nov 03 04:05:31.029650 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1603/3318] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:30 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:31.498054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:31.498872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:31.512488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:31.516626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:31.517338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:31.518213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:31.518801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:31.526449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:31.848686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:31.849349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:31.866787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:31.871128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:31.871128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:31.871128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:31.871128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:31.874389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:31.928330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:31.939434 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d03d365d-3dba-4f33-aae5-d1b5539b07e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.448085 Nov 03 04:05:31.940123 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1716/3319] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:31 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:32.060867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:32.061128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:32.071864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:32.072380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:32.072831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:32.073589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:32.074057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:32.074493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:32.205167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:32.211481 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0edb9ec0-c593-4293-bd67-fc9f50feb46d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.367489 Nov 03 04:05:32.219898 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1604/3320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:31 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:32.227657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2d34495d-22b5-4338-8cad-e68fea9c18c0 req-0ecbfdea-95f6-40fd-bb1f-7cf84aea8931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82465cf7-49c1-487c-abec-d774435ab248", "name": "network-vif-plugged", "status": "completed", "tag": "eed0ed2e-a58a-4dd6-a2d9-fc3c237abfee"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:32.261059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2d34495d-22b5-4338-8cad-e68fea9c18c0 req-0ecbfdea-95f6-40fd-bb1f-7cf84aea8931 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:32.261825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2d34495d-22b5-4338-8cad-e68fea9c18c0 req-0ecbfdea-95f6-40fd-bb1f-7cf84aea8931 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:32.262667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2d34495d-22b5-4338-8cad-e68fea9c18c0 req-0ecbfdea-95f6-40fd-bb1f-7cf84aea8931 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:32.296248 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2d34495d-22b5-4338-8cad-e68fea9c18c0 req-0ecbfdea-95f6-40fd-bb1f-7cf84aea8931 service nova] Creating event network-vif-plugged:eed0ed2e-a58a-4dd6-a2d9-fc3c237abfee for instance 82465cf7-49c1-487c-abec-d774435ab248 on n-h1-854653-7 Nov 03 04:05:32.306656 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2d34495d-22b5-4338-8cad-e68fea9c18c0 req-0ecbfdea-95f6-40fd-bb1f-7cf84aea8931 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083056 Nov 03 04:05:32.307291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1605/3321] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:32.311416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:32.328879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:32.330815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:32.336072 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b4faa40b-2db4-426f-b7bf-49802d05375a tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1372 microversion: 2.57 time: 0.280014 Nov 03 04:05:32.338462 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1717/3322] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:32 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:05:32.924794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ab91d6f0-9563-48a2-8494-501e9000e3bc req-2f878d91-c3c3-4392-b70f-eba45c9b8e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8270a258-c47c-4515-a324-c7a654e486d5", "tag": "5ec11f60-3e22-4cce-9f2c-fff6ae424ea1"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:32.947914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ab91d6f0-9563-48a2-8494-501e9000e3bc req-2f878d91-c3c3-4392-b70f-eba45c9b8e43 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:32.948408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ab91d6f0-9563-48a2-8494-501e9000e3bc req-2f878d91-c3c3-4392-b70f-eba45c9b8e43 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:32.948854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ab91d6f0-9563-48a2-8494-501e9000e3bc req-2f878d91-c3c3-4392-b70f-eba45c9b8e43 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:32.969962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:32.970591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:32.980363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:32.980867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:32.981343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:32.982061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:32.982527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:32.982964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:33.000507 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ab91d6f0-9563-48a2-8494-501e9000e3bc req-2f878d91-c3c3-4392-b70f-eba45c9b8e43 service nova] Creating event network-changed:5ec11f60-3e22-4cce-9f2c-fff6ae424ea1 for instance 8270a258-c47c-4515-a324-c7a654e486d5 on n-h2-854653-7 Nov 03 04:05:33.012447 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ab91d6f0-9563-48a2-8494-501e9000e3bc req-2f878d91-c3c3-4392-b70f-eba45c9b8e43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092953 Nov 03 04:05:33.016160 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1606/3323] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:33.251663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:33.253207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:33.263407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:33.263917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:33.264369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:33.265122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:33.269712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:33.276401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:33.286603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:33.308442 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c926d3be-9ce2-45b0-9d93-4b6b5de7b4c1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1321 microversion: 2.1 time: 0.342986 Nov 03 04:05:33.361894 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1718/3324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:32 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:33.373982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:33.375137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:33.382574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:33.383530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:33.384216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:33.385172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:33.385977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:33.387034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:33.559833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:33.589036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:33.594812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:33.598563 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2215b887-ddc4-4203-b021-2b6bc447a208 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1357 microversion: 2.57 time: 0.233336 Nov 03 04:05:33.600443 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1719/3325] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:33 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:33.636335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:33.637286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:33.647368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:33.652507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:33.653196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:33.654147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:33.656510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:33.657251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:33.718698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:05:33.831398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:33.851103 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-093a993b-8c02-437f-939b-3c70006e4b6d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.594686 Nov 03 04:05:33.851981 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1607/3326] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:33 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:34.052393 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-deba5985-cc9e-412c-9740-5a36ebc6e749 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "DELETE /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 204 len: 0 microversion: 2.57 time: 0.421365 Nov 03 04:05:34.053339 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1720/3327] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:05:33 2022] DELETE /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:05:34.062204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:34.064107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:34.102472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.108900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.109829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:34.113729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.117071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.131165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:34.339454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:34.371542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:34.376627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:34.380162 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47df7aa2-2aaa-43d2-b4d9-d67f99e31c98 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1363 microversion: 2.57 time: 0.322278 Nov 03 04:05:34.381628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:34.382423 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1608/3328] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:34 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:34.382606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:34.393922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.399812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.401396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:34.402376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.403160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.403792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:34.721493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:34.737074 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77659941-3553-4a66-a66d-7d34063f91b9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1514 microversion: 2.1 time: 0.357836 Nov 03 04:05:34.759240 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1721/3329] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:34 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1514 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:34.767318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:34.769938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:34.789709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.791022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.792582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:34.798634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.800895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.803526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:34.869009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lazy-loading 'flavor' on Instance uuid 82465cf7-49c1-487c-abec-d774435ab248 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:05:34.875807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:34.876550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:34.888708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.890531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.891785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:34.894422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:34.898049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:34.898731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:35.409960 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2755e75a-171e-4b18-af22-9e2de3149ef9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action" status: 200 len: 32 microversion: 2.1 time: 0.649080 Nov 03 04:05:35.414226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1609/3330] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:05:34 2022] POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action => generated 32 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:05:35.427330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:35.434830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:35.453820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:35.454703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:35.455422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:35.456445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:35.459345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:35.459892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:35.712690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:35.726468 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14d93c18-7dd0-414c-8f1f-f542edec6642 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.854872 Nov 03 04:05:35.737185 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1722/3331] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:34 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:35.751970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:35.753085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:35.761711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:35.762399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:35.767041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:35.768083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:35.768795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:35.769479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:35.847576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:35.862639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:35.866503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd75133f6989c4e9698aec81441432d95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d2a9ec956fb4f719c17e0ef66aadd06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:35.873436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b2e0e44-61c7-4454-b54a-137543ad239e tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 200 len: 1363 microversion: 2.57 time: 0.460859 Nov 03 04:05:35.874237 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1610/3332] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:35 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 1363 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:05:36.137117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1211742729", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5a0c48eb-7267-438e-aab0-3fac0847a89e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:36.229572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] validate_networks() for [('5a0c48eb-7267-438e-aab0-3fac0847a89e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:36.969007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:36.995448 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c14158e-022c-4f67-9cbc-3c7766a89ee9 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 1.255815 Nov 03 04:05:37.002131 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1723/3333] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:35 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:37.007846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:37.008717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:37.025786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:37.027004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:37.028105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:37.030970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:37.031570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:37.032103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:37.515363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:37.529560 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-49cf5641-51a9-4677-a601-fc9882cf6516 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.525801 Nov 03 04:05:37.530433 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1724/3334] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:37 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:37.540967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:37.541619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] [instance: 59d80c7d-cc30-48ce-93f3-1d6546fe7250] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:37.555269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:37.557124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:37.557965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:37.559453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:37.560093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:37.560693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:37.606096 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] HTTP exception thrown: Instance 59d80c7d-cc30-48ce-93f3-1d6546fe7250 could not be found. Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Request method failure captured: Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 HTTP/1.1 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3fcaH0a5HZZNTAYs4LnpbzxJaMD4qurYZ8Z4MC6FWcyxcSBDIss1jCaxMxjE2t3C-evPDYjFsG4CwUCysXd9P9lMvVxPcfq0-ExJgYLMIVHXiXR67kQ1Ek6grbDDYzeNhvzeNM3J31Fa0JZiEOBwe_VhI1uKLUeZp3-wbdChinetU Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.57 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3d2a9ec956fb4f719c17e0ef66aadd06 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerShowV257Test-1731525026 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d2a9ec956fb4f719c17e0ef66aadd06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d2a9ec956fb4f719c17e0ef66aadd06", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d2a9ec956fb4f719c17e0ef66aadd06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d2a9ec956fb4f719c17e0ef66aadd06"}]}] Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerShowV257Test-1731525026 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3d2a9ec956fb4f719c17e0ef66aadd06 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerShowV257Test-1731525026 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerShowV257Test-1731525026-project Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d75133f6989c4e9698aec81441432d95 Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerShowV257Test-1731525026-project Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 59d80c7d-cc30-48ce-93f3-1d6546fe7250 could not be found. Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '59d80c7d-cc30-48ce-93f3-1d6546fe7250'} Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59d80c7d-cc30-48ce-93f3-1d6546fe7250 could not be found. Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59d80c7d-cc30-48ce-93f3-1d6546fe7250 could not be found. Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:05:37.609755 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59d80c7d-cc30-48ce-93f3-1d6546fe7250 could not be found. Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] Returning 404 to user: Instance 59d80c7d-cc30-48ce-93f3-1d6546fe7250 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f3d5419-f23b-47db-a47d-a0494f053eb2 tempest-ServerShowV257Test-1731525026 tempest-ServerShowV257Test-1731525026-project] 10.222.0.30 "GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250" status: 404 len: 111 microversion: 2.57 time: 0.080082 Nov 03 04:05:37.620141 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1725/3335] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:05:37 2022] GET /compute/v2.1/servers/59d80c7d-cc30-48ce-93f3-1d6546fe7250 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:05:37.624387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-218951853", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "4e5bf2ea-5738-47ba-86c8-cb55a66796f5"}], "security_groups": [{"name": "tempest-securitygroup--1330863153"}], "key_name": "tempest-keypair-1781604752", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:37.972477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] validate_networks() for [('4e5bf2ea-5738-47ba-86c8-cb55a66796f5', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:38.351581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:38.361649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:38.362611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:38.363025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:38.363632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:38.378406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:38.378898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:38.380194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:38.381135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:38.381768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:38.382356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:38.414606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Getting quotas for project dd9e44b66aa045a48f1b00e6a5488200. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:38.421933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Getting quotas for user f6a300273c724268abdaba803626056b and project dd9e44b66aa045a48f1b00e6a5488200. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:38.427770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:38.438519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Going to run 2 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:38.441517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c7f09169-ea5d-4883-9917-c0fecd31c181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:38.552720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=c7f09169-ea5d-4883-9917-c0fecd31c181,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:38.740526 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89ebe399-e87a-4dec-ac1f-3e8e07b3fa2a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.864893 Nov 03 04:05:38.758634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1611/3336] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:05:38.767029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:38.767997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:38.778826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:38.780021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:38.780792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:38.782751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:38.783691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:38.784466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:39.139839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:39.149916 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-945d711b-a7f4-47ee-965e-8ec975851fb2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.395737 Nov 03 04:05:39.166945 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1612/3337] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:38 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:39.172442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:39.173294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:39.182218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Getting quotas for project e2b343e183d648cc8d845666db0e6a72. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:39.194172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:39.194673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:39.195106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:39.198759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Getting quotas for user d0d85da409e14b308b1540ae501f8297 and project e2b343e183d648cc8d845666db0e6a72. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:39.199284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:39.199770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:39.200216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:39.215301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:39.215723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:39.216404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:39.217414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:39.218023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:39.233283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:39.234001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:39.234830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:39.236278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:39.237195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:39.239469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:39.273148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Getting quotas for project e2b343e183d648cc8d845666db0e6a72. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:39.280620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Getting quotas for user d0d85da409e14b308b1540ae501f8297 and project e2b343e183d648cc8d845666db0e6a72. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:39.312080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:39.315745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:39.503596 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-52de28dd-9bfe-449b-b4ba-466c9d476c90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.882065 Nov 03 04:05:39.506206 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1726/3338] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:37 2022] POST /compute/v2.1/servers => generated 407 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:05:39.524697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:39.563079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:39.563898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Searching by: {'deleted': False, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:05:39.638206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:39.638934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:39.641179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:39.642163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:39.644299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:39.645978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:39.665507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:39.676977 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1fb8811-6315-48ee-84f3-c594f63385ca tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.508122 Nov 03 04:05:39.689217 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1613/3339] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:39 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:39.692489 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84c1f18e-028a-4d6a-8241-5bac207d421f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.183355 Nov 03 04:05:39.698629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d80ea6e-be33-44a7-8450-f257110b7f2f tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:39.706228 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1727/3340] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:05:39 2022] GET /compute/v2.1/servers => generated 677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:39.714382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16c6e9bf-3cb9-4c80-a13d-dc33a94b9055 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:39.715018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16c6e9bf-3cb9-4c80-a13d-dc33a94b9055 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:39.719780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0d80ea6e-be33-44a7-8450-f257110b7f2f tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:39.993282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16c6e9bf-3cb9-4c80-a13d-dc33a94b9055 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:40.006265 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16c6e9bf-3cb9-4c80-a13d-dc33a94b9055 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1220 microversion: 2.1 time: 0.300606 Nov 03 04:05:40.026100 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1728/3341] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:39 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1220 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:40.030455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-47c20eda-fb99-45fe-81c0-58cce2c78b7d req-df8f0741-2a69-404b-a572-ccd37797c427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b61b13-d16f-45b6-aff0-c56fac27466e", "name": "network-vif-plugged", "status": "completed", "tag": "3902d028-7167-4c1a-9a7b-fe465f176b4b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:40.044461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-47c20eda-fb99-45fe-81c0-58cce2c78b7d req-df8f0741-2a69-404b-a572-ccd37797c427 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:40.045379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-47c20eda-fb99-45fe-81c0-58cce2c78b7d req-df8f0741-2a69-404b-a572-ccd37797c427 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:40.046071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-47c20eda-fb99-45fe-81c0-58cce2c78b7d req-df8f0741-2a69-404b-a572-ccd37797c427 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:40.066443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-47c20eda-fb99-45fe-81c0-58cce2c78b7d req-df8f0741-2a69-404b-a572-ccd37797c427 service nova] Creating event network-vif-plugged:3902d028-7167-4c1a-9a7b-fe465f176b4b for instance d6b61b13-d16f-45b6-aff0-c56fac27466e on n-h2-854653-7 Nov 03 04:05:40.076987 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-47c20eda-fb99-45fe-81c0-58cce2c78b7d req-df8f0741-2a69-404b-a572-ccd37797c427 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051180 Nov 03 04:05:40.078229 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1729/3342] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:40.136831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0d80ea6e-be33-44a7-8450-f257110b7f2f tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:40.146052 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0d80ea6e-be33-44a7-8450-f257110b7f2f tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1269 microversion: 2.1 time: 0.452702 Nov 03 04:05:40.146650 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1614/3343] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:39 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1269 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:40.179774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:40.184951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:40.192358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:40.194912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:40.196145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:40.198361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:40.199888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:40.209921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:40.728264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:40.728877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:40.751483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:40.751483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:40.751483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:40.751483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:40.751483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:40.751876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:40.989857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:41.000909 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f802214f-8834-48e4-b5b9-f571647da902 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.825590 Nov 03 04:05:41.006089 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1730/3344] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:40 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:41.037552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07e6418b-0ecd-4fd0-8be7-eafcb4b9e2b1 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:41.040194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07e6418b-0ecd-4fd0-8be7-eafcb4b9e2b1 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:41.171950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07e6418b-0ecd-4fd0-8be7-eafcb4b9e2b1 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:41.180320 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07e6418b-0ecd-4fd0-8be7-eafcb4b9e2b1 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1220 microversion: 2.1 time: 0.153054 Nov 03 04:05:41.207281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1731/3345] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:41 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1220 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:41.233444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5738fa4f-2103-4b63-9525-f01d4e7b37e8 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:41.237940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5738fa4f-2103-4b63-9525-f01d4e7b37e8 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:41.356309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5738fa4f-2103-4b63-9525-f01d4e7b37e8 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:41.367737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:41.377776 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5738fa4f-2103-4b63-9525-f01d4e7b37e8 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1269 microversion: 2.1 time: 0.159688 Nov 03 04:05:41.385252 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1732/3346] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:41 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:41.385661 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30b6bc17-fd97-4c4f-9f55-638036c505c4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.658250 Nov 03 04:05:41.385661 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1615/3347] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:40 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:42.032638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:42.034158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:42.043650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.044525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.045206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.046146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.046788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.047822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.209610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:42.213982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:42.250596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.252465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.255968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.258974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.261749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.265289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.458630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:42.467701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2deb56bc-b414-44aa-bc26-80710bc49823 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1224 microversion: 2.1 time: 0.263210 Nov 03 04:05:42.472327 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1616/3348] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:42 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1224 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:42.489892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:42.491113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:42.522224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.522840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.523295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.529864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.529864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.529864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.568529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:42.574375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:42.586159 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f82f5e75-c17f-45b2-a044-57584056776c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.556933 Nov 03 04:05:42.589347 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1733/3349] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:42 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:42.604197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:42.606052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:42.621354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.622164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.622847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.624586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:42.637516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:42.638001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:42.710522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:42.719786 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e7a70ed-3510-448f-939c-cb684fdcb28c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1265 microversion: 2.1 time: 0.245490 Nov 03 04:05:42.720760 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1617/3350] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:42 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:42.937122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:42.950258 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a334315-277b-427e-9583-9cd97210d3a5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.357552 Nov 03 04:05:42.953776 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1734/3351] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:42 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:43.114858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8d7957c7-dcae-4920-bae5-a32877855871 req-310a0b55-6d5d-487d-ad9e-3a8e9285fe30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8270a258-c47c-4515-a324-c7a654e486d5", "name": "network-vif-plugged", "status": "completed", "tag": "5ec11f60-3e22-4cce-9f2c-fff6ae424ea1"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:43.134944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8d7957c7-dcae-4920-bae5-a32877855871 req-310a0b55-6d5d-487d-ad9e-3a8e9285fe30 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:43.135351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8d7957c7-dcae-4920-bae5-a32877855871 req-310a0b55-6d5d-487d-ad9e-3a8e9285fe30 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:43.135784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8d7957c7-dcae-4920-bae5-a32877855871 req-310a0b55-6d5d-487d-ad9e-3a8e9285fe30 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:43.149442 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8d7957c7-dcae-4920-bae5-a32877855871 req-310a0b55-6d5d-487d-ad9e-3a8e9285fe30 service nova] Creating event network-vif-plugged:5ec11f60-3e22-4cce-9f2c-fff6ae424ea1 for instance 8270a258-c47c-4515-a324-c7a654e486d5 on n-h2-854653-7 Nov 03 04:05:43.154629 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8d7957c7-dcae-4920-bae5-a32877855871 req-310a0b55-6d5d-487d-ad9e-3a8e9285fe30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044860 Nov 03 04:05:43.155368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1618/3352] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:43.502178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:43.503130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:43.518948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:43.519463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:43.526118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:43.529191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:43.534183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:43.534583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:43.620533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:43.620533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:43.634968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:43.636486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:43.639417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:43.640315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:43.655573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:43.655573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:43.685263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:43.692497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:43.697702 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20b773b9-a695-4da0-b04d-4fa33f15326f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1216 microversion: 2.1 time: 0.201298 Nov 03 04:05:43.710161 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1735/3353] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:43 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:43.750327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:43.751616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:43.768784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:43.774472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:43.775345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:43.776273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:43.778564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:43.779310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:43.951808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:43.969482 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48087d1d-cbee-482d-806e-b20695601a90 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1321 microversion: 2.1 time: 0.218126 Nov 03 04:05:43.969482 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1736/3354] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:43 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:43.990872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:43.996940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:44.011961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:44.012990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:44.013884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:44.019949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:44.019949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:44.019949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:44.204975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:44.219150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39b32ac1-248b-4975-900d-750f2ca14524 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.609568 Nov 03 04:05:44.220632 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1619/3355] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:43 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:44.318363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:44.327411 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-850c64bc-2c73-474b-beda-0d1faae63a02 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1313 microversion: 2.1 time: 0.342165 Nov 03 04:05:44.328528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1737/3356] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:43 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:44.736721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:44.737636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:44.757279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:44.758284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:44.759669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:44.763346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:44.765793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:44.773936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:45.016605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:45.018085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:45.039271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:45.042826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:45.043498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:45.045689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:45.049194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:45.050687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:45.096663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:45.125418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1bb000af-dcc1-432f-991e-e79e0364d8e7 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1272 microversion: 2.1 time: 0.392010 Nov 03 04:05:45.129593 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1620/3357] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:44 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1272 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:45.247031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:45.247889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:45.259298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:45.260234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:45.261918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:45.262923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:45.263547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:45.264213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:45.339269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:45.359358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2fc805b-4b40-46fa-8a11-f31684e8a549 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1329 microversion: 2.1 time: 0.378897 Nov 03 04:05:45.373514 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1738/3358] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:44 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1329 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:45.399859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:45.400882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:45.413994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:45.414882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:45.416911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:45.417908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:45.418894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:45.420324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:46.675576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:46.686712 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40b51dfe-4647-45f1-aeb4-2ac7ebeb8050 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 1.444658 Nov 03 04:05:46.687938 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1621/3359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:45 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:46.695318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:46.696107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:46.704623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:46.705799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:46.706483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:46.707476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:46.708379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:46.709422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:46.758369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:46.776235 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2324d66-d65d-45fc-968d-563411f58a09 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1463 microversion: 2.1 time: 1.394386 Nov 03 04:05:46.777147 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1739/3360] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:45 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1463 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:46.784717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:46.785626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:46.804385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:46.805270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:46.805897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:46.806948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:46.809006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:46.809915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:46.949852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:46.960936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ec3d90b-2637-4d1d-b346-926862b1c215 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1278 microversion: 2.1 time: 0.271330 Nov 03 04:05:46.961818 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1622/3361] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:46 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1278 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:46.984541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:46.985953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:46.994860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:46.995583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:46.996209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:46.997294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:46.998035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:46.998666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:47.081540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:47.090594 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ec8eebd-f14a-4421-95b6-a2b1f0707a91 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1327 microversion: 2.1 time: 0.312149 Nov 03 04:05:47.091784 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1740/3362] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:46 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1327 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:47.432885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:47.446142 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f6e1ac1-020c-4602-9023-ad0ade415ab5 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1464 microversion: 2.1 time: 0.468539 Nov 03 04:05:47.447291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1623/3363] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:46 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1464 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:47.702868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-394198410", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "d6b61b13-d16f-45b6-aff0-c56fac27466e"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:47.714699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:47.717737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:47.726619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:47.739929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:47.742690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:47.762761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:47.764838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:47.765772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:47.820413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:48.392204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:48.405042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:48.437224 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40504450-ae85-4ae6-8e45-bf615828d851 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.726136 Nov 03 04:05:48.451586 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1624/3364] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:47 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:48.477762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:48.478670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:48.521487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:48.525383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:48.526150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:48.531033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:48.534387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:48.535772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:48.653494 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:05:48.653750 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:05:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 (ip 10.222.0.30) !!! Nov 03 04:05:48.765450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:48.765877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:48.766357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:48.766766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:48.767183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:48.797779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:48.800409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:48.805378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:48.813822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:48.813822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:48.813822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:48.878371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Getting quotas for project db56e83192e0475995e6b9e373767b33. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:48.912478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Getting quotas for user 0bac75844a9f439cb9370230e50fc99d and project db56e83192e0475995e6b9e373767b33. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:48.923314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:48.934753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:48.937487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:49.000065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:49.014429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19ccd492-8a2d-4c73-9926-fc02881a9d6e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1278 microversion: 2.1 time: 0.558650 Nov 03 04:05:49.015350 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1625/3365] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:48 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1278 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:49.026103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:49.027019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:49.042552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:49.043053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:49.047895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:49.048808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:49.049909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:49.050368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:49.145899 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58b47855-f49c-4c89-a003-6426570c5e66 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.447466 Nov 03 04:05:49.147396 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1741/3366] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:05:49.460292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1388551132", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4e6041cb-eeb0-4988-b131-940532a7f1ed"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:49.568907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] validate_networks() for [('4e6041cb-eeb0-4988-b131-940532a7f1ed', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:05:49.655191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:49.669784 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-92d6c0ea-2856-483f-a69a-091776ffd112 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.650959 Nov 03 04:05:49.674752 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1626/3367] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:49 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:49.685753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7cd48ae-e707-42bb-8002-20b5351c8036 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:49.689216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7cd48ae-e707-42bb-8002-20b5351c8036 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:49.866299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f7cd48ae-e707-42bb-8002-20b5351c8036 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:49.873448 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7cd48ae-e707-42bb-8002-20b5351c8036 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1213 microversion: 2.1 time: 0.196720 Nov 03 04:05:49.877613 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1627/3368] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:49 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1213 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:49.881934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:49.881934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:49.887879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:49.888556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:49.889202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:49.890084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:49.891083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:49.891690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:50.726419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:50.737794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b9178dd-1d38-4ab3-9f89-7e084d485972 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.861105 Nov 03 04:05:50.738453 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1628/3369] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:49 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:50.744262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:50.745666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:50.752567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:50.753287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:50.754453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:50.755351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:50.755986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:50.756602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:52.316683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:52.343901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-320b81ef-1531-4d50-b85c-091bdfe61d8d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 1.586863 Nov 03 04:05:52.343901 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1629/3370] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:50 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:52.348262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:52.348883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:52.362960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:52.366777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:52.366777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:52.371883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:52.372874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:52.373356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:52.551145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:05:52.551145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:05:52.551145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:05:52.551145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:05:52.551145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:05:52.557392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=27 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:52.558957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:52.559452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:52.559901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:52.560636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:52.561121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:52.561674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:52.588082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Getting quotas for project f356b66f21df4456ba847a4ae9bd98ca. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:05:52.594047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Getting quotas for user aea68855ed88456ab919811f9d84bcb9 and project f356b66f21df4456ba847a4ae9bd98ca. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:05:52.630709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:05:52.632952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:05:52.779797 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-37d4d6ff-a8f8-4525-a14b-ef7312e1f6a0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.627139 Nov 03 04:05:52.788652 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1742/3371] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:05:52.805406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:52.807259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:52.838087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:52.845778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:52.846411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:52.847206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:52.848260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:52.853191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:53.013838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:53.025586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f76bdfa5-5b96-49e6-8a7c-5356d2260b67 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.682429 Nov 03 04:05:53.037536 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1630/3372] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:52 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:53.046062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:53.052786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:53.070675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:53.071231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:53.071688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:53.072413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:53.073702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:53.074323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:53.391825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:53.408658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1273 microversion: 2.1 time: 0.615500 Nov 03 04:05:53.408658 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1743/3373] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:52 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1273 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:53.429210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:53.431394 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-408ae4d0-3a81-4de3-9fdc-7c35d00ac6eb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007132 Nov 03 04:05:53.441331 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1744/3374] 10.222.0.30 () {56 vars in 886 bytes} [Thu Nov 3 04:05:53 2022] GET /compute/ => generated 377 bytes in 23 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 03 04:05:53.441331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e90d9c25-06c6-43a1-a1f3-7c352b790242 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:53.441331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e90d9c25-06c6-43a1-a1f3-7c352b790242 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:53.732956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e90d9c25-06c6-43a1-a1f3-7c352b790242 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:53.744046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e90d9c25-06c6-43a1-a1f3-7c352b790242 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1228 microversion: 2.1 time: 0.310704 Nov 03 04:05:53.763806 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1745/3375] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:53 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1228 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:53.766299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7ff4ff38-9768-4829-b05f-9628af862dd4 req-be1f30ea-9ba9-4ffd-8d49-167c21ca8fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f09169-ea5d-4883-9917-c0fecd31c181", "tag": "3e250990-3250-4402-88bf-0366075ec8d3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:53.777928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7ff4ff38-9768-4829-b05f-9628af862dd4 req-be1f30ea-9ba9-4ffd-8d49-167c21ca8fc4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:53.778625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7ff4ff38-9768-4829-b05f-9628af862dd4 req-be1f30ea-9ba9-4ffd-8d49-167c21ca8fc4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:53.779251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7ff4ff38-9768-4829-b05f-9628af862dd4 req-be1f30ea-9ba9-4ffd-8d49-167c21ca8fc4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:53.796593 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7ff4ff38-9768-4829-b05f-9628af862dd4 req-be1f30ea-9ba9-4ffd-8d49-167c21ca8fc4 service nova] Creating event network-changed:3e250990-3250-4402-88bf-0366075ec8d3 for instance c7f09169-ea5d-4883-9917-c0fecd31c181 on n-h1-854653-7 Nov 03 04:05:53.798451 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7ff4ff38-9768-4829-b05f-9628af862dd4 req-be1f30ea-9ba9-4ffd-8d49-167c21ca8fc4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036298 Nov 03 04:05:53.799580 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1746/3376] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:53.815801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:53.819663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:53.825192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:53.825713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:53.826359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:53.828310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:53.828967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:53.829687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:53.871595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:53.889200 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80470bea-9a37-423b-9b1b-f916c91ca947 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.856568 Nov 03 04:05:53.891623 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1631/3377] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:53 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:54.059773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:54.059773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:54.072761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.073298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.073923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:54.074824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.075443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:54.600729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:54.615691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d851b0c-d076-4d77-bdb4-2c9b22cf773d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.810865 Nov 03 04:05:54.616285 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1747/3378] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:53 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:54.632986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:54.633936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:54.640321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.640825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.641293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:54.642252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.648605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.649122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:54.806621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:54.817422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6d13730-77a0-479b-9602-9ec931c9a2b7 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.767352 Nov 03 04:05:54.819469 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1632/3379] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:54 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:54.825556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:54.826402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:54.833198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.833922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.834734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:54.835629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.836264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.836996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:54.909215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:54.925624 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71260a29-0220-49d5-ac1f-069fd17d7d42 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1271 microversion: 2.1 time: 0.307862 Nov 03 04:05:54.926609 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1748/3380] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:54 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1271 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:54.932338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:54.933292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:54.942663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.943475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.944336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:54.946463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:54.947497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:54.948273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:55.018922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:55.028221 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83c93b81-e562-4002-80ce-618b16914139 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1224 microversion: 2.1 time: 0.207502 Nov 03 04:05:55.057931 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1633/3381] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:54 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:55.420314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:55.428976 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-44f10376-d70e-41cd-820c-9d3481ee08b1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.501045 Nov 03 04:05:55.429590 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1749/3382] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:54 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:55.640266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:55.640903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:55.648779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:55.649298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:55.649878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:55.650878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:55.651343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:55.651778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:55.842491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:55.843112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:55.850401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:55.851326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:55.852019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:55.852987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:55.853713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:55.854399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.336687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:56.349192 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a19649bb-796a-4d8d-a805-db5bf3244de4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.510440 Nov 03 04:05:56.352953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1750/3383] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:55 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:56.359387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:56.372220 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50d8d87f-9cdd-4174-9223-5e6bafe4b18f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.736717 Nov 03 04:05:56.375120 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1634/3384] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:55 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:56.375911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5646ba78-21e1-4cdb-9c6f-d5d5eae4a714 req-d14fd525-f789-47cf-b2f4-be3a8cc9e48f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477fafee-65fc-43f0-a4be-4649f23ad6d6", "tag": "6644bb07-a08f-4000-93b7-579f63e12e4a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:56.381913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:56.383711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:56.391582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:56.392388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:56.393124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.395174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:56.396720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:56.400807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.400937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5646ba78-21e1-4cdb-9c6f-d5d5eae4a714 req-d14fd525-f789-47cf-b2f4-be3a8cc9e48f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:56.400937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5646ba78-21e1-4cdb-9c6f-d5d5eae4a714 req-d14fd525-f789-47cf-b2f4-be3a8cc9e48f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:56.401408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5646ba78-21e1-4cdb-9c6f-d5d5eae4a714 req-d14fd525-f789-47cf-b2f4-be3a8cc9e48f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.432120 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5646ba78-21e1-4cdb-9c6f-d5d5eae4a714 req-d14fd525-f789-47cf-b2f4-be3a8cc9e48f service nova] Creating event network-changed:6644bb07-a08f-4000-93b7-579f63e12e4a for instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 on n-h1-854653-7 Nov 03 04:05:56.445986 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5646ba78-21e1-4cdb-9c6f-d5d5eae4a714 req-d14fd525-f789-47cf-b2f4-be3a8cc9e48f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093802 Nov 03 04:05:56.448369 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1751/3385] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:56.457198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:56.458275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:56.465356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:56.466070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:56.466691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.467605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:56.468235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:56.468838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.656267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:56.665325 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36717cad-3b2b-4683-b85c-de77663ac324 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1286 microversion: 2.1 time: 0.215348 Nov 03 04:05:56.666626 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1752/3386] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:56 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1286 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:56.672839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:56.673930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:56.680334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:56.681221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:56.682011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.683012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:56.684422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:56.684870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:56.868840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:56.891019 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23e977e1-8196-4f38-9d13-59dfdefcf480 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1313 microversion: 2.1 time: 0.513780 Nov 03 04:05:56.911805 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1635/3387] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:56 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:57.062188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:57.080846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-687a85a3-94c4-44f7-a9bb-5d8d9f1a2b0c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.412835 Nov 03 04:05:57.083795 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1753/3388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:56 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:57.111632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b150694d-d67f-4a6f-bfcb-2fb90b7842f5 req-db2989ea-0ce8-44d7-b42c-9ded440023c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7309274f-fe8b-4eb7-a8ca-1f4bfe80962b", "tag": "7611ab67-cefb-4368-b602-b3114410c11b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:57.124747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b150694d-d67f-4a6f-bfcb-2fb90b7842f5 req-db2989ea-0ce8-44d7-b42c-9ded440023c8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.125764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b150694d-d67f-4a6f-bfcb-2fb90b7842f5 req-db2989ea-0ce8-44d7-b42c-9ded440023c8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.126561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b150694d-d67f-4a6f-bfcb-2fb90b7842f5 req-db2989ea-0ce8-44d7-b42c-9ded440023c8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.141513 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b150694d-d67f-4a6f-bfcb-2fb90b7842f5 req-db2989ea-0ce8-44d7-b42c-9ded440023c8 service nova] Creating event network-changed:7611ab67-cefb-4368-b602-b3114410c11b for instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b on n-h2-854653-7 Nov 03 04:05:57.148453 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b150694d-d67f-4a6f-bfcb-2fb90b7842f5 req-db2989ea-0ce8-44d7-b42c-9ded440023c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040769 Nov 03 04:05:57.156600 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1636/3389] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:57.374234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:57.375474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:57.382490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.383202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.383808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.384690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.385344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.385967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.402547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:57.403295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:57.418149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.418487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.418929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.419651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.420104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.420711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.761507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:57.773640 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b3797df-e080-4928-83f0-5ffd83bd6815 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.403146 Nov 03 04:05:57.775502 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1754/3390] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:57 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:57.781738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:57.792339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:57.802699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.803258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.803694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.804400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.804855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.817581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.823481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:57.939803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:57.945231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:05:57.957174 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b03ae435-05c1-4150-a53e-563fbe9e8a6c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.558522 Nov 03 04:05:57.959152 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1637/3391] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:57 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:57.966711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:57.967532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:57.975948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.976715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.977376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:57.978562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:57.979182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:57.979770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:58.388640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:58.412769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1e2da66-c110-4e83-b7ef-596a5375d87b tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.623098 Nov 03 04:05:58.416007 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1755/3392] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:57 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:58.422932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:58.423749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:58.434990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:58.436201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:58.436899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:58.438087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:58.439118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:58.439933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:58.633845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:58.642912 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00ac9a74-59c5-41f2-bbbb-0283ff65efac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1313 microversion: 2.1 time: 0.681633 Nov 03 04:05:58.643584 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1638/3393] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:57 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1313 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:58.650976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8c14d18a-fb9f-4c75-a6e3-9a8678eaa6b4 req-32a58cb2-e5d1-4e1a-8b2c-1dda52bb7323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d76efe24-4c7f-484c-9bb1-cf0856e3edb0", "tag": "f9689ce8-d392-4b01-9e21-8e33feab5963"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:05:58.666909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c14d18a-fb9f-4c75-a6e3-9a8678eaa6b4 req-32a58cb2-e5d1-4e1a-8b2c-1dda52bb7323 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:58.668003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c14d18a-fb9f-4c75-a6e3-9a8678eaa6b4 req-32a58cb2-e5d1-4e1a-8b2c-1dda52bb7323 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:58.668655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c14d18a-fb9f-4c75-a6e3-9a8678eaa6b4 req-32a58cb2-e5d1-4e1a-8b2c-1dda52bb7323 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:58.686120 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8c14d18a-fb9f-4c75-a6e3-9a8678eaa6b4 req-32a58cb2-e5d1-4e1a-8b2c-1dda52bb7323 service nova] Creating event network-changed:f9689ce8-d392-4b01-9e21-8e33feab5963 for instance d76efe24-4c7f-484c-9bb1-cf0856e3edb0 on n-h1-854653-7 Nov 03 04:05:58.692080 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8c14d18a-fb9f-4c75-a6e3-9a8678eaa6b4 req-32a58cb2-e5d1-4e1a-8b2c-1dda52bb7323 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046140 Nov 03 04:05:58.697478 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1639/3394] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:05:58.799797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:58.800885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:58.809821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:58.810749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:58.811270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:58.812233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:58.813729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:58.814332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:58.841301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:58.871951 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4a47fff3-842f-4b72-a680-c23b4c607220 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.454764 Nov 03 04:05:58.891965 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1756/3395] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:58 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:58.983942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:58.984562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:58.992848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:58.993660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:58.994252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:58.995123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:58.995737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:58.996329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:59.274145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:59.283349 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ee2d1d9-bd63-4340-961f-ad4a277eb573 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.487893 Nov 03 04:05:59.293743 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1640/3396] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:58 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:05:59.352992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:05:59.361210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01767de9-3adf-4263-9604-1438425cba64 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.380817 Nov 03 04:05:59.362203 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1757/3397] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:58 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:05:59.440251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:59.441920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:59.448564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:59.449097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:59.449774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:59.450513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:59.450982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:59.451417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:59.667605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:05:59.669078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:05:59.676129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:59.676628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:59.677257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:59.677978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:05:59.678571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:05:59.679021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:05:59.873225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:00.057822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:00.067606 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd3ad5f6-acaa-46f3-8767-be02d58a3cbf tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.631437 Nov 03 04:06:00.069641 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1641/3398] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:59 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:00.094156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:00.095286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:00.103109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:00.103909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:00.104661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:00.105751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:00.106381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:00.107303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:00.132569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:00.141122 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72da3b51-1095-409c-9f54-c5ec7c0f7ff2 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1313 microversion: 2.1 time: 0.477808 Nov 03 04:06:00.168326 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1758/3399] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:05:59 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:00.307486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:00.308517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:00.326584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:00.329079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:00.329079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:00.335867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:00.336690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:00.337345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:00.986264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:00.998911 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-826abdd8-cfa7-4235-8585-82c4a784d0e6 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.910914 Nov 03 04:06:01.002452 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1642/3400] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:00 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:01.011565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:01.018548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:01.032253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:01.033152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:01.033808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:01.040404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:01.040404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:01.040404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:01.296532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:01.309251 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa6fe661-26d6-40d0-82d4-0165767404e6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 1.005544 Nov 03 04:06:01.318726 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1759/3401] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:00 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:01.352972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ff33e411-ff11-4927-9091-8ce9938dfa5f req-783ef8e3-939e-4edc-83c6-3ac641bd5338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f09169-ea5d-4883-9917-c0fecd31c181", "name": "network-vif-plugged", "status": "completed", "tag": "3e250990-3250-4402-88bf-0366075ec8d3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:01.361685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ff33e411-ff11-4927-9091-8ce9938dfa5f req-783ef8e3-939e-4edc-83c6-3ac641bd5338 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:01.362237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ff33e411-ff11-4927-9091-8ce9938dfa5f req-783ef8e3-939e-4edc-83c6-3ac641bd5338 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:01.363396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ff33e411-ff11-4927-9091-8ce9938dfa5f req-783ef8e3-939e-4edc-83c6-3ac641bd5338 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:01.382326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ff33e411-ff11-4927-9091-8ce9938dfa5f req-783ef8e3-939e-4edc-83c6-3ac641bd5338 service nova] Creating event network-vif-plugged:3e250990-3250-4402-88bf-0366075ec8d3 for instance c7f09169-ea5d-4883-9917-c0fecd31c181 on n-h1-854653-7 Nov 03 04:06:01.384800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ff33e411-ff11-4927-9091-8ce9938dfa5f req-783ef8e3-939e-4edc-83c6-3ac641bd5338 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072846 Nov 03 04:06:01.386682 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1760/3402] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:01.393300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:01.395822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:01.419569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:01.420034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:01.420468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:01.421375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:01.421840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:01.422583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:01.839633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:01.849418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1cffd814-5a3d-44fa-93e9-bf9de7374ec6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.841704 Nov 03 04:06:01.850012 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1643/3403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:01 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:01.854837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:01.858571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:01.862103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:01.862803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:01.863428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:01.864305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:01.864979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:01.865472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:02.080432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:02.097539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-215bf75d-a6eb-43bc-b1dc-b84d51bdb941 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.704278 Nov 03 04:06:02.098144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1761/3404] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:01 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:02.120665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:02.122451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:02.130916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:02.131660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:02.132277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:02.133245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:02.135154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:02.135797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:02.577110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:02.841804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:02.850338 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a22f64f3-1e45-46b5-bca1-d4b4405c7917 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1313 microversion: 2.1 time: 0.999056 Nov 03 04:06:02.850929 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1644/3405] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:01 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1313 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:02.856104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:02.856823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:02.863226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:02.863970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:02.864475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:02.865377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:02.866076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:02.866727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.256932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:03.267430 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d46f926e-3290-43e8-8ab3-f3cee6d8e328 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 1.151717 Nov 03 04:06:03.268600 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1762/3406] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:02 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:03.274052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e79d2f28-5aa7-4344-9ec3-5d30b8f451b8 req-6bedf49e-7c29-40d8-8eeb-ae065c05e3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97059348-d276-4ef5-b8f5-af7dccef979a", "tag": "2b78cc30-6557-46dd-bf85-575c919b29bd"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:03.284505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e79d2f28-5aa7-4344-9ec3-5d30b8f451b8 req-6bedf49e-7c29-40d8-8eeb-ae065c05e3a7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.285317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e79d2f28-5aa7-4344-9ec3-5d30b8f451b8 req-6bedf49e-7c29-40d8-8eeb-ae065c05e3a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.285940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e79d2f28-5aa7-4344-9ec3-5d30b8f451b8 req-6bedf49e-7c29-40d8-8eeb-ae065c05e3a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.301380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e79d2f28-5aa7-4344-9ec3-5d30b8f451b8 req-6bedf49e-7c29-40d8-8eeb-ae065c05e3a7 service nova] Creating event network-changed:2b78cc30-6557-46dd-bf85-575c919b29bd for instance 97059348-d276-4ef5-b8f5-af7dccef979a on n-h2-854653-7 Nov 03 04:06:03.308617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e79d2f28-5aa7-4344-9ec3-5d30b8f451b8 req-6bedf49e-7c29-40d8-8eeb-ae065c05e3a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038201 Nov 03 04:06:03.309873 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1763/3407] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:03.315274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:03.317035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:03.323951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.324511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.325034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.325827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.326374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.326870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.414945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:03.422788 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-064e7055-5ce1-46cc-9372-1ba4bbdfe3a5 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.570490 Nov 03 04:06:03.423371 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1645/3408] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:02 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:03.428474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:03.429108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:03.435552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.436040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.436495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.437235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.437862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.438295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.743890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=7 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:03.801510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:03.809444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-81c5383c-4561-4e72-8a2a-e6ddbe18abd6 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.498161 Nov 03 04:06:03.810025 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1764/3409] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:03 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:03.832730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-052d2d06-9974-47ff-add9-33956aff6e28 req-c9db1319-5305-467d-a10f-cfe9c8bacb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477fafee-65fc-43f0-a4be-4649f23ad6d6", "name": "network-vif-plugged", "status": "completed", "tag": "6644bb07-a08f-4000-93b7-579f63e12e4a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:03.843670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-052d2d06-9974-47ff-add9-33956aff6e28 req-c9db1319-5305-467d-a10f-cfe9c8bacb34 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.845185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-052d2d06-9974-47ff-add9-33956aff6e28 req-c9db1319-5305-467d-a10f-cfe9c8bacb34 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.846097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-052d2d06-9974-47ff-add9-33956aff6e28 req-c9db1319-5305-467d-a10f-cfe9c8bacb34 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.868312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-052d2d06-9974-47ff-add9-33956aff6e28 req-c9db1319-5305-467d-a10f-cfe9c8bacb34 service nova] Creating event network-vif-plugged:6644bb07-a08f-4000-93b7-579f63e12e4a for instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 on n-h1-854653-7 Nov 03 04:06:03.874599 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-052d2d06-9974-47ff-add9-33956aff6e28 req-c9db1319-5305-467d-a10f-cfe9c8bacb34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046437 Nov 03 04:06:03.875899 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1765/3410] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:03.877645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:03.883690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:03.884618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:03.894340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f43a9225-2f4b-4564-8967-9239721ebbf0 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.469347 Nov 03 04:06:03.903804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.903804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.917755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.919609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:03.920104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:03.920585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:03.923573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1646/3411] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:03 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:04.248312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:04.258336 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b71b2e9-7256-440e-a1de-6b75e77344cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1313 microversion: 2.1 time: 0.380965 Nov 03 04:06:04.258938 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1766/3412] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:03 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:04.294329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:04.294950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:04.302381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:04.302876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:04.303313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:04.304285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:04.304897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:04.305518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:04.446757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:04.447378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:04.453433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:04.453813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:04.456209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:04.456209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:04.456209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:04.456209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:04.456581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:04.461875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a191c8e-853f-4ec4-aee7-0188ec7e388e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.171277 Nov 03 04:06:04.462593 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1647/3413] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:04 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:04.600671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:04.608785 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b971ef57-37c1-4a4a-8e28-54e0a82e9316 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.165978 Nov 03 04:06:04.609456 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1767/3414] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:04 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:04.831664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:04.832816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:04.838770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:04.839491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:04.839973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:04.840677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:04.841240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:04.841675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:04.887460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1acb278-cc84-4aa8-a265-00e6d7700432 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Action: 'create', calling method: .version_select at 0x7ff7f93f0280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1007449905", "metadata": {"Type": "work"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:04.995894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:05.004729 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-94aaa523-d83a-4610-b8ce-0884bbcbce32 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.176374 Nov 03 04:06:05.005336 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1768/3415] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:04 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:05.010255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:05.011066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:05.017240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.017921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.018548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.019435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.020109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.020548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.163077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:05.170769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f250f9b-27b0-4f0e-81d6-0b6569c31902 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.164240 Nov 03 04:06:05.171337 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1769/3416] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:05 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:05.281540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:05.282538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:05.289296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.289995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.290523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.291305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.291770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.292203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.423054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:05.431301 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5166da2f-0e3e-4c9f-a732-637c60e6875a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1313 microversion: 2.1 time: 0.153863 Nov 03 04:06:05.431878 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1770/3417] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:05 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:05.486143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:05.486458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1acb278-cc84-4aa8-a265-00e6d7700432 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.714500 Nov 03 04:06:05.486765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:05.487282 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1648/3418] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Nov 3 04:06:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 716 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 03 04:06:05.495267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.495776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.496403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.497364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.498002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.498440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.501068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7549a357-4bb4-4cb4-9317-1d6822e4515b tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f9c1a940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:05.584248 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7549a357-4bb4-4cb4-9317-1d6822e4515b tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 200 len: 353 microversion: 2.1 time: 0.087033 Nov 03 04:06:05.584842 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1649/3419] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:05 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:05.633346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:05.634060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:05.640078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.640573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.641043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.641812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.642309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.642704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.763631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:05.772219 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a6bbff1-be42-4969-afd3-a9a5b02edeb3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.290310 Nov 03 04:06:05.773091 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1771/3420] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:05 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:05.891617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:05.901140 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11bb33a7-2959-404f-81ad-0e446bde5abb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.272610 Nov 03 04:06:05.911916 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1650/3421] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:05 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:05.920723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cf06613f-59ef-471d-b461-5bee2af87cc6 req-dff60edf-bd3f-4828-beba-2854e1f0cbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7309274f-fe8b-4eb7-a8ca-1f4bfe80962b", "name": "network-vif-plugged", "status": "completed", "tag": "7611ab67-cefb-4368-b602-b3114410c11b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:05.932962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cf06613f-59ef-471d-b461-5bee2af87cc6 req-dff60edf-bd3f-4828-beba-2854e1f0cbb6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:05.933567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cf06613f-59ef-471d-b461-5bee2af87cc6 req-dff60edf-bd3f-4828-beba-2854e1f0cbb6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:05.934002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cf06613f-59ef-471d-b461-5bee2af87cc6 req-dff60edf-bd3f-4828-beba-2854e1f0cbb6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:05.947613 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cf06613f-59ef-471d-b461-5bee2af87cc6 req-dff60edf-bd3f-4828-beba-2854e1f0cbb6 service nova] Creating event network-vif-plugged:7611ab67-cefb-4368-b602-b3114410c11b for instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b on n-h2-854653-7 Nov 03 04:06:05.953073 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cf06613f-59ef-471d-b461-5bee2af87cc6 req-dff60edf-bd3f-4828-beba-2854e1f0cbb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039130 Nov 03 04:06:05.953953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1772/3422] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:06.029452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:06.033888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:06.054268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.055116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.055895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.056881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.057573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.058203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.198510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:06.199890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:06.209249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.218431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.219417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.220398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.221051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.221598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.308736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:06.318864 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55856434-2800-403a-89ed-f97b919557c3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.294886 Nov 03 04:06:06.320072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1651/3423] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:06 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:06.420409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:06.427326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23250fc7-dafd-4d50-b733-88a860b5a118 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.236480 Nov 03 04:06:06.427915 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1773/3424] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:06 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:06.461785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:06.462431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:06.470423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.470928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.471390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.472125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.472620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.473077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.600536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3417477-ff1e-426d-af55-1c4a0e410ef0 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f921c820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:06.652027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:06.660668 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-97927bad-ed16-44ff-8952-46301da0a63d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1313 microversion: 2.1 time: 0.208047 Nov 03 04:06:06.661333 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1652/3425] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:06 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:06.683796 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a3417477-ff1e-426d-af55-1c4a0e410ef0 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 200 len: 353 microversion: 2.1 time: 0.088405 Nov 03 04:06:06.684386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1774/3426] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:06 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:06.795643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:06.796312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:06.803482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.803974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.804526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.805252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.805715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.806145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.929160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:06.929789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:06.936713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.937228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.937879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.938629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:06.939071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:06.939513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:06.943500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:06.951861 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-69599410-b685-4034-95bb-7f716cd0a6d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.160159 Nov 03 04:06:06.952429 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1653/3427] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:06 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:06.965106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:07.075405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:07.083608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b884bda7-3ea5-46aa-9718-e0d7f7e12e54 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.158566 Nov 03 04:06:07.084181 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1775/3428] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:06 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:07.342214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:07.342754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:07.348783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.349299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.349736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:07.350424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.350877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.351302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:07.450873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:07.451494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:07.458607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.459091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.459529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:07.460227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.460683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.461135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:07.481890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:07.490208 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c283055-0486-4df6-a604-c33305c9e8dc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.151938 Nov 03 04:06:07.491054 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1654/3429] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:07 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:07.598509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:07.606444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c1d2e49-42d7-4c57-92d0-2f471e35c039 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.159488 Nov 03 04:06:07.607016 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1776/3430] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:07 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:07.684984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:07.685635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:07.693549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.694049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.694498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:07.695209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.695672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.696102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:07.698685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c82a9315-1db4-4d46-a267-6a94e6cd5107 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f90c5040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:07.748612 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c82a9315-1db4-4d46-a267-6a94e6cd5107 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 200 len: 354 microversion: 2.1 time: 0.053697 Nov 03 04:06:07.749207 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1777/3431] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:07 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:07.762980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a18b79db-edcf-4f14-99bc-c0a080931fc5 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f9129430>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:07.811116 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a18b79db-edcf-4f14-99bc-c0a080931fc5 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 200 len: 354 microversion: 2.1 time: 0.052063 Nov 03 04:06:07.811692 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1778/3432] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:07 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:07.825838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1b21087-8af8-49e8-bd1c-eb92f6f76de3 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f90fb8b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:07.838518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:07.846646 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11c6a905-8e6c-4566-8ee3-2ef8769efeb7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1463 microversion: 2.1 time: 0.165629 Nov 03 04:06:07.847149 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1655/3433] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:07 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:07.975960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:07.981338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Searching by: {'deleted': False, 'project_id': '0ea8f7b74cc04034a7e87fdd85bb031f'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:07.984726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:07.988161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.988643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.989107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:07.989830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:07.994860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:07.994860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.021006 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2db14f87-5190-49a2-9621-df7aab19db21 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.153595 Nov 03 04:06:08.023958 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1b21087-8af8-49e8-bd1c-eb92f6f76de3 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 202 len: 0 microversion: 2.1 time: 0.202127 Nov 03 04:06:08.028097 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1779/3434] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:06:07 2022] DELETE /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:06:08.031034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:08.031791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:08.037564 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1656/3435] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:06:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 04:06:08.046704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-679c9f33-0007-410d-a1bd-ca5ffdb0a49d tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f9cccaf0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:08.061614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.062249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.062714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.063461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.063937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.064577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.104463 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-679c9f33-0007-410d-a1bd-ca5ffdb0a49d tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 200 len: 353 microversion: 2.1 time: 0.067387 Nov 03 04:06:08.105068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1657/3436] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:08 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:08.111804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:08.117938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Searching by: {'deleted': False} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:08.122811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.123302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.123741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.124468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.126963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.126963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.213695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:08.222019 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-889d1713-7b9e-4b20-a4f0-daa3c601cf51 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.196324 Nov 03 04:06:08.224457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1780/3437] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:08 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:08.245308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:08.246199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:08.252041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:06:08.255524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.256234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.256928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.262134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:08.262268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.262268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.262268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.356494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.356920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.357391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.451797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:08.465982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eafb8085-a97b-42aa-9807-bce22abb7b76 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1395 microversion: 2.1 time: 0.240235 Nov 03 04:06:08.467153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1781/3438] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:08 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1395 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:08.472431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d36e0225-8849-493e-9b2e-97cb06e98a24 req-a4680f4a-4a57-484e-bef5-d5ef3926ec51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76efe24-4c7f-484c-9bb1-cf0856e3edb0", "name": "network-vif-plugged", "status": "completed", "tag": "f9689ce8-d392-4b01-9e21-8e33feab5963"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:08.486650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d36e0225-8849-493e-9b2e-97cb06e98a24 req-a4680f4a-4a57-484e-bef5-d5ef3926ec51 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.487885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d36e0225-8849-493e-9b2e-97cb06e98a24 req-a4680f4a-4a57-484e-bef5-d5ef3926ec51 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.488536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d36e0225-8849-493e-9b2e-97cb06e98a24 req-a4680f4a-4a57-484e-bef5-d5ef3926ec51 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.505751 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d36e0225-8849-493e-9b2e-97cb06e98a24 req-a4680f4a-4a57-484e-bef5-d5ef3926ec51 service nova] Creating event network-vif-plugged:f9689ce8-d392-4b01-9e21-8e33feab5963 for instance d76efe24-4c7f-484c-9bb1-cf0856e3edb0 on n-h1-854653-7 Nov 03 04:06:08.512069 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d36e0225-8849-493e-9b2e-97cb06e98a24 req-a4680f4a-4a57-484e-bef5-d5ef3926ec51 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043505 Nov 03 04:06:08.513151 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1782/3439] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:08.518799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:08.520828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:08.528528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.529134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.529629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.530503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.530962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.531392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.722315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:08.730936 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bde4dc3f-3e6d-46ce-b832-5e3e5cf6957b tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.216605 Nov 03 04:06:08.731526 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1783/3440] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:08 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:08.737350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:08.737975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:08.760135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.760652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.761220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:08.762024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:08.762484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:08.762977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.165873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:09.179770 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d6adcc5-d46d-4eec-bcd1-49733e6843db tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.446242 Nov 03 04:06:09.181417 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1784/3441] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:08 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:09.187500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5dc83fe-4b9d-4554-832e-f4bb60201867 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f901bee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:09.189541 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-56f17459-55aa-448f-8c39-5dea18cbf310 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20144 microversion: 2.1 time: 1.083375 Nov 03 04:06:09.190223 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1658/3442] 10.222.0.30 () {58 vars in 1171 bytes} [Thu Nov 3 04:06:08 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20144 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:06:09.246686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:09.251792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Searching by: {'deleted': False, 'project_id': '0ea8f7b74cc04034a7e87fdd85bb031f'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:09.255908 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a5dc83fe-4b9d-4554-832e-f4bb60201867 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 200 len: 353 microversion: 2.1 time: 0.072800 Nov 03 04:06:09.257513 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1785/3443] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:09.257660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.257874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.258351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.259088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.259550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.259983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.268759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:09.270065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:09.287396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:09.289775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.290436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.290577 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-77d2173f-763d-4278-8d81-5a9baea7af82 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?tenant_id=db56e83192e0475995e6b9e373767b33" status: 200 len: 15 microversion: 2.1 time: 0.048639 Nov 03 04:06:09.291292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.291461 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1659/3444] 10.222.0.30 () {58 vars in 1231 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/servers/detail?tenant_id=db56e83192e0475995e6b9e373767b33 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 04:06:09.292776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.293757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.294476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.311758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:09.318775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Searching by: {'tenant_id': 'db56e83192e0475995e6b9e373767b33', 'deleted': False} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:09.323672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.324166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.324602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.325554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.326008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.326632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.359948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:06:09.403530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.404030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.404473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.480694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:09.490983 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d21e7f69-135d-4687-8196-6fc452fa0e79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.226096 Nov 03 04:06:09.501046 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1786/3445] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:09.501046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:09.501046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:09.506562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.507417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.507518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.508217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.510011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.510011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.539235 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-429e3eaa-235b-4bf9-8072-a532a40cc29b tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=db56e83192e0475995e6b9e373767b33" status: 200 len: 4826 microversion: 2.1 time: 0.231057 Nov 03 04:06:09.541048 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1660/3446] 10.222.0.30 () {58 vars in 1257 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=db56e83192e0475995e6b9e373767b33 => generated 4826 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:09.565472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:09.572187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Searching by: {'tenant_id': '0ea8f7b74cc04034a7e87fdd85bb031f', 'deleted': False} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:09.577519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.578247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.578856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.579818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.580473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.581090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.615418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1fd28a97-25d0-4314-bf4f-a6b78bddbab5 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0ea8f7b74cc04034a7e87fdd85bb031f" status: 200 len: 15 microversion: 2.1 time: 0.053532 Nov 03 04:06:09.616306 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1661/3447] 10.222.0.30 () {58 vars in 1257 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=0ea8f7b74cc04034a7e87fdd85bb031f => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 04:06:09.639426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-efb981c6-1928-4c74-ba6b-d3cbc67c8aa0 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:09.646093 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-efb981c6-1928-4c74-ba6b-d3cbc67c8aa0 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010717 Nov 03 04:06:09.651816 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1662/3448] 10.222.0.30 () {58 vars in 1189 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 04:06:09.669606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:09.672244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:09.679426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.680047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.680543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.681850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:09.682108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:09.682695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:09.975704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:09.985717 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02e106de-86df-4ef4-9b17-ec36314c2991 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1576 microversion: 2.1 time: 0.492464 Nov 03 04:06:10.000539 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1787/3449] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1576 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:10.000539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:10.000539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:10.000539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.000539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.000539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.000539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.003121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.003582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.011224 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f5ec400-84a9-4b49-86e6-5bf566c7527e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action" status: 202 len: 0 microversion: 2.1 time: 0.346212 Nov 03 04:06:10.015173 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1663/3450] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:09 2022] POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:06:10.016664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:10.017198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:10.023223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.023720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.024168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.024869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.025363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.025911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.141599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c28a91b8-92ab-43a1-ba0b-c1897fd88cdb tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128538 Nov 03 04:06:10.142202 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1664/3451] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:06:10 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:10.146890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:10.153438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:10.154170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'db56e83192e0475995e6b9e373767b33'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:10.159512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.159992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.160438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.161226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.161685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.162210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.192676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:10.204178 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90b55abe-8676-4ddb-96df-cc246840916c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1320 microversion: 2.1 time: 0.216595 Nov 03 04:06:10.212897 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1788/3452] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:09 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:10.219076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:10.219707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:10.235929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.236580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.237055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.239934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.240435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.241362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.261116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:06:10.334461 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9efb8af1-67ee-4a99-8012-4d6b77ac4d8f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.191141 Nov 03 04:06:10.335068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1665/3453] 10.222.0.30 () {58 vars in 1150 bytes} [Thu Nov 3 04:06:10 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:10.339885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a48595f9-1c92-4c40-967c-98667d411475 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f989ac10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:10.398088 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a48595f9-1c92-4c40-967c-98667d411475 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 200 len: 353 microversion: 2.1 time: 0.061768 Nov 03 04:06:10.398799 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1666/3454] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:10 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:10.404863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:10.407299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:10.414903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.415326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.415756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.416452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.416900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.417372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.426342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:10.433524 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dae75f1c-fa2c-41bb-9f63-e24c8c4f1957 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.219187 Nov 03 04:06:10.434501 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1789/3455] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:10 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:10.516421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:10.517225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:10.523710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.524204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.524652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.525400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.525864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.526299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.674997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:10.684795 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da181499-00e7-4247-9717-1e62a8b6f9aa tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1520 microversion: 2.1 time: 0.172317 Nov 03 04:06:10.688600 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1790/3456] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:10 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:10.787216 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a814d0ba-40ff-43bd-9731-b7c9e0f44691 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action" status: 202 len: 0 microversion: 2.1 time: 0.386547 Nov 03 04:06:10.787865 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1667/3457] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:10 2022] POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:06:10.796088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:10.796979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:10.803864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.804623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.805263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:10.806304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:10.806949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:10.807771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.011326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4fbb33f0-83f0-4ccb-8e84-ec605cbc7025 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1615 microversion: 2.1 time: 0.219105 Nov 03 04:06:11.013189 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1791/3458] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:10 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1615 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:11.036551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:11.037325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:11.047358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.047964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.048410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.049242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.049601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.050023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.190742 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7abf1ec4-4f1a-45ec-8466-060629f8bbea tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1615 microversion: 2.1 time: 0.158903 Nov 03 04:06:11.206197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1668/3459] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:11 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1615 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:11.215747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:11.236772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Searching by: {'host': 'n-h2-854653-7', 'deleted': False} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:11.242366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:11.243137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:11.251866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.252515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.253141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.253638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.254131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.254916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.255073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.255182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.255333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.255978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.256754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.257331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.431656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:11.433126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:06:11.447761 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-88377f7b-b325-4dd9-bdb4-097dd631d3ba tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 200 len: 1507 microversion: 2.1 time: 0.212595 Nov 03 04:06:11.455117 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1669/3460] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:11 2022] GET /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:11.461689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be55697e-2f37-448e-9566-cf8f65d27103 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Calling method '.version_select at 0x7ff7f997b0d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:11.510221 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-be55697e-2f37-448e-9566-cf8f65d27103 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] HTTP exception thrown: Volume 767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f could not be found. Nov 03 04:06:11.512648 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-51a2abd2-19db-4840-b049-4d98ab89fcfd tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=n-h2-854653-7&all_tenants=1" status: 200 len: 1967 microversion: 2.1 time: 0.300209 Nov 03 04:06:11.513536 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1792/3461] 10.222.0.30 () {58 vars in 1190 bytes} [Thu Nov 3 04:06:11 2022] GET /compute/v2.1/servers?host=n-h2-854653-7&all_tenants=1 => generated 1967 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:11.519004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:11.520557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:11.528076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.528737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.529322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.530190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.530760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.531307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be55697e-2f37-448e-9566-cf8f65d27103 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Request method failure captured: Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f HTTP/1.1 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz4sedfiSkI87inzZAsdaqS2gkVpGB5zSVfYqt_-v8Bk9NiXpb1hR69lN6WqnHju_WJTrpMYkumtGPRChJcId4CWwZyhl-JA95N1wJU_FbGtnDBjE2iC0ysiAVD5_L1n0VhFqYLmRq7-3TNo0Y-FqQSUD8XJ3QKm5RO8zkVhK0CxiLc Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 359787ac523f44378a4bad04b475be4b Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesGetTestJSON-510636695 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/359787ac523f44378a4bad04b475be4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_359787ac523f44378a4bad04b475be4b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/359787ac523f44378a4bad04b475be4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/359787ac523f44378a4bad04b475be4b"}]}] Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesGetTestJSON-510636695 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 359787ac523f44378a4bad04b475be4b Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesGetTestJSON-510636695 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesGetTestJSON-510636695-project Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 1c5d741032934658be7a34d85e83afa0 Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesGetTestJSON-510636695-project Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: exception: Volume 767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f could not be found. Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f'} Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f could not be found. (HTTP 404) (Request-ID: req-2d5d3046-b7e4-421c-8096-771754dfc35d) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:06:11.546159 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f could not be found. Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f could not be found. Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f could not be found. Nov 03 04:06:11.553338 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:11.561918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be55697e-2f37-448e-9566-cf8f65d27103 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] Returning 404 to user: Volume 767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:11.564065 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be55697e-2f37-448e-9566-cf8f65d27103 tempest-VolumesGetTestJSON-510636695 tempest-VolumesGetTestJSON-510636695-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f" status: 404 len: 109 microversion: 2.1 time: 0.107072 Nov 03 04:06:11.569372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1670/3462] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:11 2022] GET /compute/v2.1/os-volumes/767cdfa3-3b38-4e30-8ef1-ccd3d9bb943f => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:06:11.578191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:11.579857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c7f09169-ea5d-4883-9917-c0fecd31c181] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:11.590311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.591030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.591566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.592364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.592904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.593475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.814809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:11.824628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:11.831148 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d981f12b-2763-4e14-9e7f-5b7eb8e9a044 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.316241 Nov 03 04:06:11.834756 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1793/3463] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:11 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:11.839736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:11.840536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:11.844300 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff8143d0-41f3-42df-8289-287969d99f66 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/c7f09169-ea5d-4883-9917-c0fecd31c181" status: 200 len: 1507 microversion: 2.1 time: 0.272815 Nov 03 04:06:11.847977 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1671/3464] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:11 2022] GET /compute/v2.1/servers/c7f09169-ea5d-4883-9917-c0fecd31c181 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:11.868339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.868842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.869319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.875763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.876371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.876837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.962415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5ddf7ee6-2fb7-4dc5-a2e7-7aaf778de5b2 req-71aa897f-d784-44de-abda-3814f8007b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477fafee-65fc-43f0-a4be-4649f23ad6d6", "tag": "6644bb07-a08f-4000-93b7-579f63e12e4a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:11.976889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5ddf7ee6-2fb7-4dc5-a2e7-7aaf778de5b2 req-71aa897f-d784-44de-abda-3814f8007b79 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:11.978878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5ddf7ee6-2fb7-4dc5-a2e7-7aaf778de5b2 req-71aa897f-d784-44de-abda-3814f8007b79 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:11.980138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5ddf7ee6-2fb7-4dc5-a2e7-7aaf778de5b2 req-71aa897f-d784-44de-abda-3814f8007b79 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:11.997449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5ddf7ee6-2fb7-4dc5-a2e7-7aaf778de5b2 req-71aa897f-d784-44de-abda-3814f8007b79 service nova] Creating event network-changed:6644bb07-a08f-4000-93b7-579f63e12e4a for instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 on n-h1-854653-7 Nov 03 04:06:12.004556 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5ddf7ee6-2fb7-4dc5-a2e7-7aaf778de5b2 req-71aa897f-d784-44de-abda-3814f8007b79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157026 Nov 03 04:06:12.005984 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1672/3465] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:12.012744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:12.021522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:12.027243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.027957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.028563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.029527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.030155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.031461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.090479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:12.103941 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-09e4c8cf-6083-401f-80bf-4670cfb1196c tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1576 microversion: 2.1 time: 0.267896 Nov 03 04:06:12.104565 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1794/3466] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:11 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1576 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:12.113427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:12.114273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:12.122925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.123718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.130170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.134629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.140093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.140803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.144454 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-81d0ef91-2784-41ac-bb63-266967fd674e tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.136197 Nov 03 04:06:12.145189 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1673/3467] 10.222.0.30 () {58 vars in 1196 bytes} [Thu Nov 3 04:06:12 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:06:12.152747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-96b47445-0298-492e-b98c-195d6b16fef3 req-54c839a5-4765-459f-bbc1-4a01c831db4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97059348-d276-4ef5-b8f5-af7dccef979a", "name": "network-vif-plugged", "status": "completed", "tag": "2b78cc30-6557-46dd-bf85-575c919b29bd"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:12.167168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-96b47445-0298-492e-b98c-195d6b16fef3 req-54c839a5-4765-459f-bbc1-4a01c831db4e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.167688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-96b47445-0298-492e-b98c-195d6b16fef3 req-54c839a5-4765-459f-bbc1-4a01c831db4e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.168392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-96b47445-0298-492e-b98c-195d6b16fef3 req-54c839a5-4765-459f-bbc1-4a01c831db4e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.194896 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-96b47445-0298-492e-b98c-195d6b16fef3 req-54c839a5-4765-459f-bbc1-4a01c831db4e service nova] Creating event network-vif-plugged:2b78cc30-6557-46dd-bf85-575c919b29bd for instance 97059348-d276-4ef5-b8f5-af7dccef979a on n-h2-854653-7 Nov 03 04:06:12.204527 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-96b47445-0298-492e-b98c-195d6b16fef3 req-54c839a5-4765-459f-bbc1-4a01c831db4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057078 Nov 03 04:06:12.205283 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1674/3468] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:12.211617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:12.212317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c7f09169-ea5d-4883-9917-c0fecd31c181] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:12.223762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.230201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.230201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.230201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.230201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.230201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.263249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c7f09169-ea5d-4883-9917-c0fecd31c181] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:06:12.446071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:12.562350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:12.582874 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b5fc21b4-46a8-43d9-8a22-a8064224e0b8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1500 microversion: 2.1 time: 0.471669 Nov 03 04:06:12.583825 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1795/3469] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:12 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1500 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:12.593412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:12.596517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:12.603892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.604562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.605006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.605733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.606387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.606820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.626746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:12.718793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3862bdc0-542d-4a1f-bfab-f0b35b7144bc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c7f09169-ea5d-4883-9917-c0fecd31c181" status: 204 len: 0 microversion: 2.1 time: 0.511695 Nov 03 04:06:12.725140 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1675/3470] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:06:12 2022] DELETE /compute/v2.1/servers/c7f09169-ea5d-4883-9917-c0fecd31c181 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:06:12.730977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:12.731696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:12.739119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.739541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.739977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.740897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.741589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.742197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.910496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:12.930400 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a21f917c-ff56-4e56-b590-bbe6a191c239 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1514 microversion: 2.1 time: 0.203849 Nov 03 04:06:12.932088 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1676/3471] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:12 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:12.937971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:12.938923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:12.946370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.947341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.948040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.948988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:12.949970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:12.950616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:12.988913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: d76efe24-4c7f-484c-9bb1-cf0856e3edb0] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:06:13.084542 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee8b796e-32f6-40dd-bad7-e9a1d9efabc8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action" status: 202 len: 0 microversion: 2.1 time: 0.499369 Nov 03 04:06:13.085655 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1796/3472] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:12 2022] POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:06:13.092691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:13.093480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:13.099929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.100700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.102424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.103689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.104348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.104970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.260572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:13.268825 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-138eb007-604f-4101-ba82-88024f6eea1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1328 microversion: 2.1 time: 0.181577 Nov 03 04:06:13.273074 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1797/3473] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:13 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1328 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:13.286467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7044a2cc-86c4-44be-b835-e02a5674718c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:13.296290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7044a2cc-86c4-44be-b835-e02a5674718c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 0406bf47-c941-4dcf-b440-867b58e01b59] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:13.318190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7044a2cc-86c4-44be-b835-e02a5674718c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Instance 0406bf47-c941-4dcf-b440-867b58e01b59 could not be found. Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7044a2cc-86c4-44be-b835-e02a5674718c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/0406bf47-c941-4dcf-b440-867b58e01b59/action HTTP/1.1 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 14 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: {"rescue": {}} Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0406bf47-c941-4dcf-b440-867b58e01b59 could not be found. Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0406bf47-c941-4dcf-b440-867b58e01b59', 'body': {'rescue': {}}} Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0406bf47-c941-4dcf-b440-867b58e01b59 could not be found. Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0406bf47-c941-4dcf-b440-867b58e01b59 could not be found. Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:13.329104 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0406bf47-c941-4dcf-b440-867b58e01b59 could not be found. Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7044a2cc-86c4-44be-b835-e02a5674718c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 404 to user: Instance 0406bf47-c941-4dcf-b440-867b58e01b59 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7044a2cc-86c4-44be-b835-e02a5674718c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/0406bf47-c941-4dcf-b440-867b58e01b59/action" status: 404 len: 111 microversion: 2.1 time: 0.056216 Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1798/3474] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:13 2022] POST /compute/v2.1/servers/0406bf47-c941-4dcf-b440-867b58e01b59/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:06:13.340627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:13.345841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:13.356059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.356752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.357235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.357953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.358417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.358851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.376575 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b26c235b-0605-4387-afed-e03abb42838f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0" status: 204 len: 0 microversion: 2.1 time: 0.442272 Nov 03 04:06:13.377649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1677/3475] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:06:12 2022] DELETE /compute/v2.1/servers/d76efe24-4c7f-484c-9bb1-cf0856e3edb0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:06:13.384709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:13.385679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:13.392432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.394053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.394822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.395805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.396629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.397354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.480298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:06:13.480740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:06:13.483131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:06:13.483131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:06:13.483131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:06:13.653575 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74bb6896-e0ea-40a0-af23-9963bd2a7a61 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action" status: 202 len: 0 microversion: 2.1 time: 0.273973 Nov 03 04:06:13.654126 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1678/3476] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:13 2022] POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:06:13.659081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1430075316", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5a0c48eb-7267-438e-aab0-3fac0847a89e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:13.716319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] validate_networks() for [('5a0c48eb-7267-438e-aab0-3fac0847a89e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:06:13.745523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:13.759159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.759662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.760110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.760826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.761322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.761808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.794162 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65fb71f4-83bf-4ab5-90e5-4697330eedd8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action" status: 202 len: 1068 microversion: 2.1 time: 0.460373 Nov 03 04:06:13.795398 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1799/3477] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:13 2022] POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action => generated 1068 bytes in 462 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 03 04:06:13.800920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:13.801750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:13.808012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.808565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.809296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:13.813225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:13.813225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:13.813225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.100551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:14.108527 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b76baec3-6c35-48bf-ae36-22cdf69f275d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1519 microversion: 2.1 time: 0.311850 Nov 03 04:06:14.109133 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1800/3478] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:13 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1519 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:14.131117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:14.132308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:14.138942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.139697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.140484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.141444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.142689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.143292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.342648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:06:14.343108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:06:14.343589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:06:14.344002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:06:14.344466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:06:14.353598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.354085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.354539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.355273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.355965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.356565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.370561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:14.375080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Getting quotas for project dd9e44b66aa045a48f1b00e6a5488200. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:06:14.379287 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27e8f721-5683-4e60-9dfa-5af5c640590b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.256519 Nov 03 04:06:14.380107 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1801/3479] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:14 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:14.384973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:14.385627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:14.391922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.392418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.392869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.393618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.394083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.394709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.398053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Getting quotas for user f6a300273c724268abdaba803626056b and project dd9e44b66aa045a48f1b00e6a5488200. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:06:14.415977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Going to run 2 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:06:14.419269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:06:14.507848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=c39970b5-442d-4ddb-be40-ceb3f3d43663,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:06:14.554563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:14.562979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f35e805d-1b5c-4980-b135-98b6e9a52f62 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1528 microversion: 2.1 time: 0.181730 Nov 03 04:06:14.563554 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1802/3480] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:14 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1528 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:14.587680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:14.588216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:14.594249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.597976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.597976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.597976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.597976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.597976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.640269 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-692e11a1-989c-4662-871d-f68ec8830370 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.985041 Nov 03 04:06:14.640934 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1679/3481] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:06:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 986 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 03 04:06:14.650795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:14.656706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:14.659168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Searching by: {'deleted': False, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:06:14.690220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.690220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.691781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.692638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:14.693222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:14.693721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:14.728524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:06:14.762567 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3e6b1219-bf2d-46fb-b878-4d275ffdc9a0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.116132 Nov 03 04:06:14.767093 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1680/3482] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:06:14 2022] GET /compute/v2.1/servers => generated 1337 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:14.767228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:14.778332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd480dcd-3a36-430f-8dfb-59404b2fd0cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:14.778486 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42394063-f6b4-479f-8dd0-5ee19be99d1e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1528 microversion: 2.1 time: 0.194460 Nov 03 04:06:14.779064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd480dcd-3a36-430f-8dfb-59404b2fd0cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:14.779518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1803/3483] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:14 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1528 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:14.840057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dd480dcd-3a36-430f-8dfb-59404b2fd0cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:14.847065 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd480dcd-3a36-430f-8dfb-59404b2fd0cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1218 microversion: 2.1 time: 0.073797 Nov 03 04:06:14.849237 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1681/3484] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:14 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:15.003681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:15.004274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:15.010350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.010839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.011281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.011980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.012442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.012900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.026608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] HTTP exception thrown: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Request method failure captured: Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a HTTP/1.1 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz4c1vu9iA4Y2KKnt-5EiCDiAx83FqhjA3U_bO9w4_bdwBYijqM7hqvckHjZNlsUb_G0Y4ymd7Ic0IuzwzdjEXh2--JhYSbj-GbpgPQeEQo6bv1Gam2ZG46NMUzEUQ_oL5lyPphBA8Qamr9xuu6JD-e5fn4Jf_qe4kzBdNY2L9fMNK4 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: d3c45cd16b88444ab44841746e7bc9ba Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-474799702 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3c45cd16b88444ab44841746e7bc9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3c45cd16b88444ab44841746e7bc9ba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3c45cd16b88444ab44841746e7bc9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3c45cd16b88444ab44841746e7bc9ba"}]}] Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-474799702 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: d3c45cd16b88444ab44841746e7bc9ba Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-474799702 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestMultiTenantJSON-474799702-project Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: aacda7c9301e495da4f43952985aff07 Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-474799702-project Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '97059348-d276-4ef5-b8f5-af7dccef979a'} Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:06:15.028244 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Returning 404 to user: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fcecacb4-651f-47e8-8153-962640117ba5 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] 10.222.0.30 "DELETE /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 404 len: 111 microversion: 2.1 time: 0.226416 Nov 03 04:06:15.034218 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1804/3485] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:06:14 2022] DELETE /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:06:15.040173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:15.040793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:15.047177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.048106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.053308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.053308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.053308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.053308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.139367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:15.140672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:15.156394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.156906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.157416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.159555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.160984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.161578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.234184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:15.243261 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5fdf0f5-25ab-4c2d-9cbe-8176cd3bc53f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1528 microversion: 2.1 time: 0.206929 Nov 03 04:06:15.243998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1682/3486] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:15 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1528 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:15.267233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Action: 'update', calling method: >, body: {"server": {"name": "97059348-d276-4ef5-b8f5-af7dccef979a_new"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:15.270514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:15.277979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.279363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.279817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.280537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.280999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.281463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.295628 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] HTTP exception thrown: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Request method failure captured: Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: request: PUT /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a HTTP/1.1 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 64 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz4c1vu9iA4Y2KKnt-5EiCDiAx83FqhjA3U_bO9w4_bdwBYijqM7hqvckHjZNlsUb_G0Y4ymd7Ic0IuzwzdjEXh2--JhYSbj-GbpgPQeEQo6bv1Gam2ZG46NMUzEUQ_oL5lyPphBA8Qamr9xuu6JD-e5fn4Jf_qe4kzBdNY2L9fMNK4 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: d3c45cd16b88444ab44841746e7bc9ba Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-474799702 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3c45cd16b88444ab44841746e7bc9ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d3c45cd16b88444ab44841746e7bc9ba", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d3c45cd16b88444ab44841746e7bc9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d3c45cd16b88444ab44841746e7bc9ba"}]}] Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-474799702 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: d3c45cd16b88444ab44841746e7bc9ba Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-474799702 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestMultiTenantJSON-474799702-project Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: aacda7c9301e495da4f43952985aff07 Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-474799702-project Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "97059348-d276-4ef5-b8f5-af7dccef979a_new"}} Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '97059348-d276-4ef5-b8f5-af7dccef979a', 'body': {'server': {'name': '97059348-d276-4ef5-b8f5-af7dccef979a_new'}}} Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:15.297468 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] Returning 404 to user: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:15.303067 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dbca6d65-eec4-41bd-9085-809acca04e24 tempest-ServersNegativeTestMultiTenantJSON-474799702 tempest-ServersNegativeTestMultiTenantJSON-474799702-project] 10.222.0.30 "PUT /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 404 len: 111 microversion: 2.1 time: 0.035596 Nov 03 04:06:15.305657 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1683/3487] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:06:15 2022] PUT /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:06:15.310272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:15.310784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:15.317352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.325464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.325464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.325464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.325464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.325464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.338093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:15.347184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-00543a17-6fe7-4173-9423-ea4dd79ea16b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1519 microversion: 2.1 time: 0.213803 Nov 03 04:06:15.348177 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1805/3488] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:15 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:15.368577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:06:15.413051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:15.414036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:15.420465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.423727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.423727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.423727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.423727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.423727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.770469 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c7480a6-cf40-4c36-bc8f-34c38c10a08a tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "DELETE /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 204 len: 0 microversion: 2.1 time: 0.463085 Nov 03 04:06:15.772224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1684/3489] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:06:15 2022] DELETE /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:06:15.780723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:15.781474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:15.788453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.789315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.789758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.790456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:15.790907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:15.791323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:15.952078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:15.961967 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04b1e5b3-140a-4992-849d-b9c2728fd973 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.561413 Nov 03 04:06:15.968719 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1806/3490] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:15 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:15.968719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a3afd70-9645-4cea-834e-a0f9583d10bd tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:15.969274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a3afd70-9645-4cea-834e-a0f9583d10bd tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:16.092715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a3afd70-9645-4cea-834e-a0f9583d10bd tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:16.103869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a3afd70-9645-4cea-834e-a0f9583d10bd tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1218 microversion: 2.1 time: 0.139235 Nov 03 04:06:16.105293 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1807/3491] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:15 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:16.240568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:16.252250 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15e68bc5-2fc8-4cd3-be6e-98501bc064e5 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1534 microversion: 2.1 time: 0.475562 Nov 03 04:06:16.254658 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1685/3492] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:15 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1534 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:16.378040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:16.378704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:16.385326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:16.385820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:16.386543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:16.387327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:16.387864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:16.388399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:16.653848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:16.674585 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-370c8a1e-d537-493c-a0ea-3dafc29acbf2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1499 microversion: 2.1 time: 0.300181 Nov 03 04:06:16.675067 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1808/3493] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:16 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1499 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:16.701829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:16.705302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:16.709389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:16.715181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:16.716009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:16.716661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:16.717687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:16.718343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:16.719115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:16.743481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2faf0756-f4a8-4635-8660-e00c66a62a89 req-964d5672-9ef0-43df-bdc3-431122e62189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f09169-ea5d-4883-9917-c0fecd31c181", "name": "network-vif-deleted", "tag": "3e250990-3250-4402-88bf-0366075ec8d3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:16.755261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2faf0756-f4a8-4635-8660-e00c66a62a89 req-964d5672-9ef0-43df-bdc3-431122e62189 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:16.756167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2faf0756-f4a8-4635-8660-e00c66a62a89 req-964d5672-9ef0-43df-bdc3-431122e62189 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:16.756857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2faf0756-f4a8-4635-8660-e00c66a62a89 req-964d5672-9ef0-43df-bdc3-431122e62189 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:16.775762 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2faf0756-f4a8-4635-8660-e00c66a62a89 req-964d5672-9ef0-43df-bdc3-431122e62189 service nova] Creating event network-vif-deleted:3e250990-3250-4402-88bf-0366075ec8d3 for instance c7f09169-ea5d-4883-9917-c0fecd31c181 on n-h1-854653-7 Nov 03 04:06:16.788312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lazy-loading 'flavor' on Instance uuid ee668004-ab0e-4715-b036-b468dd887743 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:06:16.790257 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2faf0756-f4a8-4635-8660-e00c66a62a89 req-964d5672-9ef0-43df-bdc3-431122e62189 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054352 Nov 03 04:06:16.791401 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1809/3494] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:16.819737 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Cannot 'rescue' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state paused Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action HTTP/1.1 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 14 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: {"rescue": {}} Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'rescue' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state paused Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ee668004-ab0e-4715-b036-b468dd887743', 'body': {'rescue': {}}} Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee668004-ab0e-4715-b036-b468dd887743 in vm_state paused. Cannot rescue while the instance is in this state. Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state paused Nov 03 04:06:16.825157 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state paused Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 409 to user: Cannot 'rescue' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state paused {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:16.829493 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d98059d9-44c3-4d9a-9c7f-626d36b13cbf tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action" status: 409 len: 144 microversion: 2.1 time: 0.131772 Nov 03 04:06:16.840773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:16.841553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:16.853086 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1686/3495] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:16 2022] POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action => generated 144 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:06:16.859756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:16.860287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:16.864419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:16.865250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:16.865830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:16.871288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:16.991824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:16.997997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:16.999570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.000067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.000512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.001249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.001710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.002139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.162567 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-611f673e-04ed-4169-838e-9faed5b35ffd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action" status: 202 len: 0 microversion: 2.1 time: 0.326686 Nov 03 04:06:17.167956 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1810/3496] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:16 2022] POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:06:17.184296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:17.188052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:17.188776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:17.194398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31aaca54-88c4-41dc-a41c-261c1abb6bb8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.206312 Nov 03 04:06:17.197259 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1687/3497] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:16 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:17.210826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.211585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.212972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.215846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.216503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.218930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:17.219699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.220035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:17.229657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.230710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.235736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.235736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.235736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.235736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.340180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:17.351416 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3aa37430-d3b4-4796-8456-bf7d36a695d3 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1214 microversion: 2.1 time: 0.172630 Nov 03 04:06:17.352290 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1811/3498] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:17 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:17.361486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:17.362232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:17.371848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.372985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.373463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.379547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:17.379547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:17.379547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:17.396281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:17.431301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:17.439286 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-402c618e-fc6f-4c9b-a926-d2d5271fc835 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1506 microversion: 2.1 time: 0.232106 Nov 03 04:06:17.440410 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1688/3499] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:17 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:17.582888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-477a9f27-ba44-46ce-bcd2-bf97024ad48d tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7fd479dc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:17.591489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:17.601230 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c271e4f-64e3-4ac3-a857-37e4b856839e tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1534 microversion: 2.1 time: 0.247548 Nov 03 04:06:17.601815 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1812/3500] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:17 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1534 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:17.636333 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-477a9f27-ba44-46ce-bcd2-bf97024ad48d tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/d3bded0c-d68e-4864-b977-05394178f581" status: 200 len: 350 microversion: 2.1 time: 0.057731 Nov 03 04:06:17.638858 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1689/3501] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:17 2022] GET /compute/v2.1/os-volumes/d3bded0c-d68e-4864-b977-05394178f581 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:18.225289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:18.226581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:18.235032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.235870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.236562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.237490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.237958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.238399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.380516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:18.381809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:18.387901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.388414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.389553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.389895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.390609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.391112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.431827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:18.440380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5516814a-f5aa-406f-bb75-ef10402cd203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.220161 Nov 03 04:06:18.441386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1813/3502] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:18 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:18.467033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:18.468395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:18.482919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.484794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.486636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.488727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.489938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.491924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.518517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:18.534068 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f66975ed-38f5-43ff-9f7a-8141a27d206a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1214 microversion: 2.1 time: 0.158592 Nov 03 04:06:18.539145 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1690/3503] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:18 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:18.625228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:18.630811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:18.635716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.636502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.637197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.638182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.638718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.639548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.645938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=93,nova_cell1:UPDATE=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:18.692147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.692913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.694471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.695113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lazy-loading 'fault' on Instance uuid 97059348-d276-4ef5-b8f5-af7dccef979a {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:06:18.760329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:18.768268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aea68855ed88456ab919811f9d84bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356b66f21df4456ba847a4ae9bd98ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:18.772885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7cc5c916-1c3c-4cec-9683-eba41371539f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1506 microversion: 2.1 time: 0.310755 Nov 03 04:06:18.778121 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1814/3504] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:18 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:18.785603 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e40873bb-c192-4371-9f03-82e4e3168954 tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 200 len: 1318 microversion: 2.1 time: 0.165276 Nov 03 04:06:18.793162 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1691/3505] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:18 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:18.827203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3ac58d18-0caa-475d-903a-eb43a0c6e1e7 req-c02a69e3-0308-448c-956b-ed6a95919ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76efe24-4c7f-484c-9bb1-cf0856e3edb0", "name": "network-vif-deleted", "tag": "f9689ce8-d392-4b01-9e21-8e33feab5963"}, {"server_uuid": "97059348-d276-4ef5-b8f5-af7dccef979a", "name": "network-vif-deleted", "tag": "2b78cc30-6557-46dd-bf85-575c919b29bd"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:18.838170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3ac58d18-0caa-475d-903a-eb43a0c6e1e7 req-c02a69e3-0308-448c-956b-ed6a95919ed9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:18.838658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3ac58d18-0caa-475d-903a-eb43a0c6e1e7 req-c02a69e3-0308-448c-956b-ed6a95919ed9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:18.839099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3ac58d18-0caa-475d-903a-eb43a0c6e1e7 req-c02a69e3-0308-448c-956b-ed6a95919ed9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:18.851970 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3ac58d18-0caa-475d-903a-eb43a0c6e1e7 req-c02a69e3-0308-448c-956b-ed6a95919ed9 service nova] Creating event network-vif-deleted:f9689ce8-d392-4b01-9e21-8e33feab5963 for instance d76efe24-4c7f-484c-9bb1-cf0856e3edb0 on n-h1-854653-7 Nov 03 04:06:18.852483 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3ac58d18-0caa-475d-903a-eb43a0c6e1e7 req-c02a69e3-0308-448c-956b-ed6a95919ed9 service nova] Creating event network-vif-deleted:2b78cc30-6557-46dd-bf85-575c919b29bd for instance 97059348-d276-4ef5-b8f5-af7dccef979a on n-h2-854653-7 Nov 03 04:06:18.860875 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3ac58d18-0caa-475d-903a-eb43a0c6e1e7 req-c02a69e3-0308-448c-956b-ed6a95919ed9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037103 Nov 03 04:06:18.865201 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1815/3506] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:19.465133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:19.466570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:19.475702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:19.476310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:19.476815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:19.477616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:19.478142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:19.478635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:19.560292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:19.563234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:19.573310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:19.574054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:19.574690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:19.583262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:19.583262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:19.583262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:19.973305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:19.983665 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c72376b-427c-4163-b971-d2d0c6435bce tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1214 microversion: 2.1 time: 0.430304 Nov 03 04:06:19.984528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1816/3507] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:19 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:19.992642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:19.993762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:20.000395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:20.001222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:20.001882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:20.002778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:20.003770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:20.004306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:20.051623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:20.059417 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-943a1078-b6e9-402c-b359-5f7f8ae82203 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.598766 Nov 03 04:06:20.064043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1692/3508] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:19 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:20.084006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:20.084634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] [instance: 97059348-d276-4ef5-b8f5-af7dccef979a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:20.091122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:20.092571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:20.092571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:20.093173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:20.093634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:20.094255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:20.115665 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] HTTP exception thrown: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Request method failure captured: Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a HTTP/1.1 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz4KTTJoic_58k8-TCbESLNFEPUd6AYz1oAAovTgrbQ1GKCsT4dzoOS14efoIFoyD25oP4rrlZM2eSXB9anP15MQ2Gadm-xvJs-yQhn9N52R3eRAcirVPUOtkeq9ZnTMSTcz1uq65lv5WnSbPp0bcwv-Lkgoxk1bwJQKfczJGKOMeDI Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: f356b66f21df4456ba847a4ae9bd98ca Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-659790780 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f356b66f21df4456ba847a4ae9bd98ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f356b66f21df4456ba847a4ae9bd98ca", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f356b66f21df4456ba847a4ae9bd98ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f356b66f21df4456ba847a4ae9bd98ca"}]}] Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-659790780 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: f356b66f21df4456ba847a4ae9bd98ca Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-659790780 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestMultiTenantJSON-659790780-project Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: aea68855ed88456ab919811f9d84bcb9 Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-659790780-project Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '97059348-d276-4ef5-b8f5-af7dccef979a'} Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:20.117245 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] Returning 404 to user: Instance 97059348-d276-4ef5-b8f5-af7dccef979a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3c241c59-f81d-429a-9c70-db10f643a40f tempest-ServersNegativeTestMultiTenantJSON-659790780 tempest-ServersNegativeTestMultiTenantJSON-659790780-project] 10.222.0.30 "GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a" status: 404 len: 111 microversion: 2.1 time: 0.053668 Nov 03 04:06:20.121354 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1693/3509] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:20 2022] GET /compute/v2.1/servers/97059348-d276-4ef5-b8f5-af7dccef979a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:06:20.323720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:20.332189 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab37d8c6-72a9-4f2c-b1d7-a3743c445fd4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1506 microversion: 2.1 time: 0.343096 Nov 03 04:06:20.332763 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1817/3510] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:19 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:20.440038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71048829-2f94-4c09-ac60-f9d2c0e18313 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7fd4d9e50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:20.488081 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71048829-2f94-4c09-ac60-f9d2c0e18313 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/83236157-b7ed-4a2e-956a-74bb0069b8e3" status: 200 len: 351 microversion: 2.1 time: 0.051505 Nov 03 04:06:20.493777 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1694/3511] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:20 2022] GET /compute/v2.1/os-volumes/83236157-b7ed-4a2e-956a-74bb0069b8e3 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:20.943497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e0bbc2d6-7c57-4cf5-a976-44fb81dd7942 req-c1c9c5a5-fe62-4176-9d2b-8a211294935e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39970b5-442d-4ddb-be40-ceb3f3d43663", "tag": "b60fad9d-1fd9-4d93-959e-dbf59aef4d24"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:20.954799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e0bbc2d6-7c57-4cf5-a976-44fb81dd7942 req-c1c9c5a5-fe62-4176-9d2b-8a211294935e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:20.955540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e0bbc2d6-7c57-4cf5-a976-44fb81dd7942 req-c1c9c5a5-fe62-4176-9d2b-8a211294935e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:20.955971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e0bbc2d6-7c57-4cf5-a976-44fb81dd7942 req-c1c9c5a5-fe62-4176-9d2b-8a211294935e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:20.967991 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e0bbc2d6-7c57-4cf5-a976-44fb81dd7942 req-c1c9c5a5-fe62-4176-9d2b-8a211294935e service nova] Creating event network-changed:b60fad9d-1fd9-4d93-959e-dbf59aef4d24 for instance c39970b5-442d-4ddb-be40-ceb3f3d43663 on n-h2-854653-7 Nov 03 04:06:20.980946 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e0bbc2d6-7c57-4cf5-a976-44fb81dd7942 req-c1c9c5a5-fe62-4176-9d2b-8a211294935e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Nov 03 04:06:20.983824 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1818/3512] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:21.008574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:21.009242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:21.015921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:21.016356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:21.016791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:21.017907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:21.018372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:21.018827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:21.083414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:21.084230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:21.090728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:21.091229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:21.091680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:21.092393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:21.092861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:21.093563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:21.095611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:21.106020 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7f572b9-c16e-401e-83a3-52279a7cf48a tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1214 microversion: 2.1 time: 0.101254 Nov 03 04:06:21.112101 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1695/3513] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:21 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:21.343538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:21.359204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:21.360178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:21.376444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:21.379215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:21.380226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:21.381100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:21.382430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:21.383197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:21.383801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:21.387324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b52a33cc-0dce-44b5-9644-ebc0819059c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.306157 Nov 03 04:06:21.405298 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1819/3514] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:21 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:21.664344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:21.672364 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a13a9743-2639-4089-abc4-26cb414a1d6c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1506 microversion: 2.1 time: 0.319430 Nov 03 04:06:21.685926 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1696/3515] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:21 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:22.132973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:22.134591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:22.145939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:22.146814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:22.147503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:22.148468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:22.149221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:22.149927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:22.256445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:22.266479 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d01d38b1-6995-44e5-b03c-78b1a2267308 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1214 microversion: 2.1 time: 0.138865 Nov 03 04:06:22.281048 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1820/3516] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:22 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:22.411001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:22.411872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:22.422545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:22.423169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:22.423721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:22.425998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:22.426570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:22.426925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:22.659848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:22.688828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6903ee4-ca38-4ca5-a6b1-634b8baf3a7b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.281609 Nov 03 04:06:22.691417 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1697/3517] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:22 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:22.704541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:22.705617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:22.714423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:22.715094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:22.719935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:22.720727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:22.721246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:22.723088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:22.939252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:22.959594 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f97695d-7728-4b10-ac79-b31bb632256c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1506 microversion: 2.1 time: 0.259312 Nov 03 04:06:22.960943 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1821/3518] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:22 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:23.292322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.293542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:23.305856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:23.306759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:23.308069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:23.317143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:23.317143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:23.317143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:23.414112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:23.423554 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84d5fd2d-7a70-4ca0-9254-aae8f2cc79cf tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1214 microversion: 2.1 time: 0.136270 Nov 03 04:06:23.436013 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1698/3519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:23.464336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1e4eb8c-df2a-4194-9307-bafdaa1be306 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7fd673f70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.537823 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1e4eb8c-df2a-4194-9307-bafdaa1be306 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/cafefaf9-6ffd-4565-a36a-0765c91a2ba2" status: 200 len: 351 microversion: 2.1 time: 0.078327 Nov 03 04:06:23.556862 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1822/3520] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/os-volumes/cafefaf9-6ffd-4565-a36a-0765c91a2ba2 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:23.557239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b711fc6a-2565-42e7-bd15-9aef69215222 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7fd4a63a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.676654 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b711fc6a-2565-42e7-bd15-9aef69215222 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.128596 Nov 03 04:06:23.681056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1699/3521] 10.222.0.30 () {58 vars in 1134 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:23.693452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68eea344-12c9-4996-9629-039cccb8dbe0 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7f98eac10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.715615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.716870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:23.733091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:23.735723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:23.737073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:23.738588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:23.741301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:23.741865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:23.833451 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68eea344-12c9-4996-9629-039cccb8dbe0 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.144113 Nov 03 04:06:23.834245 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1823/3522] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:23.848924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4fa7c596-48de-475a-9c50-998878529631 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7f882ff70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.925232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:23.935005 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2e76ba2-6d4e-4fc2-ae25-6c00cf6a0594 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.223416 Nov 03 04:06:23.945060 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1700/3523] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:23.958384 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4fa7c596-48de-475a-9c50-998878529631 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.113242 Nov 03 04:06:23.958977 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1824/3524] 10.222.0.30 () {58 vars in 1134 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:23.972127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73225d99-6dc5-4e9b-87ed-dc1890c75332 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7f98a74c0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.983191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:23.983809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:23.991524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:23.992014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:23.992449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:23.993190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:23.993654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:23.994083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:24.061240 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73225d99-6dc5-4e9b-87ed-dc1890c75332 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092950 Nov 03 04:06:24.067170 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1701/3525] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:24.076756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0deb6cad-cad5-430a-a633-09665eb67b65 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7fd488550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:24.219472 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0deb6cad-cad5-430a-a633-09665eb67b65 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.146668 Nov 03 04:06:24.220269 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1702/3526] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Nov 3 04:06:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:24.238029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-910ae865-b97c-4ac6-90c8-5dda9c7e0924 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7f9899af0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:24.250287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:24.259472 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4b2c325-5f84-4936-8b3c-ee15a9c0f176 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1514 microversion: 2.1 time: 0.279663 Nov 03 04:06:24.260946 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1825/3527] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:23 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:24.453120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:24.453889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:24.461095 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-910ae865-b97c-4ac6-90c8-5dda9c7e0924 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.230019 Nov 03 04:06:24.462079 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1703/3528] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 04:06:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:24.471107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:24.471833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:24.472288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:24.473694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:24.474164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:24.474599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:24.477679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7c1e61f6-dcfe-43f9-99dc-f9a2ebc2d9d5 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7fd479940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:24.622325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:24.664661 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80c6772f-7ffe-4baf-a509-bd6b95632345 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1278 microversion: 2.1 time: 0.219826 Nov 03 04:06:24.665325 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1826/3529] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:24 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:24.666655 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7c1e61f6-dcfe-43f9-99dc-f9a2ebc2d9d5 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.195117 Nov 03 04:06:24.667442 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1704/3530] 10.222.0.30 () {58 vars in 1188 bytes} [Thu Nov 3 04:06:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:24.683053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-913b2c5b-4ef8-4d0b-8ba3-56bbd59c5b98 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] Calling method '.version_select at 0x7ff7f9456ca0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:24.774216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-913b2c5b-4ef8-4d0b-8ba3-56bbd59c5b98 tempest-VolumesTestJSON-1373403163 tempest-VolumesTestJSON-1373403163-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094339 Nov 03 04:06:24.774216 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1827/3531] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 04:06:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:24.959906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:24.964119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:24.978086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=18 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:24.980408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=12 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:24.983066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:24.984760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:24.987872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:24.992821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:24.992821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:24.992821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:25.261217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:25.270405 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e5ba8753-6b43-4be0-ae3d-78b83a127f08 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1472 microversion: 2.1 time: 0.315395 Nov 03 04:06:25.270988 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1705/3532] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:24 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:25.700080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:25.700910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:25.713144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:25.717713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:25.718480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:25.719685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:25.721302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:25.722291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:25.820151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:25.829612 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb1638fe-0a7b-4994-bfd5-f4c540b11e26 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1276 microversion: 2.1 time: 0.136041 Nov 03 04:06:25.830523 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1828/3533] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:25 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:26.299776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:26.300538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:26.312487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:26.313841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:26.314294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:26.317941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:26.318421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:26.318891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:26.575918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-540fca66-f111-4f91-b1b0-92c44e3b0601 req-2710eedc-dfcb-4fc4-b9af-da43715ac1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39970b5-442d-4ddb-be40-ceb3f3d43663", "name": "network-vif-plugged", "status": "completed", "tag": "b60fad9d-1fd9-4d93-959e-dbf59aef4d24"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:26.584775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:26.591556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-540fca66-f111-4f91-b1b0-92c44e3b0601 req-2710eedc-dfcb-4fc4-b9af-da43715ac1ea service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:26.591556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-540fca66-f111-4f91-b1b0-92c44e3b0601 req-2710eedc-dfcb-4fc4-b9af-da43715ac1ea service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:26.591556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-540fca66-f111-4f91-b1b0-92c44e3b0601 req-2710eedc-dfcb-4fc4-b9af-da43715ac1ea service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:26.605617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-540fca66-f111-4f91-b1b0-92c44e3b0601 req-2710eedc-dfcb-4fc4-b9af-da43715ac1ea service nova] Creating event network-vif-plugged:b60fad9d-1fd9-4d93-959e-dbf59aef4d24 for instance c39970b5-442d-4ddb-be40-ceb3f3d43663 on n-h2-854653-7 Nov 03 04:06:26.618108 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-540fca66-f111-4f91-b1b0-92c44e3b0601 req-2710eedc-dfcb-4fc4-b9af-da43715ac1ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045797 Nov 03 04:06:26.619370 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1829/3534] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:26.812952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:26.823158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-33fe1959-64da-40b9-9c45-79f1db14f45b tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1490 microversion: 2.1 time: 0.527377 Nov 03 04:06:26.823830 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1706/3535] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:26 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1490 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:26.864735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:26.865622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:26.873480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:26.874143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:26.874687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:26.875577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:26.876138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:26.876666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:27.184654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:27.194060 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c9208a3-bcbf-4a0f-ab84-eff53cf4d42f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.334531 Nov 03 04:06:27.195367 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1830/3536] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:26 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:27.475433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:27.480569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:27.490964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:27.491720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:27.492168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:27.492885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:27.493429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:27.493864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:27.523930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lazy-loading 'flavor' on Instance uuid ee668004-ab0e-4715-b036-b468dd887743 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:06:27.852235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:27.853198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:27.859930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:27.861101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:27.861613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:27.863119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:27.863578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:27.864009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:27.888823 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fd352d26-a4c2-41b0-9cd8-447461948224 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action" status: 200 len: 32 microversion: 2.1 time: 0.425947 Nov 03 04:06:27.889907 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1707/3537] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:27 2022] POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:06:27.901387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:27.902396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:27.923493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:27.926996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:27.927561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:27.928401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:27.929338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:27.929851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:28.583789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:28.615947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20113b0d-d75b-42cb-a004-31526bbedd22 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1478 microversion: 2.1 time: 0.769177 Nov 03 04:06:28.620161 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1831/3538] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:27 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1478 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:28.636641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:28.636641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:28.639188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:28.655320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:28.657471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:28.660611 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-33559d40-cc39-4b3f-a475-7c743983526f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.763648 Nov 03 04:06:28.661420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:28.664884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:28.666282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:28.667060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:28.675417 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1708/3539] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:27 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:28.861917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2229c8a6-cf0a-4412-83d8-90fe6a8de289 req-a3429fbd-fed3-49cb-a264-aec9cd743a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822d98ae-1ba0-476a-9bdd-eb8accedc6f5", "tag": "c87e2e10-321c-4cd7-92ff-07442ce4f42d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:28.880021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2229c8a6-cf0a-4412-83d8-90fe6a8de289 req-a3429fbd-fed3-49cb-a264-aec9cd743a52 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:28.880520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2229c8a6-cf0a-4412-83d8-90fe6a8de289 req-a3429fbd-fed3-49cb-a264-aec9cd743a52 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:28.883354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2229c8a6-cf0a-4412-83d8-90fe6a8de289 req-a3429fbd-fed3-49cb-a264-aec9cd743a52 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:28.929066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2229c8a6-cf0a-4412-83d8-90fe6a8de289 req-a3429fbd-fed3-49cb-a264-aec9cd743a52 service nova] Creating event network-changed:c87e2e10-321c-4cd7-92ff-07442ce4f42d for instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 on n-h1-854653-7 Nov 03 04:06:28.938774 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2229c8a6-cf0a-4412-83d8-90fe6a8de289 req-a3429fbd-fed3-49cb-a264-aec9cd743a52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081131 Nov 03 04:06:28.942454 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1709/3540] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:29.311796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:29.323518 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-de0ab526-bb66-4421-8aa1-dddeb6b92d2e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.701214 Nov 03 04:06:29.324430 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1832/3541] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:28 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:29.663816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:29.669183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:29.685660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:29.687691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:29.688596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:29.695325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:29.695503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:29.695611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:29.695611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:29.695611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:29.697179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:29.697686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:29.717204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:29.719746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:29.719746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:29.719746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:30.367266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:30.380017 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c6e9c3e7-a3d0-4fa9-897d-91731424cf8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.695826 Nov 03 04:06:30.380741 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1833/3542] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:29 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:30.402280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:30.414177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:30.427265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:30.427774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:30.428469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:30.429101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:30.430004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:30.430627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:30.431217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:30.445337 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bbbbfaad-1cb4-4027-8dfb-bdfd56193c73 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1478 microversion: 2.1 time: 0.804649 Nov 03 04:06:30.445656 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1710/3543] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:29 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1478 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:30.740615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:30.744751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:30.753536 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf04ded8-64b7-48ba-8e49-9f9121e8323c tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.355005 Nov 03 04:06:30.754560 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1834/3544] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:30 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:31.405104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:31.406387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:31.417916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:31.419281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:31.420017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:31.421823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:31.423506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:31.424538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:31.478315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:31.479712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:31.494657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:31.495379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:31.496471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:31.497342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:31.497964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:31.498605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:31.707713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:31.715645 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b342095-56c3-4795-96e8-605a8489f5e0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.316431 Nov 03 04:06:31.716833 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1711/3545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:31 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:31.758294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:31.771646 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-31d3c157-e0a6-4a9c-a4bf-8c38e927ff93 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1478 microversion: 2.1 time: 0.298070 Nov 03 04:06:31.775701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:31.782627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:31.790012 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1835/3546] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:31 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1478 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:31.806773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:31.807282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:31.807728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:31.808453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:31.813902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:31.814355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:32.043889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:32.050568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:32.053310 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3568be18-f468-4b6e-9f13-66706145ff6d tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.281535 Nov 03 04:06:32.054372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1712/3547] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:31 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:32.744397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:32.745562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:32.755901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:32.756943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:32.757756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:32.758721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:32.760361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:32.761816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:32.806335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:32.807106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:32.822958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:32.823850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:32.824673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:32.827586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:32.832734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:32.833540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:33.044843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:33.064629 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-79151d8f-7bea-46bd-be6f-7356d30b2a76 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.325317 Nov 03 04:06:33.065520 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1836/3548] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:32 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:33.070967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8160c31f-8165-44f3-96cc-d60676fa6ec4 req-7c28ffa8-e7d1-42ee-aa85-97d306884a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b61b13-d16f-45b6-aff0-c56fac27466e", "name": "network-vif-plugged", "status": "completed", "tag": "3902d028-7167-4c1a-9a7b-fe465f176b4b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:33.081192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:33.083785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8160c31f-8165-44f3-96cc-d60676fa6ec4 req-7c28ffa8-e7d1-42ee-aa85-97d306884a0e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:33.084393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8160c31f-8165-44f3-96cc-d60676fa6ec4 req-7c28ffa8-e7d1-42ee-aa85-97d306884a0e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:33.084893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8160c31f-8165-44f3-96cc-d60676fa6ec4 req-7c28ffa8-e7d1-42ee-aa85-97d306884a0e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:33.098367 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8160c31f-8165-44f3-96cc-d60676fa6ec4 req-7c28ffa8-e7d1-42ee-aa85-97d306884a0e service nova] Creating event network-vif-plugged:3902d028-7167-4c1a-9a7b-fe465f176b4b for instance d6b61b13-d16f-45b6-aff0-c56fac27466e on n-h2-854653-7 Nov 03 04:06:33.103738 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8160c31f-8165-44f3-96cc-d60676fa6ec4 req-7c28ffa8-e7d1-42ee-aa85-97d306884a0e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036596 Nov 03 04:06:33.104742 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1837/3549] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:33.110055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:33.111244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:33.132035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:33.132792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:33.133486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:33.134387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:33.135203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:33.135810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:33.204403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:33.213591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca9b577a-9498-4199-bd23-588ee2bf33b8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1478 microversion: 2.1 time: 0.411742 Nov 03 04:06:33.215630 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1713/3550] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:32 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1478 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:33.454741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:33.462619 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9826dcc0-f627-4f44-8148-4ec324becfb0 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.356567 Nov 03 04:06:33.474894 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1838/3551] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:33 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:34.090743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:34.091327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:34.098958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:34.099456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:34.099905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:34.100634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:34.101101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:34.101625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:34.239653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:34.240260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:34.251436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:34.255245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:34.255719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:34.256468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:34.256929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:34.257582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:34.333102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:34.344216 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6ea311a-823f-4916-bbc4-163c26c13a68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.256275 Nov 03 04:06:34.344836 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1714/3552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:34 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:34.458134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:34.467490 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a82eac61-43e5-413e-98e2-c8ab21b38d0c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1478 microversion: 2.1 time: 0.233162 Nov 03 04:06:34.468891 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1839/3553] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:34 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1478 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:34.487489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:34.488400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:34.508496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:34.509661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:34.514871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:34.515274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:34.516302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:34.517630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:34.701853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:34.713855 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fd74dc19-2bf1-4839-a51a-fa5feda63bf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.230435 Nov 03 04:06:34.729061 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1715/3554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:34 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:35.369077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:35.370276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:35.378238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.378981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.379702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:35.380670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.381386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.382074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:35.492889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:35.494165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:35.508403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.508973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.509632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:35.510541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.515938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.515938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:35.641359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:35.652239 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-57a34575-8290-48ae-b428-c305c9e1ee05 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.287097 Nov 03 04:06:35.652828 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1840/3555] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:35 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:35.748731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:35.748731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:35.748731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.748731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.749274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:35.749930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.750787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.751309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:35.753260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:35.763033 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4385b49-76c4-4025-8955-bc8d698a9ca8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1464 microversion: 2.1 time: 0.275147 Nov 03 04:06:35.763606 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1716/3556] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:35 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1464 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:35.789705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:35.790667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:35.797277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.798051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.798862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:35.800332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:35.800969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:35.801612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.016743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:36.031810 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-828f8417-159a-4702-9399-9cf746081703 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.296658 Nov 03 04:06:36.062987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:36.078831 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1841/3557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:35 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:36.085379 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8bdac24f-3154-4347-9371-719c282e534c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1464 microversion: 2.1 time: 0.299847 Nov 03 04:06:36.096808 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1717/3558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:35 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:36.111205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:36.115848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:36.123056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.123770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.124401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.125558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.126216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.126815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.229886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:06:36.230686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:06:36.231669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:06:36.232284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:06:36.233306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:06:36.435068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-229e11cc-465d-4d21-9b42-c97f5841d53b tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Action: 'create', calling method: .version_select at 0x7ff7f94aeca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1571559071", "metadata": {"Type": "work"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-229e11cc-465d-4d21-9b42-c97f5841d53b tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Request method failure captured: Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 122 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz5LR2YH6OXL77Ips2JktxYCijWB7x4ulIhItlYbpCa7A_Rigc08Tzg4yEr2cPneE8Z4Syur01byCzL8k-EuiuXJihJq1XC62zoci7RGoUNnVYgZ0wx5t_zIPdf4FFRwRJiGiYWSMES23vA66B3zJot603tJTTFRqV_gqI1354M8c6A Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_abcf7c1ca5a64f8bb0ed34c0b982c6e3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}] Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 5dc413c767fb47c8a200b76d77cb2352 Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1571559071", "metadata": {"Type": "work"}}} Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1571559071', 'metadata': {'Type': 'work'}}}} Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi '#$%' Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:06:36.439572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 03 04:06:36.447630 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.451876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-229e11cc-465d-4d21-9b42-c97f5841d53b tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:36.451876 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-229e11cc-465d-4d21-9b42-c97f5841d53b tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.338022 Nov 03 04:06:36.451876 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1718/3559] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Nov 3 04:06:36 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 03 04:06:36.461990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5254ecf-3f2f-48b4-b36f-12fb251745d7 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Action: 'create', calling method: .version_select at 0x7ff7f97ae790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1969586933", "metadata": {"Type": "work"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:36.465217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5254ecf-3f2f-48b4-b36f-12fb251745d7 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Request method failure captured: Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 120 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz5LR2YH6OXL77Ips2JktxYCijWB7x4ulIhItlYbpCa7A_Rigc08Tzg4yEr2cPneE8Z4Syur01byCzL8k-EuiuXJihJq1XC62zoci7RGoUNnVYgZ0wx5t_zIPdf4FFRwRJiGiYWSMES23vA66B3zJot603tJTTFRqV_gqI1354M8c6A Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_abcf7c1ca5a64f8bb0ed34c0b982c6e3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}] Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 5dc413c767fb47c8a200b76d77cb2352 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1969586933", "metadata": {"Type": "work"}}} Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1969586933', 'metadata': {'Type': 'work'}}}} Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi '0' Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:06:36.465750 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5254ecf-3f2f-48b4-b36f-12fb251745d7 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5254ecf-3f2f-48b4-b36f-12fb251745d7 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009490 Nov 03 04:06:36.474764 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1719/3560] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Nov 3 04:06:36 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:06:36.478938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.479391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.482459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.483115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.483605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.486320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.497843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b27103dc-4e6d-4cb1-9253-736e55941c7d tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Action: 'create', calling method: .version_select at 0x7ff7f9cda790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-153891249", "metadata": {"Type": "work"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b27103dc-4e6d-4cb1-9253-736e55941c7d tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Request method failure captured: Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 118 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz5LR2YH6OXL77Ips2JktxYCijWB7x4ulIhItlYbpCa7A_Rigc08Tzg4yEr2cPneE8Z4Syur01byCzL8k-EuiuXJihJq1XC62zoci7RGoUNnVYgZ0wx5t_zIPdf4FFRwRJiGiYWSMES23vA66B3zJot603tJTTFRqV_gqI1354M8c6A Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_abcf7c1ca5a64f8bb0ed34c0b982c6e3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}] Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 5dc413c767fb47c8a200b76d77cb2352 Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-153891249", "metadata": {"Type": "work"}}} Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-153891249', 'metadata': {'Type': 'work'}}}} Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi '' Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:06:36.501838 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b27103dc-4e6d-4cb1-9253-736e55941c7d tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b27103dc-4e6d-4cb1-9253-736e55941c7d tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026126 Nov 03 04:06:36.507596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1720/3561] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Nov 3 04:06:36 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:06:36.519354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c43e4663-0197-49dc-a3c6-99ef4956ce79 req-1d970797-71db-44b6-aeaf-96a215e7c52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d98ae-1ba0-476a-9bdd-eb8accedc6f5", "name": "network-vif-plugged", "status": "completed", "tag": "c87e2e10-321c-4cd7-92ff-07442ce4f42d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:36.528890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c20b628-8e92-4371-9369-4561f4b73a5c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action" status: 202 len: 1068 microversion: 2.1 time: 0.422291 Nov 03 04:06:36.529940 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1842/3562] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:36 2022] POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action => generated 1068 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 03 04:06:36.531602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c43e4663-0197-49dc-a3c6-99ef4956ce79 req-1d970797-71db-44b6-aeaf-96a215e7c52b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.532210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c43e4663-0197-49dc-a3c6-99ef4956ce79 req-1d970797-71db-44b6-aeaf-96a215e7c52b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.532647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c43e4663-0197-49dc-a3c6-99ef4956ce79 req-1d970797-71db-44b6-aeaf-96a215e7c52b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.536343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b8f7d41-2313-4d62-b137-9fa0ed1933fe tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Calling method '.version_select at 0x7ff7f94cbdc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:36.550139 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c43e4663-0197-49dc-a3c6-99ef4956ce79 req-1d970797-71db-44b6-aeaf-96a215e7c52b service nova] Creating event network-vif-plugged:c87e2e10-321c-4cd7-92ff-07442ce4f42d for instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 on n-h1-854653-7 Nov 03 04:06:36.555512 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c43e4663-0197-49dc-a3c6-99ef4956ce79 req-1d970797-71db-44b6-aeaf-96a215e7c52b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041090 Nov 03 04:06:36.556362 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1721/3563] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:36.562036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:36.562969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:36.570704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.570822 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6b8f7d41-2313-4d62-b137-9fa0ed1933fe tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] HTTP exception thrown: Volume tempest-invalid-12535195 could not be found. Nov 03 04:06:36.575099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.575558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.576307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.576778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.577317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b8f7d41-2313-4d62-b137-9fa0ed1933fe tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Request method failure captured: Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-12535195 HTTP/1.1 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz5LR2YH6OXL77Ips2JktxYCijWB7x4ulIhItlYbpCa7A_Rigc08Tzg4yEr2cPneE8Z4Syur01byCzL8k-EuiuXJihJq1XC62zoci7RGoUNnVYgZ0wx5t_zIPdf4FFRwRJiGiYWSMES23vA66B3zJot603tJTTFRqV_gqI1354M8c6A Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_abcf7c1ca5a64f8bb0ed34c0b982c6e3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}] Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5dc413c767fb47c8a200b76d77cb2352 Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: exception: Volume tempest-invalid-12535195 could not be found. Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'tempest-invalid-12535195'} Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-12535195 could not be found. (HTTP 404) (Request-ID: req-d4e0f170-d1ae-47cf-af95-e8fd278b0dd2) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:36.578239 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-12535195 could not be found. Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-12535195 could not be found. Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-12535195 could not be found. Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.583368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b8f7d41-2313-4d62-b137-9fa0ed1933fe tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Returning 404 to user: Volume tempest-invalid-12535195 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:36.586384 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b8f7d41-2313-4d62-b137-9fa0ed1933fe tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-12535195" status: 404 len: 97 microversion: 2.1 time: 0.052862 Nov 03 04:06:36.586384 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1843/3564] 10.222.0.30 () {58 vars in 1212 bytes} [Thu Nov 3 04:06:36 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-12535195 => generated 97 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:06:36.594574 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-282f0060-3a5b-4e54-a9fd-f02a57961cb6 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004339 Nov 03 04:06:36.595284 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1844/3565] 10.222.0.30 () {58 vars in 1140 bytes} [Thu Nov 3 04:06:36 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 03 04:06:36.606176 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0201a757-9c48-4eaf-8b5c-35aea9cf2048 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005263 Nov 03 04:06:36.607012 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1845/3566] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:06:36 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 03 04:06:36.616524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e81e5fb7-e7a7-434e-a932-78cc96d6abea tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Calling method '.version_select at 0x7ff7f9456040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:36.656192 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-e81e5fb7-e7a7-434e-a932-78cc96d6abea tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] HTTP exception thrown: Volume bd51a028-8015-40cd-ac55-407b5967843d could not be found. Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e81e5fb7-e7a7-434e-a932-78cc96d6abea tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Request method failure captured: Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-volumes/bd51a028-8015-40cd-ac55-407b5967843d HTTP/1.1 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz5LR2YH6OXL77Ips2JktxYCijWB7x4ulIhItlYbpCa7A_Rigc08Tzg4yEr2cPneE8Z4Syur01byCzL8k-EuiuXJihJq1XC62zoci7RGoUNnVYgZ0wx5t_zIPdf4FFRwRJiGiYWSMES23vA66B3zJot603tJTTFRqV_gqI1354M8c6A Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_abcf7c1ca5a64f8bb0ed34c0b982c6e3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}] Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5dc413c767fb47c8a200b76d77cb2352 Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: exception: Volume bd51a028-8015-40cd-ac55-407b5967843d could not be found. Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'bd51a028-8015-40cd-ac55-407b5967843d'} Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd51a028-8015-40cd-ac55-407b5967843d could not be found. (HTTP 404) (Request-ID: req-c28266a8-97b4-4b56-9eb1-69ecb47488d8) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:06:36.658245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd51a028-8015-40cd-ac55-407b5967843d could not be found. Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd51a028-8015-40cd-ac55-407b5967843d could not be found. Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd51a028-8015-40cd-ac55-407b5967843d could not be found. Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e81e5fb7-e7a7-434e-a932-78cc96d6abea tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Returning 404 to user: Volume bd51a028-8015-40cd-ac55-407b5967843d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e81e5fb7-e7a7-434e-a932-78cc96d6abea tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/bd51a028-8015-40cd-ac55-407b5967843d" status: 404 len: 109 microversion: 2.1 time: 0.047984 Nov 03 04:06:36.665344 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1846/3567] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:06:36 2022] DELETE /compute/v2.1/os-volumes/bd51a028-8015-40cd-ac55-407b5967843d => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:06:36.672094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a84a22d9-0981-4dac-a8f5-7da9a68e8990 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Calling method '.version_select at 0x7ff7f94cbdc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:36.707692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a84a22d9-0981-4dac-a8f5-7da9a68e8990 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] HTTP exception thrown: Volume 2f127edf-c08a-4a56-8660-2dc33a5dacd5 could not be found. Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a84a22d9-0981-4dac-a8f5-7da9a68e8990 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Request method failure captured: Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-volumes/2f127edf-c08a-4a56-8660-2dc33a5dacd5 HTTP/1.1 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz5LR2YH6OXL77Ips2JktxYCijWB7x4ulIhItlYbpCa7A_Rigc08Tzg4yEr2cPneE8Z4Syur01byCzL8k-EuiuXJihJq1XC62zoci7RGoUNnVYgZ0wx5t_zIPdf4FFRwRJiGiYWSMES23vA66B3zJot603tJTTFRqV_gqI1354M8c6A Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_abcf7c1ca5a64f8bb0ed34c0b982c6e3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/abcf7c1ca5a64f8bb0ed34c0b982c6e3"}]}] Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: abcf7c1ca5a64f8bb0ed34c0b982c6e3 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesNegativeTest-775863895 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 5dc413c767fb47c8a200b76d77cb2352 Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesNegativeTest-775863895-project Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: exception: Volume 2f127edf-c08a-4a56-8660-2dc33a5dacd5 could not be found. Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '2f127edf-c08a-4a56-8660-2dc33a5dacd5'} Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f127edf-c08a-4a56-8660-2dc33a5dacd5 could not be found. (HTTP 404) (Request-ID: req-a2bffdef-ff65-4474-a23a-847a8727d0a5) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:06:36.710030 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f127edf-c08a-4a56-8660-2dc33a5dacd5 could not be found. Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f127edf-c08a-4a56-8660-2dc33a5dacd5 could not be found. Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f127edf-c08a-4a56-8660-2dc33a5dacd5 could not be found. Nov 03 04:06:36.716142 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:06:36.723222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a84a22d9-0981-4dac-a8f5-7da9a68e8990 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] Returning 404 to user: Volume 2f127edf-c08a-4a56-8660-2dc33a5dacd5 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:36.723222 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a84a22d9-0981-4dac-a8f5-7da9a68e8990 tempest-VolumesNegativeTest-775863895 tempest-VolumesNegativeTest-775863895-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2f127edf-c08a-4a56-8660-2dc33a5dacd5" status: 404 len: 109 microversion: 2.1 time: 0.054506 Nov 03 04:06:36.723222 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1847/3568] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:06:36 2022] GET /compute/v2.1/os-volumes/2f127edf-c08a-4a56-8660-2dc33a5dacd5 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:06:36.748828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:36.749483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:36.759624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.761004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.762290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.762867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:36.763537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:36.764116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:36.920380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:36.934950 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-56806dc3-af6f-4dc7-9a33-0e1e90724903 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.376734 Nov 03 04:06:36.935841 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1722/3569] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:36 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:36.977270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:36.985185 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1852ef6f-5ace-4ca8-8a2f-f2b46a36f788 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.260576 Nov 03 04:06:36.985956 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1848/3570] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:36 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:37.059907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:37.060749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:37.067168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:37.067660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:37.068102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:37.068801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:37.069317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:37.069755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:37.217240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:37.233302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e36b98d-18d6-4400-8377-62fe2db5041f tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.170029 Nov 03 04:06:37.233302 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1723/3571] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:37 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:37.959000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:37.959618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:37.966360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:37.966844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:37.967281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:37.967970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:37.968426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:37.968849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:38.008331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:38.008938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:38.015884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:38.016387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:38.016825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:38.017562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:38.018078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:38.018499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:38.146641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:38.155037 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f24a5a1-b1af-4421-8e24-bded3bdc82fe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.200462 Nov 03 04:06:38.155609 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1849/3572] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:37 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:38.191112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:38.199169 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8082adb3-9081-4106-98be-ea81f119a626 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.194914 Nov 03 04:06:38.208210 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1724/3573] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:38 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:38.253887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:38.254620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:38.260886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:38.262049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:38.262534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:38.263273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:38.263743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:38.264229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:38.411659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:38.419623 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d4c78a5c-ae3a-4625-ad1a-6bab268eb409 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1318 microversion: 2.1 time: 0.170497 Nov 03 04:06:38.434094 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1850/3574] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:38 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:39.180825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:39.182076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:39.189388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.190644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.191253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.192036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.192686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.193398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.224696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:39.225553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:39.232802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.234544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.234544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.234544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.235025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.239384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.394655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:39.403010 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a8044272-07b8-45db-8092-d674cb43f5b6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.228953 Nov 03 04:06:39.403694 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1725/3575] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:39 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:39.422895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:39.432531 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c789ad6-8eae-443a-81d4-753c5a98403e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.212424 Nov 03 04:06:39.433467 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1851/3576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:39 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:39.444058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:39.444817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:39.450721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.451207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.451842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.452542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.452995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.453470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.597913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:39.607362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20473aa7-0e92-4799-9636-3f44b2efe546 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1505 microversion: 2.1 time: 0.167474 Nov 03 04:06:39.611570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1726/3577] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:39 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:39.631888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:39.633571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:39.638760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.639335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.639857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.640777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.641292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.641752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.797453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:39.806857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e919660-275f-4914-95d4-8721a5885972 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663" status: 200 len: 1506 microversion: 2.1 time: 0.178840 Nov 03 04:06:39.807775 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1852/3578] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:39 2022] GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:39.831371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:39.832084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:39.843586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.843586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.843586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.843586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:39.843586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:39.843586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:39.876162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:06:40.209432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af754f22-90a5-4ea5-beef-826c1041d9cc tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663" status: 204 len: 0 microversion: 2.1 time: 0.382307 Nov 03 04:06:40.210072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1727/3579] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:06:39 2022] DELETE /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:06:40.218377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:40.218879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:40.225558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.226123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.227164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.227164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.227572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.227995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.255504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:06:40.398067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:40.427722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:40.428418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:40.437460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.443535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.443535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.443535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.443535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.443535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.582593 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68674e6e-ae67-4fff-a5a2-9857bea89174 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "DELETE /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 204 len: 0 microversion: 2.1 time: 0.367776 Nov 03 04:06:40.583385 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1853/3580] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:06:40 2022] DELETE /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:06:40.584522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:40.589027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:40.590030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:40.594233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abe5fb46-4119-4b0d-9843-351b0a8e5253 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.171376 Nov 03 04:06:40.595046 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1728/3581] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:40 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:40.596735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.597262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.597708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.598468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.598928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.599362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.600720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:40.601473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:40.607656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.608412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.608853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.609592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:40.610223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:40.611082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:40.825785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:40.826166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:40.831545 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a89d8a0a-7c25-41ef-bd53-254e44349c1e tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663" status: 200 len: 1512 microversion: 2.1 time: 0.235271 Nov 03 04:06:40.847790 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1729/3582] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:40 2022] GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663 => generated 1512 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:40.848294 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3fb0b21-31aa-4648-b576-a09bb823dab0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.251693 Nov 03 04:06:40.848294 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1854/3583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:40 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:41.621950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:41.622572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:41.632141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:41.632774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:41.633249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:41.634073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:41.634570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:41.635257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:41.862806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:41.863525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:41.875756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:41.876405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:41.877109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:41.878079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:41.878483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:41.878914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:42.193053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:42.219441 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ae11a63-ce2f-45ab-8c70-68e75618bccb tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.602183 Nov 03 04:06:42.229345 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1730/3584] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:41 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:42.232681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:42.234239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:42.241502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:42.242439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:42.242981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:42.243789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:42.244348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:42.245087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:42.264920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:42.391616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:42.416685 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b21ce17b-5492-4df5-9437-396bf06ddd96 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663" status: 200 len: 1512 microversion: 2.1 time: 0.565651 Nov 03 04:06:42.430374 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1855/3585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:41 2022] GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663 => generated 1512 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:42.536012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:42.545028 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eddf8b99-7d64-438b-852c-4497c1259bfd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.317923 Nov 03 04:06:42.545856 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1731/3586] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:42 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:43.232727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cfdcdcff-5a00-4b6b-aa6d-896300eb04cc req-cb587a8c-8318-44d5-9714-96f2fdb010a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39970b5-442d-4ddb-be40-ceb3f3d43663", "name": "network-vif-deleted", "tag": "b60fad9d-1fd9-4d93-959e-dbf59aef4d24"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:43.243294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cfdcdcff-5a00-4b6b-aa6d-896300eb04cc req-cb587a8c-8318-44d5-9714-96f2fdb010a1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.243873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cfdcdcff-5a00-4b6b-aa6d-896300eb04cc req-cb587a8c-8318-44d5-9714-96f2fdb010a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.244450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cfdcdcff-5a00-4b6b-aa6d-896300eb04cc req-cb587a8c-8318-44d5-9714-96f2fdb010a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.245685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:43.246348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:43.255342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.255839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.256587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.257361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.257822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.257996 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cfdcdcff-5a00-4b6b-aa6d-896300eb04cc req-cb587a8c-8318-44d5-9714-96f2fdb010a1 service nova] Creating event network-vif-deleted:b60fad9d-1fd9-4d93-959e-dbf59aef4d24 for instance c39970b5-442d-4ddb-be40-ceb3f3d43663 on n-h2-854653-7 Nov 03 04:06:43.258335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.262750 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cfdcdcff-5a00-4b6b-aa6d-896300eb04cc req-cb587a8c-8318-44d5-9714-96f2fdb010a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.371118 Nov 03 04:06:43.263713 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1856/3587] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:43.428317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:43.442046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a22a4d64-fe8b-4226-a47d-c1b545555d6c tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.201917 Nov 03 04:06:43.444003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:43.445287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:43.457841 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1732/3588] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:43 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:43.469844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.469844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.469844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.469844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.469844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.469844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.510026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.510655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.511106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.511565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lazy-loading 'fault' on Instance uuid c39970b5-442d-4ddb-be40-ceb3f3d43663 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:06:43.559129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:43.570782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:43.571910 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c02da0e-2497-40ab-ac24-224ac1f49cf2 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663" status: 200 len: 1308 microversion: 2.1 time: 0.133549 Nov 03 04:06:43.572601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:43.572748 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1857/3589] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:43 2022] GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663 => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:43.579450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.580096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.581512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.582457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:43.582922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:43.583637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:43.835067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:43.843578 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b61bfb7c-ddc9-4d37-8b52-0df9a7791b11 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.277043 Nov 03 04:06:43.844184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1733/3590] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:43 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:44.468304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:44.469706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:44.479798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.480336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.487267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.487267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.487267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.487267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.603586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:44.611741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: c39970b5-442d-4ddb-be40-ceb3f3d43663] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:44.614062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.614974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.615817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.616693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.617398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.618075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.636268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] HTTP exception thrown: Instance c39970b5-442d-4ddb-be40-ceb3f3d43663 could not be found. Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Request method failure captured: Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663 HTTP/1.1 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz4PD78ixR1mRozjZoIrCHdW7FRwLQOOA6RibBeF8FeyWmJk7CITYmOgrdJY1mRUETduBpv49p9Opq8q_WZY8LvMaMi5f9jj0lMtO-CjKTOtViw4xcQ4zd66bwkITS9RI-DoNa5doCy0pxilt2S_yqFSaLD2lp3P7DjWoJzpSRUQv1M Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: dd9e44b66aa045a48f1b00e6a5488200 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-MultipleCreateTestJSON-2047710464 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd9e44b66aa045a48f1b00e6a5488200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd9e44b66aa045a48f1b00e6a5488200", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd9e44b66aa045a48f1b00e6a5488200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd9e44b66aa045a48f1b00e6a5488200"}]}] Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-MultipleCreateTestJSON-2047710464 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: dd9e44b66aa045a48f1b00e6a5488200 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2047710464 Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-MultipleCreateTestJSON-2047710464-project Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f6a300273c724268abdaba803626056b Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-MultipleCreateTestJSON-2047710464-project Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance c39970b5-442d-4ddb-be40-ceb3f3d43663 could not be found. Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'c39970b5-442d-4ddb-be40-ceb3f3d43663'} Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39970b5-442d-4ddb-be40-ceb3f3d43663 could not be found. Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39970b5-442d-4ddb-be40-ceb3f3d43663 could not be found. Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:44.638443 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39970b5-442d-4ddb-be40-ceb3f3d43663 could not be found. Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Returning 404 to user: Instance c39970b5-442d-4ddb-be40-ceb3f3d43663 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0081e8c0-9db6-41e5-a792-89a3b9834784 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663" status: 404 len: 111 microversion: 2.1 time: 0.042211 Nov 03 04:06:44.647862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1734/3591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:44 2022] GET /compute/v2.1/servers/c39970b5-442d-4ddb-be40-ceb3f3d43663 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:06:44.654562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:44.655388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:44.663520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.670867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.670867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.670867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.670867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.670867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.671448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:44.678157 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee832fdf-c5b9-4e50-9c7a-2798e62b41a1 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.214133 Nov 03 04:06:44.678741 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1858/3592] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:44 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:44.706206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.706688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.707122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.707571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lazy-loading 'fault' on Instance uuid 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:06:44.749290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6a300273c724268abdaba803626056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e44b66aa045a48f1b00e6a5488200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:44.757661 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84547722-dbda-40de-9b34-de1fa15bdb23 tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 200 len: 1308 microversion: 2.1 time: 0.106879 Nov 03 04:06:44.758223 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1735/3593] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:44 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:44.875718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:44.877419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:44.884057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.884550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.884993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:44.885722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:44.886288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:44.886666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.036109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:45.044460 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb301256-1dbf-4578-ae53-87d275d7d01c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1500 microversion: 2.1 time: 0.173617 Nov 03 04:06:45.045082 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1859/3594] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:44 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1500 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:45.071910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d28b420-4712-4975-ba1d-40ab78eab54b"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:45.073070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:45.079171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.081824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.082299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.083009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.083477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.083912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.107598 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Cannot 'attach_volume' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state rescued Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/os-volume_attachments HTTP/1.1 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 74 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: {"volumeAttachment": {"volumeId": "9d28b420-4712-4975-ba1d-40ab78eab54b"}} Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'attach_volume' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state rescued Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': 'ee668004-ab0e-4715-b036-b468dd887743', 'body': {'volumeAttachment': {'volumeId': '9d28b420-4712-4975-ba1d-40ab78eab54b'}}} Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee668004-ab0e-4715-b036-b468dd887743 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 03 04:06:45.109262 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state rescued Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state rescued Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 409 to user: Cannot 'attach_volume' instance ee668004-ab0e-4715-b036-b468dd887743 while it is in vm_state rescued {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-413b32bf-0d9f-40ec-8789-88f74a08f0cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044160 Nov 03 04:06:45.117176 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1736/3595] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:06:45 2022] POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:06:45.120524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:45.121101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:45.127633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.128128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.128573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.129306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.129766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.130201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.284684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-f8bf120c-36c8-4f24-bcc7-2bd6c94a3fec req-1fc316b9-cfff-4260-bf34-75a58b25bfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822d98ae-1ba0-476a-9bdd-eb8accedc6f5", "name": "network-vif-deleted", "tag": "c87e2e10-321c-4cd7-92ff-07442ce4f42d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:45.297604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f8bf120c-36c8-4f24-bcc7-2bd6c94a3fec req-1fc316b9-cfff-4260-bf34-75a58b25bfe3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.298170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f8bf120c-36c8-4f24-bcc7-2bd6c94a3fec req-1fc316b9-cfff-4260-bf34-75a58b25bfe3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.298676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f8bf120c-36c8-4f24-bcc7-2bd6c94a3fec req-1fc316b9-cfff-4260-bf34-75a58b25bfe3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.317965 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-f8bf120c-36c8-4f24-bcc7-2bd6c94a3fec req-1fc316b9-cfff-4260-bf34-75a58b25bfe3 service nova] Creating event network-vif-deleted:c87e2e10-321c-4cd7-92ff-07442ce4f42d for instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 on n-h1-854653-7 Nov 03 04:06:45.323515 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-f8bf120c-36c8-4f24-bcc7-2bd6c94a3fec req-1fc316b9-cfff-4260-bf34-75a58b25bfe3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045648 Nov 03 04:06:45.324351 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1737/3596] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:06:45.404854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c600ce74-45e3-4242-9f84-6f5a14ead299 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action" status: 202 len: 0 microversion: 2.1 time: 0.287191 Nov 03 04:06:45.406348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1860/3597] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:06:45 2022] POST /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:06:45.418147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:45.418966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:45.431622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.432309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.434104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.438171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.440165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.440717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.695874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:45.707109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:45.707966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:45.711027 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ecf1021-f968-4da0-a7bb-4822d57e46c5 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1508 microversion: 2.1 time: 0.300226 Nov 03 04:06:45.715353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.716161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.716824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.717872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.718838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.719698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.722977 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1738/3598] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:45 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:45.781308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:45.782896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] [instance: 822d98ae-1ba0-476a-9bdd-eb8accedc6f5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:45.789842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.790550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.791195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.792202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:45.792845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:45.793462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:45.809611 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] HTTP exception thrown: Instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 could not be found. Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Request method failure captured: Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 HTTP/1.1 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz4PD78ixR1mRozjZoIrCHdW7FRwLQOOA6RibBeF8FeyWmJk7CITYmOgrdJY1mRUETduBpv49p9Opq8q_WZY8LvMaMi5f9jj0lMtO-CjKTOtViw4xcQ4zd66bwkITS9RI-DoNa5doCy0pxilt2S_yqFSaLD2lp3P7DjWoJzpSRUQv1M Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: dd9e44b66aa045a48f1b00e6a5488200 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-MultipleCreateTestJSON-2047710464 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd9e44b66aa045a48f1b00e6a5488200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dd9e44b66aa045a48f1b00e6a5488200", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dd9e44b66aa045a48f1b00e6a5488200"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dd9e44b66aa045a48f1b00e6a5488200"}]}] Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-MultipleCreateTestJSON-2047710464 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: dd9e44b66aa045a48f1b00e6a5488200 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-MultipleCreateTestJSON-2047710464 Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-MultipleCreateTestJSON-2047710464-project Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f6a300273c724268abdaba803626056b Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-MultipleCreateTestJSON-2047710464-project Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 could not be found. Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '822d98ae-1ba0-476a-9bdd-eb8accedc6f5'} Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 could not be found. Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 could not be found. Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:06:45.811928 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.817345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:06:45.817345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:06:45.817345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:06:45.817345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:06:45.817345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:06:45.817345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 could not be found. Nov 03 04:06:45.817345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:06:45.818642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] Returning 404 to user: Instance 822d98ae-1ba0-476a-9bdd-eb8accedc6f5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:06:45.819536 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-45d1bf46-dcd6-4cec-bbbe-864ee18ac5af tempest-MultipleCreateTestJSON-2047710464 tempest-MultipleCreateTestJSON-2047710464-project] 10.222.0.30 "GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5" status: 404 len: 111 microversion: 2.1 time: 0.042067 Nov 03 04:06:45.820105 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1739/3599] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:45 2022] GET /compute/v2.1/servers/822d98ae-1ba0-476a-9bdd-eb8accedc6f5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:06:46.000931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:46.014261 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85e9d56c-efcf-4853-ad00-bfebcdaf7264 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.315756 Nov 03 04:06:46.016171 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1861/3600] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:45 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:46.737664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:46.739043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:46.746506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:46.747218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:46.747836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:46.748737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:46.752583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:46.753311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:46.985703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:46.996946 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ef78d251-0fed-40bb-b803-2ad1b1affd4b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1508 microversion: 2.1 time: 0.263202 Nov 03 04:06:46.999030 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1740/3601] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:46 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:47.050415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:47.051034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:47.061668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:47.062355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:47.062957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:47.063826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:47.065002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:47.065603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:47.306716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:47.318216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af25b32a-0a19-42e0-a359-36271772a8f4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.272110 Nov 03 04:06:47.318842 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1862/3602] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:47 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:48.026983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:48.028220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:48.055943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:48.059371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:48.063285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:48.064006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:48.068469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:48.068469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:48.068469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:48.347791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:48.348635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:48.358117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:48.364768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:48.369058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:48.370013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:48.371594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:48.372285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:48.489157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:48.497658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79fef59e-3992-4b1d-ad82-5ab2d487717e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1508 microversion: 2.1 time: 0.477205 Nov 03 04:06:48.516478 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1741/3603] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:48 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1508 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:48.669353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:48.685464 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da330aea-a720-4310-a0ac-b32024fa079e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.342558 Nov 03 04:06:48.686409 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1863/3604] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:48 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:49.525040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:49.526689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:49.538101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:49.542023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:49.542709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:49.543901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:49.544954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:49.548222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:49.712169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:49.714228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:49.724761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:49.725453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:49.726003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:49.727101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:49.727646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:49.728244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:49.865410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:49.878106 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dcbc4ee7-901f-4b4a-8cce-7837c474b7e2 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1514 microversion: 2.1 time: 0.358349 Nov 03 04:06:49.894418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1742/3605] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:49 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1514 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:49.992553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:50.006453 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ecd449d-2b61-4e67-b0d0-fe81877a55ea tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.297955 Nov 03 04:06:50.007204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1864/3606] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:49 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:51.034665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:51.035287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:51.050450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:51.050954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:51.051398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:51.052114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:51.052948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:51.053265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:51.200920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:51.202546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:51.216113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:51.220397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:51.221798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:51.222783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:51.224694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:51.225508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:51.267764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:51.280208 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-214f3b40-6aab-4412-a13f-872ff24aeebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.249056 Nov 03 04:06:51.281530 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1743/3607] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:51 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:51.571747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:51.587497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:51.589244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:51.590993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b533020-0062-43af-9b16-e2384a270c73 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2954 microversion: 2.42 time: 0.398795 Nov 03 04:06:51.605824 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1865/3608] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:06:51 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2954 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:06:51.622644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:51.623078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:51.629661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:51.630406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:51.631051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:51.633600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:51.645788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:51.646675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:51.903942 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e926e2c-43f0-4373-893b-50fbfa6d7b47 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.285280 Nov 03 04:06:51.905256 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1744/3609] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 04:06:51 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b/os-interface => generated 1831 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:06:52.304264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:52.304884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:52.312350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:52.313232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:52.313930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:52.315232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:52.316207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:52.317086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:52.533802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:52.541943 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42dfa5c1-c6e1-4a66-806d-c0b1ec2c7e35 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.241304 Nov 03 04:06:52.542556 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1866/3610] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:52 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:52.793609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f856107a-ef2d-4bf2-a12f-0ae33b65cfc4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'create', calling method: .version_select at 0x7ff7fd4799d0>, body: {"keypair": {"name": "tempest-keypair-1325753863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBV9H7FtnKI2KseHd2QpgIihKyDG79Hu7/BaQxDzpXwh0G3P8eUQkumNxju+4EiBaLO/eIQK4XuPXxXxS0xNPmlznJhr5VkRBx8sMWH13hm4aj+sLZ/s3C6TiVRURdaqcQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:52.812852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f856107a-ef2d-4bf2-a12f-0ae33b65cfc4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:06:52.821357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f856107a-ef2d-4bf2-a12f-0ae33b65cfc4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for user eef8a5af3a6147e286ecc23d3aa0751e and project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:06:53.360098 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f856107a-ef2d-4bf2-a12f-0ae33b65cfc4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.572783 Nov 03 04:06:53.361740 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1745/3611] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:06:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:06:53.580336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:53.580336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:53.599588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:53.602242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:53.604488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:53.605730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:53.609361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:53.610184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:53.910810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:53.919986 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1bad0f5-c8f0-42a8-844d-39dc3b3d1e1e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.357339 Nov 03 04:06:53.920572 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1867/3612] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:53 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:54.948829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:54.950425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:54.959659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:54.960451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:54.961117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:54.962099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:54.962826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:54.963667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:55.599115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:55.609545 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3e04e266-c22d-48fc-a2f6-fde0b1811503 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.665087 Nov 03 04:06:55.610010 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1746/3613] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:54 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:56.534470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-69551052", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b19c6d7b-66aa-40da-9138-0de93bfa4b0a"}], "security_groups": [{"name": "tempest-securitygroup--1462771726"}], "key_name": "tempest-keypair-1325753863", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:06:56.634833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:56.635455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:56.641689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:56.645708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:56.645708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:56.645708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:56.645708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:56.645708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:56.672663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] validate_networks() for [('b19c6d7b-66aa-40da-9138-0de93bfa4b0a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:06:56.950286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:56.955674 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-01538ad0-5b67-484f-9b86-11e6584bb0d6 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.324568 Nov 03 04:06:56.957644 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1747/3614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:56 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:06:57.317860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:06:57.318289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:06:57.318773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:06:57.319216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:06:57.319638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:06:57.330016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:57.330562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:57.331009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:57.331752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:57.332195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:57.332676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:57.350198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:06:57.356422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Getting quotas for user eef8a5af3a6147e286ecc23d3aa0751e and project 0ac6ea284df44852a4ae8bf160ff0b02. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:06:57.372905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:06:57.377275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:06:57.583059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5319413a-b276-4cb6-9fa4-d205384844a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.056197 Nov 03 04:06:57.583758 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1868/3615] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:06:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:06:57.597622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9ae899d-f3c7-4956-94a6-41ad9a4cb8f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:57.598608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9ae899d-f3c7-4956-94a6-41ad9a4cb8f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:57.670298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9ae899d-f3c7-4956-94a6-41ad9a4cb8f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:57.684512 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9ae899d-f3c7-4956-94a6-41ad9a4cb8f7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1244 microversion: 2.1 time: 0.089450 Nov 03 04:06:57.698991 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1748/3616] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:57 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:57.981910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:57.984543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:57.996654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:57.997187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:58.001181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:58.008034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:58.008034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:58.008034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:58.277311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:58.322546 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-673168af-7862-4543-a1eb-de9464c5dafe tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.311403 Nov 03 04:06:58.325608 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1869/3617] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:57 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:58.711443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-713fb66a-060a-4b41-93d1-265bfc6541f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:58.712647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-713fb66a-060a-4b41-93d1-265bfc6541f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:58.801184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-713fb66a-060a-4b41-93d1-265bfc6541f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:58.808328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-713fb66a-060a-4b41-93d1-265bfc6541f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1244 microversion: 2.1 time: 0.100847 Nov 03 04:06:58.809291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1749/3618] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:58 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1244 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:59.355462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:59.356848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:59.378479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:59.378479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:59.378479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:59.378479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:59.379435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:59.380400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:59.385732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:06:59.801441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:59.835621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f521361-d25a-41ad-8578-d27c23cb5e12 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.487107 Nov 03 04:06:59.856327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:06:59.857089 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1870/3619] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:59 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:06:59.857216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:06:59.857216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:59.857216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:59.857216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:59.857216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:06:59.857216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:06:59.857216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:06:59.952040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:06:59.963147 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9bef2f8a-b917-4af7-bb4f-63e75615b759 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1240 microversion: 2.1 time: 0.133952 Nov 03 04:06:59.964290 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1750/3620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:06:59 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:00.870343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:00.882676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:00.898943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:00.899442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:00.899901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:00.900620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:00.901167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:00.909652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:00.993693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:00.994629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:01.013841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:01.020056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:01.020056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:01.021419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:01.023096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:01.025741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:01.237952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:01.250754 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2f88d92-3f98-4c4b-9672-b8fde176532d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1296 microversion: 2.1 time: 0.261485 Nov 03 04:07:01.259883 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1751/3621] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:00 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1296 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:01.345911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:01.363749 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ca2d14cf-8d87-4b45-89a7-8941fe370eac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.492581 Nov 03 04:07:01.363749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1871/3622] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:00 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:02.289633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:02.291103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:02.300858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:02.302036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:02.303185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:02.304907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:02.305700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:02.306300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:02.388807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:02.389339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:02.407949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:02.411865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:02.411865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:02.411865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:02.411865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:02.411865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:02.987757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:03.015814 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e373e6e1-5895-4c2e-beef-61770939ef98 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1302 microversion: 2.1 time: 0.732931 Nov 03 04:07:03.033813 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1752/3623] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:02 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1302 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:03.159470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:03.168127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4815aa17-8b1a-48a3-81a1-6956e5c9eebd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.785728 Nov 03 04:07:03.173709 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1872/3624] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:02 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:04.045647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:04.047017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:04.055792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:04.056637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:04.057292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:04.058332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:04.058972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:04.059740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:04.101870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:04.194368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:04.195123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:04.202211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:04.224348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:04.224960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:04.225459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:04.226225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:04.226692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:04.227142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:04.698380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:04.713492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b0ec959-f470-4885-822a-f26f46803e5b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.670228 Nov 03 04:07:04.714694 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1753/3625] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:04 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:04.890946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:04.913406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f6ccd0f-bd78-4d79-a6a9-591bd76dbdc7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.721013 Nov 03 04:07:04.914466 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1873/3626] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:04 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:05.120099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a5fa76c9-3d13-4ee9-8ac7-231a1363b4ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'create', calling method: .version_select at 0x7ff7fd5194c0>, body: {"keypair": {"name": "tempest-keypair-1570627810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ/o1ScCBBlnw4SouNiMTKZD45zDhjZFVegQQFuDpR7qZkRD0r4+6rhEpsAQZr6+RxDYFZBE/nwGyJ2npDbBXZ3f1d3cCpxYqFEJ6Jdu+NZsqrjSAjWXhMZT7ue+cINng=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:05.139732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a5fa76c9-3d13-4ee9-8ac7-231a1363b4ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:07:05.147897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a5fa76c9-3d13-4ee9-8ac7-231a1363b4ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for user d374eee04fe4433d862b7bc04a16a563 and project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:07:05.151684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ed25d503-309d-4d3e-bf74-4b4b7dc2946b req-dfeb940d-33de-42c1-b68f-1b4a134334e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b801e36-fff6-415b-a737-cc3e1bbfff8c", "tag": "91b7c3b9-1d33-48ec-8a3d-cdd8320b5231"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:05.169102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ed25d503-309d-4d3e-bf74-4b4b7dc2946b req-dfeb940d-33de-42c1-b68f-1b4a134334e2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:05.173191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ed25d503-309d-4d3e-bf74-4b4b7dc2946b req-dfeb940d-33de-42c1-b68f-1b4a134334e2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:05.173741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ed25d503-309d-4d3e-bf74-4b4b7dc2946b req-dfeb940d-33de-42c1-b68f-1b4a134334e2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:05.191686 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ed25d503-309d-4d3e-bf74-4b4b7dc2946b req-dfeb940d-33de-42c1-b68f-1b4a134334e2 service nova] Creating event network-changed:91b7c3b9-1d33-48ec-8a3d-cdd8320b5231 for instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c on n-h1-854653-7 Nov 03 04:07:05.198123 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ed25d503-309d-4d3e-bf74-4b4b7dc2946b req-dfeb940d-33de-42c1-b68f-1b4a134334e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050166 Nov 03 04:07:05.199161 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1874/3627] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:05.282625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a5fa76c9-3d13-4ee9-8ac7-231a1363b4ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.365339 Nov 03 04:07:05.283226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1754/3628] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:07:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:05.740972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:05.741682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:05.750564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:05.751961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:05.752620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:05.753375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:05.754207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:05.754989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:05.940866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:05.941767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:05.954661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:05.955510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:05.956155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:05.957191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:05.957918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:05.958518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:06.233341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:06.242739 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-930c413e-0816-4913-b22c-a8c21d40605a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.508626 Nov 03 04:07:06.257041 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1875/3629] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:05 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:06.315736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:06.341105 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a0eaee5-3605-45ea-92f5-f4b151c6af5e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.390306 Nov 03 04:07:06.341105 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1755/3630] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:05 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:07.270358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:07.270827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:07.277767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:07.278263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:07.279616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:07.279616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:07.279871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:07.280299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:07.341644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:07.361985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:07.366075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:07.366556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:07.374633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:07.375126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:07.375569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:07.376313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:07.376773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:07.379915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:07.611460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:07.638278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-526a2fb6-a37b-41e0-9e1d-44171dd79937 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.372684 Nov 03 04:07:07.643454 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1876/3631] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:07 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:07.728929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:07.739101 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df4d06bb-d241-4068-931d-a5e663e09147 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1473 microversion: 2.1 time: 0.389711 Nov 03 04:07:07.741061 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1756/3632] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:07 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1473 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:08.659440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1801638369", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4690854-61c6-4734-9947-73292066365c"}], "security_groups": [{"name": "tempest-securitygroup--2037874128"}], "key_name": "tempest-keypair-1570627810", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:08.675185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:08.675980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:08.690309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:08.692185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:08.692534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:08.693301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:08.694314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:08.695975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:08.854670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] validate_networks() for [('d4690854-61c6-4734-9947-73292066365c', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:07:08.999017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:09.010009 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f23a6f96-b2a4-46dd-a7a5-32841cca30a1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.340027 Nov 03 04:07:09.026038 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1757/3633] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:08 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:09.030151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:09.031625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:09.040085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:09.040611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:09.041340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:09.042501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:09.043210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:09.043992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:09.274120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:09.281540 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0041760d-5240-4900-b4b5-39911e5265bd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1491 microversion: 2.1 time: 0.258921 Nov 03 04:07:09.304797 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1758/3634] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:09 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1491 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:09.444785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:07:09.445466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:07:09.445947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:07:09.446360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:07:09.446772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:07:09.457699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:09.458189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:09.458628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:09.459640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:09.460107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:09.460755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:09.499778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:07:09.508129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for user d374eee04fe4433d862b7bc04a16a563 and project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:07:09.536712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:07:09.539944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:07:09.689913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8b10ad2-1bf3-4242-8de9-83a313399c33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.034498 Nov 03 04:07:09.692978 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1877/3635] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:07:08 2022] POST /compute/v2.1/servers => generated 409 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:07:09.704516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b13a237d-1084-4dce-8d0d-58d008d91e51 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:09.705188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b13a237d-1084-4dce-8d0d-58d008d91e51 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:09.796852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b13a237d-1084-4dce-8d0d-58d008d91e51 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:09.807128 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b13a237d-1084-4dce-8d0d-58d008d91e51 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1239 microversion: 2.1 time: 0.107021 Nov 03 04:07:09.809075 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1759/3636] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:09 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1239 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:10.037964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:10.038580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:10.045383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:10.045870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:10.046321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:10.047018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:10.047473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:10.048496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:10.183842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:10.192435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-212a1f4d-5c20-45a6-8ab7-a64320d01561 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.158234 Nov 03 04:07:10.193259 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1878/3637] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:10 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:10.311243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:10.311869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:10.319001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:10.319501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:10.320237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:10.325346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:10.325346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:10.325346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:10.494277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:10.505898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b945d1d6-b3a2-4075-81bd-207873296291 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1479 microversion: 2.1 time: 0.198455 Nov 03 04:07:10.506875 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1760/3638] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:10 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1479 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:10.830310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-934cf175-aae7-413e-9b9f-f8a51aa0d85d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:10.831018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-934cf175-aae7-413e-9b9f-f8a51aa0d85d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:10.893783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-934cf175-aae7-413e-9b9f-f8a51aa0d85d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:10.900723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-934cf175-aae7-413e-9b9f-f8a51aa0d85d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1239 microversion: 2.1 time: 0.074314 Nov 03 04:07:10.901330 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1879/3639] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:10 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:11.217087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:11.218317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:11.226366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:11.227227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:11.227888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:11.229566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:11.230428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:11.231175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:11.385852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:11.396786 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8fe32660-64f2-491b-8d7b-9c2a7b8fba49 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.182720 Nov 03 04:07:11.408081 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1761/3640] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:11 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:11.530391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:11.530809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:11.539704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:11.540271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:11.540727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:11.541469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:11.542135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:11.545096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:11.721660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:11.730399 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05aa97ba-2d25-4195-8d73-a1c2ef677768 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1479 microversion: 2.1 time: 0.204138 Nov 03 04:07:11.732334 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1880/3641] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:11 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1479 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:11.924383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:11.925008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:11.930976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:11.931464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:11.931917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:11.932619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:11.933105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:11.933542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:12.004397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:12.012521 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30571d4e-cab6-414e-b08a-d93ff4ffa909 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1291 microversion: 2.1 time: 0.092526 Nov 03 04:07:12.013118 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1762/3642] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:11 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1291 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:12.426604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:12.427179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:12.434168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:12.434665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:12.435110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:12.442597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:12.442597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:12.442597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:12.729565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:12.740171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d7820c1f-6ef6-4813-b47e-aae08ae418a7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.318199 Nov 03 04:07:12.740755 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1881/3643] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:12 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:12.769393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:12.770708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:12.782748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:12.783275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:12.783916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:12.784644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:12.785147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:12.785587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:12.959321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7bec6e23-7be8-408c-96b2-276b9613805b req-46eeb56a-6abf-412c-9a90-8fb5fdd87ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b801e36-fff6-415b-a737-cc3e1bbfff8c", "name": "network-vif-plugged", "status": "completed", "tag": "91b7c3b9-1d33-48ec-8a3d-cdd8320b5231"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:12.982697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7bec6e23-7be8-408c-96b2-276b9613805b req-46eeb56a-6abf-412c-9a90-8fb5fdd87ff5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:12.986114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7bec6e23-7be8-408c-96b2-276b9613805b req-46eeb56a-6abf-412c-9a90-8fb5fdd87ff5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:12.987379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7bec6e23-7be8-408c-96b2-276b9613805b req-46eeb56a-6abf-412c-9a90-8fb5fdd87ff5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:13.014608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7bec6e23-7be8-408c-96b2-276b9613805b req-46eeb56a-6abf-412c-9a90-8fb5fdd87ff5 service nova] Creating event network-vif-plugged:91b7c3b9-1d33-48ec-8a3d-cdd8320b5231 for instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c on n-h1-854653-7 Nov 03 04:07:13.023009 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7bec6e23-7be8-408c-96b2-276b9613805b req-46eeb56a-6abf-412c-9a90-8fb5fdd87ff5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.325878 Nov 03 04:07:13.024464 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1763/3644] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:13.036652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:13.037469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:13.043906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:13.044665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:13.045301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:13.047055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:13.048166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:13.048604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:13.092180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:13.103971 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07008bc3-569a-435d-b3ac-946b09d0e508 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1479 microversion: 2.1 time: 0.347423 Nov 03 04:07:13.104596 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1882/3645] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:12 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1479 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:13.205416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:13.220272 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee4c7362-15db-48e3-98f8-14b517eb5d14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1309 microversion: 2.1 time: 0.188045 Nov 03 04:07:13.222092 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1764/3646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:13 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:13.772250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:13.779523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:13.786412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:13.788774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:13.789283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:13.790106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:13.793157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:13.796059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:14.061547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:14.073805 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-089d4bcd-af80-415e-b76b-5e90272ed81f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1370 microversion: 2.1 time: 0.310710 Nov 03 04:07:14.081482 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1883/3647] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:13 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:14.131063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:14.131805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:14.152352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:14.154529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:14.156283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:14.157811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:14.158360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:14.159002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:14.247027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:14.247811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:14.254616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:14.255174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:14.255687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:14.256451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:14.256977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:14.257495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:14.352918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:14.367945 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-69785ab8-fab1-4b15-8b63-ccef967cec00 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1479 microversion: 2.1 time: 0.243604 Nov 03 04:07:14.368709 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1765/3648] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:14 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1479 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:14.805869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:14.813997 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bb96fcb-98a1-4a0f-886b-7936f2f44654 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.570887 Nov 03 04:07:14.814585 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1884/3649] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:14 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:15.063130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7ab6c9bc-2b5d-42f1-94ef-7edbe0b7bbd5 req-811983e7-513b-4b31-b795-edf6c31c1a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b61b13-d16f-45b6-aff0-c56fac27466e", "name": "network-vif-unplugged", "status": "completed", "tag": "3902d028-7167-4c1a-9a7b-fe465f176b4b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:15.073720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7ab6c9bc-2b5d-42f1-94ef-7edbe0b7bbd5 req-811983e7-513b-4b31-b795-edf6c31c1a71 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.074224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7ab6c9bc-2b5d-42f1-94ef-7edbe0b7bbd5 req-811983e7-513b-4b31-b795-edf6c31c1a71 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.074931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7ab6c9bc-2b5d-42f1-94ef-7edbe0b7bbd5 req-811983e7-513b-4b31-b795-edf6c31c1a71 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.086065 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7ab6c9bc-2b5d-42f1-94ef-7edbe0b7bbd5 req-811983e7-513b-4b31-b795-edf6c31c1a71 service nova] Creating event network-vif-unplugged:3902d028-7167-4c1a-9a7b-fe465f176b4b for instance d6b61b13-d16f-45b6-aff0-c56fac27466e on n-h2-854653-7 Nov 03 04:07:15.099167 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7ab6c9bc-2b5d-42f1-94ef-7edbe0b7bbd5 req-811983e7-513b-4b31-b795-edf6c31c1a71 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039630 Nov 03 04:07:15.100377 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1766/3650] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:15.107973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:15.108599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:15.122491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.122994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.123441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.124150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.124613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.126158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.392748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:15.394028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:15.395385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:15.401846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5cab11a9-0009-4832-8cf5-b20353d2de33 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1564 microversion: 2.1 time: 0.298664 Nov 03 04:07:15.402404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.402681 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1885/3651] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:15 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1564 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:15.419195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.419195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.419195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.419787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.419787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.434394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:15.436031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:15.443936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.444531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.445083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.446022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.446541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.447058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.633728 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c5399214-f87e-4d32-a861-b8632a60639a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205422 Nov 03 04:07:15.634417 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1886/3652] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:07:15 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:15.721352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:15.727830 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-95d2c2c2-fc6c-4d4c-9c85-d71f2eb81531 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1479 microversion: 2.1 time: 0.339122 Nov 03 04:07:15.745211 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1767/3653] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:15 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1479 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:15.842357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:15.842981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:15.854535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.856375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.857064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.858423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:15.859028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:15.859816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:15.979115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-aeea7915-72db-4421-a134-4a4af6300551 req-0e3bb4d5-b72c-4d66-ae0d-977a992892b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:15.999177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aeea7915-72db-4421-a134-4a4af6300551 req-0e3bb4d5-b72c-4d66-ae0d-977a992892b1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:16.001389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aeea7915-72db-4421-a134-4a4af6300551 req-0e3bb4d5-b72c-4d66-ae0d-977a992892b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:16.003667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aeea7915-72db-4421-a134-4a4af6300551 req-0e3bb4d5-b72c-4d66-ae0d-977a992892b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:16.039149 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-aeea7915-72db-4421-a134-4a4af6300551 req-0e3bb4d5-b72c-4d66-ae0d-977a992892b1 service nova] Creating event network-changed:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:07:16.050957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-aeea7915-72db-4421-a134-4a4af6300551 req-0e3bb4d5-b72c-4d66-ae0d-977a992892b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099868 Nov 03 04:07:16.052748 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1768/3654] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:16.155487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:16.165819 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33a13a1b-16c2-4c40-9a65-3e25ca32d2ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.327914 Nov 03 04:07:16.177203 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1887/3655] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:15 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:16.755417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:16.756207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:16.774612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:16.778992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:16.780919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:16.788990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:16.802664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:16.803264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:17.107476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:17.117936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cbdd592b-7afb-45c6-9061-d736114eceef tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1479 microversion: 2.1 time: 0.368714 Nov 03 04:07:17.120095 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1769/3656] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:16 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1479 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:17.137078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b38217a8-0353-45e0-86ab-b9d1e84022d4 req-a2be39c2-e425-4ebb-81e2-c916a3d44541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b61b13-d16f-45b6-aff0-c56fac27466e", "name": "network-vif-plugged", "status": "completed", "tag": "3902d028-7167-4c1a-9a7b-fe465f176b4b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:17.154387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b38217a8-0353-45e0-86ab-b9d1e84022d4 req-a2be39c2-e425-4ebb-81e2-c916a3d44541 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:17.155073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b38217a8-0353-45e0-86ab-b9d1e84022d4 req-a2be39c2-e425-4ebb-81e2-c916a3d44541 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:17.155748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b38217a8-0353-45e0-86ab-b9d1e84022d4 req-a2be39c2-e425-4ebb-81e2-c916a3d44541 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:17.169340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b38217a8-0353-45e0-86ab-b9d1e84022d4 req-a2be39c2-e425-4ebb-81e2-c916a3d44541 service nova] Creating event network-vif-plugged:3902d028-7167-4c1a-9a7b-fe465f176b4b for instance d6b61b13-d16f-45b6-aff0-c56fac27466e on n-h2-854653-7 Nov 03 04:07:17.175078 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b38217a8-0353-45e0-86ab-b9d1e84022d4 req-a2be39c2-e425-4ebb-81e2-c916a3d44541 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059330 Nov 03 04:07:17.176365 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1888/3657] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:17.195632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:17.196268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:17.231761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:17.232642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:17.233715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:17.234751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:17.236138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9bf462a8-40d5-4fa9-823d-f46ffa26bda8 req-74f4ea20-1c00-401e-9913-5e0f51a81067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b801e36-fff6-415b-a737-cc3e1bbfff8c", "tag": "91b7c3b9-1d33-48ec-8a3d-cdd8320b5231"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:17.236435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:17.237370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:17.256747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9bf462a8-40d5-4fa9-823d-f46ffa26bda8 req-74f4ea20-1c00-401e-9913-5e0f51a81067 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:17.257345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9bf462a8-40d5-4fa9-823d-f46ffa26bda8 req-74f4ea20-1c00-401e-9913-5e0f51a81067 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:17.257777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9bf462a8-40d5-4fa9-823d-f46ffa26bda8 req-74f4ea20-1c00-401e-9913-5e0f51a81067 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:17.280423 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9bf462a8-40d5-4fa9-823d-f46ffa26bda8 req-74f4ea20-1c00-401e-9913-5e0f51a81067 service nova] Creating event network-changed:91b7c3b9-1d33-48ec-8a3d-cdd8320b5231 for instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c on n-h1-854653-7 Nov 03 04:07:17.288326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9bf462a8-40d5-4fa9-823d-f46ffa26bda8 req-74f4ea20-1c00-401e-9913-5e0f51a81067 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055327 Nov 03 04:07:17.293360 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1889/3658] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:17.642297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:17.650438 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d69fcd1f-50e5-4449-841a-f8e992502319 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.462353 Nov 03 04:07:17.651318 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1770/3659] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:17 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:18.150392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:18.151738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:18.163795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:18.164487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:18.167023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:18.167023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:18.167023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:18.167810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:18.340648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:18.348151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:18.353027 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8b8b0d0-df66-486c-8d4e-80426c09b92f tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1479 microversion: 2.1 time: 0.206023 Nov 03 04:07:18.353852 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1890/3660] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:18 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1479 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:18.674601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:18.675223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:18.682441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:18.682993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:18.683435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:18.684160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:18.684619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:18.685066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:18.829857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:18.838039 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37c343a0-9ad1-4307-945c-347a90f7c830 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.167345 Nov 03 04:07:18.838681 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1771/3661] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:18 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:19.378019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:19.378636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:19.385974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.386461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.386897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.387584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.388039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.388466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.476173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:19.534604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:19.543209 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-001da1d8-3552-4e9e-9531-faa922ba83fd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1464 microversion: 2.1 time: 0.169830 Nov 03 04:07:19.543799 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1891/3662] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:19 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:19.576071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:19.578416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:19.584590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.585105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.585552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.586241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.586700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.587130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.804425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:19.806750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:19.861684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:19.872736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:19.877154 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aae4f5c1-dea6-455c-af8d-71a94a22488f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action" status: 202 len: 0 microversion: 2.1 time: 0.304819 Nov 03 04:07:19.878453 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1772/3663] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:07:19 2022] POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:07:19.881080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.881827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.886262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.886262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.886262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.886262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.886604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:19.897654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:19.905187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.908649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.909446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.914978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.914978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.914978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.972646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:19.973559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:19.974221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:19.974895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lazy-loading 'fault' on Instance uuid d6b61b13-d16f-45b6-aff0-c56fac27466e {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:07:20.123322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:20.137124 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eedc063f-70ed-408d-a3d8-f139b1b8a9eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.279410 Nov 03 04:07:20.138255 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1892/3664] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:19 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:20.233569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2a7de23-2991-45e2-8112-cae5dbfdc20f tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1598 microversion: 2.1 time: 0.351179 Nov 03 04:07:20.234649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1773/3665] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:19 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1598 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:20.256713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:20.259038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:20.265153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:20.265611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:20.266609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:20.267317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:20.267777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:20.268301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:20.567349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4cb649df-ae69-4d58-ae71-3b6a065f143c tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action" status: 202 len: 0 microversion: 2.1 time: 0.314245 Nov 03 04:07:20.567989 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1893/3666] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:07:20 2022] POST /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:07:20.576462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:20.577123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:20.584046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:20.584734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:20.585385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:20.586364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:20.586837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:20.587332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:20.720921 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e0c836e7-07f8-4440-a591-5d5f93adbfe8 tempest-ServersAdminTestJSON-1827983632 tempest-ServersAdminTestJSON-1827983632-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1615 microversion: 2.1 time: 0.148574 Nov 03 04:07:20.721539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1774/3667] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:20 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1615 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:20.744025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:20.748151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:20.751135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:20.751620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:20.752057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:20.752746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:20.753267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:20.753695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:20.779628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:07:20.898413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:21.116816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08610d0b-7104-4d95-a0e3-f782100eb53a tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 204 len: 0 microversion: 2.1 time: 0.376620 Nov 03 04:07:21.121460 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1894/3668] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:07:20 2022] DELETE /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:07:21.128842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:21.129551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:21.131514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:21.136421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:21.137004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:21.138659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:21.138659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:21.139021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:21.139350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:21.163066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:21.163773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:21.171381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:21.177082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:21.177082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:21.177082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:21.177082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:21.177082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:21.345135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:21.354321 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7bdd95cf-c7ab-4a06-b063-08d66fd082c8 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1469 microversion: 2.1 time: 0.229815 Nov 03 04:07:21.366472 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1775/3669] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:21 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1469 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:21.391325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:21.399614 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7363075-0255-4d9b-aac1-e05e20e4efe4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.240935 Nov 03 04:07:21.400179 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1895/3670] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:21 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:22.380614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:22.381512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:22.389289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:22.389779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:22.390220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:22.390953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:22.391557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:22.392023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:22.427090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:22.427090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:22.438841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:22.439609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:22.440216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:22.441149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:22.441612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:22.442048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:22.775212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:22.783793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a1e671c8-9566-4703-a9e1-cfb8dc09d514 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1469 microversion: 2.1 time: 0.407155 Nov 03 04:07:22.798032 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1776/3671] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:22 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:22.820222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:22.829233 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b945e2a-2f4d-4cd1-840f-d5a8b82275cd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.409583 Nov 03 04:07:22.829944 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1896/3672] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:22 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:23.397861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2e91cdae-1553-485a-8351-156fa3f111fa req-3c90544b-6743-4370-9aa0-7650091754b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7309274f-fe8b-4eb7-a8ca-1f4bfe80962b", "name": "network-vif-deleted", "tag": "7611ab67-cefb-4368-b602-b3114410c11b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:23.424477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2e91cdae-1553-485a-8351-156fa3f111fa req-3c90544b-6743-4370-9aa0-7650091754b6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:23.425233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2e91cdae-1553-485a-8351-156fa3f111fa req-3c90544b-6743-4370-9aa0-7650091754b6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:23.425897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2e91cdae-1553-485a-8351-156fa3f111fa req-3c90544b-6743-4370-9aa0-7650091754b6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:23.442984 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2e91cdae-1553-485a-8351-156fa3f111fa req-3c90544b-6743-4370-9aa0-7650091754b6 service nova] Creating event network-vif-deleted:7611ab67-cefb-4368-b602-b3114410c11b for instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b on n-h2-854653-7 Nov 03 04:07:23.453544 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2e91cdae-1553-485a-8351-156fa3f111fa req-3c90544b-6743-4370-9aa0-7650091754b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055657 Nov 03 04:07:23.456991 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1777/3673] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:23.811005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:23.811664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:23.818814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:23.819164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:23.819608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:23.820808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:23.821476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:23.821915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:23.859557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:23.860245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:23.861199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:23.861366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:23.862006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lazy-loading 'fault' on Instance uuid 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:07:23.862143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:23.869400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:23.869889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:23.870330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:23.871032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:23.871693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:23.872126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:23.944475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:23.953008 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5624aa50-4d8b-4d06-9cd5-40ccd9580e76 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 200 len: 1303 microversion: 2.1 time: 0.146182 Nov 03 04:07:23.954469 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1897/3674] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:23 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:24.491678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:24.499948 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8433021f-9de7-4502-9ef2-57371a9cb6b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.650714 Nov 03 04:07:24.500701 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1778/3675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:23 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:24.666983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e2c70b14-f234-438b-95d4-1ad49e15d52f req-8880bbf3-c741-4d23-a5a3-9fb1a373b84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-plugged", "status": "completed", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:24.676970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e2c70b14-f234-438b-95d4-1ad49e15d52f req-8880bbf3-c741-4d23-a5a3-9fb1a373b84b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:24.682223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e2c70b14-f234-438b-95d4-1ad49e15d52f req-8880bbf3-c741-4d23-a5a3-9fb1a373b84b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:24.682223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e2c70b14-f234-438b-95d4-1ad49e15d52f req-8880bbf3-c741-4d23-a5a3-9fb1a373b84b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:24.691187 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e2c70b14-f234-438b-95d4-1ad49e15d52f req-8880bbf3-c741-4d23-a5a3-9fb1a373b84b service nova] Creating event network-vif-plugged:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:07:24.696951 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e2c70b14-f234-438b-95d4-1ad49e15d52f req-8880bbf3-c741-4d23-a5a3-9fb1a373b84b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033344 Nov 03 04:07:24.698251 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1898/3676] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:24.978041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:24.978654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:24.984681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:24.985206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:24.986103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:24.986802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:24.987257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:24.987684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:25.001773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] HTTP exception thrown: Instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b could not be found. Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Request method failure captured: Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b HTTP/1.1 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz37eMOxUMC1FEute1Uwr8-uwpwXUIMJhJ8F53Etg-g-iAGsyh-xNq7cFscvHlft6zIDokOdj7C3OoCjQLtzX2QfVnB5-twPd7wE52PoFhOPLkWeGpPksQTVJ0RiXMln78jPcBZun9ta3oxMX6yW5fYHroBEgP7li0RzZhPL7alHp7M Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: db56e83192e0475995e6b9e373767b33 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/db56e83192e0475995e6b9e373767b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_db56e83192e0475995e6b9e373767b33", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/db56e83192e0475995e6b9e373767b33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/db56e83192e0475995e6b9e373767b33"}]}] Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: db56e83192e0475995e6b9e373767b33 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminTestJSON-500444985-project Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0bac75844a9f439cb9370230e50fc99d Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminTestJSON-500444985-project Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b could not be found. Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7309274f-fe8b-4eb7-a8ca-1f4bfe80962b'} Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b could not be found. Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b could not be found. Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:25.003461 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b could not be found. Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Returning 404 to user: Instance 7309274f-fe8b-4eb7-a8ca-1f4bfe80962b could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7fcd88d8-6961-47f1-a99f-775a15ae8f72 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b" status: 404 len: 111 microversion: 2.1 time: 0.030786 Nov 03 04:07:25.009344 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1779/3677] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:24 2022] GET /compute/v2.1/servers/7309274f-fe8b-4eb7-a8ca-1f4bfe80962b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:07:25.020163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:25.020765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:25.027845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:25.028440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:25.028819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:25.029566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:25.030081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:25.030518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:25.058828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:07:25.379563 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9de92fd9-8540-4dad-b087-92f525535aac tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 204 len: 0 microversion: 2.1 time: 0.364359 Nov 03 04:07:25.385801 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1899/3678] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:07:25 2022] DELETE /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:07:25.392852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:25.393986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:25.400983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:25.401893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:25.402739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:25.403636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:25.404303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:25.404735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:25.524144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:25.525259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:25.532178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:25.532661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:25.533923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:25.536354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:25.536354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:25.536354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:25.656192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:25.664148 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5617f933-91c6-4f0c-91ab-261af4675921 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1469 microversion: 2.1 time: 0.276632 Nov 03 04:07:25.664724 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1780/3679] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:25 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:25.772630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:25.780470 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eba3dbc3-da09-4a38-acc7-d7485f3722bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1365 microversion: 2.1 time: 0.260955 Nov 03 04:07:25.781053 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1900/3680] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:25 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:26.691048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:26.692302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:26.698687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:26.699442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:26.700075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:26.700792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:26.701275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:26.701901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:26.805357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:26.806606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:26.819435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:26.822098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:26.822098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:26.822098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:26.822098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:26.822098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:26.975449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:26.983436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52d39703-a84b-4772-bf21-dac459b9fa1d tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1469 microversion: 2.1 time: 0.297694 Nov 03 04:07:26.987485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1781/3681] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:26 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1469 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:27.102388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:27.113445 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8c634cb-ad33-483e-b5ee-e4a237dfb1b6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1552 microversion: 2.1 time: 0.312600 Nov 03 04:07:27.115199 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1901/3682] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:26 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1552 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:27.138335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:27.142691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:27.146954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.147652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.148299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.149225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.150034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.150640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.271633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60e84537-5822-4259-a6bb-4770ddf28836 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138152 Nov 03 04:07:27.279624 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1902/3683] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:07:27 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:27.343181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:27.344496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:27.350773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.351499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.352128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.353034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.353667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.354293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.382423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:07:27.533772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:27.578336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:27.579661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Searching by: {'deleted': False, 'project_id': 'e2b343e183d648cc8d845666db0e6a72'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:07:27.598134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.602164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.605468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.605468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.606769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.608093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.637210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:27.649046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:07:27.698662 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75397bad-1b18-40bf-8d37-51bb27847623 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.170878 Nov 03 04:07:27.708427 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1903/3684] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:07:27 2022] GET /compute/v2.1/servers => generated 333 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:27.714592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-56a1f9da-4ae7-41fa-9556-1937006a71c9 req-e12f9fff-0222-460e-a15b-f7e07475bff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8270a258-c47c-4515-a324-c7a654e486d5", "name": "network-vif-deleted", "tag": "5ec11f60-3e22-4cce-9f2c-fff6ae424ea1"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:27.726323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-56a1f9da-4ae7-41fa-9556-1937006a71c9 req-e12f9fff-0222-460e-a15b-f7e07475bff5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.726812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-56a1f9da-4ae7-41fa-9556-1937006a71c9 req-e12f9fff-0222-460e-a15b-f7e07475bff5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.727256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-56a1f9da-4ae7-41fa-9556-1937006a71c9 req-e12f9fff-0222-460e-a15b-f7e07475bff5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.742654 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-56a1f9da-4ae7-41fa-9556-1937006a71c9 req-e12f9fff-0222-460e-a15b-f7e07475bff5 service nova] Creating event network-vif-deleted:5ec11f60-3e22-4cce-9f2c-fff6ae424ea1 for instance 8270a258-c47c-4515-a324-c7a654e486d5 on n-h2-854653-7 Nov 03 04:07:27.747496 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-56a1f9da-4ae7-41fa-9556-1937006a71c9 req-e12f9fff-0222-460e-a15b-f7e07475bff5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045699 Nov 03 04:07:27.748102 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1904/3685] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:27.757254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:27.762058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:27.762306 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abc36666-ec87-4a02-b0dd-00d0309400f9 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 204 len: 0 microversion: 2.32 time: 0.690640 Nov 03 04:07:27.762939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Searching by: {'deleted': False, 'project_id': 'e2b343e183d648cc8d845666db0e6a72'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:07:27.769185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.769675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.770128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.770853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.771016 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1782/3686] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:07:27 2022] DELETE /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:07:27.771741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.772391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.786183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:27.786943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:27.798689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.799199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.799641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.800818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.801529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.802131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:27.867558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:07:27.948007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:27.960927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:27.961597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:27.962166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:28.105584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:28.119740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:28.121575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:28.123434 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2df84b0c-a02a-48d8-a269-bc64f084b375 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2950 microversion: 2.32 time: 0.350648 Nov 03 04:07:28.124125 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1783/3687] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:27 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2950 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:28.152093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:28.152093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:28.153724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:28.154447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:28.155065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:28.156201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:28.156965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:28.157590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:28.192965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:28.193399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:28.193838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:28.194352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lazy-loading 'fault' on Instance uuid 8270a258-c47c-4515-a324-c7a654e486d5 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:07:28.237003 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8def6bfc-825d-4259-b046-2a45fad6b188 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.484445 Nov 03 04:07:28.237740 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1905/3688] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:07:27 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:28.262128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cb35f5a7-29a2-4d5c-8ee9-109704ed41e4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:28.266369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:28.271835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:28.273795 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cb35f5a7-29a2-4d5c-8ee9-109704ed41e4 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015236 Nov 03 04:07:28.284313 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1906/3689] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:07:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:28.284563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a8971ba-b0af-41b0-a2aa-ec22696400cd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1303 microversion: 2.1 time: 0.157612 Nov 03 04:07:28.284563 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1784/3690] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:28 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:28.623635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:28.624440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:28.647916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:28.647916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:28.647916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:28.647916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:28.647916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:28.647916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:28.680995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:07:29.036646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-dc4b12c5-2f30-4a1a-a1ae-290809fdd343 req-be567425-fe74-4125-a684-95317a39541c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:29.048983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dc4b12c5-2f30-4a1a-a1ae-290809fdd343 req-be567425-fe74-4125-a684-95317a39541c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.049368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dc4b12c5-2f30-4a1a-a1ae-290809fdd343 req-be567425-fe74-4125-a684-95317a39541c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.049934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dc4b12c5-2f30-4a1a-a1ae-290809fdd343 req-be567425-fe74-4125-a684-95317a39541c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.063186 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-dc4b12c5-2f30-4a1a-a1ae-290809fdd343 req-be567425-fe74-4125-a684-95317a39541c service nova] Creating event network-changed:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:07:29.068801 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-dc4b12c5-2f30-4a1a-a1ae-290809fdd343 req-be567425-fe74-4125-a684-95317a39541c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035488 Nov 03 04:07:29.069450 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1785/3691] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:29.088138 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dccdbca1-323f-49a4-9274-c55af26db919 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "DELETE /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 204 len: 0 microversion: 2.1 time: 0.469352 Nov 03 04:07:29.088771 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1907/3692] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:07:28 2022] DELETE /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:07:29.098400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:29.099107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:29.107296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.107806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.108243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.109800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.110820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.112114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.157241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:29.158133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:29.165306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.166238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.167337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.168625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.169154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.169593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.429133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:29.439523 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52171fbf-f201-4acd-8354-4676e54bf293 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1701 microversion: 2.1 time: 0.346247 Nov 03 04:07:29.440967 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1786/3693] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:29 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1701 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:29.446297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:29.447259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:29.457125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.457973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.458654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.459894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.460633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.461321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.509860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:29.510455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:29.511155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:29.511836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lazy-loading 'fault' on Instance uuid 8270a258-c47c-4515-a324-c7a654e486d5 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:07:29.630084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:29.639537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f44cc8f-38e9-4a59-9481-d633444d5bb4 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 200 len: 1303 microversion: 2.1 time: 0.197219 Nov 03 04:07:29.641753 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1787/3694] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:29 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:29.665927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:29.679840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:29.681752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:29.683511 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b5b35625-f502-4864-8a9a-834eb475c993 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2950 microversion: 2.32 time: 0.531886 Nov 03 04:07:29.684818 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1908/3695] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:29 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2950 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:07:30.467431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:30.468052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:30.487386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:30.487890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:30.488333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:30.489060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:30.489523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:30.489953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:30.518000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:30.664658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:30.665347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: 8270a258-c47c-4515-a324-c7a654e486d5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:30.673372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:30.673877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:30.674414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:30.675138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:30.675600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:30.676032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:30.694215 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] HTTP exception thrown: Instance 8270a258-c47c-4515-a324-c7a654e486d5 could not be found. Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Request method failure captured: Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 HTTP/1.1 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz37eMOxUMC1FEute1Uwr8-uwpwXUIMJhJ8F53Etg-g-iAGsyh-xNq7cFscvHlft6zIDokOdj7C3OoCjQLtzX2QfVnB5-twPd7wE52PoFhOPLkWeGpPksQTVJ0RiXMln78jPcBZun9ta3oxMX6yW5fYHroBEgP7li0RzZhPL7alHp7M Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: db56e83192e0475995e6b9e373767b33 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/db56e83192e0475995e6b9e373767b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_db56e83192e0475995e6b9e373767b33", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/db56e83192e0475995e6b9e373767b33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/db56e83192e0475995e6b9e373767b33"}]}] Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: db56e83192e0475995e6b9e373767b33 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersAdminTestJSON-500444985-project Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 0bac75844a9f439cb9370230e50fc99d Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersAdminTestJSON-500444985-project Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8270a258-c47c-4515-a324-c7a654e486d5 could not be found. Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8270a258-c47c-4515-a324-c7a654e486d5'} Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8270a258-c47c-4515-a324-c7a654e486d5 could not be found. Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8270a258-c47c-4515-a324-c7a654e486d5 could not be found. Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:30.696800 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:30.701984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:30.701984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:30.701984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:30.701984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:07:30.701984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:07:30.701984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8270a258-c47c-4515-a324-c7a654e486d5 could not be found. Nov 03 04:07:30.701984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:30.703794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Returning 404 to user: Instance 8270a258-c47c-4515-a324-c7a654e486d5 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:07:30.705608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-caea92ac-0466-4fdd-a17d-85abb7fbabdd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5" status: 404 len: 111 microversion: 2.1 time: 0.045659 Nov 03 04:07:30.706365 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1909/3696] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:30 2022] GET /compute/v2.1/servers/8270a258-c47c-4515-a324-c7a654e486d5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:07:30.716298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:30.717652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:30.728651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:30.729347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:30.729867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:30.730721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:30.731262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:30.731773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:31.348305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:31.358095 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f88e8222-7563-40fe-a20a-572067041263 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1701 microversion: 2.1 time: 0.894399 Nov 03 04:07:31.360158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1788/3697] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:30 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1701 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:31.366788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:31.377358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:31.377358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:31.377358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:31.377358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:31.377358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:31.377358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:31.377358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:31.400589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:31.413562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:07:31.418661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:31.424480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:31.424480 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-88204d7f-cd4f-43a2-9d20-770526fcb87f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2929 microversion: 2.32 time: 0.710369 Nov 03 04:07:31.424727 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1910/3698] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:30 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2929 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:31.699898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79edbadf-e2f4-4c30-9f6f-3e84baf9259e tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 204 len: 0 microversion: 2.1 time: 0.337403 Nov 03 04:07:31.701478 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1789/3699] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:07:31 2022] DELETE /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:07:31.711638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:31.712903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:31.721080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:31.722969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:31.722969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:31.722969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:31.723732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:31.724265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:32.177562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:32.188741 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-259242e3-a2eb-46ae-8197-abc25bbd6fa7 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1470 microversion: 2.1 time: 0.481352 Nov 03 04:07:32.199548 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1911/3700] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:31 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1470 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:32.393610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:32.394641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:32.400581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:32.401104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:32.401547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:32.402251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:32.402709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:32.403130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:32.452054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:32.455031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:32.469050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:32.469050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:32.469668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:32.470631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:32.471284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:32.471890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:32.497492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:32.507641 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87ad26dd-9437-4307-84f3-25e7527a0055 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1633 microversion: 2.1 time: 0.119117 Nov 03 04:07:32.510369 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1790/3701] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:32 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1633 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:32.517924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2242cbbf-ac0c-4ae1-955d-e2c823ddcfe0 req-a5b2c43c-d44c-4f5b-8284-4371ee3d867b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-unplugged", "status": "completed", "tag": "6d00f3d5-ad14-49f4-b158-233065bddcf8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:32.531216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2242cbbf-ac0c-4ae1-955d-e2c823ddcfe0 req-a5b2c43c-d44c-4f5b-8284-4371ee3d867b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:32.532218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2242cbbf-ac0c-4ae1-955d-e2c823ddcfe0 req-a5b2c43c-d44c-4f5b-8284-4371ee3d867b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:32.532963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2242cbbf-ac0c-4ae1-955d-e2c823ddcfe0 req-a5b2c43c-d44c-4f5b-8284-4371ee3d867b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:32.561422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2242cbbf-ac0c-4ae1-955d-e2c823ddcfe0 req-a5b2c43c-d44c-4f5b-8284-4371ee3d867b service nova] Creating event network-vif-unplugged:6d00f3d5-ad14-49f4-b158-233065bddcf8 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:32.568477 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2242cbbf-ac0c-4ae1-955d-e2c823ddcfe0 req-a5b2c43c-d44c-4f5b-8284-4371ee3d867b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056452 Nov 03 04:07:32.571742 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1791/3702] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:32.764349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:32.782079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:32.785045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:32.787137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97f9d4bd-ed5d-40be-b461-2328b864eb69 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2908 microversion: 2.32 time: 0.338728 Nov 03 04:07:32.788478 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1912/3703] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:32 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2908 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:33.194591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8b35281e-0aff-4aa5-90b9-5fcb05a9bd90 req-c1346a6f-ed8d-44e4-a323-44960fd4cd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477fafee-65fc-43f0-a4be-4649f23ad6d6", "name": "network-vif-deleted", "tag": "6644bb07-a08f-4000-93b7-579f63e12e4a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:33.209512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8b35281e-0aff-4aa5-90b9-5fcb05a9bd90 req-c1346a6f-ed8d-44e4-a323-44960fd4cd2e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.216951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:33.218060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:33.223438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8b35281e-0aff-4aa5-90b9-5fcb05a9bd90 req-c1346a6f-ed8d-44e4-a323-44960fd4cd2e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.224243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8b35281e-0aff-4aa5-90b9-5fcb05a9bd90 req-c1346a6f-ed8d-44e4-a323-44960fd4cd2e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:33.230230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.234586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.245132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:33.246394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.253709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.257618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:33.268837 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8b35281e-0aff-4aa5-90b9-5fcb05a9bd90 req-c1346a6f-ed8d-44e4-a323-44960fd4cd2e service nova] Creating event network-vif-deleted:6644bb07-a08f-4000-93b7-579f63e12e4a for instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 on n-h1-854653-7 Nov 03 04:07:33.283916 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8b35281e-0aff-4aa5-90b9-5fcb05a9bd90 req-c1346a6f-ed8d-44e4-a323-44960fd4cd2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098144 Nov 03 04:07:33.287158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1792/3704] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:33.539661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:33.540708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:33.551193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:33.563002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-381f2d57-e559-41f7-b9c8-9d949718eef3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1470 microversion: 2.1 time: 0.351328 Nov 03 04:07:33.574026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.574728 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1913/3705] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:33 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1470 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:33.575472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.576110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:33.577270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.578285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.578898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:33.649251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.649740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.653000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:33.655327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lazy-loading 'fault' on Instance uuid 477fafee-65fc-43f0-a4be-4649f23ad6d6 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:07:33.738441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0d85da409e14b308b1540ae501f8297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2b343e183d648cc8d845666db0e6a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:33.746742 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2f62838-85ad-44fa-a506-0ef07747daf6 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 200 len: 1359 microversion: 2.1 time: 0.212747 Nov 03 04:07:33.747976 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1793/3706] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:33 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:33.824403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:33.825844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:33.839701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.841552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.842503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:33.845047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:33.847479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:33.848194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:34.193451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:34.209258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:34.219941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:34.233737 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bcb25ca8-22e6-415b-9a46-8808f3b9f64f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2862 microversion: 2.32 time: 0.415590 Nov 03 04:07:34.235931 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1914/3707] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:33 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2862 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:34.465644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-97ac79d3-4774-4d3f-bd47-754b102ff65a req-80d982d3-ac7b-423c-b3c2-d2e1f3f3510d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b61b13-d16f-45b6-aff0-c56fac27466e", "name": "network-vif-deleted", "tag": "3902d028-7167-4c1a-9a7b-fe465f176b4b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:34.488305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97ac79d3-4774-4d3f-bd47-754b102ff65a req-80d982d3-ac7b-423c-b3c2-d2e1f3f3510d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:34.488768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97ac79d3-4774-4d3f-bd47-754b102ff65a req-80d982d3-ac7b-423c-b3c2-d2e1f3f3510d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:34.489259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97ac79d3-4774-4d3f-bd47-754b102ff65a req-80d982d3-ac7b-423c-b3c2-d2e1f3f3510d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:34.522875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-97ac79d3-4774-4d3f-bd47-754b102ff65a req-80d982d3-ac7b-423c-b3c2-d2e1f3f3510d service nova] Creating event network-vif-deleted:3902d028-7167-4c1a-9a7b-fe465f176b4b for instance d6b61b13-d16f-45b6-aff0-c56fac27466e on n-h2-854653-7 Nov 03 04:07:34.539841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-97ac79d3-4774-4d3f-bd47-754b102ff65a req-80d982d3-ac7b-423c-b3c2-d2e1f3f3510d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089970 Nov 03 04:07:34.543687 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1794/3708] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:34.595645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-unplugged", "status": "completed", "tag": "2455d1ec-cb1c-4e26-afd2-8b73f9399820"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-unplugged", "status": "completed", "tag": "3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-unplugged", "status": "completed", "tag": "9b0a115d-5a93-4669-bac8-1ceb99cf533d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:34.613297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:34.614338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:34.634394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:34.636745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:34.639634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:34.644004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:34.644522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:34.644979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:34.650596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:34.651119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:34.651611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:34.691344 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] Creating event network-vif-unplugged:2455d1ec-cb1c-4e26-afd2-8b73f9399820 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:34.694643 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] Creating event network-vif-unplugged:3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:34.696392 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] Creating event network-vif-unplugged:9b0a115d-5a93-4669-bac8-1ceb99cf533d for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:34.707738 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-df133d17-e8fa-45f2-884b-466a6bb55332 req-d4f2c09c-7710-40ed-9ef9-1350458d2890 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.117613 Nov 03 04:07:34.708690 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1915/3709] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:34.777037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:34.778674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] [instance: 477fafee-65fc-43f0-a4be-4649f23ad6d6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:34.786804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:34.787660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:34.788691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:34.789869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:34.790613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:34.792208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:34.809559 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] HTTP exception thrown: Instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 could not be found. Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Request method failure captured: Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 HTTP/1.1 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz4JgyAbevUzPTyjRu-Dmywv1ephc2uyyu2VuaRpssz0Lez6z5FXzTaHWHiQjikHx4dM2KPsZTa_F-dsXV8YemzfXLyd1rPv3_sLDmRMcw4PaijTUqlE1sCEbWAqZf3YGnp2z2kHmyToLQCYlPtNodo_7UftvDre50B637hdx3IO6zA Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: e2b343e183d648cc8d845666db0e6a72 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestJSON-421037953 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2b343e183d648cc8d845666db0e6a72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e2b343e183d648cc8d845666db0e6a72", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e2b343e183d648cc8d845666db0e6a72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e2b343e183d648cc8d845666db0e6a72"}]}] Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestJSON-421037953 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: e2b343e183d648cc8d845666db0e6a72 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestJSON-421037953 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestJSON-421037953-project Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d0d85da409e14b308b1540ae501f8297 Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestJSON-421037953-project Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 could not be found. Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '477fafee-65fc-43f0-a4be-4649f23ad6d6'} Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 could not be found. Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 could not be found. Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:34.811751 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:34.816497 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:34.816497 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:34.816497 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:07:34.816497 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:07:34.816497 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 could not be found. Nov 03 04:07:34.816497 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:34.819529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Returning 404 to user: Instance 477fafee-65fc-43f0-a4be-4649f23ad6d6 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:07:34.820775 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d347a9e2-aac5-4efb-bb26-cd7f3c1ca912 tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6" status: 404 len: 111 microversion: 2.1 time: 0.048881 Nov 03 04:07:34.826511 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1916/3710] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:34 2022] GET /compute/v2.1/servers/477fafee-65fc-43f0-a4be-4649f23ad6d6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:07:34.833568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4dd69543-7876-44c6-a76f-d36632a3445d tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] Calling method '.version_select at 0x7ff7f88b5040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:34.867259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bac75844a9f439cb9370230e50fc99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db56e83192e0475995e6b9e373767b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:34.879264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-209d923b-873a-47e9-bfe9-c783b6038efd tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 200 len: 1299 microversion: 2.1 time: 0.278912 Nov 03 04:07:34.880764 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1795/3711] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:34 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:34.936013 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4dd69543-7876-44c6-a76f-d36632a3445d tempest-ServersTestJSON-421037953 tempest-ServersTestJSON-421037953-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781604752" status: 202 len: 0 microversion: 2.1 time: 0.107269 Nov 03 04:07:34.940924 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1917/3712] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781604752 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:07:35.262944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:35.263577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:35.270320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:35.270844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:35.271289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:35.271999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:35.272650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:35.273191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:35.419545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0d173b63-dfc0-413c-8bf9-87faadec8643 req-092ea42b-b06d-4c07-9719-0891b3b1f590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-deleted", "tag": "606a7cb9-b94b-4ddc-8269-c39b0f27ee7d"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-deleted", "tag": "2455d1ec-cb1c-4e26-afd2-8b73f9399820"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:35.431929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0d173b63-dfc0-413c-8bf9-87faadec8643 req-092ea42b-b06d-4c07-9719-0891b3b1f590 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:35.432703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0d173b63-dfc0-413c-8bf9-87faadec8643 req-092ea42b-b06d-4c07-9719-0891b3b1f590 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:35.433366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0d173b63-dfc0-413c-8bf9-87faadec8643 req-092ea42b-b06d-4c07-9719-0891b3b1f590 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:35.448980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0d173b63-dfc0-413c-8bf9-87faadec8643 req-092ea42b-b06d-4c07-9719-0891b3b1f590 service nova] Creating event network-vif-deleted:606a7cb9-b94b-4ddc-8269-c39b0f27ee7d for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:35.449871 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0d173b63-dfc0-413c-8bf9-87faadec8643 req-092ea42b-b06d-4c07-9719-0891b3b1f590 service nova] Creating event network-vif-deleted:2455d1ec-cb1c-4e26-afd2-8b73f9399820 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:35.456910 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0d173b63-dfc0-413c-8bf9-87faadec8643 req-092ea42b-b06d-4c07-9719-0891b3b1f590 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041311 Nov 03 04:07:35.458817 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1918/3713] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:35.904005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:35.904716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] [instance: d6b61b13-d16f-45b6-aff0-c56fac27466e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:35.918214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:35.918947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:35.919622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:35.920519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:35.921179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:35.921827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:35.942931 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] HTTP exception thrown: Instance d6b61b13-d16f-45b6-aff0-c56fac27466e could not be found. Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Request method failure captured: Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e HTTP/1.1 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz37eMOxUMC1FEute1Uwr8-uwpwXUIMJhJ8F53Etg-g-iAGsyh-xNq7cFscvHlft6zIDokOdj7C3OoCjQLtzX2QfVnB5-twPd7wE52PoFhOPLkWeGpPksQTVJ0RiXMln78jPcBZun9ta3oxMX6yW5fYHroBEgP7li0RzZhPL7alHp7M Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: db56e83192e0475995e6b9e373767b33 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/db56e83192e0475995e6b9e373767b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_db56e83192e0475995e6b9e373767b33", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/db56e83192e0475995e6b9e373767b33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/db56e83192e0475995e6b9e373767b33"}]}] Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: db56e83192e0475995e6b9e373767b33 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersAdminTestJSON-500444985 Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersAdminTestJSON-500444985-project Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 0bac75844a9f439cb9370230e50fc99d Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersAdminTestJSON-500444985-project Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance d6b61b13-d16f-45b6-aff0-c56fac27466e could not be found. Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'd6b61b13-d16f-45b6-aff0-c56fac27466e'} Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b61b13-d16f-45b6-aff0-c56fac27466e could not be found. Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b61b13-d16f-45b6-aff0-c56fac27466e could not be found. Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:07:35.944762 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b61b13-d16f-45b6-aff0-c56fac27466e could not be found. Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] Returning 404 to user: Instance d6b61b13-d16f-45b6-aff0-c56fac27466e could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:07:35.950374 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-943b71e1-f3e2-4f0f-a988-cc364d20dbf3 tempest-ServersAdminTestJSON-500444985 tempest-ServersAdminTestJSON-500444985-project] 10.222.0.30 "GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e" status: 404 len: 111 microversion: 2.1 time: 0.046780 Nov 03 04:07:35.951164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1919/3714] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:35 2022] GET /compute/v2.1/servers/d6b61b13-d16f-45b6-aff0-c56fac27466e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:07:36.044430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:36.058350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:36.062029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:36.066870 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48d64fda-dcb6-4938-8ae0-51819cf4d4bb tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2816 microversion: 2.32 time: 0.807853 Nov 03 04:07:36.071345 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1796/3715] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:35 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2816 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:37.101943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:37.102705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:37.117179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:37.117801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:37.118252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:37.119005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:37.119516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:37.120282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:37.511751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:37.526414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:37.532785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:37.537001 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15f869bf-ab1f-4f05-be45-2751d07bea43 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2542 microversion: 2.32 time: 0.438560 Nov 03 04:07:37.551571 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1920/3716] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:37 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2542 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:37.919748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ce338b02-4b64-489e-84bf-a3f00971e6f1 req-25ffd7e3-cd6c-469f-878e-b8f27821e52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-deleted", "tag": "6d00f3d5-ad14-49f4-b158-233065bddcf8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:37.940555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce338b02-4b64-489e-84bf-a3f00971e6f1 req-25ffd7e3-cd6c-469f-878e-b8f27821e52e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:37.945537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce338b02-4b64-489e-84bf-a3f00971e6f1 req-25ffd7e3-cd6c-469f-878e-b8f27821e52e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:37.945992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce338b02-4b64-489e-84bf-a3f00971e6f1 req-25ffd7e3-cd6c-469f-878e-b8f27821e52e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:37.972424 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ce338b02-4b64-489e-84bf-a3f00971e6f1 req-25ffd7e3-cd6c-469f-878e-b8f27821e52e service nova] Creating event network-vif-deleted:6d00f3d5-ad14-49f4-b158-233065bddcf8 for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:37.979033 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ce338b02-4b64-489e-84bf-a3f00971e6f1 req-25ffd7e3-cd6c-469f-878e-b8f27821e52e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064030 Nov 03 04:07:37.980247 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1797/3717] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:38.567946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:38.569347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:38.574214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:38.575443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:38.587662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:38.588584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:38.589326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:38.590219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:38.590852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:38.591521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:38.920629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:38.948044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:38.949483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:38.961081 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07d45123-1769-48f4-a324-56df83f679e1 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 2211 microversion: 2.32 time: 0.393167 Nov 03 04:07:38.977880 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1921/3718] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:38 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 2211 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:40.011068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:40.011787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:40.029746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:40.030254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:40.030786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:40.031512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:40.031982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:40.032420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:40.664230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2987b868-7a6a-43d2-824d-354935c09836 req-7f9a9de7-ead3-4dd0-8edf-8e34fe8c430d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-deleted", "tag": "9b0a115d-5a93-4669-bac8-1ceb99cf533d"}, {"server_uuid": "16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa", "name": "network-vif-deleted", "tag": "3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:40.675272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2987b868-7a6a-43d2-824d-354935c09836 req-7f9a9de7-ead3-4dd0-8edf-8e34fe8c430d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:40.676297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2987b868-7a6a-43d2-824d-354935c09836 req-7f9a9de7-ead3-4dd0-8edf-8e34fe8c430d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:40.676957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2987b868-7a6a-43d2-824d-354935c09836 req-7f9a9de7-ead3-4dd0-8edf-8e34fe8c430d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:40.696154 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2987b868-7a6a-43d2-824d-354935c09836 req-7f9a9de7-ead3-4dd0-8edf-8e34fe8c430d service nova] Creating event network-vif-deleted:9b0a115d-5a93-4669-bac8-1ceb99cf533d for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:40.696848 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2987b868-7a6a-43d2-824d-354935c09836 req-7f9a9de7-ead3-4dd0-8edf-8e34fe8c430d service nova] Creating event network-vif-deleted:3f7b73e3-2ed4-4a32-a8e7-36c63d4939ad for instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa on n-h2-854653-7 Nov 03 04:07:40.703666 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2987b868-7a6a-43d2-824d-354935c09836 req-7f9a9de7-ead3-4dd0-8edf-8e34fe8c430d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045084 Nov 03 04:07:40.705149 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1922/3719] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:40.740377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:40.755121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:40.770716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:40.773848 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a772b543-e8a4-49b9-be61-1e5e0079d58a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.767675 Nov 03 04:07:40.775056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1798/3720] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:40 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:41.805649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:41.807052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:41.816404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:41.817229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:41.818275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:41.821449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:41.822038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:41.822580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:41.968884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:41.980886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:41.993570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:42.003029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:42.020407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e8658b4c-7cf1-4d24-bf7e-7907d03200f7 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.207772 Nov 03 04:07:42.026527 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1923/3721] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:41 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:42.942191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1952056414", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:43.036594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:07:43.042050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:43.042852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:43.061668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:43.063069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:43.063831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:43.064901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:43.066266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:43.069703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:43.194801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:43.214994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:43.219520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:43.223886 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a94d8a65-f588-481f-9c84-0c16424d4a6f tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.185131 Nov 03 04:07:43.234539 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1924/3722] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:43 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:43.570414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:07:43.571090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:07:43.571744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:07:43.572325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:07:43.572749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:07:43.603077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:43.603882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:43.604480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:43.605364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:43.605808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:43.606242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:43.653477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Getting quotas for project 1634e468485f4b01823bcc0881520e96. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:07:43.669151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Getting quotas for user 1fac44fe2dbc4e1aa98afced6a386a35 and project 1634e468485f4b01823bcc0881520e96. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:07:43.699519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:07:43.703353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:07:43.859151 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3ff8e4f-4bd5-4bbc-98f0-9bbdc6d66645 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170321 Nov 03 04:07:43.862567 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1799/3723] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:07:43.876291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14e351d6-176e-4b26-ab76-8123c11b48f0 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:43.877709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-14e351d6-176e-4b26-ab76-8123c11b48f0 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:44.012595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14e351d6-176e-4b26-ab76-8123c11b48f0 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:44.026216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14e351d6-176e-4b26-ab76-8123c11b48f0 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1214 microversion: 2.1 time: 0.156168 Nov 03 04:07:44.026821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1925/3724] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:43 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:44.261463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:44.262193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:44.280381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:44.286505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:44.287849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:44.289590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:44.291372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:44.307535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:44.453654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:44.470402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:44.472672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:44.475165 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e74de91-7b3e-4de0-b977-2f40c85010be tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.218478 Nov 03 04:07:44.476080 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1800/3725] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:44 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:45.060743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8625606-e61f-44d3-8c19-4dcd3c4b6956 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:45.064696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8625606-e61f-44d3-8c19-4dcd3c4b6956 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:45.150535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8625606-e61f-44d3-8c19-4dcd3c4b6956 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:45.159282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8625606-e61f-44d3-8c19-4dcd3c4b6956 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1214 microversion: 2.1 time: 0.109333 Nov 03 04:07:45.173700 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1926/3726] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:45 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:45.518501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:45.518501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:45.529252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:45.529252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:45.529252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:45.529252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:45.529252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:45.529252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:45.624961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:45.638397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:45.640611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:45.642087 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-905900cf-90c5-48d4-9dda-c728c34e9179 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.142256 Nov 03 04:07:45.654637 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1801/3727] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:45 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:46.185380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:46.185380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:46.198141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:46.200655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:46.201435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:46.202945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:46.203414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:46.204120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:46.442316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:46.451144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ff5d6db-a5e5-4b0a-9fb6-39bc0bde224a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1266 microversion: 2.1 time: 0.271782 Nov 03 04:07:46.459343 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1927/3728] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:46 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:46.680730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:46.680730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:46.692603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:46.693270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:46.695096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:46.696035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:46.696797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:46.697417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:46.834650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:46.864835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:46.870522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:46.877485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6013278b-f808-4ba1-a575-3d7e3705276e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.205909 Nov 03 04:07:46.878350 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1802/3729] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:46 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:47.483632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:47.484247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:47.497226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:47.498053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:47.498666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:47.500537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:47.501199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:47.503264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:47.592575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:47.607046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8265cd1-e185-4d80-87ee-60d94d85aeae tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1272 microversion: 2.1 time: 0.126330 Nov 03 04:07:47.608357 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1928/3730] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:47 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:07:47.904466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:47.905204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:47.925001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:47.925585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:47.926025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:47.926986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:47.927454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:47.928436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:48.253588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:48.272289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:48.275395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:48.281863 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7fa909cd-a28e-44ad-b9b0-bfb0efa0518e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.377795 Nov 03 04:07:48.282899 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1803/3731] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:47 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:48.635174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:48.636589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:48.648247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:48.649075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:48.649812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:48.651477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:48.652513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:48.653154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:48.820631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:48.835513 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e71b104-fe88-4aaf-8339-f7aed8e5408e tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1272 microversion: 2.1 time: 0.206368 Nov 03 04:07:48.848901 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1929/3732] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:48 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:49.316372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:49.319306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:49.332750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:49.333547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:49.334202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:49.335150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:49.337376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:49.338084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:49.593989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:49.609327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:49.611052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:49.612274 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5e4db271-ec46-4169-8371-7ce523bbbf51 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.299800 Nov 03 04:07:49.612844 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1804/3733] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:49 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:49.862727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:49.863258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:49.880600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:49.881329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:49.881947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:49.884340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:49.884340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:49.884340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:50.263458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:50.272424 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-269d4405-93d2-4b20-8b87-860f847079ed tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.414790 Nov 03 04:07:50.290341 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1930/3734] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:49 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:50.641919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:50.642619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:50.656421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:50.657089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:50.661431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:50.661431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:50.662131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:50.662691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:50.804738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:50.820587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:50.822766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:50.823995 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b65b200-8803-4c4b-954a-a999be276c94 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.187166 Nov 03 04:07:50.834271 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1805/3735] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:50 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:51.088671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8b09d048-fb47-4061-a316-2f3c1d478a83 req-107d66bb-1bd3-4fcb-9df0-4d3b071d70fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa63cf2-1837-4175-a79a-418bd3437d98", "tag": "fad8d7a5-268e-46ee-872f-8f767e64c631"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:51.112158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8b09d048-fb47-4061-a316-2f3c1d478a83 req-107d66bb-1bd3-4fcb-9df0-4d3b071d70fe service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:51.117257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8b09d048-fb47-4061-a316-2f3c1d478a83 req-107d66bb-1bd3-4fcb-9df0-4d3b071d70fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:51.118047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8b09d048-fb47-4061-a316-2f3c1d478a83 req-107d66bb-1bd3-4fcb-9df0-4d3b071d70fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:51.167316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8b09d048-fb47-4061-a316-2f3c1d478a83 req-107d66bb-1bd3-4fcb-9df0-4d3b071d70fe service nova] Creating event network-changed:fad8d7a5-268e-46ee-872f-8f767e64c631 for instance 1aa63cf2-1837-4175-a79a-418bd3437d98 on n-h2-854653-7 Nov 03 04:07:51.176333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8b09d048-fb47-4061-a316-2f3c1d478a83 req-107d66bb-1bd3-4fcb-9df0-4d3b071d70fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091915 Nov 03 04:07:51.176958 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1931/3736] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:07:51.301881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:51.303000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:51.316452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:51.318999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:51.322655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:51.322655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:51.322655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:51.322655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:51.372907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:51.688248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:51.698882 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a13a07b-c0f9-4bd8-8dba-3bb1210e9a95 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.402630 Nov 03 04:07:51.700047 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1806/3737] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:51 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:51.857299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:51.858257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:51.865462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:51.866316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:51.866991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:51.867842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:51.868361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:51.869302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:51.993288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:52.033957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:52.039247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:52.041488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d660877f-9991-4f35-9466-149cfc5f8a6e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.189243 Nov 03 04:07:52.044525 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1932/3738] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:51 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:52.731612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:52.734464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:52.741837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:52.747970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:52.748916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:52.749908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:52.750832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:52.751502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:52.752164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:53.005005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:53.030508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ec434f0-08b3-494e-bbc5-c10611d4b2a6 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.303180 Nov 03 04:07:53.033841 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1807/3739] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:52 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:53.072266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:53.073659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:53.086116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:53.096941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:53.097443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:53.099528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:53.100810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:53.103002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:53.239257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:53.259926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:53.261890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:53.263464 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e81b382-f938-46b2-b25e-ae558fc3687b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.195170 Nov 03 04:07:53.279673 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1933/3740] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:53 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:54.059226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:54.059852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:54.064544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:54.074295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:54.079044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:54.079550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:54.080001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:54.085141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:54.085141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:54.085141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:54.306536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:54.309547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:54.324279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:54.325439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:54.326359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:54.327551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:54.328870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:54.329771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:54.420141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:54.428975 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcae3879-f868-463a-92e2-1b41ab0433f3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.373661 Nov 03 04:07:54.432232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1808/3741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:54 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:54.450558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:54.462133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:54.464164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:54.465755 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f057c9ec-b501-4822-a8de-edc7748acaa5 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.172811 Nov 03 04:07:54.466682 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1934/3742] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:54 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:55.455082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:55.456441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:55.464264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:55.465186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:55.468884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:55.468884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:55.468884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:55.468884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:55.506517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:55.508443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:55.523695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:55.548452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:55.552220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:55.552922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:55.556547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:55.559354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:55.560038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:55.720374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:55.737232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:55.738850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:55.740085 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-322d8354-d4f4-4cc7-9a0e-9d8d38691229 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.248127 Nov 03 04:07:55.740847 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1935/3743] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:55 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:55.823604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:55.832349 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-128c5126-435f-47c0-ab93-15d0ffcfd922 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.380745 Nov 03 04:07:55.850721 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1809/3744] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:55 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:56.781564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:56.783148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:56.792742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:56.794579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:56.795235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:56.796682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:56.797364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:56.798645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:56.864614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:56.865946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:56.873292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:56.874680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:56.875323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:56.876391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:56.877049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:56.877655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:56.895685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:56.918943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:56.926861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:56.928386 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7dfdebe4-9866-484d-8963-6dbdd065e94a tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.152269 Nov 03 04:07:56.936773 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1936/3745] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:56 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:57.692350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:57.719112 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bfdfd941-e3af-46c6-a70e-6befba5dbfa3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.858581 Nov 03 04:07:57.719736 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1810/3746] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:56 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:57.956843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:57.958773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:57.980424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:57.981468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:57.982122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:57.983080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:57.983720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:57.987618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:58.284413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2012627086", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "3a6cdb76-47b8-4999-a485-934f71d32151"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:58.332621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:58.347088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:58.349591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:58.357032 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a7806bd9-5b9f-4899-9be8-1a66e8915888 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1604 microversion: 2.32 time: 0.405978 Nov 03 04:07:58.363135 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1937/3747] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:57 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1604 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:07:58.388408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] validate_networks() for [('3a6cdb76-47b8-4999-a485-934f71d32151', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:07:58.751274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:58.751904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:58.755168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:07:58.758661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:58.759160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:58.759651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:58.760738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:58.762971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:58.763409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:59.135990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:59.145009 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1d9681c3-ca2a-41f1-a13d-dbdf4eda0a3a tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.400642 Nov 03 04:07:59.145719 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1938/3748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:58 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:07:59.178087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8dcd3c39-1a6d-4ffe-804d-2aab38f05bbe req-01823fbc-5035-4f91-837c-c31d24be426c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa63cf2-1837-4175-a79a-418bd3437d98", "name": "network-vif-plugged", "status": "completed", "tag": "fad8d7a5-268e-46ee-872f-8f767e64c631"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:07:59.192082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dcd3c39-1a6d-4ffe-804d-2aab38f05bbe req-01823fbc-5035-4f91-837c-c31d24be426c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:59.194289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dcd3c39-1a6d-4ffe-804d-2aab38f05bbe req-01823fbc-5035-4f91-837c-c31d24be426c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:59.194289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dcd3c39-1a6d-4ffe-804d-2aab38f05bbe req-01823fbc-5035-4f91-837c-c31d24be426c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:59.227410 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8dcd3c39-1a6d-4ffe-804d-2aab38f05bbe req-01823fbc-5035-4f91-837c-c31d24be426c service nova] Creating event network-vif-plugged:fad8d7a5-268e-46ee-872f-8f767e64c631 for instance 1aa63cf2-1837-4175-a79a-418bd3437d98 on n-h2-854653-7 Nov 03 04:07:59.240802 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8dcd3c39-1a6d-4ffe-804d-2aab38f05bbe req-01823fbc-5035-4f91-837c-c31d24be426c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066010 Nov 03 04:07:59.241805 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1939/3749] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:07:59.391638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:59.393351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:07:59.410698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:59.412421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:59.413291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:59.414213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:59.414907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:59.415579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:59.449872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:59.450350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:59.451035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:59.452171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lazy-loading 'fault' on Instance uuid 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:07:59.591860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:59.626306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:59.628241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:07:59.631814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3aa3c7c5-3939-4934-ad64-5bdc7fe77716 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1609 microversion: 2.32 time: 0.245482 Nov 03 04:07:59.646009 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1940/3750] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:07:59 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1609 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:07:59.736948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:07:59.738596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:07:59.739688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:07:59.740332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:07:59.740984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:07:59.753115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:59.754138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:59.755292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:59.756520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:07:59.766958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:07:59.769488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:07:59.791779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Getting quotas for project 50564f0b9f544653a589374bfd154659. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:07:59.799849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Getting quotas for user f2e7f6c26e7a4e698ae8eacece5dab69 and project 50564f0b9f544653a589374bfd154659. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:07:59.816800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:07:59.820871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:07:59.954301 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.861947 Nov 03 04:07:59.961568 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1811/3751] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:07:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:07:59.967965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe933e52-3c65-49c0-8beb-d7bc46d98a36 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:07:59.969345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fe933e52-3c65-49c0-8beb-d7bc46d98a36 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:00.170137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:00.171592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:00.182463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:00.185080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:00.186417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:00.187867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:00.189686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:00.190853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:00.408241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fe933e52-3c65-49c0-8beb-d7bc46d98a36 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:00.420058 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fe933e52-3c65-49c0-8beb-d7bc46d98a36 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1217 microversion: 2.1 time: 0.456914 Nov 03 04:08:00.422729 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1941/3752] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:07:59 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1217 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:08:00.634281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:00.647074 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-066deb67-d202-4203-b6f4-0fcb04e29ad3 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1314 microversion: 2.1 time: 0.481672 Nov 03 04:08:00.649964 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1812/3753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:00 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:00.668939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:00.669900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:00.679346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:00.682236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:00.682969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:00.684022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:00.687446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:00.688014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:00.767153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:00.768236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:00.769594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:00.771062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lazy-loading 'fault' on Instance uuid 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:08:00.849246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:00.928219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:00.935243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd19de6967f614510ab082f1a005a9b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '443306a268084a118f8f88b6a85220bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:00.938567 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a433191d-efd1-46f8-9e1d-3e96a750b096 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 200 len: 1609 microversion: 2.32 time: 0.279693 Nov 03 04:08:00.948184 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1942/3754] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:00 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 1609 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:01.448809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-77e978d5-532f-4109-8440-7d78718985e8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:01.449471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-77e978d5-532f-4109-8440-7d78718985e8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:01.544668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-77e978d5-532f-4109-8440-7d78718985e8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:01.559172 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-77e978d5-532f-4109-8440-7d78718985e8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1217 microversion: 2.1 time: 0.113875 Nov 03 04:08:01.560097 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1813/3755] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:01 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:01.672720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:01.673405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:01.681674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:01.682095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:01.682539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:01.683250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:01.683710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:01.684140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:01.839355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:01.847999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4045680f-d5c5-43b2-ad9c-add8b0bd9ac8 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1464 microversion: 2.1 time: 0.179301 Nov 03 04:08:01.848591 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1943/3756] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:01 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:01.966182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:01.966812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:01.975432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:01.976330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:01.977220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:01.978287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:01.978977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:01.979794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:01.986387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:02.003189 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] HTTP exception thrown: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Request method failure captured: Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa HTTP/1.1 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzvOYXRArrG2CI5RTPoScxXq7gAXDLayasgqmljoHRk-Yevqh5HIvUSfgK8skYsh2_fIzqMnj8UIAKjeNHqXB7NLlVeagwHyhENyIfOaHHkP1GZ8ZF0fUw9OMEaeCVuMhj4zGjRx4xAPsUFw9TyLrjAphsrTjkUzx-0vG4eMTWG9hxM Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.32 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 443306a268084a118f8f88b6a85220bb Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443306a268084a118f8f88b6a85220bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443306a268084a118f8f88b6a85220bb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443306a268084a118f8f88b6a85220bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443306a268084a118f8f88b6a85220bb"}]}] Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 443306a268084a118f8f88b6a85220bb Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TaggedBootDevicesTest-1045295547-project Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d19de6967f614510ab082f1a005a9b09 Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TaggedBootDevicesTest-1045295547-project Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa'} Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:02.005474 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:02.011736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:02.014326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Returning 404 to user: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:08:02.015610 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5fe40184-08fa-4864-a3b6-53248d52648e tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 404 len: 111 microversion: 2.32 time: 0.055256 Nov 03 04:08:02.016702 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1944/3757] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:01 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:08:02.033861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b4211b3a-2895-4d90-bb61-78da8454fa90 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '.version_select at 0x7ff7fd5323a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:02.117278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b4211b3a-2895-4d90-bb61-78da8454fa90 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101536118" status: 204 len: 0 microversion: 2.32 time: 0.096209 Nov 03 04:08:02.121379 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1945/3758] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 04:08:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101536118 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:08:02.287587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Calling method '.version_select at 0x7ff7f8b1a5e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:02.307667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.311110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.311110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.332242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.333230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.336063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.366680 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f03bd1c-3b82-428f-aeb3-7d2ba6b61c70 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/1634e468485f4b01823bcc0881520e96?start=2022-11-02T04%3A08%3A01.864740&end=2022-11-04T04%3A08%3A01.864740" status: 200 len: 695 microversion: 2.1 time: 0.496382 Nov 03 04:08:02.371655 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1814/3759] 10.222.0.30 () {58 vars in 1412 bytes} [Thu Nov 3 04:08:01 2022] GET /compute/v2.1/os-simple-tenant-usage/1634e468485f4b01823bcc0881520e96?start=2022-11-02T04%3A08%3A01.864740&end=2022-11-04T04%3A08%3A01.864740 => generated 695 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:02.389855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '.version_select at 0x7ff7f9062c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:02.415544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.420446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.420446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.462213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.463091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.463770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.511996 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83d5cdb6-82ec-4126-a462-cfbd3ab18d49 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/1634e468485f4b01823bcc0881520e96?start=2022-11-02T04%3A08%3A01.864740&end=2022-11-04T04%3A08%3A01.864740" status: 200 len: 695 microversion: 2.1 time: 0.127461 Nov 03 04:08:02.516164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1946/3760] 10.222.0.30 () {58 vars in 1412 bytes} [Thu Nov 3 04:08:02 2022] GET /compute/v2.1/os-simple-tenant-usage/1634e468485f4b01823bcc0881520e96?start=2022-11-02T04%3A08%3A01.864740&end=2022-11-04T04%3A08%3A01.864740 => generated 695 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:02.531041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Calling method '.version_select at 0x7ff7f8711ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:02.561525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.562692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.563584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.582610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:02.583227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:02.586189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.587179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.588447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.593104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.593594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.594041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.594758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.605694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.606210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.724858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:02.737305 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69f87981-394b-41dc-ad7a-cf7e18434b96 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1269 microversion: 2.1 time: 0.158769 Nov 03 04:08:02.737890 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1947/3761] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:02 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:08:02.884117 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d9bb5cb-4000-4e79-b16e-425d6d085a19 tempest-TenantUsagesTestJSON-969916018 tempest-TenantUsagesTestJSON-969916018-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-02T04%3A08%3A01.864740&end=2022-11-04T04%3A08%3A01.864740&detailed=1" status: 200 len: 44940 microversion: 2.1 time: 0.357407 Nov 03 04:08:02.885538 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1815/3762] 10.222.0.30 () {58 vars in 1335 bytes} [Thu Nov 3 04:08:02 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-02T04%3A08%3A01.864740&end=2022-11-04T04%3A08%3A01.864740&detailed=1 => generated 44940 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:08:02.941163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:02.942110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:02.955749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.959660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.959660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:02.961965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:02.963792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:02.965062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:03.000758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:08:03.396057 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-219cd602-f52c-4c54-a466-a719b392e5a4 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 204 len: 0 microversion: 2.1 time: 0.460271 Nov 03 04:08:03.397374 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1948/3763] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:08:02 2022] DELETE /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:08:03.413788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:03.414966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:03.440454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:03.440965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:03.441458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:03.442179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:03.442662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:03.443090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:03.680441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:03.690075 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-437af30d-a569-4b46-9090-fe35e1622426 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1470 microversion: 2.1 time: 0.280927 Nov 03 04:08:03.690944 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1816/3764] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:03 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:03.762123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:03.762762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:03.770416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:03.770913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:03.771511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:03.772077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:03.772738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:03.773195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:03.859015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:03.868196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb00d126-1dcc-40b8-a6d9-636f929b6a8c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1275 microversion: 2.1 time: 0.110782 Nov 03 04:08:03.869168 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1949/3765] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:03 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:04.714761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:04.716274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:04.724587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:04.725127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:04.725568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:04.726274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:04.726718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:04.727137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:04.892742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:04.893198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:04.908727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:04.909278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:04.909724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:04.910454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:04.910956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:04.911389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:05.096355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:05.107073 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73b06345-9dbc-406e-a0d1-10af0602a1ff tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1470 microversion: 2.1 time: 0.396613 Nov 03 04:08:05.124399 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1817/3766] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:04 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:05.374486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:05.393328 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1737823f-b713-4f75-b6cd-a961c140c943 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.499942 Nov 03 04:08:05.393328 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1950/3767] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:04 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:05.984682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a2f8636a-c992-44b6-b3cb-0dd451430a7a req-3100c481-a441-48cd-9711-cbc7e97a2635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc5e154-6671-4b65-869c-76ec32daa678", "tag": "d0d7647c-37f0-458f-a7e3-3d36b1703441"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:05.999145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a2f8636a-c992-44b6-b3cb-0dd451430a7a req-3100c481-a441-48cd-9711-cbc7e97a2635 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:05.999627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a2f8636a-c992-44b6-b3cb-0dd451430a7a req-3100c481-a441-48cd-9711-cbc7e97a2635 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:06.000061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a2f8636a-c992-44b6-b3cb-0dd451430a7a req-3100c481-a441-48cd-9711-cbc7e97a2635 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:06.023904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a2f8636a-c992-44b6-b3cb-0dd451430a7a req-3100c481-a441-48cd-9711-cbc7e97a2635 service nova] Creating event network-changed:d0d7647c-37f0-458f-a7e3-3d36b1703441 for instance 6fc5e154-6671-4b65-869c-76ec32daa678 on n-h1-854653-7 Nov 03 04:08:06.029500 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a2f8636a-c992-44b6-b3cb-0dd451430a7a req-3100c481-a441-48cd-9711-cbc7e97a2635 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050816 Nov 03 04:08:06.030102 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1818/3768] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:08:06.155695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:06.156733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:06.180206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:06.187596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:06.187596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:06.188975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:06.189165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:06.189862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:06.330484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:06.356508 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2b8ca54a-9cd2-4a78-8ff9-d34dede17f1b tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1428 microversion: 2.1 time: 0.192751 Nov 03 04:08:06.358081 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1951/3769] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:06 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1428 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:06.413622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:06.414554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:06.422995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:06.427777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:06.427777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:06.427777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:06.427777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:06.427777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:06.688204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:06.696847 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06aa65c6-a587-423c-ba82-12f3c5d8ecd2 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.288614 Nov 03 04:08:06.713145 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1819/3770] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:06 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:07.388983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:07.394228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:07.402403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:07.402894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:07.403341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:07.414644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:07.415381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:07.415841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:07.507072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:07.507483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:07.509063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:07.509842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lazy-loading 'fault' on Instance uuid 1aa63cf2-1837-4175-a79a-418bd3437d98 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:08:07.659557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fac44fe2dbc4e1aa98afced6a386a35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1634e468485f4b01823bcc0881520e96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:07.666933 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-146ab538-70dc-4e34-9eec-7261dbaff885 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 200 len: 1304 microversion: 2.1 time: 0.282455 Nov 03 04:08:07.683813 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1952/3771] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:07 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 1304 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:07.720876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:07.721579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:07.727979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:07.728673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:07.729326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:07.730196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:07.730846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:07.731441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:07.931388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:07.939446 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70ef6a7d-e0e2-41d1-9584-9ab2a1202210 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.222890 Nov 03 04:08:07.940015 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1820/3772] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:07 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:08.065319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2a592051-f2cc-4d92-a0cb-a7b83d61d365 req-71fd550c-afbe-49d8-8d07-ce12e6a122f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa63cf2-1837-4175-a79a-418bd3437d98", "name": "network-vif-deleted", "tag": "fad8d7a5-268e-46ee-872f-8f767e64c631"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:08.079237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2a592051-f2cc-4d92-a0cb-a7b83d61d365 req-71fd550c-afbe-49d8-8d07-ce12e6a122f6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:08.079719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2a592051-f2cc-4d92-a0cb-a7b83d61d365 req-71fd550c-afbe-49d8-8d07-ce12e6a122f6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:08.080363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2a592051-f2cc-4d92-a0cb-a7b83d61d365 req-71fd550c-afbe-49d8-8d07-ce12e6a122f6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:08.095190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2a592051-f2cc-4d92-a0cb-a7b83d61d365 req-71fd550c-afbe-49d8-8d07-ce12e6a122f6 service nova] Creating event network-vif-deleted:fad8d7a5-268e-46ee-872f-8f767e64c631 for instance 1aa63cf2-1837-4175-a79a-418bd3437d98 on n-h2-854653-7 Nov 03 04:08:08.100671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2a592051-f2cc-4d92-a0cb-a7b83d61d365 req-71fd550c-afbe-49d8-8d07-ce12e6a122f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041195 Nov 03 04:08:08.102321 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1953/3773] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:08.691611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:08.692706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] [instance: 1aa63cf2-1837-4175-a79a-418bd3437d98] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:08.700015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:08.704017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:08.704017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:08.704017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:08.704017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:08.704572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:08.722673 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] HTTP exception thrown: Instance 1aa63cf2-1837-4175-a79a-418bd3437d98 could not be found. Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Request method failure captured: Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 HTTP/1.1 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz6M3jzPkaZTuVLKSASk2f_SXQ9uu_8m2fCy8mTrecNGEriu3zuOI5vGcjCpAIVnwLGLVkKs3RW4-HimXD6lTiN79AvJnH1Na-QytOawWwAxz7eb9P6LRgOiMZTj_2NTQn4r-TgmRzOXLe4K9-c6yLSexze8VRPhKfQsLZ8puO5Bt0E Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 1634e468485f4b01823bcc0881520e96 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TenantUsagesTestJSON-1815857206 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1634e468485f4b01823bcc0881520e96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1634e468485f4b01823bcc0881520e96", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1634e468485f4b01823bcc0881520e96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1634e468485f4b01823bcc0881520e96"}]}] Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TenantUsagesTestJSON-1815857206 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 1634e468485f4b01823bcc0881520e96 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1815857206 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TenantUsagesTestJSON-1815857206-project Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 1fac44fe2dbc4e1aa98afced6a386a35 Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TenantUsagesTestJSON-1815857206-project Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1aa63cf2-1837-4175-a79a-418bd3437d98 could not be found. Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1aa63cf2-1837-4175-a79a-418bd3437d98'} Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa63cf2-1837-4175-a79a-418bd3437d98 could not be found. Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa63cf2-1837-4175-a79a-418bd3437d98 could not be found. Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:08.725131 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:08.729934 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:08.729934 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:08.729934 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:08.729934 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:08:08.729934 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:08:08.729934 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa63cf2-1837-4175-a79a-418bd3437d98 could not be found. Nov 03 04:08:08.729934 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:08.731816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] Returning 404 to user: Instance 1aa63cf2-1837-4175-a79a-418bd3437d98 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:08:08.732984 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7531ef9-f5b0-45fd-88f7-ac7cb767b191 tempest-TenantUsagesTestJSON-1815857206 tempest-TenantUsagesTestJSON-1815857206-project] 10.222.0.30 "GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98" status: 404 len: 111 microversion: 2.1 time: 0.045379 Nov 03 04:08:08.734104 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1821/3774] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:08 2022] GET /compute/v2.1/servers/1aa63cf2-1837-4175-a79a-418bd3437d98 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:08:08.963271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:08.964157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:08.970414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:08.970938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:08.971375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:08.972076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:08.972530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:08.972954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:09.180629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:09.190220 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c28bde15-a343-4b27-8c5c-72fa745793dd tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.231894 Nov 03 04:08:09.193245 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1954/3775] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:08 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:09.585230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:09.586058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:09.593963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:09.599196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:09.599196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:09.599196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:09.599196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:09.599196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:09.610496 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] HTTP exception thrown: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Request method failure captured: Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa HTTP/1.1 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYzvOYXRArrG2CI5RTPoScxXq7gAXDLayasgqmljoHRk-Yevqh5HIvUSfgK8skYsh2_fIzqMnj8UIAKjeNHqXB7NLlVeagwHyhENyIfOaHHkP1GZ8ZF0fUw9OMEaeCVuMhj4zGjRx4xAPsUFw9TyLrjAphsrTjkUzx-0vG4eMTWG9hxM Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.32 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 443306a268084a118f8f88b6a85220bb Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443306a268084a118f8f88b6a85220bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443306a268084a118f8f88b6a85220bb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443306a268084a118f8f88b6a85220bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443306a268084a118f8f88b6a85220bb"}]}] Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 443306a268084a118f8f88b6a85220bb Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TaggedBootDevicesTest-1045295547-project Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d19de6967f614510ab082f1a005a9b09 Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TaggedBootDevicesTest-1045295547-project Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa'} Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:08:09.612297 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Returning 404 to user: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d912d1d7-7934-4cd5-a58c-314aa1565d17 tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 404 len: 111 microversion: 2.32 time: 0.032513 Nov 03 04:08:09.622090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1822/3776] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:08:09 2022] DELETE /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:08:09.623564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:09.624188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] [instance: 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:09.639399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:09.639985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:09.640332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:09.641057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:09.643284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:09.643284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:09.657507 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] HTTP exception thrown: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Request method failure captured: Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa HTTP/1.1 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYzvOYXRArrG2CI5RTPoScxXq7gAXDLayasgqmljoHRk-Yevqh5HIvUSfgK8skYsh2_fIzqMnj8UIAKjeNHqXB7NLlVeagwHyhENyIfOaHHkP1GZ8ZF0fUw9OMEaeCVuMhj4zGjRx4xAPsUFw9TyLrjAphsrTjkUzx-0vG4eMTWG9hxM Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.32 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 443306a268084a118f8f88b6a85220bb Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443306a268084a118f8f88b6a85220bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_443306a268084a118f8f88b6a85220bb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/443306a268084a118f8f88b6a85220bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/443306a268084a118f8f88b6a85220bb"}]}] Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 443306a268084a118f8f88b6a85220bb Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1045295547 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TaggedBootDevicesTest-1045295547-project Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d19de6967f614510ab082f1a005a9b09 Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TaggedBootDevicesTest-1045295547-project Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa'} Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.659299 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. Nov 03 04:08:09.664498 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:09.666032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] Returning 404 to user: Instance 16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:08:09.666891 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98d27962-3f73-4735-b5e9-fd5a3b04571b tempest-TaggedBootDevicesTest-1045295547 tempest-TaggedBootDevicesTest-1045295547-project] 10.222.0.30 "GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa" status: 404 len: 111 microversion: 2.32 time: 0.047375 Nov 03 04:08:09.667453 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1955/3777] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:09 2022] GET /compute/v2.1/servers/16dffb3f-8d5c-4bc7-a9a5-2cc0d1cfadfa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 03 04:08:10.215041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:10.216769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:10.227289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:10.227781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:10.230949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:10.231685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:10.232200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:10.234243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:10.440368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:10.456179 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5254545-df9c-47dc-b40b-fb021e9b996c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.246039 Nov 03 04:08:10.456768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1823/3778] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:10 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:11.479568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:11.480243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:11.487298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:11.500825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:11.501364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:11.501823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:11.503553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:11.506156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:11.506608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:11.671351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:11.680730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-885f352e-e2a2-4034-8870-f7eaa9d4ff8e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.204577 Nov 03 04:08:11.681330 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1956/3779] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:11 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:12.707773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:12.708564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:12.713434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:12.715646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:12.724264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:12.725134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:12.729183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:12.730208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:12.731695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:12.733094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:13.026294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:13.035475 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7d66fa9-4ced-4987-a58b-539caf41410c tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.332225 Nov 03 04:08:13.036322 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1824/3780] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:12 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:13.830495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:13.983800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-802c5778-d523-4578-b9c7-2bca8eebdc18 tempest-TenantUsagesNegativeTestJSON-1745289405 tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-02T04%3A08%3A13.821311&end=2022-11-04T04%3A08%3A13.821311" status: 404 len: 112 microversion: - time: 0.158616 Nov 03 04:08:13.984327 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1957/3781] 10.222.0.30 () {58 vars in 1316 bytes} [Thu Nov 3 04:08:13 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-02T04%3A08%3A13.821311&end=2022-11-04T04%3A08%3A13.821311 => generated 112 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 03 04:08:13.999320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-126ac534-22bd-4371-934e-bfacfe79d492 tempest-TenantUsagesNegativeTestJSON-1745289405 tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin] Calling method '.version_select at 0x7ff7f89c41f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:13.999320 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-126ac534-22bd-4371-934e-bfacfe79d492 tempest-TenantUsagesNegativeTestJSON-1745289405 tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-126ac534-22bd-4371-934e-bfacfe79d492 tempest-TenantUsagesNegativeTestJSON-1745289405 tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin] Request method failure captured: Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-simple-tenant-usage/8b70ea7245fa4aab85c1864c7f75adc6?start=2022-11-04T04%3A08%3A13.821311&end=2022-11-02T04%3A08%3A13.821311 HTTP/1.1 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz6tYhw_tWtj_TNDXLnGMUA8OjpVGHO1wUnQwzxYLXHcg92_qIfRx5nKQNHvEtomSF01IbYdSJT8XV5ZN_lKLgkbAkwB-FH6TtaE4zDml_4mc2TXKByX-LPaja_qJ057ec5XsTWu06vjwDok4GpKL2Hd8t9jh8R4z3qFrhXSjizQRtk Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: caf1d31734a04351be67621e811a1a92 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1745289405 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/caf1d31734a04351be67621e811a1a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_caf1d31734a04351be67621e811a1a92", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/caf1d31734a04351be67621e811a1a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/caf1d31734a04351be67621e811a1a92"}]}] Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1745289405 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: caf1d31734a04351be67621e811a1a92 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1745289405 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0460fd6ab62e4e068cad98bf00666160 Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid start time. The start time cannot occur after the end time. Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '8b70ea7245fa4aab85c1864c7f75adc6'} Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 03 04:08:14.007927 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:08:14.024629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-126ac534-22bd-4371-934e-bfacfe79d492 tempest-TenantUsagesNegativeTestJSON-1745289405 tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:08:14.024629 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-126ac534-22bd-4371-934e-bfacfe79d492 tempest-TenantUsagesNegativeTestJSON-1745289405 tempest-TenantUsagesNegativeTestJSON-1745289405-project-admin] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage/8b70ea7245fa4aab85c1864c7f75adc6?start=2022-11-04T04%3A08%3A13.821311&end=2022-11-02T04%3A08%3A13.821311" status: 400 len: 111 microversion: 2.1 time: 0.019476 Nov 03 04:08:14.024629 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1825/3782] 10.222.0.30 () {58 vars in 1412 bytes} [Thu Nov 3 04:08:13 2022] GET /compute/v2.1/os-simple-tenant-usage/8b70ea7245fa4aab85c1864c7f75adc6?start=2022-11-04T04%3A08%3A13.821311&end=2022-11-02T04%3A08%3A13.821311 => generated 111 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:08:14.062547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:14.063235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:14.081655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:14.083714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:14.084183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:14.087184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:14.088844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:14.090634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:14.147607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6cfbb7da-cf89-40aa-987e-83b07c1b601e tempest-TenantUsagesNegativeTestJSON-269033642 tempest-TenantUsagesNegativeTestJSON-269033642-project] Calling method '.version_select at 0x7ff7fd62c790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:14.154741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6cfbb7da-cf89-40aa-987e-83b07c1b601e tempest-TenantUsagesNegativeTestJSON-269033642 tempest-TenantUsagesNegativeTestJSON-269033642-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '0d383bd6a8b64147ad43927ca32eab84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b70ea7245fa4aab85c1864c7f75adc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6cfbb7da-cf89-40aa-987e-83b07c1b601e tempest-TenantUsagesNegativeTestJSON-269033642 tempest-TenantUsagesNegativeTestJSON-269033642-project] Request method failure captured: Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-02T04%3A08%3A13.821311&end=2022-11-04T04%3A08%3A13.821311&detailed=1 HTTP/1.1 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz6sRmzrX851iDGduz3Y3hXP0yBHQNqC2HNrrDGhlQpN2v_KIGtAZPBPeVQOQqcm5RCIDH9GN-AO6KysZ41VC2uHKo2jbJkjbRMeeDY9Nmw9FNwtFFahEzAhhuf31J8Ukb4R4T-DXJm5Lmbqi_pBvkss8khQqQphFvLHNeAenxaJb0A Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 8b70ea7245fa4aab85c1864c7f75adc6 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-269033642 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b70ea7245fa4aab85c1864c7f75adc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b70ea7245fa4aab85c1864c7f75adc6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b70ea7245fa4aab85c1864c7f75adc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b70ea7245fa4aab85c1864c7f75adc6"}]}] Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-269033642 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 8b70ea7245fa4aab85c1864c7f75adc6 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-269033642 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TenantUsagesNegativeTestJSON-269033642-project Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 0d383bd6a8b64147ad43927ca32eab84 Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-269033642-project Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: action_args: {} Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise self.value Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 03 04:08:14.158319 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 03 04:08:14.163773 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:14.166464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6cfbb7da-cf89-40aa-987e-83b07c1b601e tempest-TenantUsagesNegativeTestJSON-269033642 tempest-TenantUsagesNegativeTestJSON-269033642-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:08:14.171997 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6cfbb7da-cf89-40aa-987e-83b07c1b601e tempest-TenantUsagesNegativeTestJSON-269033642 tempest-TenantUsagesNegativeTestJSON-269033642-project] 10.222.0.30 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-02T04%3A08%3A13.821311&end=2022-11-04T04%3A08%3A13.821311&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.149423 Nov 03 04:08:14.171997 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1958/3783] 10.222.0.30 () {58 vars in 1335 bytes} [Thu Nov 3 04:08:14 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-02T04%3A08%3A13.821311&end=2022-11-04T04%3A08%3A13.821311&detailed=1 => generated 123 bytes in 153 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:08:14.445743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:14.454046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85dddec3-d133-4f4d-a32b-de957f7c5bd7 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.398982 Nov 03 04:08:14.455515 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1826/3784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:14 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:15.030398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4917351d-f076-4f3e-aa1c-8893761ee81f req-b682acf8-2e66-47e6-86e3-91d48cf7315a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc5e154-6671-4b65-869c-76ec32daa678", "name": "network-vif-plugged", "status": "completed", "tag": "d0d7647c-37f0-458f-a7e3-3d36b1703441"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:15.063767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4917351d-f076-4f3e-aa1c-8893761ee81f req-b682acf8-2e66-47e6-86e3-91d48cf7315a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:15.065861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4917351d-f076-4f3e-aa1c-8893761ee81f req-b682acf8-2e66-47e6-86e3-91d48cf7315a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:15.067102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4917351d-f076-4f3e-aa1c-8893761ee81f req-b682acf8-2e66-47e6-86e3-91d48cf7315a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:15.112184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4917351d-f076-4f3e-aa1c-8893761ee81f req-b682acf8-2e66-47e6-86e3-91d48cf7315a service nova] Creating event network-vif-plugged:d0d7647c-37f0-458f-a7e3-3d36b1703441 for instance 6fc5e154-6671-4b65-869c-76ec32daa678 on n-h1-854653-7 Nov 03 04:08:15.129352 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4917351d-f076-4f3e-aa1c-8893761ee81f req-b682acf8-2e66-47e6-86e3-91d48cf7315a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101764 Nov 03 04:08:15.130261 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1959/3785] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:15.477934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:15.479461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:15.488467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:15.489534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:15.490215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:15.491575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:15.492316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:15.493082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:15.775259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:15.786347 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72e25451-197b-4f4e-8c21-fe60a853598e tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.313228 Nov 03 04:08:15.787003 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1827/3786] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:15 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:16.811047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:16.811777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:16.820202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:16.820781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:16.821318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:16.822111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:16.822804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:16.823305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:17.039499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:17.049641 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5d52af8-7fc2-4c67-89a8-e149e678aacf tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1317 microversion: 2.1 time: 0.243357 Nov 03 04:08:17.050787 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1960/3787] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:16 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:18.074749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:18.077249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:18.082107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.082603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.083095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:18.083847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.084283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.084711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:18.295674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:18.319331 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-edd48f1f-8617-4931-8ec8-432b0beb041d tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1505 microversion: 2.1 time: 0.244135 Nov 03 04:08:18.332829 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1828/3788] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:18 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:18.351192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:18.351987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:18.370461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.371155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.371655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:18.372974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.377361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.378600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:18.469505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:18.473860 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d36417e-8bd0-4ea1-8b79-4c8112761e5f tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678/os-instance-actions/req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f" status: 200 len: 313 microversion: 2.1 time: 0.127285 Nov 03 04:08:18.475706 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1961/3789] 10.222.0.30 () {58 vars in 1419 bytes} [Thu Nov 3 04:08:18 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678/os-instance-actions/req-0fb60105-90a8-4ed9-bfcb-2d6d1c615b3f => generated 313 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:18.506898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:18.515884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:18.542918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.547079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.547538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:18.561414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.562203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.562955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:18.598526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:18.952306 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43bfb2cb-ba05-4ef6-b333-566b9025ec28 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "POST /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678/action" status: 202 len: 0 microversion: 2.1 time: 0.467179 Nov 03 04:08:18.953472 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1829/3790] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:08:18 2022] POST /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:08:18.962667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:18.963598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:18.972894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.973619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.974145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:18.975225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:18.975945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:18.977557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:19.241172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:19.259863 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6efaf8b4-0bc5-45a2-ae2a-65a02e251243 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1507 microversion: 2.1 time: 0.301753 Nov 03 04:08:19.261146 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1962/3791] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:18 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:20.298628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:20.299383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:20.313737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:20.314517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:20.315139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:20.316516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:20.317194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:20.317989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:20.527099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:20.552318 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-437b5d44-5904-4588-aca2-fd67679dc413 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1512 microversion: 2.1 time: 0.268057 Nov 03 04:08:20.576180 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1830/3792] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:20 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:21.579290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:21.579736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:21.592937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:21.592937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:21.592937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:21.592937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:21.592937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:21.592937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:21.860978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:21.871108 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-516927b7-c976-49a0-a323-1b20283e93af tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1505 microversion: 2.1 time: 0.296634 Nov 03 04:08:21.873688 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1963/3793] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:21 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:21.900840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '.version_select at 0x7ff7f86bd550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:21.902020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:21.917523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:21.920834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:21.922263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:21.923006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:21.924195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:21.924634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:21.975027 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-acea0e6f-6a4e-418b-b638-050aab21bcba tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.080047 Nov 03 04:08:21.983476 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1831/3794] 10.222.0.30 () {58 vars in 1296 bytes} [Thu Nov 3 04:08:21 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678/os-instance-actions => generated 611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:21.989027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:21.989676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:21.998960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:21.999780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:22.000533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:22.002203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:22.002948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:22.003857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:22.037322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:08:22.055036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:22.460580 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ecdb3617-627e-42d3-b77d-1495a8e2d19b tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 204 len: 0 microversion: 2.1 time: 0.475436 Nov 03 04:08:22.462226 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1964/3795] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:08:21 2022] DELETE /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:08:22.473966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:22.474818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:22.486270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:22.492553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:22.492553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:22.493554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:22.494233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:22.496207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:22.992497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:22.999922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6aa0ead-ff2b-4104-a09b-c05705839dd0 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1511 microversion: 2.1 time: 0.531503 Nov 03 04:08:23.000450 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1832/3796] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:22 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1511 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:24.026443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:24.030299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:24.045473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:24.045983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:24.046435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:24.047169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:24.047631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:24.048065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:24.446220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:24.458709 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c0d774f-bab0-4db5-9f17-554f660d5454 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1511 microversion: 2.1 time: 0.433596 Nov 03 04:08:24.462200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1965/3797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:24 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:25.188080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-dbc6a3b1-4367-46f1-b3dd-13e120cadb23 req-0253c92a-2f0e-49d9-b57e-902dd4893591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc5e154-6671-4b65-869c-76ec32daa678", "name": "network-vif-deleted", "tag": "d0d7647c-37f0-458f-a7e3-3d36b1703441"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:25.202565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:25.210209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dbc6a3b1-4367-46f1-b3dd-13e120cadb23 req-0253c92a-2f0e-49d9-b57e-902dd4893591 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:25.213269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dbc6a3b1-4367-46f1-b3dd-13e120cadb23 req-0253c92a-2f0e-49d9-b57e-902dd4893591 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:25.217185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dbc6a3b1-4367-46f1-b3dd-13e120cadb23 req-0253c92a-2f0e-49d9-b57e-902dd4893591 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:25.248516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-dbc6a3b1-4367-46f1-b3dd-13e120cadb23 req-0253c92a-2f0e-49d9-b57e-902dd4893591 service nova] Creating event network-vif-deleted:d0d7647c-37f0-458f-a7e3-3d36b1703441 for instance 6fc5e154-6671-4b65-869c-76ec32daa678 on n-h1-854653-7 Nov 03 04:08:25.263596 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-dbc6a3b1-4367-46f1-b3dd-13e120cadb23 req-0253c92a-2f0e-49d9-b57e-902dd4893591 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079480 Nov 03 04:08:25.264680 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1833/3798] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:25.488110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:25.490104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:25.498484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:25.499490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:25.500155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:25.501238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:25.501925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:25.502576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:25.604239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:25.613962 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3529a7b8-8bf3-4ed8-a044-b0913c1c2de1 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1302 microversion: 2.1 time: 0.129225 Nov 03 04:08:25.615117 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1966/3799] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:25 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:26.655530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:26.656777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:26.671768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:26.672270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:26.675840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:26.678359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:26.679071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:26.680528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:26.750992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:26.751663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:26.752803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:26.755150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lazy-loading 'fault' on Instance uuid 6fc5e154-6671-4b65-869c-76ec32daa678 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:08:26.872908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7f6c26e7a4e698ae8eacece5dab69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50564f0b9f544653a589374bfd154659', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:26.884721 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50f14cd5-568d-410e-9fe6-edbc7e1845b8 tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 200 len: 1307 microversion: 2.1 time: 0.249970 Nov 03 04:08:26.893717 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1834/3800] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:26 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 1307 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:27.919682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:27.920883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] [instance: 6fc5e154-6671-4b65-869c-76ec32daa678] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:27.933197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:27.933713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:27.934167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:27.934932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:27.938666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:27.942992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:27.974749 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] HTTP exception thrown: Instance 6fc5e154-6671-4b65-869c-76ec32daa678 could not be found. Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Request method failure captured: Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 HTTP/1.1 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz6dEwLKKRwPsROS_0tQGjGdjTzu1o-aWqXTwc7daJ_IYPQoLRpLFGmhUQ2-z2cH4Uu5C1orYnJlivH5hqjIx9s1TkKDXvvN3DBydZa4Rujb47QuQlnuoV1fow_sZsHxRvfyaJp7XFLYtlmoLII420JZq_FwjMOjh4LGjcaxksX49Sk Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 50564f0b9f544653a589374bfd154659 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-InstanceActionsTestJSON-852894655 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/50564f0b9f544653a589374bfd154659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_50564f0b9f544653a589374bfd154659", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/50564f0b9f544653a589374bfd154659"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/50564f0b9f544653a589374bfd154659"}]}] Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-InstanceActionsTestJSON-852894655 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 50564f0b9f544653a589374bfd154659 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-InstanceActionsTestJSON-852894655 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-InstanceActionsTestJSON-852894655-project Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f2e7f6c26e7a4e698ae8eacece5dab69 Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-InstanceActionsTestJSON-852894655-project Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 6fc5e154-6671-4b65-869c-76ec32daa678 could not be found. Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '6fc5e154-6671-4b65-869c-76ec32daa678'} Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc5e154-6671-4b65-869c-76ec32daa678 could not be found. Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc5e154-6671-4b65-869c-76ec32daa678 could not be found. Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:08:27.977213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc5e154-6671-4b65-869c-76ec32daa678 could not be found. Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] Returning 404 to user: Instance 6fc5e154-6671-4b65-869c-76ec32daa678 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-39cd6591-480e-429c-a90d-212a8548efce tempest-InstanceActionsTestJSON-852894655 tempest-InstanceActionsTestJSON-852894655-project] 10.222.0.30 "GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678" status: 404 len: 111 microversion: 2.1 time: 0.074072 Nov 03 04:08:27.991471 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1967/3801] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:27 2022] GET /compute/v2.1/servers/6fc5e154-6671-4b65-869c-76ec32daa678 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:08:32.333941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b577ece-bb3a-4c38-bbf5-e381333423da"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:32.336614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:32.379292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:32.379292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:32.379292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:32.379292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:32.379907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:32.388883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:33.605876 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-db01594a-2b4d-467b-81fc-44e7286acf1a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.275104 Nov 03 04:08:33.613111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1835/3802] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:08:32 2022] POST /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 194 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:41.643213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:41.643213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:41.902013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-690742972", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": "none"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:42.019975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:08:42.021189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:08:42.021976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:08:42.022632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:08:42.024096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:08:42.066336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:42.067090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:42.067913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:42.070103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:42.070848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:42.071544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:42.098533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Getting quotas for project 0b9f79bd31cb41fd8b655a42d4fac6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:08:42.106349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Getting quotas for user e033b58eb60e4e3dac2fd92c1143bde4 and project 0b9f79bd31cb41fd8b655a42d4fac6ac. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:08:42.125263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:08:42.130439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:08:42.350597 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ebf92d7a-200b-4ea6-8c10-6386db4f7451 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.718425 Nov 03 04:08:42.358233 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1968/3803] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:08:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:08:42.370733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-16c292c7-0723-4e1c-821d-2e6a6812beb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:42.371673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-16c292c7-0723-4e1c-821d-2e6a6812beb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:42.388802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=7 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:42.662208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-16c292c7-0723-4e1c-821d-2e6a6812beb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:42.686615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-16c292c7-0723-4e1c-821d-2e6a6812beb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:42.696833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-16c292c7-0723-4e1c-821d-2e6a6812beb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:42.702659 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-16c292c7-0723-4e1c-821d-2e6a6812beb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1277 microversion: 2.54 time: 0.336407 Nov 03 04:08:42.726220 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1836/3804] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:42 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1277 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:43.733363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ad771ce-b511-4a73-b331-177eaef4de48 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:43.734226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0ad771ce-b511-4a73-b331-177eaef4de48 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:43.809614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0ad771ce-b511-4a73-b331-177eaef4de48 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:43.823560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0ad771ce-b511-4a73-b331-177eaef4de48 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:43.825084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0ad771ce-b511-4a73-b331-177eaef4de48 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:43.826468 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0ad771ce-b511-4a73-b331-177eaef4de48 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1277 microversion: 2.54 time: 0.099356 Nov 03 04:08:43.827028 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1969/3805] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:43 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:44.788170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:44.788896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:44.793433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:44.803436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:44.804153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:44.804902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:44.806034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:44.806964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:44.807579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:44.864688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:44.865347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:44.893448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:44.894022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:44.894482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:44.905214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:44.906182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:44.916306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:45.223950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:45.230152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:45.232223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:45.234375 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d101521-b1dd-4409-a241-4c9c1c2460dc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1329 microversion: 2.54 time: 0.377403 Nov 03 04:08:45.235445 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1970/3806] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:44 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1329 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:45.467005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5855f224-13f4-4379-aec3-0f0224971460 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Action: 'create', calling method: .version_select at 0x7ff7f90629d0>, body: {"keypair": {"name": "tempest-keypair-1875930638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdOw+eERnzywj+0MWPKSpJtvI1xO3UA4zHckzHfioZ92RuFwTkkLpZYzQZQnXduU+1F+UgqTX2c+K4Pynmx5x7XCCQBR3b4Zz40yKEaEI373KI2IDF5cr3/22DoJ7pjRw=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:45.491659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5855f224-13f4-4379-aec3-0f0224971460 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Getting quotas for project 6e92fb95e80b4d6cace544d5cb063953. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:08:45.501997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:45.516885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5855f224-13f4-4379-aec3-0f0224971460 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Getting quotas for user 7711a11a426b4b3987c5150fb4540c6e and project 6e92fb95e80b4d6cace544d5cb063953. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:08:45.527236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-201d3a24-ec4c-4e98-a4af-6b78b53220fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.743788 Nov 03 04:08:45.529006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1837/3807] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:44 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:45.559960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:45.563429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:45.582046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:45.583436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:45.584145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:45.585668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:45.586368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:45.587031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:45.668125 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5855f224-13f4-4379-aec3-0f0224971460 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.430844 Nov 03 04:08:45.677804 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1971/3808] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:08:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:45.826983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:45.835884 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85242ce8-2708-4487-a011-e1dce50e520f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.284114 Nov 03 04:08:45.836474 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1838/3809] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:45 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:45.859003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:45.861350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:45.867843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:45.868494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:45.868774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:45.869711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:45.870178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:45.870607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:46.182729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:46.192753 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e6d4a044-585b-4c4a-9c5d-8a9819540a5a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.337960 Nov 03 04:08:46.198726 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1972/3810] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:45 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:46.227584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-12630665"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:46.228518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:46.237529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:46.238039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:46.238947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:46.240372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:46.241096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:46.241779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:46.266688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:46.267326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:46.281408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:46.282006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:46.282403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:46.283132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:46.285962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:46.290260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:46.411284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:46.433629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:46.435303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:46.436858 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-280053da-830b-48ef-9667-b31d1f6d5450 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1335 microversion: 2.54 time: 0.175874 Nov 03 04:08:46.437561 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1973/3811] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:46 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:46.922727 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-502a8e2a-3804-4c0e-9da6-814eb01c1649 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.709302 Nov 03 04:08:46.926407 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1839/3812] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:08:46 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 03 04:08:47.464017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:47.465882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:47.473862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:47.474932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:47.475689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:47.478045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:47.479122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:47.479809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:47.574529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:47.586705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:47.586705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:47.587157 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8c87418-a15b-40a2-a136-5e3bec8ba15e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1335 microversion: 2.54 time: 0.127581 Nov 03 04:08:47.587724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1974/3813] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:47 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1335 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:48.640114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:48.641892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:48.653226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:48.653996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:48.654617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:48.655736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:48.656935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:48.657699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:48.756558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:48.766736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:48.768229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:48.769423 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-810dea5e-eace-4de1-9757-4046f55c2f51 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1335 microversion: 2.54 time: 0.157680 Nov 03 04:08:48.769989 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1840/3814] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:48 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1335 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:49.529926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-258082225", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1dcc32ad-2743-4ff3-9517-fc7e565382ef"}], "security_groups": [{"name": "tempest-securitygroup--1064103660"}], "key_name": "tempest-keypair-1875930638", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:49.642858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:49.646131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:49.653907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:49.654712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:49.655532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:49.656583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:49.657736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:49.658399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:49.689988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lazy-loading 'flavor' on Instance uuid 8b801e36-fff6-415b-a737-cc3e1bbfff8c {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:08:49.703017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] validate_networks() for [('1dcc32ad-2743-4ff3-9517-fc7e565382ef', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:08:50.175871 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d9d0615-5adc-4381-8105-1b9a495cfe34 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/action" status: 200 len: 32 microversion: 2.1 time: 0.535464 Nov 03 04:08:50.191142 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1841/3815] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:08:49 2022] POST /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/action => generated 32 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:08:50.206708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:50.207709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:50.217890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:50.218658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:50.220021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:50.221243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:50.221940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:50.222846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:50.429632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:50.449156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:50.453000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:50.456771 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e296b7df-38a1-4a58-b1d6-1e1e549ca317 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1356 microversion: 2.54 time: 0.256682 Nov 03 04:08:50.457959 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1842/3816] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:50 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1356 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:50.487650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:50.489401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:50.499597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:50.500426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:50.503387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:50.505553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:50.506285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:50.508267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:51.027763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:51.040087 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa76e5e1-b0b7-41ff-a832-853790e1fa26 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.573592 Nov 03 04:08:51.053986 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1843/3817] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:50 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:51.061886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34f22be5-01ae-4f34-b6ac-6b4616366dc3 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Action: 'create', calling method: .version_select at 0x7ff7fd488790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-786742133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaPnNXR22fa/o1rjChVd6hKbJDrTv7lZohqfz4XYTyGOHKYEqylX2BDDATEFT7UDaP5lHeahG8a9U+LN6BUmQQYQ4QHXhFQkqypUsjMIV5x+JbeT1IP/fkh0ysFo4z6mQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:51.087990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-34f22be5-01ae-4f34-b6ac-6b4616366dc3 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Getting quotas for project 0b9f79bd31cb41fd8b655a42d4fac6ac. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:08:51.097902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-34f22be5-01ae-4f34-b6ac-6b4616366dc3 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Getting quotas for user e033b58eb60e4e3dac2fd92c1143bde4 and project 0b9f79bd31cb41fd8b655a42d4fac6ac. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:08:51.220819 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-34f22be5-01ae-4f34-b6ac-6b4616366dc3 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.164700 Nov 03 04:08:51.221482 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1844/3818] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 04:08:51 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 04:08:51.239668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-786742133", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:51.247843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:51.289591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:51.296835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:51.310970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:51.314735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:51.315423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:51.317532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:51.320332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:08:51.321263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:08:51.321749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:08:51.322162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:08:51.322580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:08:51.335270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:51.335844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:51.336347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:51.337378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:51.337844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:51.342539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:51.396804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Getting quotas for project 6e92fb95e80b4d6cace544d5cb063953. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:08:51.418906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Getting quotas for user 7711a11a426b4b3987c5150fb4540c6e and project 6e92fb95e80b4d6cace544d5cb063953. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:08:51.434032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:08:51.443295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:08:51.480968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:08:51.481557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:08:51.482149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:08:51.482637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:08:51.485527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:08:51.680051 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e8cc665-ecc6-45dd-9221-5d7ba39c7efc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.153247 Nov 03 04:08:51.682957 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1975/3819] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:08:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:08:51.698204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5a2418c6-caf1-4476-8ae9-28a0516b8803 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:51.700123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a2418c6-caf1-4476-8ae9-28a0516b8803 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:51.819147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5a2418c6-caf1-4476-8ae9-28a0516b8803 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:51.826193 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5a2418c6-caf1-4476-8ae9-28a0516b8803 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1241 microversion: 2.1 time: 0.135379 Nov 03 04:08:51.826786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1976/3820] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:51 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:51.878883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:51.900145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:51.900664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:51.902739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:51.903501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:51.905727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:51.905982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:51.969197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fc11e717-c3ef-4745-a725-e382483a1325 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "POST /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30/action" status: 202 len: 1138 microversion: 2.54 time: 0.734061 Nov 03 04:08:51.969807 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1845/3821] 10.222.0.30 () {62 vars in 1320 bytes} [Thu Nov 3 04:08:51 2022] POST /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30/action => generated 1138 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 03 04:08:51.999617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:52.000340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:52.012428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:52.013359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:52.013981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:52.018442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:52.018442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:52.018442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:52.068539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:52.069872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:52.084881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:52.085787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:52.086481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:52.087625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:52.088312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:52.088969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:52.185077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:52.205282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:52.215707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:52.217660 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4379b9d1-7286-471e-b8b4-73cbda541aaf tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.227108 Nov 03 04:08:52.223322 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1977/3822] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:51 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:52.383797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:52.394835 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b16ff9f6-8d8f-4b5e-92c6-8ffb20ceea79 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.331340 Nov 03 04:08:52.408698 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1846/3823] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:52 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:52.858793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d73c71fb-ab25-4181-a18f-21f35d694d69 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:52.861217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d73c71fb-ab25-4181-a18f-21f35d694d69 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:52.957596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d73c71fb-ab25-4181-a18f-21f35d694d69 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:52.967998 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d73c71fb-ab25-4181-a18f-21f35d694d69 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1241 microversion: 2.1 time: 0.117823 Nov 03 04:08:52.970745 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1978/3824] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:52 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:53.252611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:53.253970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:53.261789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:53.262816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:53.263526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:53.264460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:53.265172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:53.266316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:53.416714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:53.435773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:53.438205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:53.438837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:53.440276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:53.441808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7dfa9541-695e-4000-b298-19cd170a7a96 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.193100 Nov 03 04:08:53.445161 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1847/3825] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:53 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:53.451514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:53.452009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:53.452963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:53.455562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:53.456042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:53.460749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:53.713572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:53.749820 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ea16444a-3b04-4dc6-99d5-b439d81ce585 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.315325 Nov 03 04:08:53.766508 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1979/3826] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:53 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:08:53.994732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:53.995349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:54.004951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:54.006935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:54.008547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:54.009813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:54.016701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:54.017626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:54.137218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:54.141322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:08:54.146514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f4e2b18e-16ec-421f-89dd-4497af39d06a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1237 microversion: 2.1 time: 0.155610 Nov 03 04:08:54.162683 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1848/3827] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:53 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1237 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:54.477348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:54.478699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:54.490730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:54.496284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:54.497166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:54.498653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:54.500054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:54.500428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:54.748622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:54.779957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:54.780606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:54.793961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:54.797426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:54.798176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:54.798360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:54.799078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:54.799537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:54.800151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:54.800449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:54.801934 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fdadc2d0-7ef8-46d4-9fb5-2b30499e8d70 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.335570 Nov 03 04:08:54.809500 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1980/3828] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:54 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:55.115332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:55.126583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4871baa1-8b27-4aec-9d02-bf3a37eca25e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.350803 Nov 03 04:08:55.127374 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1849/3829] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:54 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:55.172828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:55.173981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:55.184457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:55.185815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:55.186950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:55.187944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:55.189054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:55.189881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:55.213131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ab816d5c-8902-4f72-adf0-d5ea3757e3ed req-c9cc09c8-be03-41c3-af7d-3cd0f5eb92f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-plugged", "status": "completed", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:08:55.241113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ab816d5c-8902-4f72-adf0-d5ea3757e3ed req-c9cc09c8-be03-41c3-af7d-3cd0f5eb92f5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:55.242786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ab816d5c-8902-4f72-adf0-d5ea3757e3ed req-c9cc09c8-be03-41c3-af7d-3cd0f5eb92f5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:55.247701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ab816d5c-8902-4f72-adf0-d5ea3757e3ed req-c9cc09c8-be03-41c3-af7d-3cd0f5eb92f5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:55.280123 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ab816d5c-8902-4f72-adf0-d5ea3757e3ed req-c9cc09c8-be03-41c3-af7d-3cd0f5eb92f5 service nova] Creating event network-vif-plugged:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:08:55.295609 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ab816d5c-8902-4f72-adf0-d5ea3757e3ed req-c9cc09c8-be03-41c3-af7d-3cd0f5eb92f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088671 Nov 03 04:08:55.300689 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1850/3830] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:08:55.361076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:55.385852 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ca47656f-4e54-4253-bec3-b14d64cd1438 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1293 microversion: 2.1 time: 0.218923 Nov 03 04:08:55.387503 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1981/3831] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:55 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1293 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:55.831817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:55.833187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:55.840537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:55.841351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:55.841965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:55.843259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:55.848632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:55.848632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:55.999357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:56.008907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:56.010511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:56.012391 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c93399e6-3d12-4719-b235-53a9e934d8c6 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.186162 Nov 03 04:08:56.026187 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1851/3832] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:55 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:08:56.154708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:56.155188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:56.164388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:56.169327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:56.169327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:56.169327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:56.169327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:56.169327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:56.418248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:56.419387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:56.429344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:56.430036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:56.430667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:56.431587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:56.432278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:56.432911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:56.703566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:56.711898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7fbf639-6c29-4bee-acfc-649a24fe1c33 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1299 microversion: 2.1 time: 0.301024 Nov 03 04:08:56.712487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1852/3833] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:56 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1299 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:57.076144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:57.394326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:57.404315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:57.414234 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0d99e28a-f4aa-476d-b29b-66bbcee682cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 1.264023 Nov 03 04:08:57.418155 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1982/3834] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:56 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:57.421040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:57.422634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:57.424445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-243a9aba-7ef4-4fdf-b16c-9a8fc86ee5e8 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.384945 Nov 03 04:08:57.426179 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1853/3835] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:57 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:08:57.742950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:57.743978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:57.752782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:57.753761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:57.755071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:57.756346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:57.757568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:57.762958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:58.260561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:58.269127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8defa0e8-4f2a-4f82-94b6-df7f7c62adc9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1299 microversion: 2.1 time: 0.530640 Nov 03 04:08:58.269722 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1983/3836] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:57 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1299 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:58.469368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:58.472655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:58.472655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:58.473248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:58.511518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:58.514484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:58.514917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:58.515161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:58.515837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:58.518415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:58.520718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:58.522065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:58.522568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:58.523356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:58.523815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:58.525365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:58.893900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:58.917558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:58.925434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:58.932372 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-075870cd-002e-4a22-b215-f9fc6bb3db32 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.475549 Nov 03 04:08:58.935504 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1984/3837] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:58 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:08:58.992783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:59.008704 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5d72d22-55d4-4ac9-9724-35dd1beda213 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.564442 Nov 03 04:08:59.012533 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1854/3838] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:58 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:59.295863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:59.296773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:59.312672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:59.317736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:59.319591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:59.320375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:59.323938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:59.328434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:59.844868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:08:59.870063 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1bfd85fc-0e1d-4651-b027-210cbe3533a8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.579933 Nov 03 04:08:59.889773 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1985/3839] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:08:59 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:08:59.963826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:08:59.966299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:08:59.979565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:59.980099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:59.984120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:08:59.986044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:08:59.986550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:08:59.986988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:00.035040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:00.035670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:00.054209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:00.054209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:00.054209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:00.054209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:00.054799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:00.065352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:00.395698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:00.414330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:00.419191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:00.419191 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42252d97-dd89-446b-a0b4-5d05eb3ae9b0 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.457579 Nov 03 04:09:00.422879 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1855/3840] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:08:59 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:00.901281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:00.902108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:00.920831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:00.921764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:00.925878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:00.930157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:00.933961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:00.934895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:01.112898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:01.275976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:01.290140 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61f2285b-346e-4e6d-9139-2a2ce41e3b3e tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 1.255084 Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1986/3841] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:00 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:01.545783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:01.806406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:01.807551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:01.830671 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dcac154e-5e3d-4253-b0e6-5dc05d05da96 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.933249 Nov 03 04:09:01.846034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1856/3842] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:00 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:01.846977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:01.858298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:01.864065 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53e67aa4-c98d-408e-a829-bbaa190fb70d tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.415907 Nov 03 04:09:01.869679 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1987/3843] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:01 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:09:02.320997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:02.321753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:02.339747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:02.347113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:02.352293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:02.352293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:02.352293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:02.352293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:02.453598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1226650298", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "6f5610ba-fae8-4a98-acec-896207f07ddb"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:02.592156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] validate_networks() for [('6f5610ba-fae8-4a98-acec-896207f07ddb', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:09:02.962895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=22 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:03.408218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:03.422517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f58f0475-c607-4fac-9f5f-af658f398422 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 1.106669 Nov 03 04:09:03.441481 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1988/3844] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:02 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:03.456937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:03.457806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:03.487387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:03.487895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:03.488347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:03.490025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:03.490519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:03.490961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:04.223193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:04.231299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:04.245305 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc66072f-fa41-4ba0-9019-371e60ea996e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.802248 Nov 03 04:09:04.275136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1989/3845] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:03 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:04.283766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:04.285253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:04.300119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:04.301653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:04.302107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:04.314657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:04.317919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:04.318427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:04.553469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:04.567518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:04.570798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:04.574539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da07c298-2d8a-4c6a-9f36-1185db3d8ab9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.297951 Nov 03 04:09:04.577313 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1990/3846] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:04 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:04.588925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:04.591457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:04.607578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:04.609597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:04.612391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:04.614360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:04.616151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:04.617517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.162545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:09:05.163524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:09:05.164236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:09:05.164915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:09:05.165456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:09:05.181065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:05.181522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:05.182180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:05.187796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.187796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:05.187796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:05.187796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.194843 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abddb872-bfca-42e9-b96b-a6ebb3cb61d4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.614988 Nov 03 04:09:05.217071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1991/3847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:04 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:05.228574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7a6ad433-1533-4fa9-9bf9-f56b5dfcc198 req-53069295-371c-4651-ade4-8cf49e7fccdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ce6fca-a03d-4801-8283-860ebaae7eab", "tag": "5d9f36bb-2e04-4ae1-a0a1-f087046b811f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:05.232094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Getting quotas for project 9e66cf0f0dcc44d787dd964df9f09c0c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:09:05.248656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Getting quotas for user df99f0bacc8e47edbdcf7235603881ad and project 9e66cf0f0dcc44d787dd964df9f09c0c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:09:05.250825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a6ad433-1533-4fa9-9bf9-f56b5dfcc198 req-53069295-371c-4651-ade4-8cf49e7fccdd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:05.250825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a6ad433-1533-4fa9-9bf9-f56b5dfcc198 req-53069295-371c-4651-ade4-8cf49e7fccdd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:05.251244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a6ad433-1533-4fa9-9bf9-f56b5dfcc198 req-53069295-371c-4651-ade4-8cf49e7fccdd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.266510 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7a6ad433-1533-4fa9-9bf9-f56b5dfcc198 req-53069295-371c-4651-ade4-8cf49e7fccdd service nova] Creating event network-changed:5d9f36bb-2e04-4ae1-a0a1-f087046b811f for instance 79ce6fca-a03d-4801-8283-860ebaae7eab on n-h1-854653-7 Nov 03 04:09:05.275106 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7a6ad433-1533-4fa9-9bf9-f56b5dfcc198 req-53069295-371c-4651-ade4-8cf49e7fccdd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056329 Nov 03 04:09:05.278326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:09:05.280685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:09:05.281279 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1992/3848] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:05.290685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:05.291465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:05.307452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:05.308562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:05.312595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.312595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:05.312595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:05.312841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.435762 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6fc5cdf-b681-4634-adfd-e2c20e2e46a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.585710 Nov 03 04:09:05.438554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1857/3849] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:09:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:09:05.450141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9364cbcc-265f-461f-875d-294d2989d2ce tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:05.452038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9364cbcc-265f-461f-875d-294d2989d2ce tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:05.697771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9364cbcc-265f-461f-875d-294d2989d2ce tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:05.712039 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9364cbcc-265f-461f-875d-294d2989d2ce tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1225 microversion: 2.1 time: 0.262997 Nov 03 04:09:05.712676 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1858/3850] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:05 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1225 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:09:05.731895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:05.736278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:05.779125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:05.779659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:05.780163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.781141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:05.781791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:05.782242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:05.986098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:05.997154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:05.998657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:05.999861 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8140f3c7-59e0-4b77-a404-ca0498cf6fb1 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.284331 Nov 03 04:09:06.000612 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1859/3851] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:05 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:06.133528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:06.133528 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a12418d6-8f49-4119-829c-28805c7e3005 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.773048 Nov 03 04:09:06.133528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1993/3852] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:05 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:06.227653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:06.231029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:06.250069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:06.258513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:06.258513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:06.258513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:06.258513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:06.258513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:06.604119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:06.616495 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-423f6eef-f63e-40de-8fed-cc06b4222271 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.395159 Nov 03 04:09:06.634629 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1860/3853] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:06 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:06.738787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-826e8da0-05f9-4f4c-b419-3d4978fef21a tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:06.742290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-826e8da0-05f9-4f4c-b419-3d4978fef21a tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:06.755450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:06.848711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-826e8da0-05f9-4f4c-b419-3d4978fef21a tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:06.860942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-826e8da0-05f9-4f4c-b419-3d4978fef21a tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1225 microversion: 2.1 time: 0.126163 Nov 03 04:09:06.861571 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1994/3854] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:06 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:07.025493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:07.026119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:07.036144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.036646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.037125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:07.041460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.042511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.046383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:07.153480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:07.154112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:07.164056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.172198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.173163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:07.174195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.174675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.175109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:07.179572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:07.204617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:07.208132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:07.214368 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2480203f-3a07-4569-8203-1be599878dc9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.188859 Nov 03 04:09:07.216863 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1861/3855] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:07 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:07.459094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:07.471477 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c1150a20-75d0-4ae6-8499-99e334d96341 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.322516 Nov 03 04:09:07.486197 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1995/3856] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:07 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:07.652474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:07.654117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:07.661928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.662422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.662858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:07.663598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.664047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.664615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:07.862359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:07.875624 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04b0c3e6-d716-452c-8661-ad319d3de0a3 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.231754 Nov 03 04:09:07.890073 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1862/3857] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:07 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:07.891348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:07.892388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:07.909424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.911251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.912279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:07.916131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:07.917594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:07.919583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:08.037193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:08.048818 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-794d566c-ccf9-4782-8fe4-68766c6be3d4 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1229 microversion: 2.1 time: 0.164372 Nov 03 04:09:08.053430 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1996/3858] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:07 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1229 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:09:08.248265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:08.249302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:08.274975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:08.276170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:08.277811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:08.280450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:08.281718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:08.282173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:08.414614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:08.426006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:08.427458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:08.428640 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-97aeaf4c-b916-46d9-b47c-6bc9c0132072 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.187146 Nov 03 04:09:08.438943 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1863/3859] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:08 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:08.507844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:08.509375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:08.525652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:08.526981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:08.550189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:08.555392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:08.556062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:08.556660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:08.908416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:08.909064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:08.929032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:08.929814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:08.930420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:08.931131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:08.931736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:08.932325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:09.436050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:09.445067 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01e1676f-65c5-407d-adfc-bb077f21270c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.942071 Nov 03 04:09:09.448986 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1997/3860] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:08 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:09.476332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:09.477365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:09.488648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:09.491456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:09.492097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:09.492976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:09.501084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:09.501772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:09.522458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:09.532264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9336b5bf-9743-46f8-bf2e-d272a1c328fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.627631 Nov 03 04:09:09.532842 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1864/3861] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:08 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:09:09.555256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:09.563764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:09.582490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:09.583288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:09.584071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:09.584969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:09.585704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:09.586347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:09.647255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:09.666693 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-62635894-defe-4a68-bcf8-3c0bfbea5ecc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1285 microversion: 2.1 time: 0.216285 Nov 03 04:09:09.682275 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1998/3862] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:09 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:09.690310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:09.705956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:09.708756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:09.710718 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-120e1858-6942-4e37-bc4e-f243518f0439 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.159381 Nov 03 04:09:09.715039 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1865/3863] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:09 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:10.474833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:10.475724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:10.487471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:10.499082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:10.499541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:10.500746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:10.501889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:10.502529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:10.570910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:10.572387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:10.580018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:10.593405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:10.598592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:10.598592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:10.605660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:10.612180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:11.114206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:11.130583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7f0a049-8fdc-4609-b206-0a27f47f20c7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.573740 Nov 03 04:09:11.145835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1866/3864] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:10 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:11.161735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:11.163591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:11.181591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:11.184778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:11.185646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:11.187130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:11.215748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:11.215748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:11.219312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:11.227427 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1034f51-411e-4173-9eaa-121c95cfe3a2 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.757463 Nov 03 04:09:11.240391 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 1999/3865] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:10 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:11.246105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:11.263319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:11.280715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:11.281400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:11.282042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:11.283927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:11.284687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:11.285426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:11.422800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:11.422800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:11.422800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:11.422800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e99119e-cbbd-4bfd-9b08-954dd7df6c6b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.171244 Nov 03 04:09:11.422800 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2000/3866] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:11 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:11.461865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:11.465965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:11.470462 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-325d2368-1a2d-4d13-b4f7-8a2467bc3390 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 0.320792 Nov 03 04:09:11.471028 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1867/3867] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:11 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:12.166144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:12.167874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:12.188901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.189528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.190025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.190820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.193926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.194464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.269060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:12.270449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:12.280583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:12.287704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.288498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.289206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.291734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.292455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.293697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.587756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:12.601465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9ddc1d3-cbb6-4acc-9917-bfaf33ed8325 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1735 microversion: 2.1 time: 0.444628 Nov 03 04:09:12.602591 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2001/3868] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:12 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1735 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:12.607333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:12.608117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:12.614766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.615441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.616040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.616864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.617478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.618220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.630963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:12.639427 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47fe9e42-553b-4c38-8fbc-6534d968bf19 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.375038 Nov 03 04:09:12.640323 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1868/3869] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:12 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:12.651762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:12.659305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:12.667339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.667339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.667757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.668472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:12.668965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:12.669418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:12.815917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:12.834218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:12.842041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:12.845911 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12da7b43-1f07-4959-8ff4-81de5b0b4956 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.240837 Nov 03 04:09:12.848144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2002/3870] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:12 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:12.970053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:12.977878 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed8b3960-8aa5-43c1-99df-f5ee9716b0a5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 0.336217 Nov 03 04:09:12.983212 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1869/3871] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:12 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:13.399884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-de933174-3c0a-4a9f-a80c-82ec498866a2 req-0018eeed-ffbd-4fdc-a85a-e764394597d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5f4c01-32f7-4593-b8d8-4579e23f7f18", "tag": "c47e3ff0-d1a7-481f-971f-650b701a751d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:13.419937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-de933174-3c0a-4a9f-a80c-82ec498866a2 req-0018eeed-ffbd-4fdc-a85a-e764394597d9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:13.420424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-de933174-3c0a-4a9f-a80c-82ec498866a2 req-0018eeed-ffbd-4fdc-a85a-e764394597d9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:13.420866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-de933174-3c0a-4a9f-a80c-82ec498866a2 req-0018eeed-ffbd-4fdc-a85a-e764394597d9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:13.630322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:13.633537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:13.646830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:13.647670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:13.649176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:13.656479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:13.656479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:13.656479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:13.992385 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-de933174-3c0a-4a9f-a80c-82ec498866a2 req-0018eeed-ffbd-4fdc-a85a-e764394597d9 service nova] Creating event network-changed:c47e3ff0-d1a7-481f-971f-650b701a751d for instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 on n-h2-854653-7 Nov 03 04:09:14.003209 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-de933174-3c0a-4a9f-a80c-82ec498866a2 req-0018eeed-ffbd-4fdc-a85a-e764394597d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.609367 Nov 03 04:09:14.006999 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2003/3872] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:14.018814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:14.019537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:14.039166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.041903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.042628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.043508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.046234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.046842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.441502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:14.457229 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e13b0c0-f639-4f9a-8cee-4d88560c5a8c tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1715 microversion: 2.1 time: 0.830541 Nov 03 04:09:14.469040 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1870/3873] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:13 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1715 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:14.471399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:14.472655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:14.509496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.509993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.510487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.511191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.519997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.520451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.614189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:14.630596 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad67aab8-8d9b-4239-9d40-442513403f6d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 0.622281 Nov 03 04:09:14.638269 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2004/3874] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:14 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:14.664531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-fe2b3af8-ca54-4a48-a97d-6fbed302078b req-a3c60ffc-d2cf-45f0-bcb9-42b79d6c2491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ce6fca-a03d-4801-8283-860ebaae7eab", "name": "network-vif-plugged", "status": "completed", "tag": "5d9f36bb-2e04-4ae1-a0a1-f087046b811f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:14.701274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fe2b3af8-ca54-4a48-a97d-6fbed302078b req-a3c60ffc-d2cf-45f0-bcb9-42b79d6c2491 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.702113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fe2b3af8-ca54-4a48-a97d-6fbed302078b req-a3c60ffc-d2cf-45f0-bcb9-42b79d6c2491 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.702692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fe2b3af8-ca54-4a48-a97d-6fbed302078b req-a3c60ffc-d2cf-45f0-bcb9-42b79d6c2491 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.722095 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-fe2b3af8-ca54-4a48-a97d-6fbed302078b req-a3c60ffc-d2cf-45f0-bcb9-42b79d6c2491 service nova] Creating event network-vif-plugged:5d9f36bb-2e04-4ae1-a0a1-f087046b811f for instance 79ce6fca-a03d-4801-8283-860ebaae7eab on n-h1-854653-7 Nov 03 04:09:14.725892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:14.728334 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-fe2b3af8-ca54-4a48-a97d-6fbed302078b req-a3c60ffc-d2cf-45f0-bcb9-42b79d6c2491 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087876 Nov 03 04:09:14.730277 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2005/3875] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:14.742054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:14.743312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:14.746557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:14.753487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.754208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.754839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.755720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.756331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.756971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.769125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:14.814903 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-feaa24f0-2e86-4968-8fb1-92e05d5e1cc2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.321393 Nov 03 04:09:14.815541 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1871/3876] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:14 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:14.831392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:14.832151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:14.848548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.849388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.849836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:14.850554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:14.851049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:14.851445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.085460 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Cannot 'detach_volume' instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c while it is in vm_state rescued Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments/8b577ece-bb3a-4c38-bbf5-e381333423da HTTP/1.1 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'detach_volume' instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c while it is in vm_state rescued Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '8b801e36-fff6-415b-a737-cc3e1bbfff8c', 'id': '8b577ece-bb3a-4c38-bbf5-e381333423da'} Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c while it is in vm_state rescued Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:15.087505 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:15.092693 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:15.092693 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:15.092693 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:09:15.092693 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:09:15.092693 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c while it is in vm_state rescued Nov 03 04:09:15.092693 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:15.094670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 409 to user: Cannot 'detach_volume' instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c while it is in vm_state rescued {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:09:15.095764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b3aa8b9-6b66-4a8c-905c-4c937b9860e1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments/8b577ece-bb3a-4c38-bbf5-e381333423da" status: 409 len: 152 microversion: 2.1 time: 0.268394 Nov 03 04:09:15.096855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1872/3877] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:09:14 2022] DELETE /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments/8b577ece-bb3a-4c38-bbf5-e381333423da => generated 152 bytes in 272 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:09:15.122348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:15.122923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:15.140800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.141450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.144849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.147037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.147037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.147252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.187995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:15.195667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:15.210798 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e2c2c9d8-be68-438f-af9f-ba1786f1d4be tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 0.478734 Nov 03 04:09:15.220082 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2006/3878] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:14 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:15.449814 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cb33f9ff-bd7e-4ee7-b032-b4ee288a29f1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/action" status: 202 len: 0 microversion: 2.1 time: 0.338135 Nov 03 04:09:15.450628 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1873/3879] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:09:15 2022] POST /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:09:15.466832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:15.467706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:15.476768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.477615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.478266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.479043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.480313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.480937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.669756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:15.670860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:15.694824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.698398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.704782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.710187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.712391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.719221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.722066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:15.772498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:15.785070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82f90920-88e7-4f34-8af5-7747daef0c30 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1723 microversion: 2.1 time: 0.329736 Nov 03 04:09:15.797141 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2007/3880] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:15 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:15.847840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:15.848640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:15.870714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.871230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.871673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:15.872466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:15.872882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:15.873508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:16.356298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:16.367106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:16.378999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:16.380501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5aee182-476a-4cde-bebd-861a9778de9b tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.536641 Nov 03 04:09:16.381578 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2008/3881] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:15 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:09:16.397908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:16.398743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:16.410628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:16.411127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:16.411576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:16.412294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:16.412755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:16.413424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:16.462463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:16.791530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:16.800745 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40adbc40-0c03-4110-9639-8253a3bd879f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1367 microversion: 2.1 time: 1.137206 Nov 03 04:09:16.801900 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1874/3882] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:15 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1367 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:09:16.821777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:16.825547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:16.832034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:16.832749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:16.833372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:16.834233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:16.834841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:16.835422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:16.852986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:17.227002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:17.255326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e477e72-2d0c-4390-8487-6378682999a8 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 0.858955 Nov 03 04:09:17.256070 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2009/3883] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:16 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:17.408007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:17.413472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:17.426940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:17.427456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:17.427905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:17.428635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:17.429128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:17.429564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:17.501913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:17.513061 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-075be9b3-4cc6-4462-8d3e-1aa827289cf0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1723 microversion: 2.1 time: 0.694649 Nov 03 04:09:17.513738 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1875/3884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:16 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1723 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:17.557159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:17.566448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:17.568189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:17.569438 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6658b94f-9b64-4c19-ae5f-4c67501785d9 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1407 microversion: 2.54 time: 0.165435 Nov 03 04:09:17.570156 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2010/3885] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:17 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:09:17.830387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:17.832478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:17.840798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:17.846536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:17.846536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:17.846536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:17.846536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:17.846536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:18.044108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:18.055398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10c7d38c-abb8-4d3c-a3e4-5c22ca175d18 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1556 microversion: 2.1 time: 0.227447 Nov 03 04:09:18.055398 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1876/3886] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:17 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1556 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:18.077128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:18.077880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:18.084665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:18.085399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:18.086000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:18.086718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:18.089741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:18.089741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:18.173537 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cb2a41b1-9103-4d51-908b-5e39c13da9a9 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100878 Nov 03 04:09:18.174140 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2011/3887] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:09:18 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:09:18.294597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:18.296867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:18.316410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:18.317865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:18.318516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:18.320011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:18.322292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:18.326060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:18.540795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:18.541484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:18.558390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:18.559403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:18.559403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:18.560049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:18.560518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:18.560953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:19.286718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-397adc36-5183-44a0-986c-f93f200c94f0 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1723 microversion: 2.1 time: 0.762152 Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2012/3888] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:18 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1723 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:19.327503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:19.368814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:19.381070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7a5300b-8077-459b-93fe-b6f2a9c7d9d5 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 1.095562 Nov 03 04:09:19.382236 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1877/3889] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:18 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:19.443520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:19.465585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:19.468198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:19.470059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-106a92b3-e61f-4273-bc52-1342fd56ecb2 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1425 microversion: 2.54 time: 0.168753 Nov 03 04:09:19.471309 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2013/3890] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:19 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1425 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:20.325595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:20.326226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:20.333899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.334409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.334853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.335571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.336323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.336760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.406185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:20.407406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:20.417265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.418063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.418700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.419600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.420465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.442310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.624637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:20.654901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48dfb5b5-9340-44bb-9480-7f159789dceb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1723 microversion: 2.1 time: 0.334464 Nov 03 04:09:20.656743 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1878/3891] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:20 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:20.665106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:20.666686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:20.681653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.682970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.683420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.684324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.684792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.685258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.742230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:20.756186 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18825c77-a09e-4949-b5ab-c7b85ed60e43 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 0.353805 Nov 03 04:09:20.757106 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2014/3892] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:20 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:20.762853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:20.763737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:20.770577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.771284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.771868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.772789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.773543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.774342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.862347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:20.886591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:20.888106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:20.889357 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41976e5c-31b4-496b-8463-1369cd0f31b7 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1413 microversion: 2.54 time: 0.131053 Nov 03 04:09:20.889915 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2015/3893] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:20 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:20.914331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:20.924186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-90e0ca14-3e89-48ee-8c24-f6cf651ed747 req-6f57fdda-97ed-44a3-bb60-3e6ab3a3fcaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ce6fca-a03d-4801-8283-860ebaae7eab", "tag": "5d9f36bb-2e04-4ae1-a0a1-f087046b811f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:20.937539 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-17343610-4476-4475-bea9-f13025ce9220 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.275953 Nov 03 04:09:20.937714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-90e0ca14-3e89-48ee-8c24-f6cf651ed747 req-6f57fdda-97ed-44a3-bb60-3e6ab3a3fcaf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:20.937830 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1879/3894] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:20 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:20.937916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-90e0ca14-3e89-48ee-8c24-f6cf651ed747 req-6f57fdda-97ed-44a3-bb60-3e6ab3a3fcaf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:20.937916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-90e0ca14-3e89-48ee-8c24-f6cf651ed747 req-6f57fdda-97ed-44a3-bb60-3e6ab3a3fcaf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:20.953846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-90e0ca14-3e89-48ee-8c24-f6cf651ed747 req-6f57fdda-97ed-44a3-bb60-3e6ab3a3fcaf service nova] Creating event network-changed:5d9f36bb-2e04-4ae1-a0a1-f087046b811f for instance 79ce6fca-a03d-4801-8283-860ebaae7eab on n-h1-854653-7 Nov 03 04:09:20.959023 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-90e0ca14-3e89-48ee-8c24-f6cf651ed747 req-6f57fdda-97ed-44a3-bb60-3e6ab3a3fcaf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052869 Nov 03 04:09:20.959848 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2016/3895] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:21.681416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:21.682681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:21.690033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:21.690852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:21.691532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:21.692451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:21.693145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:21.693790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:21.782965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:21.784459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:21.791269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:21.791963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:21.792652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:21.793475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:21.794006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:21.794505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.139808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:22.150335 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcb0b0c8-8132-4704-b508-94caa9394e68 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1729 microversion: 2.1 time: 0.472645 Nov 03 04:09:22.152208 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1880/3896] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:21 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1729 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:22.157181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-35d4c8db-7d72-491c-b82a-6a23b4a27dcd req-a414862f-453a-412d-bb19-96d2c8f8426f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5f4c01-32f7-4593-b8d8-4579e23f7f18", "name": "network-vif-plugged", "status": "completed", "tag": "c47e3ff0-d1a7-481f-971f-650b701a751d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:22.169783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-35d4c8db-7d72-491c-b82a-6a23b4a27dcd req-a414862f-453a-412d-bb19-96d2c8f8426f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.170621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-35d4c8db-7d72-491c-b82a-6a23b4a27dcd req-a414862f-453a-412d-bb19-96d2c8f8426f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.170891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:22.171102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-35d4c8db-7d72-491c-b82a-6a23b4a27dcd req-a414862f-453a-412d-bb19-96d2c8f8426f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.179210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-49923bb0-b1ca-49b1-9797-07e461a1f8a2 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 0.401229 Nov 03 04:09:22.180054 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2017/3897] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:21 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:09:22.184950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:22.185589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:22.191241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-35d4c8db-7d72-491c-b82a-6a23b4a27dcd req-a414862f-453a-412d-bb19-96d2c8f8426f service nova] Creating event network-vif-plugged:c47e3ff0-d1a7-481f-971f-650b701a751d for instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 on n-h2-854653-7 Nov 03 04:09:22.191938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.192590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.193240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.193952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.194445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.194835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.202187 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-35d4c8db-7d72-491c-b82a-6a23b4a27dcd req-a414862f-453a-412d-bb19-96d2c8f8426f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043600 Nov 03 04:09:22.202187 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1881/3898] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:22.204657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:22.213923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:22.228223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.230235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.230703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.231440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.231909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.232343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.314215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:22.324159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bfe72d27-a266-405b-943e-ddb3289db69e tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1398 microversion: 2.54 time: 0.145860 Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2018/3899] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:22 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1398 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.345356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.568559 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-503253f5-9800-49e3-b690-cbf03546b2bd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.238039 Nov 03 04:09:22.570082 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2019/3900] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:09:22 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-interface => generated 285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:22.578246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98c25e20-cb88-4a6e-a972-9067cf690e5a tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '.version_select at 0x7ff7f8581670>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:22.675943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:22.685033 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-515228dc-1080-44b3-ba49-2f302ad8b897 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.485521 Nov 03 04:09:22.698894 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1882/3901] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:22 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:22.710660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-745999760"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:22.714025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:22.721406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.721907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.722390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.723286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.723570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.724006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.801647 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98c25e20-cb88-4a6e-a972-9067cf690e5a tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-786742133" status: 204 len: 0 microversion: 2.54 time: 0.229789 Nov 03 04:09:22.803484 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2020/3902] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 04:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-786742133 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:09:22.825643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:22.828798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:22.854398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.854927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.855380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.856126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:22.861000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:22.864174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:22.917625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:09:23.051277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:23.262690 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-372d6248-1274-490b-9315-21e5c411b9ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.555635 Nov 03 04:09:23.264822 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1883/3903] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:09:22 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 03 04:09:23.321503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:23.324939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:23.336093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:23.337078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:23.337822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:23.338932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:23.339725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:23.340318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e08826b0-ab97-49dc-b435-fa6a502d183f tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "DELETE /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 204 len: 0 microversion: 2.54 time: 0.536848 Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2021/3904] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:09:22 2022] DELETE /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:23.724117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:23.735664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:23.735664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd275e8b-0c41-49fb-afb4-0ffe7df024fc tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1404 microversion: 2.54 time: 0.191236 Nov 03 04:09:23.735664 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2022/3905] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:23 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1404 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:23.737897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:23.737897 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f35ac42a-ed54-4316-ada1-c4e5a6d40a55 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1325 microversion: 2.1 time: 0.388013 Nov 03 04:09:23.737897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1884/3906] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:23 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:24.395864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-02180ac3-cb43-4b3f-9037-fb6e09480cf6 req-6f302115-56b8-44f4-83ee-96006d0932fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b801e36-fff6-415b-a737-cc3e1bbfff8c", "tag": "91b7c3b9-1d33-48ec-8a3d-cdd8320b5231"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:24.442579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-02180ac3-cb43-4b3f-9037-fb6e09480cf6 req-6f302115-56b8-44f4-83ee-96006d0932fe service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:24.442579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-02180ac3-cb43-4b3f-9037-fb6e09480cf6 req-6f302115-56b8-44f4-83ee-96006d0932fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:24.442579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-02180ac3-cb43-4b3f-9037-fb6e09480cf6 req-6f302115-56b8-44f4-83ee-96006d0932fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:24.458282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-02180ac3-cb43-4b3f-9037-fb6e09480cf6 req-6f302115-56b8-44f4-83ee-96006d0932fe service nova] Creating event network-changed:91b7c3b9-1d33-48ec-8a3d-cdd8320b5231 for instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c on n-h1-854653-7 Nov 03 04:09:24.466199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-02180ac3-cb43-4b3f-9037-fb6e09480cf6 req-6f302115-56b8-44f4-83ee-96006d0932fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075723 Nov 03 04:09:24.468122 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2023/3907] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:24.605371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:24.605983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:24.625682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:24.628385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:24.628986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:24.629780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:24.630476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:24.631936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:24.682452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:24.683481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:24.696072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:24.697998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:24.698643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:24.699883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:24.701356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:24.705068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:24.757364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:24.771784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:24.771784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:24.772917 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ad7d753-80dd-4b7a-b0f5-7c7e0d148814 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1404 microversion: 2.54 time: 0.172773 Nov 03 04:09:24.774072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1885/3908] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:24 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:25.336788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:25.346963 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-882b62e0-ed26-4dd6-a863-968e8a93e613 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1521 microversion: 2.1 time: 0.670389 Nov 03 04:09:25.347875 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2024/3909] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:24 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1521 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:25.373193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:25.380596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:25.386694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.389910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.390752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.391665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.392286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.392880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.437717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] HTTP exception thrown: Action 999 not found Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Request method failure captured: Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18/os-instance-actions/999 HTTP/1.1 Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz7d82hPpCEe4CqEu5W3mYqj5iIR-mD_xOJPqeKv24dz8RryNWDpK0um2dMrjsS_oFlEmoR8cSXZ_1yqQOwbgnqZfjfEVPM5IiuUgFwdFdq8iYzicsps1-FAtDnEYrOiquzSX85-UZxeQQU0hOF9_WeeoP37WV8Cy7wJw39odDuC1XM Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 9e66cf0f0dcc44d787dd964df9f09c0c Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e66cf0f0dcc44d787dd964df9f09c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9e66cf0f0dcc44d787dd964df9f09c0c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e66cf0f0dcc44d787dd964df9f09c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9e66cf0f0dcc44d787dd964df9f09c0c"}]}] Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 9e66cf0f0dcc44d787dd964df9f09c0c Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-InstanceActionsNegativeTestJSON-934237250-project Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: df99f0bacc8e47edbdcf7235603881ad Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-934237250-project Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: exception: Action 999 not found Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '7e5f4c01-32f7-4593-b8d8-4579e23f7f18', 'id': '999'} Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Nov 03 04:09:25.446744 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.452794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Returning 404 to user: Action 999 not found {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:09:25.452794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ec9aaa7-6512-47f4-b713-92afe979c3bc tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.080840 Nov 03 04:09:25.455286 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1886/3910] 10.222.0.30 () {58 vars in 1308 bytes} [Thu Nov 3 04:09:25 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18/os-instance-actions/999 => generated 66 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:09:25.463236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f53d5f7f-c69f-4fb0-aad7-dca366ab315c tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '.version_select at 0x7ff7fd5d58b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:25.463720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f53d5f7f-c69f-4fb0-aad7-dca366ab315c tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 1e9b1ff8-5a4d-4afb-842f-4d20b185a74b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:25.470851 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f53d5f7f-c69f-4fb0-aad7-dca366ab315c tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] HTTP exception thrown: Instance 1e9b1ff8-5a4d-4afb-842f-4d20b185a74b could not be found. Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f53d5f7f-c69f-4fb0-aad7-dca366ab315c tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Request method failure captured: Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/1e9b1ff8-5a4d-4afb-842f-4d20b185a74b/os-instance-actions HTTP/1.1 Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz7d82hPpCEe4CqEu5W3mYqj5iIR-mD_xOJPqeKv24dz8RryNWDpK0um2dMrjsS_oFlEmoR8cSXZ_1yqQOwbgnqZfjfEVPM5IiuUgFwdFdq8iYzicsps1-FAtDnEYrOiquzSX85-UZxeQQU0hOF9_WeeoP37WV8Cy7wJw39odDuC1XM Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 9e66cf0f0dcc44d787dd964df9f09c0c Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e66cf0f0dcc44d787dd964df9f09c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9e66cf0f0dcc44d787dd964df9f09c0c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e66cf0f0dcc44d787dd964df9f09c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9e66cf0f0dcc44d787dd964df9f09c0c"}]}] Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 9e66cf0f0dcc44d787dd964df9f09c0c Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-InstanceActionsNegativeTestJSON-934237250-project Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: df99f0bacc8e47edbdcf7235603881ad Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-934237250-project Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 1e9b1ff8-5a4d-4afb-842f-4d20b185a74b could not be found. Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': '1e9b1ff8-5a4d-4afb-842f-4d20b185a74b'} Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9b1ff8-5a4d-4afb-842f-4d20b185a74b could not be found. Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:09:25.473317 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9b1ff8-5a4d-4afb-842f-4d20b185a74b could not be found. Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9b1ff8-5a4d-4afb-842f-4d20b185a74b could not be found. Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f53d5f7f-c69f-4fb0-aad7-dca366ab315c tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Returning 404 to user: Instance 1e9b1ff8-5a4d-4afb-842f-4d20b185a74b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:09:25.477043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f53d5f7f-c69f-4fb0-aad7-dca366ab315c tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/1e9b1ff8-5a4d-4afb-842f-4d20b185a74b/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015680 Nov 03 04:09:25.480718 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2025/3911] 10.222.0.30 () {58 vars in 1296 bytes} [Thu Nov 3 04:09:25 2022] GET /compute/v2.1/servers/1e9b1ff8-5a4d-4afb-842f-4d20b185a74b/os-instance-actions => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:09:25.495045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:25.495672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:25.503710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.504213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.504657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.505396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.505947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.506888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.571035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:09:25.665291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2fd9b544-0fe3-4299-b0e7-49baee713a29 req-d0b5c075-e4a7-4f64-930b-3012c66af76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-unplugged", "status": "completed", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:25.695542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2fd9b544-0fe3-4299-b0e7-49baee713a29 req-d0b5c075-e4a7-4f64-930b-3012c66af76e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.696965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2fd9b544-0fe3-4299-b0e7-49baee713a29 req-d0b5c075-e4a7-4f64-930b-3012c66af76e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.697954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2fd9b544-0fe3-4299-b0e7-49baee713a29 req-d0b5c075-e4a7-4f64-930b-3012c66af76e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.731731 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2fd9b544-0fe3-4299-b0e7-49baee713a29 req-d0b5c075-e4a7-4f64-930b-3012c66af76e service nova] Creating event network-vif-unplugged:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:09:25.741959 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2fd9b544-0fe3-4299-b0e7-49baee713a29 req-d0b5c075-e4a7-4f64-930b-3012c66af76e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088354 Nov 03 04:09:25.743030 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2026/3912] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:25.802357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:25.803453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:25.821130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.821130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.821130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.821130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.821130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.821130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.882827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:25.883619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:25.884312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:25.885472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lazy-loading 'fault' on Instance uuid 650acdab-4623-415c-9fb5-6a8705cdcf30 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:09:25.958110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:25.978341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:25.980645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:25.983181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4a163552-a825-48d0-a27c-74683c7298b4 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1409 microversion: 2.54 time: 0.187615 Nov 03 04:09:25.999002 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2027/3913] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:25 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1409 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:26.017967 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f2fb94e-9327-439c-b128-b9991eebe4a1 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 204 len: 0 microversion: 2.1 time: 0.527841 Nov 03 04:09:26.018862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1887/3914] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:09:25 2022] DELETE /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:09:26.039803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:26.041142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:26.053563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:26.053563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:26.054046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:26.057487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:26.058340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:26.059019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:26.211997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:26.232525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:26.245171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-640c019c-8e99-4671-96ee-e46ab8e198d6 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1527 microversion: 2.1 time: 0.215204 Nov 03 04:09:26.246077 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2028/3915] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:26 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1527 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:26.497234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6ef4a949-90d5-483b-8775-dbf0798f8267 req-85d40f74-5113-4c00-85d3-d04a5783098a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b801e36-fff6-415b-a737-cc3e1bbfff8c", "tag": "91b7c3b9-1d33-48ec-8a3d-cdd8320b5231"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:26.513994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ef4a949-90d5-483b-8775-dbf0798f8267 req-85d40f74-5113-4c00-85d3-d04a5783098a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:26.514454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ef4a949-90d5-483b-8775-dbf0798f8267 req-85d40f74-5113-4c00-85d3-d04a5783098a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:26.514853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ef4a949-90d5-483b-8775-dbf0798f8267 req-85d40f74-5113-4c00-85d3-d04a5783098a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:26.562104 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6ef4a949-90d5-483b-8775-dbf0798f8267 req-85d40f74-5113-4c00-85d3-d04a5783098a service nova] Creating event network-changed:91b7c3b9-1d33-48ec-8a3d-cdd8320b5231 for instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c on n-h1-854653-7 Nov 03 04:09:26.562104 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6ef4a949-90d5-483b-8775-dbf0798f8267 req-85d40f74-5113-4c00-85d3-d04a5783098a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065197 Nov 03 04:09:26.562104 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1888/3916] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:27.013709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:27.014897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:27.025955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:27.028161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:27.028161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:27.028161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:27.028664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:27.029260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:27.072602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:27.073550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:27.074235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:27.075179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lazy-loading 'fault' on Instance uuid 650acdab-4623-415c-9fb5-6a8705cdcf30 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:09:27.134397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:27.145515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:27.147069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e033b58eb60e4e3dac2fd92c1143bde4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f79bd31cb41fd8b655a42d4fac6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:27.148297 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-944fb2bf-ffa5-4498-874d-767bf7ae9971 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 200 len: 1409 microversion: 2.54 time: 0.138736 Nov 03 04:09:27.149104 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2029/3917] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:27 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:09:27.270754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:27.271562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:27.279198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:27.279787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:27.280305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:27.281041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:27.281505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:27.281942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:27.431644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:27.439952 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c92e86ac-25ce-412d-9fdf-88141b4ba310 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1527 microversion: 2.1 time: 0.175365 Nov 03 04:09:27.440533 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1889/3918] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:27 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1527 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:28.178290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:28.178906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] [instance: 650acdab-4623-415c-9fb5-6a8705cdcf30] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:28.202797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:28.206195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:28.206742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:28.207549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:28.208192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:28.208819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:28.240090 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] HTTP exception thrown: Instance 650acdab-4623-415c-9fb5-6a8705cdcf30 could not be found. Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Request method failure captured: Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 HTTP/1.1 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz7JAKiMb5VoX6REQ59Gi2wtgAnSyjpoHUX1IPBFf4F3NbONiE1Kbniv5TBoqea2SUOHBx5W8fwcehIXQZw7RVF19IwTcAAS_ygYM0XjYGRp8ewcr5aZsO_smm_6vxwuucUhoqs-m654iENnjCPxklSN6vI8Etm6f0G-LDLPF28yQNs Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.54 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0b9f79bd31cb41fd8b655a42d4fac6ac Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerShowV254Test-1155184627 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b9f79bd31cb41fd8b655a42d4fac6ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0b9f79bd31cb41fd8b655a42d4fac6ac", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0b9f79bd31cb41fd8b655a42d4fac6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0b9f79bd31cb41fd8b655a42d4fac6ac"}]}] Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerShowV254Test-1155184627 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0b9f79bd31cb41fd8b655a42d4fac6ac Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerShowV254Test-1155184627 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerShowV254Test-1155184627-project Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: e033b58eb60e4e3dac2fd92c1143bde4 Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerShowV254Test-1155184627-project Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 650acdab-4623-415c-9fb5-6a8705cdcf30 could not be found. Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '650acdab-4623-415c-9fb5-6a8705cdcf30'} Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650acdab-4623-415c-9fb5-6a8705cdcf30 could not be found. Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650acdab-4623-415c-9fb5-6a8705cdcf30 could not be found. Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:28.241817 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650acdab-4623-415c-9fb5-6a8705cdcf30 could not be found. Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] Returning 404 to user: Instance 650acdab-4623-415c-9fb5-6a8705cdcf30 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd70d3cd-5817-46a9-b2cf-63815a058288 tempest-ServerShowV254Test-1155184627 tempest-ServerShowV254Test-1155184627-project] 10.222.0.30 "GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30" status: 404 len: 111 microversion: 2.54 time: 0.069795 Nov 03 04:09:28.250009 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2030/3919] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:09:28 2022] GET /compute/v2.1/servers/650acdab-4623-415c-9fb5-6a8705cdcf30 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:09:28.312546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-08bbe4e3-6fab-4bcf-93ce-63f0d10df5bb req-82a10efc-1c80-49c3-88e8-86278d67cf1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5f4c01-32f7-4593-b8d8-4579e23f7f18", "name": "network-vif-deleted", "tag": "c47e3ff0-d1a7-481f-971f-650b701a751d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:28.324041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-08bbe4e3-6fab-4bcf-93ce-63f0d10df5bb req-82a10efc-1c80-49c3-88e8-86278d67cf1b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:28.324617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-08bbe4e3-6fab-4bcf-93ce-63f0d10df5bb req-82a10efc-1c80-49c3-88e8-86278d67cf1b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:28.325148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-08bbe4e3-6fab-4bcf-93ce-63f0d10df5bb req-82a10efc-1c80-49c3-88e8-86278d67cf1b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:28.337543 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-08bbe4e3-6fab-4bcf-93ce-63f0d10df5bb req-82a10efc-1c80-49c3-88e8-86278d67cf1b service nova] Creating event network-vif-deleted:c47e3ff0-d1a7-481f-971f-650b701a751d for instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 on n-h2-854653-7 Nov 03 04:09:28.343568 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-08bbe4e3-6fab-4bcf-93ce-63f0d10df5bb req-82a10efc-1c80-49c3-88e8-86278d67cf1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036817 Nov 03 04:09:28.344479 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1890/3920] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:09:28.464287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:28.464955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:28.471624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:28.472513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:28.473625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:28.474822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:28.475491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:28.476135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:28.576635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:28.592901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87b05797-fde4-4426-b1b9-90674e6c7cfd tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1310 microversion: 2.1 time: 0.133507 Nov 03 04:09:28.593746 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2031/3921] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:28 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:29.617455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:29.618272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:29.626224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:29.626770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:29.627208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:29.627917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:29.628375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:29.628804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:29.664897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:29.665547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:29.665929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:29.666387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lazy-loading 'fault' on Instance uuid 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:09:29.712526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df99f0bacc8e47edbdcf7235603881ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e66cf0f0dcc44d787dd964df9f09c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:29.729564 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b2b194b-b4df-4074-b7bd-7274a43aae4d tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 200 len: 1315 microversion: 2.1 time: 0.116641 Nov 03 04:09:29.733700 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1891/3922] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:29 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 1315 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:30.756437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:30.758067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] [instance: 7e5f4c01-32f7-4593-b8d8-4579e23f7f18] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:30.771292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:30.771991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:30.772596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:30.773520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:30.774134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:30.774828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:30.790542 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] HTTP exception thrown: Instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 could not be found. Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Request method failure captured: Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 HTTP/1.1 Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz7d82hPpCEe4CqEu5W3mYqj5iIR-mD_xOJPqeKv24dz8RryNWDpK0um2dMrjsS_oFlEmoR8cSXZ_1yqQOwbgnqZfjfEVPM5IiuUgFwdFdq8iYzicsps1-FAtDnEYrOiquzSX85-UZxeQQU0hOF9_WeeoP37WV8Cy7wJw39odDuC1XM Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 9e66cf0f0dcc44d787dd964df9f09c0c Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e66cf0f0dcc44d787dd964df9f09c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9e66cf0f0dcc44d787dd964df9f09c0c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9e66cf0f0dcc44d787dd964df9f09c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9e66cf0f0dcc44d787dd964df9f09c0c"}]}] Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 9e66cf0f0dcc44d787dd964df9f09c0c Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-934237250 Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-InstanceActionsNegativeTestJSON-934237250-project Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: df99f0bacc8e47edbdcf7235603881ad Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-934237250-project Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 could not be found. Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7e5f4c01-32f7-4593-b8d8-4579e23f7f18'} Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 could not be found. Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 could not be found. Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:30.792621 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 could not be found. Nov 03 04:09:30.796405 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:09:30.797738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] Returning 404 to user: Instance 7e5f4c01-32f7-4593-b8d8-4579e23f7f18 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:09:30.798730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d0b99a0-9cf8-4acd-b48b-32d4ee940724 tempest-InstanceActionsNegativeTestJSON-934237250 tempest-InstanceActionsNegativeTestJSON-934237250-project] 10.222.0.30 "GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18" status: 404 len: 111 microversion: 2.1 time: 0.048977 Nov 03 04:09:30.803139 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2032/3923] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:30 2022] GET /compute/v2.1/servers/7e5f4c01-32f7-4593-b8d8-4579e23f7f18 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:09:31.692642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7a3f0a79-620c-43a3-ae1a-a7ec7468e825 req-da4415d9-287f-4462-94d8-2c991337cd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-plugged", "status": "completed", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:31.707119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7a3f0a79-620c-43a3-ae1a-a7ec7468e825 req-da4415d9-287f-4462-94d8-2c991337cd31 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:31.707618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7a3f0a79-620c-43a3-ae1a-a7ec7468e825 req-da4415d9-287f-4462-94d8-2c991337cd31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:31.708055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7a3f0a79-620c-43a3-ae1a-a7ec7468e825 req-da4415d9-287f-4462-94d8-2c991337cd31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:31.723149 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7a3f0a79-620c-43a3-ae1a-a7ec7468e825 req-da4415d9-287f-4462-94d8-2c991337cd31 service nova] Creating event network-vif-plugged:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:09:31.731252 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7a3f0a79-620c-43a3-ae1a-a7ec7468e825 req-da4415d9-287f-4462-94d8-2c991337cd31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042936 Nov 03 04:09:31.732456 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1892/3924] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:09:53.218487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:53.219223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=18 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:53.589849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1149441508", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "72728bb9-4315-48e5-9b4f-59ba515773af"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:09:53.740897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] validate_networks() for [('72728bb9-4315-48e5-9b4f-59ba515773af', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:09:55.233339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:09:55.233983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:09:55.234645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:09:55.235663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:09:55.236087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:09:55.268167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:55.269146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:55.275230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:55.276709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:55.277415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:55.278072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:55.318091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Getting quotas for project 34f90da150154e9a8f55a110606870d1. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:09:55.363699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Getting quotas for user 7f68df4da9df4e7fabace0aa43f6427b and project 34f90da150154e9a8f55a110606870d1. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:09:55.415484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Going to run 3 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:09:55.423196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:09:55.592510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=edb62951-75bd-43a2-aef5-8a52b39c0185,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:09:55.831005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=88b269c6-cfaf-4c5a-8d5d-91b7d4617c28,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:09:56.078335 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b45fdb66-ed1e-4a75-8b61-04e5140743c7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.866819 Nov 03 04:09:56.091975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:56.092495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:09:56.107493 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2033/3925] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:09:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:09:56.112600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:56.135200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:56.142365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:09:56.218396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:56.219808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:56.220470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:56.221553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:09:56.222540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:09:56.223543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:09:56.326394 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6656bf88-1750-4b60-a234-a15f5ad5ce9f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.230597 Nov 03 04:09:56.329249 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1893/3926] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:09:56 2022] GET /compute/v2.1/servers => generated 1018 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:56.341392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b58c336e-7f8d-4328-b03a-64e6e2cc0cd2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:56.342019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b58c336e-7f8d-4328-b03a-64e6e2cc0cd2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:56.689275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b58c336e-7f8d-4328-b03a-64e6e2cc0cd2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:56.705917 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b58c336e-7f8d-4328-b03a-64e6e2cc0cd2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1223 microversion: 2.1 time: 0.367793 Nov 03 04:09:56.708928 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2034/3927] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:56 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1223 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:57.732063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c13ec6a-4967-4aa1-8706-e3f739959be9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:57.732809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c13ec6a-4967-4aa1-8706-e3f739959be9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:57.931849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c13ec6a-4967-4aa1-8706-e3f739959be9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:57.944910 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c13ec6a-4967-4aa1-8706-e3f739959be9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1223 microversion: 2.1 time: 0.213550 Nov 03 04:09:57.946492 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1894/3928] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:57 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1223 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:09:58.968604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ed6e36d-36b8-4de1-99a8-ffe91fd19d8e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:09:58.970043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ed6e36d-36b8-4de1-99a8-ffe91fd19d8e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:09:59.177725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ed6e36d-36b8-4de1-99a8-ffe91fd19d8e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:09:59.189330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ed6e36d-36b8-4de1-99a8-ffe91fd19d8e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1223 microversion: 2.1 time: 0.224359 Nov 03 04:09:59.190078 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2035/3929] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:09:58 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1223 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:00.243793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c69af32b-bbf7-4aa7-92f8-7d57fd701309 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:00.244313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c69af32b-bbf7-4aa7-92f8-7d57fd701309 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:00.501899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c69af32b-bbf7-4aa7-92f8-7d57fd701309 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:00.511264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c69af32b-bbf7-4aa7-92f8-7d57fd701309 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1223 microversion: 2.1 time: 0.295377 Nov 03 04:10:00.526127 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1895/3930] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:00 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1223 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:00.592439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:00.593660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:00.611177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:00.611986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:00.612627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:00.613783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:00.614618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:00.617965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:00.923639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:00.955120 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3867517f-a1de-48f8-9f7e-9dc1549e4d75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.368524 Nov 03 04:10:00.958392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2036/3931] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:00 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:01.536019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:01.536750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:01.545919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:01.547335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:01.547986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:01.550491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:01.551668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:01.555957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:01.847638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:01.857124 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9cbe744b-bb5e-48b6-9327-62e11a7b1c07 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1275 microversion: 2.1 time: 0.324998 Nov 03 04:10:01.862420 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1896/3932] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:01 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1275 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:01.995158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:01.996403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:02.016146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:02.018747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:02.020559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:02.021351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:02.023141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:02.027441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:02.863220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:02.873554 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90797d44-104d-486a-96e1-9dd5a1fae806 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.894437 Nov 03 04:10:02.880176 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2037/3933] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:01 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:02.881894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:02.882565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:02.893166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:02.893716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:02.894158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:02.904674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:02.905207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:02.905655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:02.907466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-340747705"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:02.910469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:02.934737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:02.935907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:02.937934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:02.939520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:02.943160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:02.943853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:03.279047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:03.293498 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82225d35-9a6b-4f56-b97e-01d163a927af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1283 microversion: 2.1 time: 0.412053 Nov 03 04:10:03.296331 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1897/3934] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:02 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1283 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:03.655534 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8dd8d9fa-f3f1-4a6d-b3a7-0dda8390a2dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.753165 Nov 03 04:10:03.656903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2038/3935] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:10:02 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Nov 03 04:10:03.672637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:03.673923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:03.693916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:03.694430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:03.694888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:03.697887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:03.699610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:03.700074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:04.059013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6e56dac6-9d56-49b4-aa8e-d9fbf3e3da1f req-f0ecc466-8f48-4565-948f-29552d800869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-unplugged", "status": "completed", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:04.072868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6e56dac6-9d56-49b4-aa8e-d9fbf3e3da1f req-f0ecc466-8f48-4565-948f-29552d800869 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:04.073858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6e56dac6-9d56-49b4-aa8e-d9fbf3e3da1f req-f0ecc466-8f48-4565-948f-29552d800869 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:04.074303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6e56dac6-9d56-49b4-aa8e-d9fbf3e3da1f req-f0ecc466-8f48-4565-948f-29552d800869 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:04.088611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6e56dac6-9d56-49b4-aa8e-d9fbf3e3da1f req-f0ecc466-8f48-4565-948f-29552d800869 service nova] Creating event network-vif-unplugged:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:10:04.095381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6e56dac6-9d56-49b4-aa8e-d9fbf3e3da1f req-f0ecc466-8f48-4565-948f-29552d800869 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041228 Nov 03 04:10:04.098628 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2039/3936] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:04.327168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:04.329304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:04.344189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:04.345715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:04.347953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:04.350107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:04.350860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:04.352765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:04.622536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:04.633571 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ded3b27d-2421-4f32-a911-182d76472ec2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1281 microversion: 2.1 time: 0.312942 Nov 03 04:10:04.635152 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2040/3937] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:04 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:04.792780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:04.803304 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50432efc-81a2-421b-8789-510dda58108c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 1.139272 Nov 03 04:10:04.807945 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1898/3938] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:03 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:05.658367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:05.667240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:05.682654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:05.698293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:05.701310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:05.705092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:05.706818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:05.709437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:05.712372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:05.839081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:05.839798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:05.853689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:05.854798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:05.855722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:05.856644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:05.857358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:05.857986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:06.081463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:06.090902 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e19dcaa0-8b59-4775-9df8-84c66f8debd7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.437320 Nov 03 04:10:06.115691 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2041/3939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:05 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:06.295983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:06.411845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:06.439100 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90e5761f-60e6-4955-a16b-4a913e5c0ef4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.615053 Nov 03 04:10:06.455673 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1899/3940] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:05 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:07.130714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:07.131402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:07.145827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:07.146414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:07.146876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:07.147625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:07.148089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:07.148554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:07.447925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1060c118-35a7-40cb-b651-7edeef7fd2ab req-9aa43846-3a1b-4c0e-ae07-2acaaa0905ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d44823-1769-45c6-bfdc-a1ea4c24a78c", "tag": "0792fe37-d6e9-41a9-b0a9-aec9aa24abee"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:07.468260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1060c118-35a7-40cb-b651-7edeef7fd2ab req-9aa43846-3a1b-4c0e-ae07-2acaaa0905ff service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:07.474484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1060c118-35a7-40cb-b651-7edeef7fd2ab req-9aa43846-3a1b-4c0e-ae07-2acaaa0905ff service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:07.474484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1060c118-35a7-40cb-b651-7edeef7fd2ab req-9aa43846-3a1b-4c0e-ae07-2acaaa0905ff service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:07.492849 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1060c118-35a7-40cb-b651-7edeef7fd2ab req-9aa43846-3a1b-4c0e-ae07-2acaaa0905ff service nova] Creating event network-changed:0792fe37-d6e9-41a9-b0a9-aec9aa24abee for instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c on n-h2-854653-7 Nov 03 04:10:07.503853 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1060c118-35a7-40cb-b651-7edeef7fd2ab req-9aa43846-3a1b-4c0e-ae07-2acaaa0905ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060505 Nov 03 04:10:07.504779 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1900/3941] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:07.510633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:07.511583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:07.518629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:07.519451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:07.520074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:07.521044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:07.521672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:07.522369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:07.664640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:07.678082 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84b9dc40-73b9-4303-a11e-50292a158345 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.552681 Nov 03 04:10:07.680300 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2042/3942] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:07 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:07.922155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-877362ba-6c2e-45d7-9eb8-de940a1b0aae req-c3663bf9-36af-4087-99f8-27f5bcc08256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb62951-75bd-43a2-aef5-8a52b39c0185", "tag": "3488ec5b-5bc4-4eb8-b144-4ff4363b1c5f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:07.932360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-877362ba-6c2e-45d7-9eb8-de940a1b0aae req-c3663bf9-36af-4087-99f8-27f5bcc08256 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:07.933165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-877362ba-6c2e-45d7-9eb8-de940a1b0aae req-c3663bf9-36af-4087-99f8-27f5bcc08256 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:07.933786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-877362ba-6c2e-45d7-9eb8-de940a1b0aae req-c3663bf9-36af-4087-99f8-27f5bcc08256 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:07.945894 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-877362ba-6c2e-45d7-9eb8-de940a1b0aae req-c3663bf9-36af-4087-99f8-27f5bcc08256 service nova] Creating event network-changed:3488ec5b-5bc4-4eb8-b144-4ff4363b1c5f for instance edb62951-75bd-43a2-aef5-8a52b39c0185 on n-h2-854653-7 Nov 03 04:10:07.951617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-877362ba-6c2e-45d7-9eb8-de940a1b0aae req-c3663bf9-36af-4087-99f8-27f5bcc08256 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034210 Nov 03 04:10:07.952498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2043/3943] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:08.139333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:08.147758 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb330b36-7b08-4052-bea8-6430fe3e1fcd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.641628 Nov 03 04:10:08.157640 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1901/3944] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:07 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:08.712648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:08.714037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:08.722732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:08.723135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:08.723586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:08.724301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:08.724764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:08.725252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:08.930876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:08.943927 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fdd895de-bdbb-4c16-ba51-d3d2cd648b37 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.238230 Nov 03 04:10:08.944556 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2044/3945] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:08 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:09.176599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:09.177275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:09.184183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:09.184687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:09.185175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:09.185892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:09.186364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:09.186801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:09.878668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:09.905930 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9a08c895-3d41-4f22-9b1a-ea4842ac8451 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1687 microversion: 2.1 time: 0.733194 Nov 03 04:10:09.921334 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1902/3946] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:09 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1687 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:09.972652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:09.976405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:09.987193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:09.992679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:09.993543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:09.995421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:09.997536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:09.998334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:09.999323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:10.002482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-49f727b7-5ab5-48ee-a92e-00cc5f72e4c5 req-aa9362dc-b4f4-4dd2-b43f-acc2e298e278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b269c6-cfaf-4c5a-8d5d-91b7d4617c28", "tag": "585685c3-f193-4431-87f5-1aee5e89908e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:10.018244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49f727b7-5ab5-48ee-a92e-00cc5f72e4c5 req-aa9362dc-b4f4-4dd2-b43f-acc2e298e278 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:10.019731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49f727b7-5ab5-48ee-a92e-00cc5f72e4c5 req-aa9362dc-b4f4-4dd2-b43f-acc2e298e278 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:10.022072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-49f727b7-5ab5-48ee-a92e-00cc5f72e4c5 req-aa9362dc-b4f4-4dd2-b43f-acc2e298e278 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:10.042785 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-49f727b7-5ab5-48ee-a92e-00cc5f72e4c5 req-aa9362dc-b4f4-4dd2-b43f-acc2e298e278 service nova] Creating event network-changed:585685c3-f193-4431-87f5-1aee5e89908e for instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 on n-h1-854653-7 Nov 03 04:10:10.059669 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-49f727b7-5ab5-48ee-a92e-00cc5f72e4c5 req-aa9362dc-b4f4-4dd2-b43f-acc2e298e278 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061091 Nov 03 04:10:10.060730 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1903/3947] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:10.388886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:10.405621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cdb20d8c-3b4c-4ea1-9d74-7030fbe7e9bb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.439002 Nov 03 04:10:10.407750 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2045/3948] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:09 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:10.936216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:10.940527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:10.941285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:10.947578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:10.948072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:10.948516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:10.949258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:10.949723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:10.950155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:11.135795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:11.151350 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dace6490-b246-42bf-8780-ab26ba78f76a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1687 microversion: 2.1 time: 0.216931 Nov 03 04:10:11.154874 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1904/3949] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:10 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:11.434645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:11.435313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:11.442595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:11.447956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:11.447956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:11.447956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:11.447956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:11.447956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:11.633301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:11.643339 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b7fca23d-6d00-49c7-9fab-570dab2180b4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.212677 Nov 03 04:10:11.644426 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2046/3950] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:11 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:11.979755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1d0774fe-22f2-4be0-b1b9-5d3131120c8d req-2a49cd57-e725-435f-9ac1-b04653643ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-plugged", "status": "completed", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:12.000360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d0774fe-22f2-4be0-b1b9-5d3131120c8d req-2a49cd57-e725-435f-9ac1-b04653643ab4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:12.001445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d0774fe-22f2-4be0-b1b9-5d3131120c8d req-2a49cd57-e725-435f-9ac1-b04653643ab4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:12.002504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d0774fe-22f2-4be0-b1b9-5d3131120c8d req-2a49cd57-e725-435f-9ac1-b04653643ab4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:12.021380 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1d0774fe-22f2-4be0-b1b9-5d3131120c8d req-2a49cd57-e725-435f-9ac1-b04653643ab4 service nova] Creating event network-vif-plugged:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:10:12.037004 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1d0774fe-22f2-4be0-b1b9-5d3131120c8d req-2a49cd57-e725-435f-9ac1-b04653643ab4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065085 Nov 03 04:10:12.037004 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1905/3951] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:12.184726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:12.186814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:12.214198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:12.217469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:12.218029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:12.219597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:12.222743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:12.223298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:12.466692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:12.475522 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2fcea9e9-397a-4d08-b4ed-b327d198431a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1687 microversion: 2.1 time: 0.300782 Nov 03 04:10:12.489050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2047/3952] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:12 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1687 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:12.669154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:12.679287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:12.697574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:12.698087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:12.698543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:12.702875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:12.703357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:12.705036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:13.270196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:13.285711 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c36c01da-83ab-4654-b428-5b7c1b88f9d0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.621585 Nov 03 04:10:13.286618 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1906/3953] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:12 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:13.517994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:13.517994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:13.529091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:13.529633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:13.531472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:13.532245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:13.532719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:13.536301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:14.051917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-fa2756b2-d22e-4611-9977-2fc9703cec2b req-fbf8f1a2-f96a-41f6-949a-d0652e6ae96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d44823-1769-45c6-bfdc-a1ea4c24a78c", "name": "network-vif-plugged", "status": "completed", "tag": "0792fe37-d6e9-41a9-b0a9-aec9aa24abee"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:14.071378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fa2756b2-d22e-4611-9977-2fc9703cec2b req-fbf8f1a2-f96a-41f6-949a-d0652e6ae96b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:14.072960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fa2756b2-d22e-4611-9977-2fc9703cec2b req-fbf8f1a2-f96a-41f6-949a-d0652e6ae96b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:14.074528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fa2756b2-d22e-4611-9977-2fc9703cec2b req-fbf8f1a2-f96a-41f6-949a-d0652e6ae96b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:14.098276 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-fa2756b2-d22e-4611-9977-2fc9703cec2b req-fbf8f1a2-f96a-41f6-949a-d0652e6ae96b service nova] Creating event network-vif-plugged:0792fe37-d6e9-41a9-b0a9-aec9aa24abee for instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c on n-h2-854653-7 Nov 03 04:10:14.115485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-fa2756b2-d22e-4611-9977-2fc9703cec2b req-fbf8f1a2-f96a-41f6-949a-d0652e6ae96b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068326 Nov 03 04:10:14.117563 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1907/3954] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:14.170797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:14.222091 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-659632f8-b7b2-44e1-b0fb-b535518ae1d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1687 microversion: 2.1 time: 0.720295 Nov 03 04:10:14.225089 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2048/3955] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:13 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1687 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:14.314412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:14.315141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:14.326376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:14.331934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:14.331934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:14.331934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:14.331934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:14.331934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:14.846492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:14.875853 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0065be93-a2bc-4eee-bd43-1c9ff5e04504 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.569831 Nov 03 04:10:14.876471 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1908/3956] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:14 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:15.250084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:15.250518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:15.264582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:15.279704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:15.282375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:15.284202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:15.285472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:15.286027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:15.562970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:15.576947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33e6e9a8-27d8-4d42-ab1c-73e71501cb60 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1687 microversion: 2.1 time: 0.331815 Nov 03 04:10:15.589233 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2049/3957] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:15 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1687 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:15.902661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:15.903191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:15.919783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:15.920481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:15.921895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:15.922848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:15.923473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:15.924270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:16.142321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-39a21928-6716-4b54-aaea-824aca8900e7 req-2a2e86c2-e1a8-47e7-84f7-0ff653c6a0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb62951-75bd-43a2-aef5-8a52b39c0185", "name": "network-vif-plugged", "status": "completed", "tag": "3488ec5b-5bc4-4eb8-b144-4ff4363b1c5f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:16.151745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-39a21928-6716-4b54-aaea-824aca8900e7 req-2a2e86c2-e1a8-47e7-84f7-0ff653c6a0a7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:16.152245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-39a21928-6716-4b54-aaea-824aca8900e7 req-2a2e86c2-e1a8-47e7-84f7-0ff653c6a0a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:16.152865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-39a21928-6716-4b54-aaea-824aca8900e7 req-2a2e86c2-e1a8-47e7-84f7-0ff653c6a0a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:16.164066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:16.166434 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-39a21928-6716-4b54-aaea-824aca8900e7 req-2a2e86c2-e1a8-47e7-84f7-0ff653c6a0a7 service nova] Creating event network-vif-plugged:3488ec5b-5bc4-4eb8-b144-4ff4363b1c5f for instance edb62951-75bd-43a2-aef5-8a52b39c0185 on n-h2-854653-7 Nov 03 04:10:16.172441 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-39a21928-6716-4b54-aaea-824aca8900e7 req-2a2e86c2-e1a8-47e7-84f7-0ff653c6a0a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035027 Nov 03 04:10:16.173084 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2050/3958] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:16.175706 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20d03642-b492-47f5-9898-6240b3996bfb tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1323 microversion: 2.1 time: 0.277644 Nov 03 04:10:16.177067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1909/3959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:15 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:16.606161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:16.607042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:16.622020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:16.623818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:16.625567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:16.627684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:16.629323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:16.629990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:16.904238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:16.923976 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-504e3579-f9b3-4618-8110-10556c614543 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1687 microversion: 2.1 time: 0.325049 Nov 03 04:10:16.924783 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2051/3960] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:16 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1687 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:17.205267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:17.205267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:17.221997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:17.222511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:17.226547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:17.226547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:17.226547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:17.226547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:17.437686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:17.451398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3036b962-91c6-45a8-a443-785b8b5a76d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 200 len: 1516 microversion: 2.1 time: 0.254336 Nov 03 04:10:17.454741 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1910/3961] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:17 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:17.477889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:17.479470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:17.487147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:17.488021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:17.492802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:17.492802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:17.492802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:17.492802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:17.677414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:17.685056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:17.688033 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f5b0973-ab37-41b1-85db-7dc7e54d9b1c tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1323 microversion: 2.1 time: 0.215617 Nov 03 04:10:17.689057 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2052/3962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:17 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:17.948434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:17.949110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:17.956131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:17.956934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:17.957833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:17.959137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:17.960156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:17.961453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:18.188292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dc1e63df-57e7-49ff-9d9d-3a0bcf79a622 req-5b139384-4309-472d-844a-ba8420513a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b269c6-cfaf-4c5a-8d5d-91b7d4617c28", "name": "network-vif-plugged", "status": "completed", "tag": "585685c3-f193-4431-87f5-1aee5e89908e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:18.222428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:18.231720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc1e63df-57e7-49ff-9d9d-3a0bcf79a622 req-5b139384-4309-472d-844a-ba8420513a3c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:18.232282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc1e63df-57e7-49ff-9d9d-3a0bcf79a622 req-5b139384-4309-472d-844a-ba8420513a3c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:18.232735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc1e63df-57e7-49ff-9d9d-3a0bcf79a622 req-5b139384-4309-472d-844a-ba8420513a3c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:18.234850 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b497a00e-a6cc-4fb5-9bff-96e157ae9e3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.290500 Nov 03 04:10:18.236454 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1911/3963] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:17 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:18.257999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dc1e63df-57e7-49ff-9d9d-3a0bcf79a622 req-5b139384-4309-472d-844a-ba8420513a3c service nova] Creating event network-vif-plugged:585685c3-f193-4431-87f5-1aee5e89908e for instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 on n-h1-854653-7 Nov 03 04:10:18.263135 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dc1e63df-57e7-49ff-9d9d-3a0bcf79a622 req-5b139384-4309-472d-844a-ba8420513a3c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078491 Nov 03 04:10:18.263988 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2053/3964] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:18.713413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:18.714033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:18.721081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:18.721918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:18.723420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:18.724235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:18.724892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:18.725536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:18.978077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:18.988838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83407876-581b-4f33-86f0-5e1e70227394 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1323 microversion: 2.1 time: 0.280955 Nov 03 04:10:18.990226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1912/3965] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:18 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1323 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:19.278493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:19.279235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:19.301939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:19.308071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:19.308765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:19.309750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:19.310404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:19.311026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:19.615937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:19.624921 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c876da6e-edd5-404e-bbe9-1c5ca2a85701 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.368386 Nov 03 04:10:19.626420 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2054/3966] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:19 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:20.028366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:20.032108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:20.046426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:20.048180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:20.048707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:20.050548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:20.051031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:20.051692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:20.425728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:20.436919 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b83950a6-6264-4eba-ac17-62b5249229c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1323 microversion: 2.1 time: 0.416869 Nov 03 04:10:20.438403 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1913/3967] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:20 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1323 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:20.651311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:20.652556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:20.660974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:20.661695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:20.662322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:20.663235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:20.663886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:20.664464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:20.925334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:20.935397 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae3ec11f-cad0-419f-a92a-7f39afb70e35 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.289144 Nov 03 04:10:20.936118 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2055/3968] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:20 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:21.459735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:21.460501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:21.479955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:21.480468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:21.480960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:21.481774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:21.482125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:21.482554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:21.723902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:21.728527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:21.736650 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff5f36d9-ff56-4ba4-a361-66c110f5e314 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1516 microversion: 2.1 time: 0.280713 Nov 03 04:10:21.751487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1914/3969] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:21 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1516 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:21.777709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:21.778571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:21.795263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:21.796258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:21.797635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:21.799353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:21.800155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:21.800754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:21.966396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:21.969622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:21.992211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:21.995035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:21.995752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:21.997835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:21.998685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:22.002570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:22.060285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:22.075661 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2ab46816-789c-4363-8612-18a4839588b8 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 200 len: 1516 microversion: 2.1 time: 0.301753 Nov 03 04:10:22.076334 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2056/3970] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:21 2022] GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 1516 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:22.099649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:22.112579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:22.137448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:22.140955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:22.143252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:22.144008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:22.145540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:22.145919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:22.234011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:10:22.360517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:22.370408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a81aad48-70c6-44b0-80d8-3b7dae4da175 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.415572 Nov 03 04:10:22.371699 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1915/3971] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:21 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:22.742747 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb8fbab5-4653-43b9-b954-d4c00188ca8b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "DELETE /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 204 len: 0 microversion: 2.1 time: 0.647462 Nov 03 04:10:22.743821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2057/3972] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:10:22 2022] DELETE /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:10:22.752691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:22.753608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:22.767234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:22.769293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:22.772764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:22.772764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:22.772764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:22.772764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:22.971218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:22.982779 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a8259554-1504-4d37-82dc-f40fdb56337e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 200 len: 1522 microversion: 2.1 time: 0.234958 Nov 03 04:10:22.987384 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1916/3973] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:22 2022] GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:23.395550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:23.396318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:23.404518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:23.405039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:23.405481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:23.406221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:23.406683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:23.407122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:23.731133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:23.741730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0fb0bb9d-4cb3-4975-83c7-2053a55d8318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.349895 Nov 03 04:10:23.761394 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2058/3974] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:23 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:24.012716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:24.013365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:24.021574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:24.022101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:24.022561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:24.023280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:24.023744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:24.024181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:24.231123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:24.245426 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5668038c-e52d-4d80-bfab-a5afa2f725db tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 200 len: 1522 microversion: 2.1 time: 0.236656 Nov 03 04:10:24.247397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1917/3975] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:24 2022] GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:24.770171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:24.771588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:24.777509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:24.787666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:24.788211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:24.788648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:24.797140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:24.797888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:24.799432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:25.168836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:25.183842 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e31f81d-fe44-4c47-83ad-c7872cea20ff tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.418389 Nov 03 04:10:25.186830 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2059/3976] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:24 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:25.274040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:25.275247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:25.285443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:25.286217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:25.287681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:25.287681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:25.288915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:25.289563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:25.637412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:25.644650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a51c9d53-1d0b-4d2f-ae71-721b633f8f35 req-add23426-bdbb-4ec7-bf32-df13cb937e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb62951-75bd-43a2-aef5-8a52b39c0185", "name": "network-vif-deleted", "tag": "3488ec5b-5bc4-4eb8-b144-4ff4363b1c5f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:25.662592 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72fa3264-bcdc-4fde-a94e-2877e56ffb06 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 200 len: 1480 microversion: 2.1 time: 0.392503 Nov 03 04:10:25.667124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1918/3977] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:25 2022] GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 1480 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:25.675384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a51c9d53-1d0b-4d2f-ae71-721b633f8f35 req-add23426-bdbb-4ec7-bf32-df13cb937e83 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:25.676156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a51c9d53-1d0b-4d2f-ae71-721b633f8f35 req-add23426-bdbb-4ec7-bf32-df13cb937e83 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:25.681923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a51c9d53-1d0b-4d2f-ae71-721b633f8f35 req-add23426-bdbb-4ec7-bf32-df13cb937e83 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:25.718241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a51c9d53-1d0b-4d2f-ae71-721b633f8f35 req-add23426-bdbb-4ec7-bf32-df13cb937e83 service nova] Creating event network-vif-deleted:3488ec5b-5bc4-4eb8-b144-4ff4363b1c5f for instance edb62951-75bd-43a2-aef5-8a52b39c0185 on n-h2-854653-7 Nov 03 04:10:25.759450 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a51c9d53-1d0b-4d2f-ae71-721b633f8f35 req-add23426-bdbb-4ec7-bf32-df13cb937e83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130335 Nov 03 04:10:25.764621 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2060/3978] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:26.209351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:26.210012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:26.219156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:26.219667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:26.220143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:26.225363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:26.226710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:26.229366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:26.534540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:26.552319 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2af1c9b8-f8bc-43b4-a2da-0f24c2bb6270 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.346828 Nov 03 04:10:26.554905 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1919/3979] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:26 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:26.693114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:26.694478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:26.707948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:26.709595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:26.713685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:26.714676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:26.715315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:26.717643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:26.819962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:26.820906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:26.821536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:26.822252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lazy-loading 'fault' on Instance uuid edb62951-75bd-43a2-aef5-8a52b39c0185 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:10:26.918200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:26.940714 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b43d682-1b75-419a-b51b-8314a884afcf tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 200 len: 1313 microversion: 2.1 time: 0.253331 Nov 03 04:10:26.941675 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2061/3980] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:26 2022] GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:27.582276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:27.583816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:27.597539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:27.598710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:27.599896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:27.601608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:27.602124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:27.602792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:27.815651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:27.841729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1bf166b-fe51-4343-b504-a32134a64557 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.254687 Nov 03 04:10:27.841729 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1920/3981] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:27 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:27.970611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:27.971469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:27.996578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:27.997316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:27.997736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.000717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.002293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.003136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.053572 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] HTTP exception thrown: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 HTTP/1.1 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'edb62951-75bd-43a2-aef5-8a52b39c0185'} Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:28.054669 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:28.065946 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.069392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 404 to user: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:28.075783 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f615175-716c-4cbc-bb4d-ceab1194c4b2 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 404 len: 111 microversion: 2.1 time: 0.104324 Nov 03 04:10:28.075783 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2062/3982] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:27 2022] GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:10:28.083376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.101194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:28.105954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:28.118132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.118623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.119069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.119802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.120268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.129594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.253730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.254199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:28.264470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.266441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.268502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.273380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.276181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.277061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.396793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-250fd0a3-6a6c-4dd2-917b-182e25a68694 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.318473 Nov 03 04:10:28.400728 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1921/3983] 10.222.0.30 () {58 vars in 1230 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:10:28.419607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b3fc4742-b382-45c9-8c1e-48d422cb3a6b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b3fc4742-b382-45c9-8c1e-48d422cb3a6b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: action_args: {} Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi '2011/01/01' Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 03 04:10:28.438379 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b3fc4742-b382-45c9-8c1e-48d422cb3a6b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:28.443890 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b3fc4742-b382-45c9-8c1e-48d422cb3a6b tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.034321 Nov 03 04:10:28.449359 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1922/3984] 10.222.0.30 () {58 vars in 1182 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:10:28.468320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.473099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:28.473773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:28.495565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.496094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.496550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.497344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.497809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.500265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.532618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lazy-loading 'services' on Instance uuid 8b801e36-fff6-415b-a737-cc3e1bbfff8c {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:10:28.550173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:10:28.627468 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb6868cf-bf8a-4b4c-859c-ba6f92a8f9d1 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.169633 Nov 03 04:10:28.634894 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1923/3985] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers => generated 683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:28.647713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.653087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:28.655943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.servers [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Removing options 'limit' from query {{(pid=127593) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 03 04:10:28.656837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:28.670331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.671862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.675051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.676616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.679562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.680191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.721389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:10:28.794517 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a64f5571-fd86-4855-85bb-b5a23ad75f4f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.150590 Nov 03 04:10:28.795448 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1924/3986] 10.222.0.30 () {58 vars in 1144 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:28.815407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b94cc014-9bc5-4727-bdf7-54464ff909a4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.830714 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-63720834-1859-49ab-9417-20ccadcf7823 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments/8b577ece-bb3a-4c38-bbf5-e381333423da" status: 202 len: 0 microversion: 2.1 time: 0.581227 Nov 03 04:10:28.831614 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2063/3987] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:10:28 2022] DELETE /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments/8b577ece-bb3a-4c38-bbf5-e381333423da => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b94cc014-9bc5-4727-bdf7-54464ff909a4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: action_args: {} Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi '-1' Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 03 04:10:28.841248 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Nov 03 04:10:28.846207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.853429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.853580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b94cc014-9bc5-4727-bdf7-54464ff909a4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:28.853580 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b94cc014-9bc5-4727-bdf7-54464ff909a4 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.038817 Nov 03 04:10:28.853580 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1925/3988] 10.222.0.30 () {58 vars in 1142 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:10:28.853798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:28.868892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-071665b1-f2f7-4fbb-beee-77bda7f2ec7e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-071665b1-f2f7-4fbb-beee-77bda7f2ec7e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: action_args: {} Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'minimum': 0, Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance[0]: Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'testing' Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 03 04:10:28.877485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Nov 03 04:10:28.882805 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:28.887001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.887001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.887001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.887001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.887001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.887001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.888637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-071665b1-f2f7-4fbb-beee-77bda7f2ec7e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:28.890063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-071665b1-f2f7-4fbb-beee-77bda7f2ec7e tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.032340 Nov 03 04:10:28.894858 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1926/3989] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:10:28.900854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:28.903733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:28.912320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.914063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.914793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.915954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:28.916662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:28.917348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:28.981942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e8dc973-3a7b-4ef9-b0c9-032978584d3b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142902 Nov 03 04:10:28.984677 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2064/3990] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:28.993849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab57be65-c1a0-4842-aa72-ae91715acaa9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:29.002716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab57be65-c1a0-4842-aa72-ae91715acaa9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:29.007359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab57be65-c1a0-4842-aa72-ae91715acaa9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:29.015148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.compute.servers [None req-ab57be65-c1a0-4842-aa72-ae91715acaa9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Flavor 'non_existing_flavor' could not be found {{(pid=127594) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Nov 03 04:10:29.016680 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab57be65-c1a0-4842-aa72-ae91715acaa9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.030466 Nov 03 04:10:29.027754 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2065/3991] 10.222.0.30 () {58 vars in 1178 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:10:29.035671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:29.049097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:29.050072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:29.066907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:29.067474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:29.068123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:29.069854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:29.070504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:29.071099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:29.203466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:29.217679 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b9a1dea-5b7f-418d-81cf-9c29e6fa037a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.325370 Nov 03 04:10:29.219085 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1927/3992] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:28 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:29.229909 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07068459-3666-402d-ac78-a14e449bca3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.200671 Nov 03 04:10:29.240410 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2066/3993] 10.222.0.30 () {58 vars in 1174 bytes} [Thu Nov 3 04:10:29 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:10:29.255695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:29.267571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:29.268607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:29.278592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:29.279301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:29.280590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:29.281493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:29.282071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:29.282695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:29.498790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07a411c3-5f52-431a-a9cb-6c48d3b7f281 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.251173 Nov 03 04:10:29.499140 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1928/3994] 10.222.0.30 () {58 vars in 1184 bytes} [Thu Nov 3 04:10:29 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:10:29.512423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:29.524865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:29.525740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:29.542868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:29.543344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:29.545472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:29.547008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:29.548621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:29.550838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:29.629654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:10:29.706940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:29.722894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:29.723408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:29.723864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:29.998945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:30.002067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:30.034207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.034207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.034207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.034207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.034207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.034207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.049742 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ec96796-5bd9-4122-819a-2ad48030ab3f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.540467 Nov 03 04:10:30.051468 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2067/3995] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:10:29 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:30.119411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-587f0c1a-2a7c-4e44-9732-468f2b16d577 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:30.125906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-587f0c1a-2a7c-4e44-9732-468f2b16d577 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:30.127294 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-587f0c1a-2a7c-4e44-9732-468f2b16d577 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013082 Nov 03 04:10:30.130134 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2068/3996] 10.222.0.30 () {58 vars in 1178 bytes} [Thu Nov 3 04:10:30 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:10:30.140742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:30.147043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:30.149642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Searching by: {'deleted': False, 'project_id': '34f90da150154e9a8f55a110606870d1'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:10:30.158039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.158700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.159249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.160147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.160870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.161557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.179701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c05b37cd-ef5b-45de-8de4-a6b2a748e078 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184885 Nov 03 04:10:30.180631 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1929/3997] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:29 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:30.201187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:10:30.252591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:30.253258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:30.262154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.262940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.263605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.264525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.265515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.266158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.269859 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ebc0afa4-d610-4ed6-8751-07495af355af tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.130332 Nov 03 04:10:30.272962 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2069/3998] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:10:30 2022] GET /compute/v2.1/servers => generated 683 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:30.291211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:30.291759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:30.309853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.310441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.310979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.311862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.312259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.312719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.348458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] HTTP exception thrown: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 HTTP/1.1 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'edb62951-75bd-43a2-aef5-8a52b39c0185'} Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:10:30.350407 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 404 to user: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:30.364676 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3aae33b4-cc79-4527-bcb4-83c1cc711179 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "DELETE /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 404 len: 111 microversion: 2.1 time: 0.071844 Nov 03 04:10:30.366917 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2070/3999] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:10:30 2022] DELETE /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:10:30.377624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:30.378136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:30.394125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.397892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.398836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.399767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.400400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.400987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.414375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:30.479924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:10:30.630651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:30.639470 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cb60664d-f2e8-46cd-9e0c-b886e3a57a86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.391545 Nov 03 04:10:30.647150 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1930/4000] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:30 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:30.923663 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e059103-94d2-4098-83c3-5af3b256761f tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "DELETE /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 204 len: 0 microversion: 2.1 time: 0.555810 Nov 03 04:10:30.924879 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2071/4001] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:10:30 2022] DELETE /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:10:30.934508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:30.934508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:30.936711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=75 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:30.957603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.960856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.960856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:30.960856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:30.960856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:30.961799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.075818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:10:31.196655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:31.199625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:31.225843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.229214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.232094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.232956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.235537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.236411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.403684 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-476d3957-e99c-4c48-bb2f-c494c31dd39a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214299 Nov 03 04:10:31.411031 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2072/4002] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:31 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:31.510052 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0391b4c6-601d-4849-a143-3d878e418530 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 204 len: 0 microversion: 2.1 time: 0.579868 Nov 03 04:10:31.513191 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1931/4003] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:10:30 2022] DELETE /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:10:31.521582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:31.523023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: edb62951-75bd-43a2-aef5-8a52b39c0185] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:31.543179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.543848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.544319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.550827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.551412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.551878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.588749 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] HTTP exception thrown: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 HTTP/1.1 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'edb62951-75bd-43a2-aef5-8a52b39c0185'} Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:31.590493 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 404 to user: Instance edb62951-75bd-43a2-aef5-8a52b39c0185 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d5e3f8a-a123-4913-8947-fc34593c20b9 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185" status: 404 len: 111 microversion: 2.1 time: 0.074531 Nov 03 04:10:31.597967 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2073/4004] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:31 2022] GET /compute/v2.1/servers/edb62951-75bd-43a2-aef5-8a52b39c0185 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:10:31.602995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:31.604721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:31.613899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.614406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.617548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.617548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.617548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.617847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.675486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:31.675486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:31.690536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.691173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.691800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:31.692381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:31.692852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:31.693318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:32.237080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:32.242605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:32.257977 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-990f6b84-1455-464f-94c9-46fd7942b3c6 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1522 microversion: 2.1 time: 0.657816 Nov 03 04:10:32.274578 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1932/4005] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:31 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:32.281916 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e3018ff7-a070-46eb-9e39-e07952f70bea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.610755 Nov 03 04:10:32.284062 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2074/4006] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:31 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:32.419534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:32.423641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:32.440680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:32.441360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:32.442250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:32.445083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:32.445742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:32.446361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:32.498564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:32.566163 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2facb10c-275d-4e07-a953-9e02486a6d75 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151372 Nov 03 04:10:32.568035 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1933/4007] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:32 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:33.290204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:33.291439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:33.311209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:33.311951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:33.316934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:33.317707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:33.323027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:33.323929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:33.325750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:33.335538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:33.335820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:33.335820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:33.335820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:33.339991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:33.340757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:33.341468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:34.010777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:34.025404 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1e3aa252-492e-48d9-9d44-e19bbe7bbbd7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.718542 Nov 03 04:10:34.039884 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1934/4008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:33 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:34.064970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:34.067375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:34.079804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:34.082916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:34.093265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:34.096809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:34.096809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:34.097411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:34.131509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:34.141767 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb777faa-fd76-400b-bd7f-73cec241385d tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1522 microversion: 2.1 time: 0.856747 Nov 03 04:10:34.148003 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2075/4009] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:33 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1522 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:34.196189 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f551c867-34b1-4453-9ed3-1182af867b4f tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153362 Nov 03 04:10:34.202033 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1935/4010] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:34 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:35.055546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:35.057501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:35.070372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:35.085175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:35.085617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:35.086299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:35.097559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:35.099765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:35.179078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:35.180482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:35.200083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:35.206021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:35.207544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:35.214302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:35.215456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:35.217817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:35.888163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:35.901328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0185c694-f332-4a78-9658-82a4ba2cf4d7 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1480 microversion: 2.1 time: 0.722311 Nov 03 04:10:35.908781 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1936/4011] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:35 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1480 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:35.927688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:35.933173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:35.963433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:35.967168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:35.967957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:35.976008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:35.984239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:35.985381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:36.076913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:36.094028 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b41a71d-120b-47ae-810b-9a7bd9886a4f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 1.041428 Nov 03 04:10:36.097388 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2076/4012] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:35 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:36.127826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-57a09e89-f38f-48f0-8ec9-5f89b6861271 req-11b532f9-6842-406a-b0a9-1ee9fb0977b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d44823-1769-45c6-bfdc-a1ea4c24a78c", "name": "network-vif-deleted", "tag": "0792fe37-d6e9-41a9-b0a9-aec9aa24abee"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:36.152578 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-764d3460-f0ab-48bb-9e34-3cec925c7e2d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240080 Nov 03 04:10:36.160006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1937/4013] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:35 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:36.176191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-57a09e89-f38f-48f0-8ec9-5f89b6861271 req-11b532f9-6842-406a-b0a9-1ee9fb0977b5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:36.176191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-57a09e89-f38f-48f0-8ec9-5f89b6861271 req-11b532f9-6842-406a-b0a9-1ee9fb0977b5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:36.176191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-57a09e89-f38f-48f0-8ec9-5f89b6861271 req-11b532f9-6842-406a-b0a9-1ee9fb0977b5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:36.230369 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-57a09e89-f38f-48f0-8ec9-5f89b6861271 req-11b532f9-6842-406a-b0a9-1ee9fb0977b5 service nova] Creating event network-vif-deleted:0792fe37-d6e9-41a9-b0a9-aec9aa24abee for instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c on n-h2-854653-7 Nov 03 04:10:36.270407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-57a09e89-f38f-48f0-8ec9-5f89b6861271 req-11b532f9-6842-406a-b0a9-1ee9fb0977b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167653 Nov 03 04:10:36.273232 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2077/4014] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:36.927752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:36.928972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:36.951376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:36.952415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:36.953527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:36.956046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:36.958686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:36.959372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:37.061974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:37.062490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:37.062933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:37.073680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lazy-loading 'fault' on Instance uuid 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:10:37.125996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:37.126924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:37.154751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:37.155904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:37.157490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:37.160558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:37.174734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:37.175698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:37.218969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f68df4da9df4e7fabace0aa43f6427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f90da150154e9a8f55a110606870d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:37.233947 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8f69540-5865-4d2b-905e-3d8c316b89c0 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 200 len: 1313 microversion: 2.1 time: 0.304436 Nov 03 04:10:37.237349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1938/4015] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:36 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:37.274294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:37.279554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:37.300954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:37.301486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:37.306803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:37.314650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:37.315543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:37.316216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:37.391877 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b20b18c-0d15-4686-923e-227d557f826b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133393 Nov 03 04:10:37.408589 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1939/4016] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:37 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:37.571315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:37.583444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc84bac4-aa98-44ca-a2e7-d465448776c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.460192 Nov 03 04:10:37.584375 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2078/4017] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:37 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:38.272284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:38.272284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:38.286501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.287251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.288438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.289347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.289964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.290732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.313921 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] HTTP exception thrown: Instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 could not be found. Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 HTTP/1.1 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 could not be found. Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '88b269c6-cfaf-4c5a-8d5d-91b7d4617c28'} Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 could not be found. Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 could not be found. Nov 03 04:10:38.329030 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 could not be found. Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 404 to user: Instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dcd9cd25-c9a9-4b06-a94d-cfd26eaaabbd tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28" status: 404 len: 111 microversion: 2.1 time: 0.064694 Nov 03 04:10:38.339832 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1940/4018] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:38 2022] GET /compute/v2.1/servers/88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:10:38.343026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:38.343785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] [instance: e9d44823-1769-45c6-bfdc-a1ea4c24a78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:38.355811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.357633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.358546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.361885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.362477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.369949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-120d11c7-67d1-43df-bd70-cadd0a4c0db4 req-a7ebc938-adef-4dba-bb01-4ac8e35bc4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b269c6-cfaf-4c5a-8d5d-91b7d4617c28", "name": "network-vif-deleted", "tag": "585685c3-f193-4431-87f5-1aee5e89908e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:38.374960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.384164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-120d11c7-67d1-43df-bd70-cadd0a4c0db4 req-a7ebc938-adef-4dba-bb01-4ac8e35bc4cf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.384930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-120d11c7-67d1-43df-bd70-cadd0a4c0db4 req-a7ebc938-adef-4dba-bb01-4ac8e35bc4cf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.386106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-120d11c7-67d1-43df-bd70-cadd0a4c0db4 req-a7ebc938-adef-4dba-bb01-4ac8e35bc4cf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.399317 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-120d11c7-67d1-43df-bd70-cadd0a4c0db4 req-a7ebc938-adef-4dba-bb01-4ac8e35bc4cf service nova] Creating event network-vif-deleted:585685c3-f193-4431-87f5-1aee5e89908e for instance 88b269c6-cfaf-4c5a-8d5d-91b7d4617c28 on n-h1-854653-7 Nov 03 04:10:38.406780 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-120d11c7-67d1-43df-bd70-cadd0a4c0db4 req-a7ebc938-adef-4dba-bb01-4ac8e35bc4cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041493 Nov 03 04:10:38.409724 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1941/4019] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:38.417945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:38.420473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:38.428142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.435356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.435673 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] HTTP exception thrown: Instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c could not be found. Nov 03 04:10:38.436332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.437352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Request method failure captured: Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c HTTP/1.1 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz8Qtcwv9OjyY8Fi_iqHD4j3ScvVnC44-WAAQoyIBBoCnfRRF21jNgJZ_bhGIm2gd0IEWaNeUFCjMYRqHymPFQKoACo5ftqynRPZ8GXDMc20yHwSdzNBmQBmZZtaquULB2jK7BkT_QnHmBb_7qHSODm1vb3DB7pAdsOXLe5WwcuYxdU Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_34f90da150154e9a8f55a110606870d1", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "tempest-type-26990429", "name": "tempest-service-997395084", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/34f90da150154e9a8f55a110606870d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/34f90da150154e9a8f55a110606870d1"}]}] Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 34f90da150154e9a8f55a110606870d1 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1979518868 Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7f68df4da9df4e7fabace0aa43f6427b Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ListServersNegativeTestJSON-1979518868-project Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c could not be found. Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e9d44823-1769-45c6-bfdc-a1ea4c24a78c'} Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c could not be found. Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c could not be found. Nov 03 04:10:38.437607 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c could not be found. Nov 03 04:10:38.443708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:38.444293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.444293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.444457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] Returning 404 to user: Instance e9d44823-1769-45c6-bfdc-a1ea4c24a78c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:38.444457 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f0181ee-fd48-4444-a0d1-96c22471a768 tempest-ListServersNegativeTestJSON-1979518868 tempest-ListServersNegativeTestJSON-1979518868-project] 10.222.0.30 "GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c" status: 404 len: 111 microversion: 2.1 time: 0.103691 Nov 03 04:10:38.446418 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2079/4020] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:38 2022] GET /compute/v2.1/servers/e9d44823-1769-45c6-bfdc-a1ea4c24a78c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:10:38.512694 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b54d9523-4f03-422e-b111-09811ee2e840 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096937 Nov 03 04:10:38.514083 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1942/4021] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:38 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:38.619043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:38.619860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:38.640261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.645696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.646362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:38.651890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:38.656719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:38.657380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:39.526472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:39.529790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:39.555635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:39.563220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:39.563927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:39.564677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:39.566349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:39.566988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:39.567663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:39.617963 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-db3ec144-d091-491f-936a-45d04846cb24 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096489 Nov 03 04:10:39.624127 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1943/4022] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:39 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:39.705520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:39.766132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:39.783038 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4cc347c2-cb25-4769-bf15-323e20d32973 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 1.167690 Nov 03 04:10:39.784182 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2080/4023] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:38 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:40.653869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:40.664578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:40.720024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:40.721919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:40.722453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:40.724311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:40.726985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:40.727531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:40.815050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:40.816813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:40.840408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:40.856160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:40.860437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:40.863105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:40.873109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:40.876880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:40.881556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:40.908580 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90a101e6-435b-43c6-9928-eef9726c5b4d tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.281135 Nov 03 04:10:40.924942 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1944/4024] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:10:40 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c/os-volume_attachments => generated 25 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:10:41.031844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:41.034307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:41.065417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.071339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.071339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.075478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.082320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.086409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.182289 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Cannot 'reboot' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action HTTP/1.1 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 28 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: {"reboot": {"type": "HARD"}} Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'reboot' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '82465cf7-49c1-487c-abec-d774435ab248', 'body': {'reboot': {'type': 'HARD'}}} Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82465cf7-49c1-487c-abec-d774435ab248 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:10:41.186784 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.190653 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.198015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 409 to user: Cannot 'reboot' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:41.198985 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-600be022-e887-44af-b80e-16d28d4fa156 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action" status: 409 len: 145 microversion: 2.1 time: 0.172606 Nov 03 04:10:41.203819 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1945/4025] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:10:41 2022] POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action => generated 145 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 03 04:10:41.214300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:41.247017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:41.266069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.272415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.272415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.272415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.272415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.272415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.375038 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Cannot 'rebuild' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action HTTP/1.1 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 65 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'rebuild' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '82465cf7-49c1-487c-abec-d774435ab248', 'body': {'rebuild': {'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1'}}} Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82465cf7-49c1-487c-abec-d774435ab248 in vm_state rescued. Cannot rebuild while the instance is in this state. Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:41.388657 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued Nov 03 04:10:41.392229 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:41.397560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 409 to user: Cannot 'rebuild' instance 82465cf7-49c1-487c-abec-d774435ab248 while it is in vm_state rescued {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:41.398642 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f8ef057f-8618-4677-b364-1e98db41d6f8 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action" status: 409 len: 146 microversion: 2.1 time: 0.192541 Nov 03 04:10:41.405292 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1946/4026] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:10:41 2022] POST /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248/action => generated 146 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:10:41.412753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:41.413291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:41.433738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.434243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.434689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.436916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.438229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.439167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.508994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:10:41.800716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:41.814816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-038ba010-3d69-42f6-b28e-3aaa35b994d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 1.006939 Nov 03 04:10:41.819313 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2081/4027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:40 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:41.838018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db3ea7ac-92a6-4f68-9e75-d30babef0cad"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:41.852191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:41.884758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.888210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.888709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.893926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:41.895564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:41.901240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:41.969619 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6da87fb7-6aa5-40f8-a6c4-86fc30dd1d44 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 204 len: 0 microversion: 2.1 time: 0.560485 Nov 03 04:10:41.970255 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1947/4028] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:10:41 2022] DELETE /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:10:41.980219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:41.981199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:42.001037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:42.004143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:42.004961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:42.005914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:42.007356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:42.012291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:42.402392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:42.410866 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af063ae6-2154-4280-8ae0-905f8085f537 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1689 microversion: 2.1 time: 0.436123 Nov 03 04:10:42.411461 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1948/4029] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:41 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1689 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:42.846717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:42.847514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:42.861942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:42.883892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:42.887226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:42.902962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:42.919354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:42.923683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:43.300247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:43.313874 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-81d91237-60e0-4332-b2a2-ff4781cea7ed tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.468632 Nov 03 04:10:43.334158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1949/4030] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:42 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:43.438586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:43.439476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:43.450572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:43.451274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:43.451863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:43.457969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:43.457969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:43.457969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:43.471472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:43.757091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:43.767619 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7347306c-eb87-4575-81f1-dae8594644b4 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1689 microversion: 2.1 time: 0.332366 Nov 03 04:10:43.768617 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1950/4031] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:43 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1689 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:44.341841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:44.343174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:44.380558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:44.381152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:44.381547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:44.382277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:44.382806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:44.383268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:44.719109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:44.733846 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ab9be87-2d7f-42a6-bbd3-df78ffba7833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1682 microversion: 2.1 time: 0.396551 Nov 03 04:10:44.734831 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1951/4032] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:44 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1682 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:44.798589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:44.799636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:44.825887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:44.828933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:44.829593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:44.831720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:44.834037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:44.836517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:45.116771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:45.125488 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5f633c7a-c6b9-471a-9add-36be1f1e5361 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1689 microversion: 2.1 time: 0.333531 Nov 03 04:10:45.127807 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1952/4033] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:44 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1689 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:45.655323 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ec97e29-5dbf-4e34-b37d-53d8305e0410 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "POST /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.831970 Nov 03 04:10:45.656586 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2082/4034] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:10:41 2022] POST /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 194 bytes in 3836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:45.760226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:45.761806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:45.791974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:45.795731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:45.796246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:45.802644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:45.803668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:45.808317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:46.159378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:46.162698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:46.181466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:46.187568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:46.189671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:46.192335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:46.199302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:46.200085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:46.512710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:46.525970 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f0faeb26-7b29-4f27-992c-a6c62a0ebe8a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.768677 Nov 03 04:10:46.527006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1953/4035] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:45 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:46.955706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:46.971479 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95484453-30be-40fe-8feb-278e19369bbb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1689 microversion: 2.1 time: 0.811058 Nov 03 04:10:46.977424 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2083/4036] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:46 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1689 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:10:48.006959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:48.008506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:48.021922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:48.024157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:48.025969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:48.032761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:48.032761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:48.032761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:48.272152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:48.293347 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6aa22c1a-d806-442a-9ef7-08c4a431b599 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1621 microversion: 2.1 time: 0.293261 Nov 03 04:10:48.297938 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1954/4037] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:47 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1621 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:48.917220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:48.917220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:48.929798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:48.930501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:48.930957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:48.931688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:48.932155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:48.932593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:49.144201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-55e17373-9e5b-451d-b1ed-a14f776f994e req-ed2b81c9-1e0a-4060-bd1c-a65347f35852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-unplugged", "status": "completed", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:49.177592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-55e17373-9e5b-451d-b1ed-a14f776f994e req-ed2b81c9-1e0a-4060-bd1c-a65347f35852 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:49.177592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-55e17373-9e5b-451d-b1ed-a14f776f994e req-ed2b81c9-1e0a-4060-bd1c-a65347f35852 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:49.177592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-55e17373-9e5b-451d-b1ed-a14f776f994e req-ed2b81c9-1e0a-4060-bd1c-a65347f35852 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:49.205800 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-55e17373-9e5b-451d-b1ed-a14f776f994e req-ed2b81c9-1e0a-4060-bd1c-a65347f35852 service nova] Creating event network-vif-unplugged:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:10:49.220497 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-55e17373-9e5b-451d-b1ed-a14f776f994e req-ed2b81c9-1e0a-4060-bd1c-a65347f35852 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080377 Nov 03 04:10:49.230296 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1955/4038] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:10:49.260597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-72d7e0e7-13fc-4c6d-b999-2f1e087e3413 req-95e8d5bd-45fa-4cc7-bc3d-5b499a6e5422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b801e36-fff6-415b-a737-cc3e1bbfff8c", "name": "network-vif-deleted", "tag": "91b7c3b9-1d33-48ec-8a3d-cdd8320b5231"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:49.282646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-72d7e0e7-13fc-4c6d-b999-2f1e087e3413 req-95e8d5bd-45fa-4cc7-bc3d-5b499a6e5422 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:49.288378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-72d7e0e7-13fc-4c6d-b999-2f1e087e3413 req-95e8d5bd-45fa-4cc7-bc3d-5b499a6e5422 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:49.288378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-72d7e0e7-13fc-4c6d-b999-2f1e087e3413 req-95e8d5bd-45fa-4cc7-bc3d-5b499a6e5422 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:49.300218 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-72d7e0e7-13fc-4c6d-b999-2f1e087e3413 req-95e8d5bd-45fa-4cc7-bc3d-5b499a6e5422 service nova] Creating event network-vif-deleted:91b7c3b9-1d33-48ec-8a3d-cdd8320b5231 for instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c on n-h1-854653-7 Nov 03 04:10:49.312103 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-72d7e0e7-13fc-4c6d-b999-2f1e087e3413 req-95e8d5bd-45fa-4cc7-bc3d-5b499a6e5422 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067813 Nov 03 04:10:49.313085 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1956/4039] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:10:49.341234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:49.341946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:49.361181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:49.363076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:49.365794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:49.368102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:49.371979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:49.373181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:49.507271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:49.527798 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95f46eef-5b3d-48df-9c26-bf5fd08a2cdd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.618254 Nov 03 04:10:49.541124 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2084/4040] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:48 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:49.575880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:49.587743 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52690c04-7833-4758-80a4-b30694901251 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1329 microversion: 2.1 time: 0.269004 Nov 03 04:10:49.588661 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1957/4041] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:49 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1329 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:50.613255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:50.614327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:50.634223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:50.635490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:50.641122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:50.641122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:50.641122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:50.643619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:50.769994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:50.770510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:50.770965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:50.772057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lazy-loading 'fault' on Instance uuid 8b801e36-fff6-415b-a737-cc3e1bbfff8c {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:10:50.872139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:50.882719 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86e98af5-822e-4b21-9024-0f2e856a95cb tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 200 len: 1334 microversion: 2.1 time: 0.274621 Nov 03 04:10:50.883858 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2085/4042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:50 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 1334 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:51.921857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:51.923926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 8b801e36-fff6-415b-a737-cc3e1bbfff8c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:51.937935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:51.937935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:51.937935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:51.937935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:51.939736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:51.940452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:51.970453 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c could not be found. Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c HTTP/1.1 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c could not be found. Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '8b801e36-fff6-415b-a737-cc3e1bbfff8c'} Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c could not be found. Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c could not be found. Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:51.972412 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c could not be found. Nov 03 04:10:51.977141 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:51.978419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 404 to user: Instance 8b801e36-fff6-415b-a737-cc3e1bbfff8c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:51.980362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0d75d326-5924-472f-90a5-212a39d453de tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c" status: 404 len: 111 microversion: 2.1 time: 0.075780 Nov 03 04:10:51.981466 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1958/4043] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:51 2022] GET /compute/v2.1/servers/8b801e36-fff6-415b-a737-cc3e1bbfff8c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:10:51.990158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-893773ba-0e99-4109-9735-905f127ad66b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '.version_select at 0x7ff7f94560d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:52.107982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-893773ba-0e99-4109-9735-905f127ad66b tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325753863" status: 202 len: 0 microversion: 2.1 time: 0.122004 Nov 03 04:10:52.108689 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2086/4044] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325753863 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:10:53.830134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad7c7f42-aeba-480e-bac3-84528de2c8b6 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-35352936", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ad7c7f42-aeba-480e-bac3-84528de2c8b6 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] HTTP exception thrown: min_count must be <= max_count Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad7c7f42-aeba-480e-bac3-84528de2c8b6 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Request method failure captured: Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 182 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz9NGEqLzbz9Ve2Sd2kuR91fXk2RtjluBgAIGsiiFoU0-1byQeLVYSbBmKsQFpGYgLnm_vJW5Np06-ZGU5P94-wWQ715RUXqJT6HmlcJLQikD_oammoJ69SHMmfrBVlAXTu-aSr9AXo0lZuT5NaMAWwTYcsvCXMogEWmlrhuZkw3hwc Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_baa3d689072c4a41a8cb97077156e8c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/baa3d689072c4a41a8cb97077156e8c7"}]}] Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 2821f8588ae5413b999a14b9c52c2338 Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-35352936", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: exception: min_count must be <= max_count Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-35352936', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:10:53.858721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:10:53.867817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 03 04:10:53.867817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.867817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad7c7f42-aeba-480e-bac3-84528de2c8b6 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Returning 400 to user: min_count must be <= max_count {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:53.867817 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad7c7f42-aeba-480e-bac3-84528de2c8b6 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.313633 Nov 03 04:10:53.867817 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1959/4045] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:10:53 2022] POST /compute/v2.1/servers => generated 74 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 04:10:53.923166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b0f72a8-3abe-4abd-a50a-266fa8ce2014 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-538269111", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "max_count": 0}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b0f72a8-3abe-4abd-a50a-266fa8ce2014 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Request method failure captured: Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 167 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz9NGEqLzbz9Ve2Sd2kuR91fXk2RtjluBgAIGsiiFoU0-1byQeLVYSbBmKsQFpGYgLnm_vJW5Np06-ZGU5P94-wWQ715RUXqJT6HmlcJLQikD_oammoJ69SHMmfrBVlAXTu-aSr9AXo0lZuT5NaMAWwTYcsvCXMogEWmlrhuZkw3hwc Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_baa3d689072c4a41a8cb97077156e8c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/baa3d689072c4a41a8cb97077156e8c7"}]}] Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 2821f8588ae5413b999a14b9c52c2338 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-538269111", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "max_count": 0}} Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-538269111', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'max_count': 0}}} Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 0 Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:10:53.936207 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:10:53.941278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b0f72a8-3abe-4abd-a50a-266fa8ce2014 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:53.948282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b0f72a8-3abe-4abd-a50a-266fa8ce2014 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.024153 Nov 03 04:10:53.949518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2087/4046] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:10:53 2022] POST /compute/v2.1/servers => generated 130 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:10:54.228569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a4a822e-6df1-47ff-ada0-6a6e971a3bcf tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1935893469", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "max_count": 2.5}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a4a822e-6df1-47ff-ada0-6a6e971a3bcf tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Request method failure captured: Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 170 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz9NGEqLzbz9Ve2Sd2kuR91fXk2RtjluBgAIGsiiFoU0-1byQeLVYSbBmKsQFpGYgLnm_vJW5Np06-ZGU5P94-wWQ715RUXqJT6HmlcJLQikD_oammoJ69SHMmfrBVlAXTu-aSr9AXo0lZuT5NaMAWwTYcsvCXMogEWmlrhuZkw3hwc Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_baa3d689072c4a41a8cb97077156e8c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/baa3d689072c4a41a8cb97077156e8c7"}]}] Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 2821f8588ae5413b999a14b9c52c2338 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1935893469", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "max_count": 2.5}} Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1935893469', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'max_count': 2.5}}} Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 2.5 Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:10:54.238540 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.244184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a4a822e-6df1-47ff-ada0-6a6e971a3bcf tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:54.246331 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a4a822e-6df1-47ff-ada0-6a6e971a3bcf tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022183 Nov 03 04:10:54.248313 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1960/4047] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:10:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:10:54.324001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:54.325099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:54.335679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:54.339702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:54.340449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:54.342998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:54.344923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:54.345666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f45c508c-c1cf-43fb-978b-8826e08ea621 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1391755836", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 0}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f45c508c-c1cf-43fb-978b-8826e08ea621 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Request method failure captured: Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 168 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz9NGEqLzbz9Ve2Sd2kuR91fXk2RtjluBgAIGsiiFoU0-1byQeLVYSbBmKsQFpGYgLnm_vJW5Np06-ZGU5P94-wWQ715RUXqJT6HmlcJLQikD_oammoJ69SHMmfrBVlAXTu-aSr9AXo0lZuT5NaMAWwTYcsvCXMogEWmlrhuZkw3hwc Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_baa3d689072c4a41a8cb97077156e8c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/baa3d689072c4a41a8cb97077156e8c7"}]}] Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 2821f8588ae5413b999a14b9c52c2338 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1391755836", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 0}} Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1391755836', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'min_count': 0}}} Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 0 Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:54.389906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.393493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f45c508c-c1cf-43fb-978b-8826e08ea621 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:54.403935 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f45c508c-c1cf-43fb-978b-8826e08ea621 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027431 Nov 03 04:10:54.409488 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1961/4048] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:10:54 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:10:54.453996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:10:54.686088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b42fc02b-789d-48d5-ad52-143467506c81 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1969525101", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 2.5}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b42fc02b-789d-48d5-ad52-143467506c81 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Request method failure captured: Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 170 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz9NGEqLzbz9Ve2Sd2kuR91fXk2RtjluBgAIGsiiFoU0-1byQeLVYSbBmKsQFpGYgLnm_vJW5Np06-ZGU5P94-wWQ715RUXqJT6HmlcJLQikD_oammoJ69SHMmfrBVlAXTu-aSr9AXo0lZuT5NaMAWwTYcsvCXMogEWmlrhuZkw3hwc Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_baa3d689072c4a41a8cb97077156e8c7", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/baa3d689072c4a41a8cb97077156e8c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/baa3d689072c4a41a8cb97077156e8c7"}]}] Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: baa3d689072c4a41a8cb97077156e8c7 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-888201025 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 2821f8588ae5413b999a14b9c52c2338 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-888201025-project Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1969525101", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "min_count": 2.5}} Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1969525101', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'min_count': 2.5}}} Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 2.5 Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:10:54.695172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b42fc02b-789d-48d5-ad52-143467506c81 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:10:54.700056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b42fc02b-789d-48d5-ad52-143467506c81 tempest-MultipleCreateNegativeTestJSON-888201025 tempest-MultipleCreateNegativeTestJSON-888201025-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016054 Nov 03 04:10:54.705515 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1962/4049] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:10:54 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:10:55.399263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:55.408857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-268efaaf-77fa-4041-89df-d11fe5601e34 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 1.091840 Nov 03 04:10:55.421042 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2088/4050] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:54 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:55.438183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:55.438816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:55.452966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:55.454132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:55.454584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:55.463613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:55.463613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:55.463613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:56.120041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:56.128468 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c4e8399e-89e6-4a28-872b-ad88f11dc675 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.695117 Nov 03 04:10:56.133855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1963/4051] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:55 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:56.156867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:56.157525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:56.166448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:56.170395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:56.171260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:56.172313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:56.172927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:56.173544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:56.554792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:56.566850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b08e6cff-e6fb-44b5-a6a2-5d64e56aae61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.414497 Nov 03 04:10:56.593546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:10:56.596219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:56.598753 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2089/4052] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:56 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:56.616169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:56.616671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:56.617216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:56.618315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:56.619010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:56.621554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:56.900899 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9151957-8bd9-42b8-844e-3620ea3b0fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.310750 Nov 03 04:10:56.902440 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1964/4053] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:10:56 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:10:56.923522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:56.924419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:56.933307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:56.934684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:56.934684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:56.935785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:56.936415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:56.937001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:57.726384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:57.734746 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e269291-ea5e-4d3c-a425-71afc509e1f5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1671 microversion: 2.1 time: 0.816545 Nov 03 04:10:57.735784 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2090/4054] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:56 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1671 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:10:58.764138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:10:58.764845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:10:58.778373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:58.789650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:58.789650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:58.789650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:10:58.789650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:10:58.789650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:10:59.198068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:10:59.211923 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-54ab4ba3-dfff-4b69-88d6-8a8f6f308a2e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1671 microversion: 2.1 time: 0.453033 Nov 03 04:10:59.215672 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1965/4055] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:10:58 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1671 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:00.242686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:00.244187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:00.252952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:00.255058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:00.256035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:00.257215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:00.258211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:00.258837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:00.259701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:00.537266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:00.546101 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d05360d2-c0ba-42dd-801b-c38b5bd41e78 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.309119 Nov 03 04:11:00.569803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:00.572617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:00.574452 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2091/4056] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:00 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:00.579867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:00.580533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:00.581179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:00.582028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:00.582633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:00.583329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:00.663030 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc07a230-2e27-44cd-ae9a-bd40f3585ab6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 200 len: 324 microversion: 2.1 time: 0.097966 Nov 03 04:11:00.665119 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1966/4057] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:11:00 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 324 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:00.678924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:00.679585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:00.698302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:00.698302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:00.698302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:00.698302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:00.698302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:00.698302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:01.002567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:01.006757 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21e8f441-b607-4e8b-ad23-81dc10b16b5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.332661 Nov 03 04:11:01.007341 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2092/4058] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:00 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:01.033701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:01.035238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:01.042920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:01.043755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:01.044194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:01.044917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:01.045433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:01.045777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:01.270003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:01.286081 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7e03e729-bda3-444f-93a9-a6a7249633f6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.253396 Nov 03 04:11:01.290140 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1967/4059] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:01 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:01.315802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:01.316542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:01.340788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:01.340788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:01.340788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:01.340788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:01.340788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:01.342016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:01.760114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:01.768289 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0d298944-bf33-4019-879f-cf4b68df7699 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.456370 Nov 03 04:11:01.776345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2093/4060] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:01 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:01.799805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:01.800435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:01.803574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:01.810075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:01.810576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:01.811027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:01.811759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:01.812191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:01.812622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:02.204867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:02.215952 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-608b0527-0690-4ac6-970f-b91f58e87ff9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.425206 Nov 03 04:11:02.216541 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1968/4061] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:01 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:02.640330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-535311376", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": "none"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:02.750942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:11:02.751822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:11:02.752526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:11:02.753195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:11:02.753862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:11:02.774400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:02.775271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:02.777626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:02.778865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:02.779839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:02.783151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:02.831997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Getting quotas for project c5a729d5b96d4fcabf79ce077817f4bd. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:11:02.854786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Getting quotas for user db144c2c7df34fd3bc5d08d91b99aed0 and project c5a729d5b96d4fcabf79ce077817f4bd. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:11:02.874494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:11:02.877252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:11:02.891887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1395880943", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "d4690854-61c6-4734-9947-73292066365c"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:02.990577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] validate_networks() for [('d4690854-61c6-4734-9947-73292066365c', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:11:03.007216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4898961-91f0-4555-84ee-41788a4a5846 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.905724 Nov 03 04:11:03.008192 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2094/4062] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:11:03.019451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eaa7bdbf-dbe1-4c74-adb1-a3da6641f941 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:03.020075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eaa7bdbf-dbe1-4c74-adb1-a3da6641f941 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:03.158542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eaa7bdbf-dbe1-4c74-adb1-a3da6641f941 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:03.167996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eaa7bdbf-dbe1-4c74-adb1-a3da6641f941 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:03.177556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eaa7bdbf-dbe1-4c74-adb1-a3da6641f941 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:03.178890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eaa7bdbf-dbe1-4c74-adb1-a3da6641f941 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1280 microversion: 2.47 time: 0.163695 Nov 03 04:11:03.188938 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2095/4063] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:03 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:04.209738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-167f4d9b-2ac3-42fc-b9e9-898448c58884 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:04.210388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-167f4d9b-2ac3-42fc-b9e9-898448c58884 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:04.289613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-167f4d9b-2ac3-42fc-b9e9-898448c58884 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:04.300267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-167f4d9b-2ac3-42fc-b9e9-898448c58884 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:04.302599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-167f4d9b-2ac3-42fc-b9e9-898448c58884 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:04.303718 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-167f4d9b-2ac3-42fc-b9e9-898448c58884 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1280 microversion: 2.47 time: 0.098407 Nov 03 04:11:04.305862 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2096/4064] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:04 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:04.423475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:11:04.423475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:11:04.423475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:11:04.423475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:11:04.423475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:11:04.438009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:04.438867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:04.439488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:04.448172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:04.448995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:04.449739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:04.471380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:11:04.479926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for user d374eee04fe4433d862b7bc04a16a563 and project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:11:04.495223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:11:04.500271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:11:04.687270 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10c7e62f-9d7a-4bea-94b8-c62434648aec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799983 Nov 03 04:11:04.698391 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1969/4065] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:11:04.703992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5181a79-0b78-4f12-b230-5b35fae97771 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:04.705315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "05d4e648-798b-442b-b786-c67b4146c810"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:04.708743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:04.711994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5181a79-0b78-4f12-b230-5b35fae97771 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:04.778814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:04.785607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:04.790271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:04.791117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:04.792453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:04.795442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:04.823062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5181a79-0b78-4f12-b230-5b35fae97771 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:04.832066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5181a79-0b78-4f12-b230-5b35fae97771 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1215 microversion: 2.1 time: 0.132315 Nov 03 04:11:04.839094 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1970/4066] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:04 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:04.961800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] HTTP exception thrown: Volume 05d4e648-798b-442b-b786-c67b4146c810 could not be found. Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Request method failure captured: Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments/db3ea7ac-92a6-4f68-9e75-d30babef0cad HTTP/1.1 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 74 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz7M_W23AopBuPNH1Rth5lGxnXJVhPyNFZHk05v_nw5TKxCZrJvsv-D66Yvi44VeWKAJ0faeq9yLL-I6s8BRyMksH13HulMdIJLNyocrFks3W2M9Xat1gqvqqwSr0AVkjV2W6bpmuk9FFQaSG-GkGJ_2TuqlUiB3MvG8fDCRpE-nyPc Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f8d119ebf0a84166aa842d9644060774 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesAdminNegativeTest-1751480913 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f8d119ebf0a84166aa842d9644060774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f8d119ebf0a84166aa842d9644060774", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f8d119ebf0a84166aa842d9644060774"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f8d119ebf0a84166aa842d9644060774"}]}] Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesAdminNegativeTest-1751480913 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f8d119ebf0a84166aa842d9644060774 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1751480913 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesAdminNegativeTest-1751480913-project-admin Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 92df6b6bbaef4e9db15936c53d7dcf85 Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesAdminNegativeTest-1751480913-project-admin Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: {"volumeAttachment": {"volumeId": "05d4e648-798b-442b-b786-c67b4146c810"}} Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: exception: Volume 05d4e648-798b-442b-b786-c67b4146c810 could not be found. Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': '79ce6fca-a03d-4801-8283-860ebaae7eab', 'id': 'db3ea7ac-92a6-4f68-9e75-d30babef0cad', 'body': {'volumeAttachment': {'volumeId': '05d4e648-798b-442b-b786-c67b4146c810'}}} Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05d4e648-798b-442b-b786-c67b4146c810 could not be found. (HTTP 404) (Request-ID: req-91f9c787-62fa-4982-b9cf-aab94e9ee0e5) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:11:04.964091 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05d4e648-798b-442b-b786-c67b4146c810 could not be found. Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 05d4e648-798b-442b-b786-c67b4146c810 could not be found. Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05d4e648-798b-442b-b786-c67b4146c810 could not be found. Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Returning 400 to user: Volume 05d4e648-798b-442b-b786-c67b4146c810 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2de0d932-3437-4c2d-8468-cfa5f62edff3 tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments/db3ea7ac-92a6-4f68-9e75-d30babef0cad" status: 400 len: 107 microversion: 2.1 time: 0.625061 Nov 03 04:11:04.967847 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2097/4067] 10.222.0.30 () {60 vars in 1433 bytes} [Thu Nov 3 04:11:04 2022] PUT /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments/db3ea7ac-92a6-4f68-9e75-d30babef0cad => generated 107 bytes in 627 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 03 04:11:05.075783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:05.076608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:05.107049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.107928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.109777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.110977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.114415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.115069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.220352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lazy-loading 'services' on Instance uuid 79ce6fca-a03d-4801-8283-860ebaae7eab {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:11:05.351626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:05.352264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:05.363370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.364895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.365594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.366502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.367299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.367911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.458693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:05.484370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:05.488489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:05.490979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0d4a8411-c83b-4c11-9a62-b465fd1ab214 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1332 microversion: 2.47 time: 0.147882 Nov 03 04:11:05.493935 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2098/4068] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:05 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1332 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:11:05.529690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:05.530288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:05.537778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.538739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.539402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.540333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.540925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.541808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.578792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:11:05.580109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1544e3cf-8b22-4790-b656-b9bbe0eb4caf tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments/db3ea7ac-92a6-4f68-9e75-d30babef0cad" status: 202 len: 0 microversion: 2.1 time: 0.508152 Nov 03 04:11:05.585925 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1971/4069] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:11:05 2022] DELETE /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments/db3ea7ac-92a6-4f68-9e75-d30babef0cad => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:11:05.592847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:05.596386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:05.607612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.608173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.608689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.609439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:05.610166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:05.610622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:05.683328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee3e7303-2840-4d0a-9f6d-a7a119e6a0cc tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095675 Nov 03 04:11:05.693307 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1972/4070] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:05 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:05.855836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec9cc498-f7db-4224-aecc-1744fd319883 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:05.856454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec9cc498-f7db-4224-aecc-1744fd319883 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:05.929977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec9cc498-f7db-4224-aecc-1744fd319883 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:05.939200 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec9cc498-f7db-4224-aecc-1744fd319883 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1215 microversion: 2.1 time: 0.087430 Nov 03 04:11:05.940285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1973/4071] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:05 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:06.062321 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7988864f-4bcc-4794-a50a-0941cfa20656 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 204 len: 0 microversion: 2.1 time: 0.547776 Nov 03 04:11:06.062922 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2099/4072] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:11:05 2022] DELETE /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:11:06.071524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:06.072476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:06.082333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.083214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.085277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:06.086849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.087543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.089125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:06.122239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:06.305152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:06.316368 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8fdfbdf3-53b7-4fe8-839e-261697f7a677 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1506 microversion: 2.1 time: 0.249257 Nov 03 04:11:06.316964 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1974/4073] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:06 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:06.525824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:06.526532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:06.533705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.534464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.535117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:06.536045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.536686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.537393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:06.629495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:06.642881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:06.642881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:06.643190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c504a9e4-78a2-4cdd-84a6-e6a2898f47eb tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1340 microversion: 2.47 time: 0.121433 Nov 03 04:11:06.657663 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2100/4074] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:06 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1340 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:11:06.704753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:06.709125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:06.741281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.741810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.742261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:06.742983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.743448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.743882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:06.804589 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c178cef-bba7-4832-b2b0-277b3b122497 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110089 Nov 03 04:11:06.805760 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1975/4075] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:06 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:06.962777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:06.963677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:06.970002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.970720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.971371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:06.972266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:06.972878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:06.973528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:07.065659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:07.077657 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b254de9d-64df-492e-a96e-23ab42f384ef tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1267 microversion: 2.1 time: 0.118676 Nov 03 04:11:07.093827 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2101/4076] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:06 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:07.345275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:07.346753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:07.358064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:07.358693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:07.359367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:07.360456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:07.361130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:07.363519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:07.522530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:07.531939 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1573c29a-f1ac-4216-8876-89bcb5eba858 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1506 microversion: 2.1 time: 0.192062 Nov 03 04:11:07.532552 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1976/4077] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:07 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:07.674340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:07.674818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:07.682539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:07.684038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:07.684038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:07.684538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:07.685173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:07.685939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:07.817350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:07.820742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:07.827871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:07.830029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:07.830029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:07.830029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:07.830832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:07.831473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:07.856680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:07.880755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:07.887760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:07.890435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-177c976d-4ddb-4949-bedd-c6343ea6f9b9 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1338 microversion: 2.47 time: 0.220650 Nov 03 04:11:07.893222 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2102/4078] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:07 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:07.901273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f82e73e9-a984-449f-b640-da2547c936b3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087972 Nov 03 04:11:07.902425 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1977/4079] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:07 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:11:08.104581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:08.105267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:08.124165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.125587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.128567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.129764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.131781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.133500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.304283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:08.313056 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec321469-963f-4550-b991-874aa0b672af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1267 microversion: 2.1 time: 0.212404 Nov 03 04:11:08.326752 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2103/4080] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:08 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:08.354797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a0f3cf68-677a-4317-b555-e6404bdb3671 req-30b5c196-76b9-46b9-9723-e93761f13ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82465cf7-49c1-487c-abec-d774435ab248", "name": "network-vif-deleted", "tag": "eed0ed2e-a58a-4dd6-a2d9-fc3c237abfee"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:08.368045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a0f3cf68-677a-4317-b555-e6404bdb3671 req-30b5c196-76b9-46b9-9723-e93761f13ade service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.368602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a0f3cf68-677a-4317-b555-e6404bdb3671 req-30b5c196-76b9-46b9-9723-e93761f13ade service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.369317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a0f3cf68-677a-4317-b555-e6404bdb3671 req-30b5c196-76b9-46b9-9723-e93761f13ade service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.394638 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a0f3cf68-677a-4317-b555-e6404bdb3671 req-30b5c196-76b9-46b9-9723-e93761f13ade service nova] Creating event network-vif-deleted:eed0ed2e-a58a-4dd6-a2d9-fc3c237abfee for instance 82465cf7-49c1-487c-abec-d774435ab248 on n-h1-854653-7 Nov 03 04:11:08.403153 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a0f3cf68-677a-4317-b555-e6404bdb3671 req-30b5c196-76b9-46b9-9723-e93761f13ade service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052301 Nov 03 04:11:08.408755 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1978/4081] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:08.570999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:08.571636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:08.599340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.601266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.601739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.605276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.605782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.606489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.734290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:08.743970 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86262870-9b10-474e-bc07-17b7cddc206a tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1292 microversion: 2.1 time: 0.186873 Nov 03 04:11:08.748411 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2104/4082] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:08 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1292 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:08.923340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:08.924260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:08.929578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:08.936219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:08.946152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.946345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.946653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.947201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.947663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.948646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.950142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.953183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:08.953665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.953779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:08.954141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:08.954249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:09.027759 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c5c9204-479e-455f-b152-1453659f4f61 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108935 Nov 03 04:11:09.035391 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1979/4083] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:08 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:09.142120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:09.152020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:09.153561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:09.154901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0fbaa574-e2c1-4cd5-97a6-38adf0a801de tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1338 microversion: 2.47 time: 0.237323 Nov 03 04:11:09.155625 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2105/4084] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:08 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1338 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:09.342839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:09.343857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:09.351536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:09.352032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:09.352511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:09.353429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:09.354088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:09.354532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:09.620238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:09.627962 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7c36d75b-a88e-4d07-842a-06ee2a932b6f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1285 microversion: 2.1 time: 0.292968 Nov 03 04:11:09.653128 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1980/4085] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:09 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:09.770601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:09.771225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:09.779359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:09.780211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:09.780718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:09.781528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:09.782140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:09.782646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:09.815455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:09.825365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:09.825859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:09.826301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:09.826750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lazy-loading 'fault' on Instance uuid 82465cf7-49c1-487c-abec-d774435ab248 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:11:09.941645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:09.955593 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fa3d3730-80ca-4d87-89d5-1871adc9b589 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 200 len: 1311 microversion: 2.1 time: 0.188938 Nov 03 04:11:09.975402 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2106/4086] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:09 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 1311 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:10.042607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:10.045567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:10.063754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.064302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.064753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:10.066831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.067431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.067878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:10.176270 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd703e8b-2231-42ff-982a-f89f14350d2f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139749 Nov 03 04:11:10.181669 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1981/4087] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:10 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:10.186768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:10.191053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:10.199836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.200703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.201332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:10.202251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.202855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.203431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:10.318948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:10.332938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:10.334088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:10.335317 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f29e02c-db54-49c9-a391-918f16ad9547 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1359 microversion: 2.47 time: 0.156738 Nov 03 04:11:10.338317 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2107/4088] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:10 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:10.363805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-411356539"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:10.366947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:10.384034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.390217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.390217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:10.390217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.390217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.391555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:10.660063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:10.663449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:10.675932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.679706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.681053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:10.682451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:10.693393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:10.693393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.035994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:11.044969 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75ede244-7040-4578-826b-9662238170d1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 0.392728 Nov 03 04:11:11.046004 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2108/4089] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:10 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:11.066873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:11.072761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: 82465cf7-49c1-487c-abec-d774435ab248] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:11.094015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.097295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.102573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.103203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.106923 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b61f7ebb-749c-44b3-96a1-e37e13e5dfe5 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "POST /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996/action" status: 202 len: 52 microversion: 2.47 time: 0.747956 Nov 03 04:11:11.107649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1982/4090] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:11:10 2022] POST /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996/action => generated 52 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Nov 03 04:11:11.120264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:11.120771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.121376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.125533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:11.156306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.159576 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Instance 82465cf7-49c1-487c-abec-d774435ab248 could not be found. Nov 03 04:11:11.167045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.167740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.168373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.168851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.169378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 HTTP/1.1 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 82465cf7-49c1-487c-abec-d774435ab248 could not be found. Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '82465cf7-49c1-487c-abec-d774435ab248'} Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82465cf7-49c1-487c-abec-d774435ab248 could not be found. Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82465cf7-49c1-487c-abec-d774435ab248 could not be found. Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:11.171278 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82465cf7-49c1-487c-abec-d774435ab248 could not be found. Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 404 to user: Instance 82465cf7-49c1-487c-abec-d774435ab248 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ae2ad5b-5a42-46f8-a144-136f91f4e360 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248" status: 404 len: 111 microversion: 2.1 time: 0.110535 Nov 03 04:11:11.174981 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2109/4091] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:11 2022] GET /compute/v2.1/servers/82465cf7-49c1-487c-abec-d774435ab248 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:11:11.186241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:11.189107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:11.205317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.205829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.206281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.210034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.210437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.210903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.239377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:11:11.274625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:11:11.649574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07b4242b-d48c-4e55-8f94-2896d9ec7f01 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 204 len: 0 microversion: 2.47 time: 0.534022 Nov 03 04:11:11.650301 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1983/4092] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:11:11 2022] DELETE /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:11:11.658247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:11.664111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:11.677853 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab5821a8-0a58-4c31-85af-ff47501131cc tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 204 len: 0 microversion: 2.1 time: 0.497772 Nov 03 04:11:11.678659 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2110/4093] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:11:11 2022] DELETE /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:11:11.687260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:11.689319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:11.690854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.691562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.694092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.695146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.696720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.698316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.715110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.715110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.715110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.716463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.716952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.717423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.760898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce76db9d-2b01-4554-82ca-cb286ea7fe5a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108577 Nov 03 04:11:11.762359 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1984/4094] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:11 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:11.775114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:11.779131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:11.789422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.790582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.792058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.793339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:11.794051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:11.794836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:11.906105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:11.917350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:11.919045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:11.925302 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13b259e5-95d9-478f-b57a-e528268c134c tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1365 microversion: 2.47 time: 0.242404 Nov 03 04:11:11.946905 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2111/4095] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:11 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:12.069351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:12.070082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:12.086961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:12.087634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:12.088130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:12.089230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:12.090004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:12.090503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:12.349718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:12.359193 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1573e26-9388-4a42-bee6-afeb1042b1e7 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.594585 Nov 03 04:11:12.360514 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1985/4096] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:11 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:12.681430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:12.703785 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1085a06f-5421-4654-b441-1a0b3dfbbc65 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 0.625249 Nov 03 04:11:12.707101 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2112/4097] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:12 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:12.775951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:12.778401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:12.786795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:12.787474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:12.788085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:12.789103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:12.789810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:12.790397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:12.836111 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bc7c5f92-8fc4-4df3-a5a4-43b8be87b96a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064740 Nov 03 04:11:12.841002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1986/4098] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:12 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:12.954594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:12.955209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:12.958350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:12.972693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:12.973842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:12.974505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:12.976624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:12.977273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:12.977911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.061150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:13.075751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:13.083461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:13.096506 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15c45375-2d6e-4f1d-95d7-e1fbf0e38744 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1365 microversion: 2.47 time: 0.139814 Nov 03 04:11:13.097827 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2113/4099] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:12 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:13.151516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-82e25654-5c44-4793-ae6b-a7abf67258ac req-247ca0e5-b810-4fa0-9363-9242e13c8258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a89c8874-6e5c-4d54-b5b3-04d416801153", "tag": "4d314987-2e70-453e-8561-399be3e4c819"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:13.187893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-82e25654-5c44-4793-ae6b-a7abf67258ac req-247ca0e5-b810-4fa0-9363-9242e13c8258 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:13.188700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-82e25654-5c44-4793-ae6b-a7abf67258ac req-247ca0e5-b810-4fa0-9363-9242e13c8258 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:13.189999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-82e25654-5c44-4793-ae6b-a7abf67258ac req-247ca0e5-b810-4fa0-9363-9242e13c8258 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.240380 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-82e25654-5c44-4793-ae6b-a7abf67258ac req-247ca0e5-b810-4fa0-9363-9242e13c8258 service nova] Creating event network-changed:4d314987-2e70-453e-8561-399be3e4c819 for instance a89c8874-6e5c-4d54-b5b3-04d416801153 on n-h2-854653-7 Nov 03 04:11:13.250315 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-82e25654-5c44-4793-ae6b-a7abf67258ac req-247ca0e5-b810-4fa0-9363-9242e13c8258 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104988 Nov 03 04:11:13.251690 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1987/4100] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:13.390946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:13.391565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:13.413329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:13.413329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:13.413329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.413329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:13.413329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:13.413329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.731390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:13.732109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:13.758849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:13.765538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:13.768471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:13.769557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.770569 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-576537ee-92a5-4098-b763-9e0643eb76fd tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.382952 Nov 03 04:11:13.771573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:13.772876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:13.775470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.781829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2114/4101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:13 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:13.849688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:13.852374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:13.859132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:13.859630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:13.860613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.861453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:13.861992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:13.862502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:13.915947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78f7aa44-aea5-40f3-95de-5224d830a752 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063211 Nov 03 04:11:13.916882 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2115/4102] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:13 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:11:14.040725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:14.050075 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7a380efe-eceb-4c96-b6f1-c089caf01942 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 0.324903 Nov 03 04:11:14.069232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1988/4103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:13 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:14.139026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:14.143881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:14.159472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:14.160412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:14.161294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:14.162316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:14.162968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:14.163596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:14.298763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:14.440677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:14.461702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:14.473330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db144c2c7df34fd3bc5d08d91b99aed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a729d5b96d4fcabf79ce077817f4bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:14.479914 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15937edc-9061-466a-823e-8db74ad1c402 tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 200 len: 1365 microversion: 2.47 time: 0.355461 Nov 03 04:11:14.484075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2116/4104] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:14 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:11:14.797497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:14.798331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:14.802241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:14.814605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:14.819325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:14.827865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:14.827865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:14.827865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:14.827865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:14.832774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:14.931154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:14.934670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:14.945714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:14.946526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:14.947053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:14.948157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:14.948260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:14.948673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:15.015376 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d21ba13-95dd-453a-b3a6-9ff7d6637510 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090085 Nov 03 04:11:15.017823 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2117/4105] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:11:14 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:11:15.079070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:15.079819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:15.100023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:15.102293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:15.104223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:15.105402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:15.106090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:15.106582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:15.448777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:15.465111 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3c42ff4f-a392-4973-95e8-77b3da87d930 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1520 microversion: 2.1 time: 0.671174 Nov 03 04:11:15.467998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1989/4106] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:14 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1520 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:15.476555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-984508818", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1dcc32ad-2743-4ff3-9517-fc7e565382ef"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:15.561484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] validate_networks() for [('1dcc32ad-2743-4ff3-9517-fc7e565382ef', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:11:15.850371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:15.897380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f48f1ca-4689-4050-8289-4c60ac4fb680 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 0.818218 Nov 03 04:11:15.939107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:15.940143 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2118/4107] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:15 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:15.957517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:15.969072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] [instance: 7ddcc57f-842f-4af4-9cf2-f167eaa7e996] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:16.006259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.010217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.010851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.011638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.017170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.018053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.057191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] HTTP exception thrown: Instance 7ddcc57f-842f-4af4-9cf2-f167eaa7e996 could not be found. Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Request method failure captured: Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 HTTP/1.1 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz9V_1XYdfJ-fC-WBPxwBiYbPnm7aQ5PX64rih-Zw8b_hgMRX5MQnlWXM_6TJaZqQGb-i9S0QiZdjVym1U9VP7PudgknShwvqX-k7jCF2gtSHvBhQaPEdhTeDVLoT4iu067MrtQtUs1b-tPjiHx4gGaE2M8e8QsoNEjyMtnhXQ8DNsk Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.47 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: c5a729d5b96d4fcabf79ce077817f4bd Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersAaction247Test-1980821806 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5a729d5b96d4fcabf79ce077817f4bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c5a729d5b96d4fcabf79ce077817f4bd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c5a729d5b96d4fcabf79ce077817f4bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c5a729d5b96d4fcabf79ce077817f4bd"}]}] Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersAaction247Test-1980821806 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: c5a729d5b96d4fcabf79ce077817f4bd Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersAaction247Test-1980821806 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersAaction247Test-1980821806-project Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: db144c2c7df34fd3bc5d08d91b99aed0 Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersAaction247Test-1980821806-project Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 7ddcc57f-842f-4af4-9cf2-f167eaa7e996 could not be found. Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7ddcc57f-842f-4af4-9cf2-f167eaa7e996'} Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ddcc57f-842f-4af4-9cf2-f167eaa7e996 could not be found. Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ddcc57f-842f-4af4-9cf2-f167eaa7e996 could not be found. Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:16.062185 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ddcc57f-842f-4af4-9cf2-f167eaa7e996 could not be found. Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] Returning 404 to user: Instance 7ddcc57f-842f-4af4-9cf2-f167eaa7e996 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9cac8409-9169-42f2-a83a-4e98282069ce tempest-ServersAaction247Test-1980821806 tempest-ServersAaction247Test-1980821806-project] 10.222.0.30 "GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996" status: 404 len: 111 microversion: 2.47 time: 0.122474 Nov 03 04:11:16.066626 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2119/4108] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:11:15 2022] GET /compute/v2.1/servers/7ddcc57f-842f-4af4-9cf2-f167eaa7e996 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:11:16.121477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b405323a-8b5b-40e4-bca9-5f32f9eae0d2 req-322ff260-c656-40fa-bd05-b23cea7bde12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee668004-ab0e-4715-b036-b468dd887743", "name": "network-vif-deleted", "tag": "ddb1c8db-77d4-4d1f-a953-0b70570f0efc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:16.163661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b405323a-8b5b-40e4-bca9-5f32f9eae0d2 req-322ff260-c656-40fa-bd05-b23cea7bde12 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.166979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b405323a-8b5b-40e4-bca9-5f32f9eae0d2 req-322ff260-c656-40fa-bd05-b23cea7bde12 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.169104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b405323a-8b5b-40e4-bca9-5f32f9eae0d2 req-322ff260-c656-40fa-bd05-b23cea7bde12 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.196695 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b405323a-8b5b-40e4-bca9-5f32f9eae0d2 req-322ff260-c656-40fa-bd05-b23cea7bde12 service nova] Creating event network-vif-deleted:ddb1c8db-77d4-4d1f-a953-0b70570f0efc for instance ee668004-ab0e-4715-b036-b468dd887743 on n-h1-854653-7 Nov 03 04:11:16.203993 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b405323a-8b5b-40e4-bca9-5f32f9eae0d2 req-322ff260-c656-40fa-bd05-b23cea7bde12 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086987 Nov 03 04:11:16.204991 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2120/4109] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:11:16.496131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:16.496855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:16.515201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.515973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.516658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.518715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.522504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.523216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.545846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:11:16.546826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:11:16.548058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:11:16.549032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:11:16.549639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:11:16.566916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.566916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.566916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.566916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.567348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.567740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.593741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Getting quotas for project 6e92fb95e80b4d6cace544d5cb063953. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:11:16.601726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Getting quotas for user 7711a11a426b4b3987c5150fb4540c6e and project 6e92fb95e80b4d6cace544d5cb063953. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:11:16.622723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:11:16.625551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:11:16.718031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef8a5af3a6147e286ecc23d3aa0751e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ac6ea284df44852a4ae8bf160ff0b02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:16.731388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cad88cbd-c530-4a13-aa06-f8a3b5103cc1 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 200 len: 1306 microversion: 2.1 time: 0.239625 Nov 03 04:11:16.745037 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2121/4110] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:16 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 1306 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:16.886505 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0f160c1e-ed86-4224-814c-f58bdfff7319 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417032 Nov 03 04:11:16.896421 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1990/4111] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:11:16.901997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32a4bcda-d2e2-4bfe-91d2-dbfce09b5374 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:16.906666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-32a4bcda-d2e2-4bfe-91d2-dbfce09b5374 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:16.927360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:16.928022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:16.956198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.957944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.959010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:16.964341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:16.965890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:16.966913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:17.796828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-32a4bcda-d2e2-4bfe-91d2-dbfce09b5374 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:17.805765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-32a4bcda-d2e2-4bfe-91d2-dbfce09b5374 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1217 microversion: 2.1 time: 0.908200 Nov 03 04:11:17.808943 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2122/4112] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:16 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1217 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:17.823864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:17.827514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] [instance: ee668004-ab0e-4715-b036-b468dd887743] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:17.840912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:17.843644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:17.844280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:17.852496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:17.852496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:17.852496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:17.883706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] HTTP exception thrown: Instance ee668004-ab0e-4715-b036-b468dd887743 could not be found. Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Request method failure captured: Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 HTTP/1.1 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz3xqByDbUYbx948s5Y9IDgQTbyZFOVAha2u2gfvZNPMmozpUSR1r_rG0aVdcz4gwcM8pHpb8VXGfdGl3DCNt0Pz0Z-Yb96tOzLeiidYd2oyCDhjYXtsnNBZIGovUl6r15SrQ7IOAAv75IFcizjexR-0ig6lFVjULq7oP7BRXNzzADY Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ac6ea284df44852a4ae8bf160ff0b02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ac6ea284df44852a4ae8bf160ff0b02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ac6ea284df44852a4ae8bf160ff0b02"}]}] Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0ac6ea284df44852a4ae8bf160ff0b02 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1677912591 Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: eef8a5af3a6147e286ecc23d3aa0751e Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1677912591-project Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ee668004-ab0e-4715-b036-b468dd887743 could not be found. Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ee668004-ab0e-4715-b036-b468dd887743'} Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee668004-ab0e-4715-b036-b468dd887743 could not be found. Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee668004-ab0e-4715-b036-b468dd887743 could not be found. Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:17.886965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee668004-ab0e-4715-b036-b468dd887743 could not be found. Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:11:17.890689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] Returning 404 to user: Instance ee668004-ab0e-4715-b036-b468dd887743 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:11:17.895837 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b35bb21-9d4e-4075-9822-aef76210d431 tempest-ServerRescueNegativeTestJSON-1677912591 tempest-ServerRescueNegativeTestJSON-1677912591-project] 10.222.0.30 "GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743" status: 404 len: 111 microversion: 2.1 time: 0.081880 Nov 03 04:11:17.903761 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2123/4113] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:17 2022] GET /compute/v2.1/servers/ee668004-ab0e-4715-b036-b468dd887743 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:11:18.033636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:18.060360 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-701f53fa-fce9-4a92-b092-c7c5fcc5cafd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 1.141330 Nov 03 04:11:18.062284 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1991/4114] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:16 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:18.857714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:18.858573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:18.880900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:18.884181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:18.889115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:18.890011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:18.891349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:18.902158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:18.902874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:19.022554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:19.027201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:19.037384 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20758330-2301-4e0b-9ac2-fa7f1a1ec3ca tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1221 microversion: 2.1 time: 0.194286 Nov 03 04:11:19.039422 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2124/4115] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:18 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1221 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:19.089943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:19.091167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:19.103703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:19.109481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:19.111126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:19.114790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:19.115529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:19.116164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:19.535771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:19.553408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2af93a41-787d-4415-ac48-14eb75bfa0e2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 0.461216 Nov 03 04:11:19.561096 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1992/4116] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:19 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:20.068028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:20.075739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:20.107082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:20.107586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:20.108033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:20.108763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:20.109252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:20.109688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:20.367052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:20.384134 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c8e84c7-7dda-4614-8e9b-2e9030d831ec tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1277 microversion: 2.1 time: 0.321073 Nov 03 04:11:20.387493 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2125/4117] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:20 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:20.587254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:20.588037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:20.609037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:20.614072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:20.614951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:20.618072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:20.621501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:20.629078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:20.980613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:21.000717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7543a937-108d-4d3c-b050-b7f096edd6f7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 0.422599 Nov 03 04:11:21.004727 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1993/4118] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:20 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:21.411238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:21.413184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:21.427219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:21.428230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:21.428940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:21.430085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:21.430717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:21.431322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:21.626886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:21.647177 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa678fd8-597f-415d-b727-063d1d70386a tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1275 microversion: 2.1 time: 0.240637 Nov 03 04:11:21.661070 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2126/4119] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:21 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:22.038408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:22.039675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:22.057760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:22.058654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:22.062631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:22.063726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:22.064457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:22.065383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:22.310243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-507c6779-c50a-4328-9090-438e8cb7e767 req-51f68f19-a838-407b-890d-21236eb75dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c8874-6e5c-4d54-b5b3-04d416801153", "name": "network-vif-plugged", "status": "completed", "tag": "4d314987-2e70-453e-8561-399be3e4c819"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:22.328183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-507c6779-c50a-4328-9090-438e8cb7e767 req-51f68f19-a838-407b-890d-21236eb75dcd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:22.328676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-507c6779-c50a-4328-9090-438e8cb7e767 req-51f68f19-a838-407b-890d-21236eb75dcd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:22.329158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-507c6779-c50a-4328-9090-438e8cb7e767 req-51f68f19-a838-407b-890d-21236eb75dcd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:22.370657 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-507c6779-c50a-4328-9090-438e8cb7e767 req-51f68f19-a838-407b-890d-21236eb75dcd service nova] Creating event network-vif-plugged:4d314987-2e70-453e-8561-399be3e4c819 for instance a89c8874-6e5c-4d54-b5b3-04d416801153 on n-h2-854653-7 Nov 03 04:11:22.376316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-507c6779-c50a-4328-9090-438e8cb7e767 req-51f68f19-a838-407b-890d-21236eb75dcd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071485 Nov 03 04:11:22.377451 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2127/4120] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:22.674322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:22.713905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:22.715384 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4df1a375-0a2d-4f83-8855-cd2defd0d7d2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 0.688714 Nov 03 04:11:22.716672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:22.720833 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1994/4121] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:22 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:22.734347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:22.736767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:22.737382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:22.740998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:22.742305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:22.742874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:23.122235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:23.140967 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e6d4b02-e5ff-4fc5-8a38-102fe2e4c264 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 0.473989 Nov 03 04:11:23.142204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2128/4122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:22 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:23.746826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:23.746826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:23.761646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:23.762346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:23.762960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:23.764020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:23.764884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:23.765500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:24.168477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:24.169926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:24.179901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:24.180398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:24.181467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:24.182203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:24.182673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:24.183127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:25.242523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:25.253162 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f6e9e0c-aeaf-4a01-9675-d308dd8e1e18 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1315 microversion: 2.1 time: 1.513097 Nov 03 04:11:25.256324 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1995/4123] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:23 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1315 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:25.321347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:25.333603 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33f7b1d1-f4bd-4d8c-9d4a-11fe366e13a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 1.169767 Nov 03 04:11:25.339361 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2129/4124] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:24 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:25.903350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a730031c-0692-4123-a7d0-05d9749d2959 req-b2008bb6-02aa-4397-9e77-d8364d32258b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3646ef8f-3bf6-4fab-b317-8f3dc64d435e", "tag": "5cb65745-5086-4b0a-bfcf-12c9d138fc0c"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:25.933856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a730031c-0692-4123-a7d0-05d9749d2959 req-b2008bb6-02aa-4397-9e77-d8364d32258b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:25.936254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a730031c-0692-4123-a7d0-05d9749d2959 req-b2008bb6-02aa-4397-9e77-d8364d32258b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:25.936689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a730031c-0692-4123-a7d0-05d9749d2959 req-b2008bb6-02aa-4397-9e77-d8364d32258b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:25.979214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a730031c-0692-4123-a7d0-05d9749d2959 req-b2008bb6-02aa-4397-9e77-d8364d32258b service nova] Creating event network-changed:5cb65745-5086-4b0a-bfcf-12c9d138fc0c for instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e on n-h1-854653-7 Nov 03 04:11:25.989056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a730031c-0692-4123-a7d0-05d9749d2959 req-b2008bb6-02aa-4397-9e77-d8364d32258b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089575 Nov 03 04:11:25.993074 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1996/4125] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:26.281780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:26.283428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:26.306962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:26.314004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:26.316433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:26.320762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:26.321288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:26.321744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:26.361648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:26.366811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:26.383614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:26.384527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:26.385296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:26.386961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:26.387665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:26.388577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:26.587714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:26.967566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:26.977517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4fe5df71-f6f0-4778-a786-337a9836c2ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1502 microversion: 2.1 time: 0.701903 Nov 03 04:11:26.980880 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2130/4126] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:26 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1502 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:27.005799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-811a93c3-5e4d-4244-a4ea-42bec205fb54 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:27.016679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-811a93c3-5e4d-4244-a4ea-42bec205fb54 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:27.021172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-811a93c3-5e4d-4244-a4ea-42bec205fb54 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:27.021172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-811a93c3-5e4d-4244-a4ea-42bec205fb54 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:27.070210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-811a93c3-5e4d-4244-a4ea-42bec205fb54 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Going to try to stop instance {{(pid=127594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:11:27.175918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:27.185357 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36863078-ab47-46c3-bcbe-3cd491d181b8 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 0.828392 Nov 03 04:11:27.194770 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1997/4127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:26 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:27.276278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-811a93c3-5e4d-4244-a4ea-42bec205fb54 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153/action" status: 202 len: 0 microversion: 2.1 time: 0.275048 Nov 03 04:11:27.279871 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2131/4128] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:11:26 2022] POST /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:11:27.287554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:27.288487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:27.300440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:27.301490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:27.302640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:27.305417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:27.306128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:27.307953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:27.364250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:27.749961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:27.756392 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-125b5d35-094e-403e-8831-64177ab2beb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.473406 Nov 03 04:11:27.757589 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1998/4129] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:27 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:28.209693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:28.214828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:28.215750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:28.222569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:28.225062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:28.225062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:28.225689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:28.226322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:28.226760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:28.791669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:28.793696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:28.804739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:28.818717 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d92d99d-5747-4a37-9c84-ae0ac5e2ac01 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 0.609294 Nov 03 04:11:28.822464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:28.825373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:28.825611 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2132/4130] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:28 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:28.856951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:28.856951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:28.856951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:28.856951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:28.856951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:29.327305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:29.341748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1c9210b-e0ac-4f68-b0eb-0277ed2e82bd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.565359 Nov 03 04:11:29.346097 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 1999/4131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:28 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:29.852240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:29.852872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:29.867827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:29.868329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:29.868959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:29.869895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:29.870532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:29.870974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:30.375769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:30.380085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:30.390552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:30.391986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:30.394818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:30.397126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:30.398386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:30.401291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:31.008601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:31.023930 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48b19375-f02c-45c2-8346-3681c8558de4 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 1.175468 Nov 03 04:11:31.041921 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2133/4132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:29 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:31.093510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:31.105333 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d70489c2-0df2-47d0-9a0b-200e27a297a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.740043 Nov 03 04:11:31.106415 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2000/4133] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:30 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:32.048332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:32.049567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:32.067412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:32.068263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:32.068776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:32.070690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:32.071783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:32.072292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:32.131545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:32.132774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:32.146850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:32.146850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:32.147266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:32.147744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:32.151485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:32.151939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:32.834618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:32.848442 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79f2a600-a117-4dcb-8813-de9a9e559ec4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.721305 Nov 03 04:11:32.849580 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2001/4134] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:32 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:32.853822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:32.868668 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f4222364-9171-4bd0-8b2c-4507a91531f3 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 0.824139 Nov 03 04:11:32.869314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2134/4135] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:32 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:33.874258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:33.876088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:33.897498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:33.899118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:33.899658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:33.900812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:33.901282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:33.902389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:33.908761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:33.917587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:33.918884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:33.919993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:33.922267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:33.923250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:33.926191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:33.926846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:34.442055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:34.450707 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9c7d5532-0831-4294-990f-36a0f6cc873c tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 0.556594 Nov 03 04:11:34.451348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2135/4136] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:33 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:34.472462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:34.482523 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-819bf3e6-8596-4ee7-a837-ecddd88c128b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.612590 Nov 03 04:11:34.483701 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2002/4137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:33 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:35.373908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7de7849b-15bd-4ebc-8a94-595f27475c2a req-ce0f6c5f-98b7-4a91-a78d-d248570a0fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3646ef8f-3bf6-4fab-b317-8f3dc64d435e", "name": "network-vif-plugged", "status": "completed", "tag": "5cb65745-5086-4b0a-bfcf-12c9d138fc0c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:35.425948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7de7849b-15bd-4ebc-8a94-595f27475c2a req-ce0f6c5f-98b7-4a91-a78d-d248570a0fa7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:35.425948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7de7849b-15bd-4ebc-8a94-595f27475c2a req-ce0f6c5f-98b7-4a91-a78d-d248570a0fa7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:35.425948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7de7849b-15bd-4ebc-8a94-595f27475c2a req-ce0f6c5f-98b7-4a91-a78d-d248570a0fa7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:35.475883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:35.476731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:35.492032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:35.492539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:35.492983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:35.493733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:35.494192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:35.494625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:35.513565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7de7849b-15bd-4ebc-8a94-595f27475c2a req-ce0f6c5f-98b7-4a91-a78d-d248570a0fa7 service nova] Creating event network-vif-plugged:5cb65745-5086-4b0a-bfcf-12c9d138fc0c for instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e on n-h1-854653-7 Nov 03 04:11:35.530410 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7de7849b-15bd-4ebc-8a94-595f27475c2a req-ce0f6c5f-98b7-4a91-a78d-d248570a0fa7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161043 Nov 03 04:11:35.554089 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2136/4138] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:11:35.586396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:35.595931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:35.632929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:35.633466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:35.640411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:35.657119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:35.657119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:35.657119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:36.673132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:36.687320 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-148a87f5-c010-4353-8c1d-022bf7ec2c00 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 1.215721 Nov 03 04:11:36.687946 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2003/4139] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:35 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:36.816760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:36.830313 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b16cdaeb-1c76-43ab-a1ef-bc2e9d1e3fcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 1.274496 Nov 03 04:11:36.835923 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2137/4140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:35 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:37.727383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:37.728014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:37.737391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:37.738466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:37.739087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:37.739974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:37.740587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:37.741232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:37.856471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:37.857135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:37.875221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:37.877227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:37.879254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:37.887927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:37.889116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:37.889794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:38.349003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:38.360441 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3e162323-fcc1-408f-b7bc-47b83622df1d tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1317 microversion: 2.1 time: 0.640274 Nov 03 04:11:38.374761 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2004/4141] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:37 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:38.450087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:38.465123 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-518a1a8f-20ca-44c0-82b8-6ff653c86447 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.613005 Nov 03 04:11:38.465724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2138/4142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:37 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:39.386775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:39.387539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:39.404525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:39.406456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:39.408111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:39.414626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:39.415141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:39.415595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:39.869837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:39.881583 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92181d24-6b56-41b8-a86a-96bc10c1e307 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1506 microversion: 2.1 time: 0.495836 Nov 03 04:11:39.882203 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2139/4143] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:39 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:39.890923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:39.891803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:39.898207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:39.898909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:39.899690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:39.900414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:39.905943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:39.906744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:39.952726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-690058928", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "d4318622-122f-4000-a0fe-b0f55f3a5aad"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:40.116379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] validate_networks() for [('d4318622-122f-4000-a0fe-b0f55f3a5aad', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:11:40.278330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:40.312529 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-447f5224-2bb8-4416-9abe-884245564b1d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.427588 Nov 03 04:11:40.316946 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2140/4144] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:39 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:41.339110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:41.339110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:41.357153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:41.357728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:41.358029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:41.358762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:41.359230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:41.365992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:41.481416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:11:41.482998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:11:41.484402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:11:41.485300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:11:41.485913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:11:41.504616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:41.508539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:41.509297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:41.510246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:41.513983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:41.514729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:41.569130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Getting quotas for project 1604ae1a0e584b68af832b82691d5d00. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:11:41.586146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Getting quotas for user 0a19d5a2b76a4ed18ab336a91610ee3c and project 1604ae1a0e584b68af832b82691d5d00. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:11:41.624426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:11:41.633006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:11:41.786260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:41.791759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:41.813142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-133f2edf-e983-4342-a4f5-6d5094f3c5d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.481032 Nov 03 04:11:41.829244 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2141/4145] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:41 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:41.919601 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a02d0afa-af53-4067-b498-7017ab7b9cc2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.651703 Nov 03 04:11:41.920881 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2005/4146] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:11:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:11:41.932594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee09ead5-f24f-4e2a-9039-ec296edff467 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:41.933283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee09ead5-f24f-4e2a-9039-ec296edff467 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:42.331827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ee09ead5-f24f-4e2a-9039-ec296edff467 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:42.350669 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee09ead5-f24f-4e2a-9039-ec296edff467 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1216 microversion: 2.1 time: 0.417873 Nov 03 04:11:42.350669 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2142/4147] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:41 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1216 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:42.847460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:42.847460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:42.890557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:42.894601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:42.896968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:42.935830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:42.941301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:42.941974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:43.376085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9026ef56-6c3f-4275-a18e-4e21be508166 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:43.377573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9026ef56-6c3f-4275-a18e-4e21be508166 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:43.411908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:43.426748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84d8e567-2923-4cb9-8efd-3eecf4e8d2d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.586771 Nov 03 04:11:43.435276 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2006/4148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:42 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:43.631780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9026ef56-6c3f-4275-a18e-4e21be508166 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:43.640861 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9026ef56-6c3f-4275-a18e-4e21be508166 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1216 microversion: 2.1 time: 0.274942 Nov 03 04:11:43.667859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2143/4149] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:43 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1216 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:44.163175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a56120c1-fd5d-4ccc-90fc-446ba30a1921"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:44.176094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:44.194203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:44.194706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:44.195156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:44.196610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:44.198286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:44.202150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:44.306488 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] HTTP exception thrown: Volume 7026ce5e-153d-4b94-8c43-5417b8e32cfb could not be found. Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Request method failure captured: Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: request: PUT /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e/os-volume_attachments/7026ce5e-153d-4b94-8c43-5417b8e32cfb HTTP/1.1 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 74 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz7M_W23AopBuPNH1Rth5lGxnXJVhPyNFZHk05v_nw5TKxCZrJvsv-D66Yvi44VeWKAJ0faeq9yLL-I6s8BRyMksH13HulMdIJLNyocrFks3W2M9Xat1gqvqqwSr0AVkjV2W6bpmuk9FFQaSG-GkGJ_2TuqlUiB3MvG8fDCRpE-nyPc Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: f8d119ebf0a84166aa842d9644060774 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesAdminNegativeTest-1751480913 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f8d119ebf0a84166aa842d9644060774"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f8d119ebf0a84166aa842d9644060774", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f8d119ebf0a84166aa842d9644060774"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f8d119ebf0a84166aa842d9644060774"}]}] Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesAdminNegativeTest-1751480913 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: f8d119ebf0a84166aa842d9644060774 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1751480913 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesAdminNegativeTest-1751480913-project-admin Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 92df6b6bbaef4e9db15936c53d7dcf85 Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesAdminNegativeTest-1751480913-project-admin Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: {"volumeAttachment": {"volumeId": "a56120c1-fd5d-4ccc-90fc-446ba30a1921"}} Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: exception: Volume 7026ce5e-153d-4b94-8c43-5417b8e32cfb could not be found. Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '3646ef8f-3bf6-4fab-b317-8f3dc64d435e', 'id': '7026ce5e-153d-4b94-8c43-5417b8e32cfb', 'body': {'volumeAttachment': {'volumeId': 'a56120c1-fd5d-4ccc-90fc-446ba30a1921'}}} Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7026ce5e-153d-4b94-8c43-5417b8e32cfb could not be found. (HTTP 404) (Request-ID: req-ed2de0e8-8a58-4a78-aa73-e8c0cc994de4) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:11:44.308969 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7026ce5e-153d-4b94-8c43-5417b8e32cfb could not be found. Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7026ce5e-153d-4b94-8c43-5417b8e32cfb could not be found. Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7026ce5e-153d-4b94-8c43-5417b8e32cfb could not be found. Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] Returning 404 to user: Volume 7026ce5e-153d-4b94-8c43-5417b8e32cfb could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dea13aa3-961f-4b74-ac8d-918f03dee19a tempest-VolumesAdminNegativeTest-1751480913 tempest-VolumesAdminNegativeTest-1751480913-project-admin] 10.222.0.30 "PUT /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e/os-volume_attachments/7026ce5e-153d-4b94-8c43-5417b8e32cfb" status: 404 len: 109 microversion: 2.1 time: 0.154129 Nov 03 04:11:44.312716 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2007/4150] 10.222.0.30 () {60 vars in 1433 bytes} [Thu Nov 3 04:11:44 2022] PUT /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e/os-volume_attachments/7026ce5e-153d-4b94-8c43-5417b8e32cfb => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:11:44.457688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:44.458552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:44.472863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:44.473394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:44.473840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:44.479614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:44.480474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:44.483447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:44.679934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:44.682198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:44.700187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:44.700880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:44.701513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:44.703112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:44.703749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:44.708374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:44.720292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:44.909931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:44.937377 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-88f5eeca-c336-4520-8ecf-ee05cf19fe8e tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1212 microversion: 2.1 time: 0.264139 Nov 03 04:11:44.938570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2008/4151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:44 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1212 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:45.006788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:45.021579 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-063307f8-0bc9-4a98-a4ae-bf55ec2674bf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.564229 Nov 03 04:11:45.022903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2144/4152] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:44 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:45.967232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:45.968060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:45.981847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:45.998265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:45.999112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:46.011255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:46.012135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:46.015790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:46.057651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:46.059331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:46.083504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:46.084690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:46.086070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:46.087619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:46.104197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:46.110917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:46.444623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:46.462904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-167e8f6f-1ca0-4d78-97b9-70a39f4a75a9 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1276 microversion: 2.1 time: 0.497341 Nov 03 04:11:46.463633 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2009/4153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:45 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1276 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:47.438530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:47.457639 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3c5b7b7-88a0-45f2-9bfb-ad4901d7c99f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 1.410155 Nov 03 04:11:47.476412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2145/4154] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:46 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:47.486436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:47.487524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:47.495845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:47.497531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:47.497531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:47.503280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:47.504751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:47.506090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:47.656650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:47.677361 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-63afc4a4-2457-429c-844e-ed55c9f1d208 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1274 microversion: 2.1 time: 0.187921 Nov 03 04:11:47.677361 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2010/4155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:47 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:48.364727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-354223045", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:48.492708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] validate_networks() for [('4b8fa68c-7b16-4d7b-96b3-aa4d0316b388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:11:48.494155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:48.498484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:48.534445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:48.536963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:48.537919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:48.539913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:48.540825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:48.544050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:48.937408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:48.957637 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-795c3aa8-d7b7-4de4-a32d-696d5af5d1ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.472522 Nov 03 04:11:48.961602 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2011/4156] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:48 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:48.976132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:48.976789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:49.013679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:49.022704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:49.024886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:49.027958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:49.034708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:49.035251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:49.635333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:49.646431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51dab025-4d1a-405d-8b00-fc73bc10453a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.682324 Nov 03 04:11:49.649249 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2012/4157] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:48 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:49.779126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:11:49.780275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:11:49.780754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:11:49.781196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:11:49.781758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:11:49.803506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:49.805220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:49.811254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:49.811254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:49.811254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:49.811254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:49.866490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Getting quotas for project 643105f36872458fa8c9e8d70089b9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:11:49.907021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Getting quotas for user f52ea9e0295e4b2a8eefa7ac31bf3ddf and project 643105f36872458fa8c9e8d70089b9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:11:49.948085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:11:49.961798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:11:49.988085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:49.988719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:50.001672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:50.002436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:50.004483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:50.005697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:50.008718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:50.009473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:50.125554 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-992bfd74-8e15-41cd-8cbb-d3a2ec1cfa3e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.008762 Nov 03 04:11:50.126799 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2146/4158] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:11:50.139204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-681a214b-8908-4d6f-a1e6-b381a0257816 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:50.140299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-681a214b-8908-4d6f-a1e6-b381a0257816 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:50.232565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-681a214b-8908-4d6f-a1e6-b381a0257816 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:50.242285 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-681a214b-8908-4d6f-a1e6-b381a0257816 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1216 microversion: 2.1 time: 0.107365 Nov 03 04:11:50.244110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2147/4159] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:50 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1216 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:50.353832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:50.354413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:50.365623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:50.370545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:50.373869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:50.373869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:50.374308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:50.374756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:50.414038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:50.442188 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e22af69-3503-4e6f-b3fa-ac94ec8141cb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.458951 Nov 03 04:11:50.445082 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2013/4160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:49 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:50.462959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:11:50.676417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:50.679108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:50.797921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:50.797921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:50.797921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:50.797921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:50.797921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:50.797921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:50.903516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:50.912298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8b1ed24-8d71-4d45-98b7-2facec538928 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.243516 Nov 03 04:11:50.913782 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2014/4161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:50 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:51.266662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06619790-da74-4764-ba02-73490cd5a1b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:51.267794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-06619790-da74-4764-ba02-73490cd5a1b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:51.343647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-06619790-da74-4764-ba02-73490cd5a1b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:51.355583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06619790-da74-4764-ba02-73490cd5a1b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1216 microversion: 2.1 time: 0.091215 Nov 03 04:11:51.356193 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2015/4162] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:51 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:51.477457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:51.478578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:51.489896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:51.492627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:51.493403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:51.496004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:51.497439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:51.498269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:51.554108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:51.670284 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d4f7ff4-ce4e-4d6d-8aed-5df2a07bddfe tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 204 len: 0 microversion: 2.1 time: 1.322114 Nov 03 04:11:51.671444 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2148/4163] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:11:50 2022] DELETE /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 0 bytes in 1325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:11:51.681728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:51.686771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:51.710766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:51.713246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:51.716004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:51.726091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:51.727526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:51.729113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:51.875932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:51.892021 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-22c63863-cf05-4217-9e7e-a671be8fa9d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.413509 Nov 03 04:11:51.892021 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2016/4164] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:51 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:51.979209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:51.995820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:52.047062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:52.049886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:52.053844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:52.057585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:52.061457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:52.071820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:52.200532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:52.212266 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7371805c-4479-4dc1-ac16-dba19b82e282 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1512 microversion: 2.1 time: 0.536291 Nov 03 04:11:52.223238 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2149/4165] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:51 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:52.389866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25b7e0c0-670a-45df-8aeb-cf266bd7103c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:52.392179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-25b7e0c0-670a-45df-8aeb-cf266bd7103c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:52.414789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:52.538674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:52.554922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-78533c21-f75a-4e32-bab0-d06cac935ec3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.613357 Nov 03 04:11:52.570801 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2017/4166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:51 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:52.620535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-25b7e0c0-670a-45df-8aeb-cf266bd7103c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:52.631839 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-25b7e0c0-670a-45df-8aeb-cf266bd7103c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1216 microversion: 2.1 time: 0.250030 Nov 03 04:11:52.644246 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2150/4167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:52 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:52.870637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1d6da3ce-bbf9-47f4-ad27-4a8306580dc0 req-b8a129ca-171a-4993-a32a-a7e84e67cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4acb053-a3d2-4e2f-a038-ba19cbee2dd2", "tag": "67e61d51-26ec-49af-94a2-cdc955a37748"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:52.891570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d6da3ce-bbf9-47f4-ad27-4a8306580dc0 req-b8a129ca-171a-4993-a32a-a7e84e67cfa2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:52.894848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d6da3ce-bbf9-47f4-ad27-4a8306580dc0 req-b8a129ca-171a-4993-a32a-a7e84e67cfa2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:52.902133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d6da3ce-bbf9-47f4-ad27-4a8306580dc0 req-b8a129ca-171a-4993-a32a-a7e84e67cfa2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:52.923245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:52.923965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:52.938503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:52.940245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:52.942042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:52.943011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:52.944372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:52.944833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:52.952731 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1d6da3ce-bbf9-47f4-ad27-4a8306580dc0 req-b8a129ca-171a-4993-a32a-a7e84e67cfa2 service nova] Creating event network-changed:67e61d51-26ec-49af-94a2-cdc955a37748 for instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 on n-h2-854653-7 Nov 03 04:11:52.969261 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1d6da3ce-bbf9-47f4-ad27-4a8306580dc0 req-b8a129ca-171a-4993-a32a-a7e84e67cfa2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.319343 Nov 03 04:11:52.972001 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2018/4168] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:53.165549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:53.174815 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b6a98d22-ca09-4bb4-b9f5-49aed3406489 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.256518 Nov 03 04:11:53.189040 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2151/4169] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:52 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:53.250694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:53.251435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:53.260354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:53.268660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:53.268660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:53.268660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:53.268660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:53.268660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:53.583564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:53.586164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:53.596880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:53.597422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:53.598699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:53.599436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:53.599908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:53.602749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:53.937616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:53.947618 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d53bf518-9583-4aee-8762-c97ab165b537 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.369385 Nov 03 04:11:53.950319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:53.961522 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2152/4170] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:53 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:53.964084 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bd78aeb9-f700-4688-b2e2-93fd0361125e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1512 microversion: 2.1 time: 0.718195 Nov 03 04:11:53.968147 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2019/4171] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:53 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1512 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:53.970591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:53.972043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:53.978585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:53.979401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:53.980075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:53.980996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:53.981744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:53.982392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:54.082994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:54.094228 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-932d7ea0-9b1a-4224-911a-1e626fee7407 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1268 microversion: 2.1 time: 0.131433 Nov 03 04:11:54.103570 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2153/4172] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:53 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1268 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:54.201682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:54.203121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:54.213625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:54.214984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:54.215637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:54.217143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:54.217985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:54.218946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:54.605775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:54.624253 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-312cff02-5c09-4a06-8e9a-b996bfd10a3c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.428197 Nov 03 04:11:54.640677 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2020/4173] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:54 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:54.870933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9737dc90-06d4-44c8-809b-5e861b90b876 req-bb92d34b-f47d-4d5d-ad16-25ef4fe4e81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3646ef8f-3bf6-4fab-b317-8f3dc64d435e", "name": "network-vif-deleted", "tag": "5cb65745-5086-4b0a-bfcf-12c9d138fc0c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:54.890419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9737dc90-06d4-44c8-809b-5e861b90b876 req-bb92d34b-f47d-4d5d-ad16-25ef4fe4e81b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:54.891010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9737dc90-06d4-44c8-809b-5e861b90b876 req-bb92d34b-f47d-4d5d-ad16-25ef4fe4e81b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:54.891528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9737dc90-06d4-44c8-809b-5e861b90b876 req-bb92d34b-f47d-4d5d-ad16-25ef4fe4e81b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:54.921162 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9737dc90-06d4-44c8-809b-5e861b90b876 req-bb92d34b-f47d-4d5d-ad16-25ef4fe4e81b service nova] Creating event network-vif-deleted:5cb65745-5086-4b0a-bfcf-12c9d138fc0c for instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e on n-h1-854653-7 Nov 03 04:11:54.927142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9737dc90-06d4-44c8-809b-5e861b90b876 req-bb92d34b-f47d-4d5d-ad16-25ef4fe4e81b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303698 Nov 03 04:11:54.928811 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2154/4174] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:11:54.988795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:54.993751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:54.998428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:54.999790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:55.007803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.009136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.009825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.011148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.012284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.012951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.027623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.030111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.030298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.031541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.032745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.033399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.107073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.110082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.110538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.114077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lazy-loading 'fault' on Instance uuid 3646ef8f-3bf6-4fab-b317-8f3dc64d435e {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:11:55.350128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:55.362066 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-31f02b45-edae-442a-8ff0-965f524061f7 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 200 len: 1307 microversion: 2.1 time: 0.369213 Nov 03 04:11:55.367454 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2155/4175] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:54 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:55.396532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:55.399216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:55.412106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.414906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.417319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.418606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.421748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.422346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.604259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:55.613675 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6a2a9c8-138c-4eb5-8cad-3265c3f4df78 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1274 microversion: 2.1 time: 0.244878 Nov 03 04:11:55.614249 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2156/4176] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:55 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1274 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:55.647837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:55.648371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:55.654007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:55.665643 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f19fadb7-6fdd-4750-8585-08f767798ee2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.694250 Nov 03 04:11:55.673046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.673556 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2021/4177] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:54 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:55.682962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.685266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:55.686068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:55.686546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:55.687157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:56.065061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:56.075589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ead0231-144d-4b6c-b88f-10915b462833 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.431695 Nov 03 04:11:56.078069 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2157/4178] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:55 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:56.397693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:56.399522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 3646ef8f-3bf6-4fab-b317-8f3dc64d435e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:56.407399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:56.408157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:56.411509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:56.412424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:56.413521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:56.414254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:56.436394 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] HTTP exception thrown: Instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e could not be found. Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Request method failure captured: Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e HTTP/1.1 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz69XPEeqhrZRjYGhFIkTzpLcz-Fft-Ji_qioMaQwR4L1obRsZ0oS3nlKwNKn1j_JrDzpOe9Lbk0wBvwP8pXKzQhs6ngPj6POvn19XUAC9SJakR3kOyk9NEYrjxYM72NHJlIVlnNC07jnxo6OhUmyU-ijtbGlA0W-DdmBZtspg-Ak2Q Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 6e92fb95e80b4d6cace544d5cb063953 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesAdminNegativeTest-1414384497 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e92fb95e80b4d6cace544d5cb063953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e92fb95e80b4d6cace544d5cb063953", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e92fb95e80b4d6cace544d5cb063953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e92fb95e80b4d6cace544d5cb063953"}]}] Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesAdminNegativeTest-1414384497 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 6e92fb95e80b4d6cace544d5cb063953 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1414384497 Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesAdminNegativeTest-1414384497-project Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7711a11a426b4b3987c5150fb4540c6e Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesAdminNegativeTest-1414384497-project Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e could not be found. Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '3646ef8f-3bf6-4fab-b317-8f3dc64d435e'} Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e could not be found. Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e could not be found. Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:11:56.438489 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e could not be found. Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:11:56.448450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Returning 404 to user: Instance 3646ef8f-3bf6-4fab-b317-8f3dc64d435e could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:11:56.449200 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-22834672-2a34-4228-a6fc-6393f2e666a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e" status: 404 len: 111 microversion: 2.1 time: 0.061498 Nov 03 04:11:56.450853 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2022/4179] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:56 2022] GET /compute/v2.1/servers/3646ef8f-3bf6-4fab-b317-8f3dc64d435e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:11:56.636488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:56.644072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:56.659783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:56.660474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:56.661126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:56.662165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:56.662798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:56.663397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:56.693162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:56.693834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:56.710333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:56.711018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:56.713592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:56.715511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:56.719380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:56.724845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:57.040690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:57.053988 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5332f887-0c23-4dea-a586-c479f1bb748f tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.365699 Nov 03 04:11:57.056445 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2023/4180] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:56 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:57.100433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:57.101359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:57.111404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:57.119438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:57.120029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:57.120966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:57.121627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:57.122248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:57.152725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:57.161386 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d2d98b8-77f8-48e5-b99c-5bc07fc7bbbc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.528772 Nov 03 04:11:57.162231 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2158/4181] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:56 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:57.949452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:57.957357 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8dae5c4d-815c-4b4a-b462-3142a3393068 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1512 microversion: 2.1 time: 0.860834 Nov 03 04:11:57.957951 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2024/4182] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:57 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1512 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:58.081824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:58.082428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:58.099995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:58.100725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:58.101367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:58.102250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:58.102877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:58.103471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:58.191382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:58.193138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:58.211378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:58.212233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:58.212851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:58.213825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:58.214483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:58.215350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:58.598088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:58.607012 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-492e75a2-81dc-46dc-8fe9-94ab0ca6dee6 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.530974 Nov 03 04:11:58.608166 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2159/4183] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:58 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:58.620595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:58.630599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-337f0e64-e565-47c8-95cb-a9ed5384d5a9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.443785 Nov 03 04:11:58.644689 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2025/4184] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:58 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:11:58.954106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-167f82b6-b45a-4204-aee0-e0d9808efe04 req-2587804f-3449-4e73-82b4-eecc6338f44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d5654b4-009d-4bff-b1f3-d835ea94a615", "tag": "eda54677-27f1-4356-ba50-c78608583439"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:58.970609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-167f82b6-b45a-4204-aee0-e0d9808efe04 req-2587804f-3449-4e73-82b4-eecc6338f44f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:58.971735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-167f82b6-b45a-4204-aee0-e0d9808efe04 req-2587804f-3449-4e73-82b4-eecc6338f44f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:58.972144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-167f82b6-b45a-4204-aee0-e0d9808efe04 req-2587804f-3449-4e73-82b4-eecc6338f44f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:58.985528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:58.986894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:58.998865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:58.999764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.003832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.005112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:59.005768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.010318 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-167f82b6-b45a-4204-aee0-e0d9808efe04 req-2587804f-3449-4e73-82b4-eecc6338f44f service nova] Creating event network-changed:eda54677-27f1-4356-ba50-c78608583439 for instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 on n-h1-854653-7 Nov 03 04:11:59.013642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.024309 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-167f82b6-b45a-4204-aee0-e0d9808efe04 req-2587804f-3449-4e73-82b4-eecc6338f44f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081861 Nov 03 04:11:59.025443 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2160/4185] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:59.358461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:59.373241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e369fb94-7b56-4b5f-b4eb-4ef49bea462c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1489 microversion: 2.1 time: 0.391689 Nov 03 04:11:59.374057 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2026/4186] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:58 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1489 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:59.401050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:11:59.403482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:59.418756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:59.420116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.420980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.421945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:59.422617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.424899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.482290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a01b957c-dbac-4789-b60a-84dca709cfec tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 200 len: 167 microversion: 2.1 time: 0.085845 Nov 03 04:11:59.488304 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2161/4187] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:11:59 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 167 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:11:59.493639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:59.494263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:59.509948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:59.510609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.511184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.512019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:59.513223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.513731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.520275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:59.631407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:59.635460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:11:59.643277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:59.643777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.644225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.645418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:11:59.646058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:11:59.646647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:11:59.831440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:11:59.957667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:11:59.973845 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb794bb5-e1e4-4bf1-8d86-e4fdeb2b78ea tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.483910 Nov 03 04:11:59.989048 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2027/4188] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:59 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:11:59.989048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:11:59.989048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:00.017184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.018008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.018644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.019613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.020231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.020675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.112615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:00.116793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:00.126507 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-391423c7-5ac8-4c33-84bd-bc8db11e4eb3 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.498616 Nov 03 04:12:00.146129 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2162/4189] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:59 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:00.162232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:00.164359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:00.177582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.182595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.183141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.192928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.193567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.194089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.500879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:00.515796 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7b7c6eb-2c8f-477c-b69e-1235e6bf4cdb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.538828 Nov 03 04:12:00.518771 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2028/4190] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:11:59 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:00.536777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-51d3da00-fa11-481f-a299-91c9dfbd9dfd req-5a904819-b088-47ff-81ec-ac4163cdc09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4acb053-a3d2-4e2f-a038-ba19cbee2dd2", "name": "network-vif-plugged", "status": "completed", "tag": "67e61d51-26ec-49af-94a2-cdc955a37748"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:00.539014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:00.547673 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1414e4e5-d4f4-462b-8912-28b1d18152dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.395914 Nov 03 04:12:00.548252 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2163/4191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:00 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:00.571694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:00.572642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:00.574708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-51d3da00-fa11-481f-a299-91c9dfbd9dfd req-5a904819-b088-47ff-81ec-ac4163cdc09b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.575279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-51d3da00-fa11-481f-a299-91c9dfbd9dfd req-5a904819-b088-47ff-81ec-ac4163cdc09b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.575819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-51d3da00-fa11-481f-a299-91c9dfbd9dfd req-5a904819-b088-47ff-81ec-ac4163cdc09b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.579850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.581575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.582431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.583341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.584007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.584626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.603213 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-51d3da00-fa11-481f-a299-91c9dfbd9dfd req-5a904819-b088-47ff-81ec-ac4163cdc09b service nova] Creating event network-vif-plugged:67e61d51-26ec-49af-94a2-cdc955a37748 for instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 on n-h2-854653-7 Nov 03 04:12:00.616789 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-51d3da00-fa11-481f-a299-91c9dfbd9dfd req-5a904819-b088-47ff-81ec-ac4163cdc09b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093487 Nov 03 04:12:00.616789 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2029/4192] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:00.881136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:00.892464 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82a84104-c657-4a31-a876-7eccda73729b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.324736 Nov 03 04:12:00.907342 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2164/4193] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:00 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:00.919518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:00.921630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:00.924538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:00.945502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.947167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.947693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:00.948445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:00.948934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:00.959225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:01.158922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:01.159913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:01.166361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:01.166853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:01.166966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:01.167406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:01.167980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:01.168435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:01.168858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:01.179632 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04146e1d-9643-402b-a6f7-a8398b361c69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.264809 Nov 03 04:12:01.180433 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2030/4194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:00 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:01.326623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-916911708", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "d4690854-61c6-4734-9947-73292066365c"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:01.351854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:01.360671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c900f13-7c2b-48a0-84bc-62d76544fc1b tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1316 microversion: 2.1 time: 0.206682 Nov 03 04:12:01.362200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2165/4195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:01 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:01.363212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:01.421183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] validate_networks() for [('d4690854-61c6-4734-9947-73292066365c', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:12:01.540348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:01.540980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:01.548024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:01.548984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:01.549648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:01.550517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:01.551250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:01.551740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:01.855948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:01.868871 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4df9ba82-31f0-4d1b-aec9-efba9c663367 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.332767 Nov 03 04:12:01.870449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2166/4196] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:01 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:01.992804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:12:01.993391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:12:01.993971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:12:01.994392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:12:01.994812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:12:02.014244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.014860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.015433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.016762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.017375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.018369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.057923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:12:02.064209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for user d374eee04fe4433d862b7bc04a16a563 and project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:12:02.077206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:12:02.079569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:12:02.163190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:02.163708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:02.170419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.172651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.179203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.186004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.191148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.191148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.240185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:12:02.252808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f42d74d5-91a5-465e-8ba1-46c79205f15e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930163 Nov 03 04:12:02.278733 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2031/4197] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:12:02.309818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12ea28c2-6d5d-4a47-abae-1a6315a53f30 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:02.311897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12ea28c2-6d5d-4a47-abae-1a6315a53f30 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:02.432950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-12ea28c2-6d5d-4a47-abae-1a6315a53f30 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:02.456251 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12ea28c2-6d5d-4a47-abae-1a6315a53f30 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1214 microversion: 2.1 time: 0.159584 Nov 03 04:12:02.459144 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2032/4198] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:02 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:02.464209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:02.465117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:02.475278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.476089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.476729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.483629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.485162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.486644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.630420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=14 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:02.699633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a33db835-b368-4726-8397-ec3b40589b9f tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "DELETE /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 204 len: 0 microversion: 2.1 time: 0.540366 Nov 03 04:12:02.700662 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2167/4199] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:12:02 2022] DELETE /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:12:02.709558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:02.710315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:02.722804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.723567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.724684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.725823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.726546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.727495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.753953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:02.764166 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1b8c2515-8742-46ab-84d5-fe14142ee62c tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1505 microversion: 2.1 time: 0.303632 Nov 03 04:12:02.774998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2033/4200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:02 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:02.788729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:02.789810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:02.800384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.800888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.802055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.802797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.803258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.803703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.832859 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96e5ed70-acca-4cef-bccf-95d1672724f0 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2/ips" status: 200 len: 109 microversion: 2.1 time: 0.048870 Nov 03 04:12:02.834119 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2034/4201] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:12:02 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2/ips => generated 109 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:02.849263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:02.849851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:02.862169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.862679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.865340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.866099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.866717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.869265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.926409 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4321332d-4980-4557-a8ac-ef4168f58adc tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2/ips" status: 200 len: 109 microversion: 2.1 time: 0.081236 Nov 03 04:12:02.927689 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2035/4202] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:12:02 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2/ips => generated 109 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:02.940779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:02.942290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:02.961062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.961905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.962564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:02.963482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:02.964141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:02.964769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:03.125235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:03.137481 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99d9f249-e1bf-4f70-a126-90f969850214 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1681 microversion: 2.1 time: 0.431307 Nov 03 04:12:03.140979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2168/4203] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:02 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1681 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:03.163793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:03.177864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:03.184509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:03.190832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:03.190832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:03.190832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:03.190832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:03.190832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:03.223796 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c523598c-eea5-43be-87b4-eb6d7046edd1 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2/ips/tempest-ServerAddressesTestJSON-1350960045-network" status: 200 len: 94 microversion: 2.1 time: 0.081368 Nov 03 04:12:03.224485 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2169/4204] 10.222.0.30 () {58 vars in 1401 bytes} [Thu Nov 3 04:12:03 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2/ips/tempest-ServerAddressesTestJSON-1350960045-network => generated 94 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:03.239330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:03.239850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:03.240102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:03.247889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:03.248388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:03.248837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:03.249625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:03.250091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:03.250196 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8829dd4c-b2e7-4475-bb01-6dd064fde05a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.321034 Nov 03 04:12:03.250528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:03.251020 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2036/4205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:02 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:03.280165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:12:03.487357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-944fcdd7-edff-4325-812b-ecc59f003b16 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:03.488017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-944fcdd7-edff-4325-812b-ecc59f003b16 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:03.544362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-944fcdd7-edff-4325-812b-ecc59f003b16 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:03.551936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-944fcdd7-edff-4325-812b-ecc59f003b16 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1214 microversion: 2.1 time: 0.071938 Nov 03 04:12:03.552728 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2037/4206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:03 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:03.731254 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d3fef482-f75a-48a1-bef9-477edef7f571 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 204 len: 0 microversion: 2.1 time: 0.497041 Nov 03 04:12:03.732916 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2170/4207] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:12:03 2022] DELETE /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:12:03.743388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:03.744245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:03.752387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:03.755943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:03.755943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:03.755943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:03.755943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:03.755943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:03.902679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:03.911793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcbd3602-9f62-44a8-949a-768143819421 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1511 microversion: 2.1 time: 0.173373 Nov 03 04:12:03.912372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2038/4208] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:03 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:04.179705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:04.181037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:04.190529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:04.193696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:04.195155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:04.196394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:04.196977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:04.197699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:04.275782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:04.276400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:04.283822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:04.286901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:04.287377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:04.288126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:04.288601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:04.289046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:04.535885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:04.554426 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9fc64faf-e5d0-4c0c-9664-cda4ff9077a6 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1681 microversion: 2.1 time: 0.384591 Nov 03 04:12:04.555688 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2171/4209] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:04 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1681 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:04.637492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:04.646693 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50e8b3cc-4168-4886-9e49-63882b6284e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.374728 Nov 03 04:12:04.649515 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2039/4210] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:04 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:04.935285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:04.936124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:04.950161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:04.952999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:04.956546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:04.960714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:04.961439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:04.962077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:05.023667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:05.024373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:05.037903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:05.038502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:05.039353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:05.040166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:05.040685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:05.047086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:05.296991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:05.321111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-801590f6-4db6-4143-bba6-2a1e45641671 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1218 microversion: 2.1 time: 0.748565 Nov 03 04:12:05.322790 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2172/4211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:04 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1218 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:05.463861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:05.474863 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fb7e2cda-394a-46a0-be24-8b5d218ae99a tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1511 microversion: 2.1 time: 0.543277 Nov 03 04:12:05.475862 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2040/4212] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:04 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1511 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:05.582864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:05.583859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:05.597348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:05.599705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:05.600487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:05.603426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:05.604693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:05.610923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:05.674797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:05.675419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:05.683463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:05.684264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:05.684946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:05.685706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:05.686171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:05.686606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:06.323872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:06.347263 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a1d48894-7f8b-4240-8c79-413231828cba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.665359 Nov 03 04:12:06.347263 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2041/4213] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:05 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:06.350140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:06.350990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:06.371684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:06.372458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:06.372904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:06.373648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:06.374269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:06.374888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:06.451421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:06.476843 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4cbc0232-8630-4d28-965f-7f0e0f2e39fb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1681 microversion: 2.1 time: 0.898150 Nov 03 04:12:06.486530 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2173/4214] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:05 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1681 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:06.493793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-defd9a7d-70df-4092-8c50-b078302a7da3 req-17564e4c-e040-400e-814f-2fd3050031cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4acb053-a3d2-4e2f-a038-ba19cbee2dd2", "name": "network-vif-deleted", "tag": "67e61d51-26ec-49af-94a2-cdc955a37748"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:06.534923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-defd9a7d-70df-4092-8c50-b078302a7da3 req-17564e4c-e040-400e-814f-2fd3050031cf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:06.535702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-defd9a7d-70df-4092-8c50-b078302a7da3 req-17564e4c-e040-400e-814f-2fd3050031cf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:06.536305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-defd9a7d-70df-4092-8c50-b078302a7da3 req-17564e4c-e040-400e-814f-2fd3050031cf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:06.558768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:06.571456 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-95368492-af93-4443-a11c-6af61eab07df tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1266 microversion: 2.1 time: 0.229046 Nov 03 04:12:06.577518 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2042/4215] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:06 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:06.587781 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-defd9a7d-70df-4092-8c50-b078302a7da3 req-17564e4c-e040-400e-814f-2fd3050031cf service nova] Creating event network-vif-deleted:67e61d51-26ec-49af-94a2-cdc955a37748 for instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 on n-h2-854653-7 Nov 03 04:12:06.594253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:06.594880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:06.617289 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-defd9a7d-70df-4092-8c50-b078302a7da3 req-17564e4c-e040-400e-814f-2fd3050031cf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126195 Nov 03 04:12:06.620763 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2174/4216] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:06.638699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:06.638699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:06.638699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:06.638699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:06.638699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:06.638699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:06.714536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0f3fa93c-d2ce-4c43-9400-99e1fd336ac7 req-c1f66a78-8943-4843-b2b8-25b7935dc58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5654b4-009d-4bff-b1f3-d835ea94a615", "name": "network-vif-plugged", "status": "completed", "tag": "eda54677-27f1-4356-ba50-c78608583439"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:06.748592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f3fa93c-d2ce-4c43-9400-99e1fd336ac7 req-c1f66a78-8943-4843-b2b8-25b7935dc58f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:06.749154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f3fa93c-d2ce-4c43-9400-99e1fd336ac7 req-c1f66a78-8943-4843-b2b8-25b7935dc58f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:06.749758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f3fa93c-d2ce-4c43-9400-99e1fd336ac7 req-c1f66a78-8943-4843-b2b8-25b7935dc58f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:06.778748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0f3fa93c-d2ce-4c43-9400-99e1fd336ac7 req-c1f66a78-8943-4843-b2b8-25b7935dc58f service nova] Creating event network-vif-plugged:eda54677-27f1-4356-ba50-c78608583439 for instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 on n-h1-854653-7 Nov 03 04:12:06.789203 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0f3fa93c-d2ce-4c43-9400-99e1fd336ac7 req-c1f66a78-8943-4843-b2b8-25b7935dc58f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087108 Nov 03 04:12:06.790432 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2175/4217] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:06.838907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:06.862894 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1a9946d-a0b3-430e-8a85-b67807c064eb tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1469 microversion: 2.1 time: 0.280846 Nov 03 04:12:06.863580 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2043/4218] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:06 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:07.366551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:07.367747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:07.378735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:07.389496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:07.392907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:07.392907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:07.392907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:07.392907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:07.511636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:07.512724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:07.543745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:07.548656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:07.550644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:07.552226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:07.554169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:07.555336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:07.734443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:07.754354 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f405e2f0-6f4e-4be0-b78d-9f94fe3eef42 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1613 microversion: 2.1 time: 0.248241 Nov 03 04:12:07.755614 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2044/4219] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:07 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1613 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:07.760497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:07.761339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:07.792007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:07.794929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:07.795636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:07.796566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:07.800696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:07.801399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:07.896392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:07.913630 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71dee823-76cf-4cce-aaf3-9d3938f56b1e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1316 microversion: 2.1 time: 0.553768 Nov 03 04:12:07.933051 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2176/4220] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:07 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:07.942259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-05342969-d903-484f-835a-44cb0b5c2d41 req-b22a2fcd-84ff-4b7d-95e4-384da735bf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ce6fca-a03d-4801-8283-860ebaae7eab", "name": "network-vif-deleted", "tag": "5d9f36bb-2e04-4ae1-a0a1-f087046b811f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:07.961240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:07.976503 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-894b3def-d05c-4a7d-b529-711e129848d0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1272 microversion: 2.1 time: 0.218955 Nov 03 04:12:07.977728 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2045/4221] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:07 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:07.985565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:07.986234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:08.002245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-05342969-d903-484f-835a-44cb0b5c2d41 req-b22a2fcd-84ff-4b7d-95e4-384da735bf09 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.012006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-05342969-d903-484f-835a-44cb0b5c2d41 req-b22a2fcd-84ff-4b7d-95e4-384da735bf09 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.012550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-05342969-d903-484f-835a-44cb0b5c2d41 req-b22a2fcd-84ff-4b7d-95e4-384da735bf09 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.016396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.016970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.021188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.022367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.027065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.029449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.045307 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-05342969-d903-484f-835a-44cb0b5c2d41 req-b22a2fcd-84ff-4b7d-95e4-384da735bf09 service nova] Creating event network-vif-deleted:5d9f36bb-2e04-4ae1-a0a1-f087046b811f for instance 79ce6fca-a03d-4801-8283-860ebaae7eab on n-h1-854653-7 Nov 03 04:12:08.067443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-05342969-d903-484f-835a-44cb0b5c2d41 req-b22a2fcd-84ff-4b7d-95e4-384da735bf09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138910 Nov 03 04:12:08.068266 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2177/4222] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:08.115730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.116391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.117063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.117917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lazy-loading 'fault' on Instance uuid e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:12:08.167745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19d5a2b76a4ed18ab336a91610ee3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1604ae1a0e584b68af832b82691d5d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:08.179704 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-065adf75-0a7c-45b9-9968-c9afb0709f45 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 200 len: 1306 microversion: 2.1 time: 0.200409 Nov 03 04:12:08.180536 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2046/4223] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:07 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 1306 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:08.785666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:08.786408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:08.794654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.795438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.796045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.796927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.797564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.798155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.830273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:08.878499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.881634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.882110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.882592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lazy-loading 'fault' on Instance uuid 79ce6fca-a03d-4801-8283-860ebaae7eab {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:12:08.952245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:08.953224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:08.969907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.973745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.974234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:08.974986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:08.975453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:08.975990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:09.003368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7711a11a426b4b3987c5150fb4540c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e92fb95e80b4d6cace544d5cb063953', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:09.016046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c025f81-d4bd-4b5a-84a5-d53973278f7e tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 200 len: 1331 microversion: 2.1 time: 0.235945 Nov 03 04:12:09.017949 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2178/4224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:08 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 1331 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:09.025435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:09.026564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:09.029104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:09.062885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:09.063402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:09.063858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:09.064682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:09.065192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:09.065635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:09.300566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:09.314272 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85a92275-5d71-4703-b298-07e34e22af16 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.364763 Nov 03 04:12:09.315757 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2047/4225] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:08 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:09.333871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:09.334372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] [instance: e4acb053-a3d2-4e2f-a038-ba19cbee2dd2] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:09.341915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:09.347915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:09.347915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:09.347915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:09.347915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:09.348608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:09.348984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:09.353671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0459b30-a713-496c-a4f2-d0101277049f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.332154 Nov 03 04:12:09.354455 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2179/4226] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:09 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:09.410563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] HTTP exception thrown: Instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 could not be found. Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Request method failure captured: Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 HTTP/1.1 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz96Chz21hl2JhUp5beuJPASTQDy7PFoaD5E87VusGj_p5Tl6Ajj7umlcdDo-dLRmcIRyrb5NGbeedcE3wGZLG9_N__C5esV8mBZu4RkBDn62bFebs831YmewJu3CZL8QyO0rdVPuQ8sDZ3QEmSjbro1sYM31TLVzN59A9VG7Z5Q9nw Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 1604ae1a0e584b68af832b82691d5d00 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerAddressesTestJSON-823397706 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1604ae1a0e584b68af832b82691d5d00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1604ae1a0e584b68af832b82691d5d00", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1604ae1a0e584b68af832b82691d5d00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1604ae1a0e584b68af832b82691d5d00"}]}] Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerAddressesTestJSON-823397706 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 1604ae1a0e584b68af832b82691d5d00 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerAddressesTestJSON-823397706 Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerAddressesTestJSON-823397706-project Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0a19d5a2b76a4ed18ab336a91610ee3c Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerAddressesTestJSON-823397706-project Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 could not be found. Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e4acb053-a3d2-4e2f-a038-ba19cbee2dd2'} Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 could not be found. Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 could not be found. Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:09.415787 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:09.420802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:09.420802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:09.420802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:09.420802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:09.420802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:09.420802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 could not be found. Nov 03 04:12:09.420802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:09.422484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] Returning 404 to user: Instance e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:09.423740 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e15bafc0-6457-4cbe-a132-c8eeef8748b2 tempest-ServerAddressesTestJSON-823397706 tempest-ServerAddressesTestJSON-823397706-project] 10.222.0.30 "GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2" status: 404 len: 111 microversion: 2.1 time: 0.104531 Nov 03 04:12:09.429163 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2048/4227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:09 2022] GET /compute/v2.1/servers/e4acb053-a3d2-4e2f-a038-ba19cbee2dd2 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:12:09.537817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1576076391", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:09.615117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] validate_networks() for [('4b8fa68c-7b16-4d7b-96b3-aa4d0316b388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:12:10.046504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:10.047390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] [instance: 79ce6fca-a03d-4801-8283-860ebaae7eab] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:10.056454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:10.057381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:10.058042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:10.058984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:10.059651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:10.060286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:10.081335 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] HTTP exception thrown: Instance 79ce6fca-a03d-4801-8283-860ebaae7eab could not be found. Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Request method failure captured: Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab HTTP/1.1 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz69XPEeqhrZRjYGhFIkTzpLcz-Fft-Ji_qioMaQwR4L1obRsZ0oS3nlKwNKn1j_JrDzpOe9Lbk0wBvwP8pXKzQhs6ngPj6POvn19XUAC9SJakR3kOyk9NEYrjxYM72NHJlIVlnNC07jnxo6OhUmyU-ijtbGlA0W-DdmBZtspg-Ak2Q Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 6e92fb95e80b4d6cace544d5cb063953 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesAdminNegativeTest-1414384497 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e92fb95e80b4d6cace544d5cb063953"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e92fb95e80b4d6cace544d5cb063953", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e92fb95e80b4d6cace544d5cb063953"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e92fb95e80b4d6cace544d5cb063953"}]}] Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesAdminNegativeTest-1414384497 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 6e92fb95e80b4d6cace544d5cb063953 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1414384497 Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesAdminNegativeTest-1414384497-project Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7711a11a426b4b3987c5150fb4540c6e Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesAdminNegativeTest-1414384497-project Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 79ce6fca-a03d-4801-8283-860ebaae7eab could not be found. Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '79ce6fca-a03d-4801-8283-860ebaae7eab'} Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ce6fca-a03d-4801-8283-860ebaae7eab could not be found. Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ce6fca-a03d-4801-8283-860ebaae7eab could not be found. Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:10.083716 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:10.087664 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:10.087664 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:10.087664 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:10.087664 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:10.087664 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:10.087664 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ce6fca-a03d-4801-8283-860ebaae7eab could not be found. Nov 03 04:12:10.087664 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:10.089832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Returning 404 to user: Instance 79ce6fca-a03d-4801-8283-860ebaae7eab could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:10.091586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-761c9163-16f4-4b5b-b205-93dc93843fbb tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab" status: 404 len: 111 microversion: 2.1 time: 0.050241 Nov 03 04:12:10.093093 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2049/4228] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:10 2022] GET /compute/v2.1/servers/79ce6fca-a03d-4801-8283-860ebaae7eab => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:12:10.104138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d14c4e2f-08e7-494a-ac12-97296784b434 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] Calling method '.version_select at 0x7ff7f9e27040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:10.194522 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d14c4e2f-08e7-494a-ac12-97296784b434 tempest-VolumesAdminNegativeTest-1414384497 tempest-VolumesAdminNegativeTest-1414384497-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875930638" status: 202 len: 0 microversion: 2.1 time: 0.096094 Nov 03 04:12:10.196334 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2050/4229] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875930638 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:12:10.357712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:12:10.358313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:12:10.358851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:12:10.359266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:12:10.365032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:12:10.369535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d223445d-294c-4c8a-8cc2-48141d7bfd19 req-67904193-c7f9-4ac2-8cc4-4f975d3036da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ee051f-98cd-44b1-9f8f-0e2c1d907fa1", "tag": "7f73f7ab-8181-44dc-b7fc-0de3e0f23a72"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:10.392154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:10.392853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:10.393376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:10.394117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:10.394578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:10.398904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d223445d-294c-4c8a-8cc2-48141d7bfd19 req-67904193-c7f9-4ac2-8cc4-4f975d3036da service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:10.404773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:10.405772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d223445d-294c-4c8a-8cc2-48141d7bfd19 req-67904193-c7f9-4ac2-8cc4-4f975d3036da service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:10.406223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d223445d-294c-4c8a-8cc2-48141d7bfd19 req-67904193-c7f9-4ac2-8cc4-4f975d3036da service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:10.436296 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d223445d-294c-4c8a-8cc2-48141d7bfd19 req-67904193-c7f9-4ac2-8cc4-4f975d3036da service nova] Creating event network-changed:7f73f7ab-8181-44dc-b7fc-0de3e0f23a72 for instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 on n-h2-854653-7 Nov 03 04:12:10.456914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d223445d-294c-4c8a-8cc2-48141d7bfd19 req-67904193-c7f9-4ac2-8cc4-4f975d3036da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095882 Nov 03 04:12:10.469497 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2051/4230] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:12:10.470168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Getting quotas for project 643105f36872458fa8c9e8d70089b9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:12:10.473555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:10.482069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:10.488453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Getting quotas for user f52ea9e0295e4b2a8eefa7ac31bf3ddf and project 643105f36872458fa8c9e8d70089b9d9. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:12:10.506079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:10.508738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:10.510256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:10.513356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:10.513695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:10.519659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:10.537467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:12:10.540007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:12:10.764875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:10.777929 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f54bb40d-74fe-40f0-8170-7adcc1b11f13 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.319181 Nov 03 04:12:10.778721 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2052/4231] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:10 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:10.790289 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-44476ebb-f0c4-42a8-9ec6-74a9c088e818 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257030 Nov 03 04:12:10.794368 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2180/4232] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:12:10.814030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ba38de4-2aa9-428c-9357-91f6e3552963 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:10.814559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ba38de4-2aa9-428c-9357-91f6e3552963 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:11.370393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ba38de4-2aa9-428c-9357-91f6e3552963 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:11.380942 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ba38de4-2aa9-428c-9357-91f6e3552963 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1217 microversion: 2.1 time: 0.570839 Nov 03 04:12:11.382232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2053/4233] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:10 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1217 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:11.806893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:11.808133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:11.816954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:11.817601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:11.818055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:11.818822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:11.819482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:11.819921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:12.332622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:12.366221 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-64c596b6-c4ee-4d9f-a38e-2183fee1f40b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.563128 Nov 03 04:12:12.366953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2181/4234] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:11 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:12.411845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:12.412535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:12.419270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:12.434740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:12.435653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:12.436575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:12.437530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:12.438180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:12.451681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:12.591696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:12.600068 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1805d14-5e21-4669-87cd-4c03ec981689 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1221 microversion: 2.1 time: 0.193233 Nov 03 04:12:12.601079 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2054/4235] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:12 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1221 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:13.392706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:13.393380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:13.400770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:13.417607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:13.418100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:13.418869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:13.419346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:13.419778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:13.627480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:13.630402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:13.660039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:13.662484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:13.669839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:13.669839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:13.669839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:13.669839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:13.818579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:13.831760 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-360d3dcb-2e83-4ca9-b4f5-2a3db145d420 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1277 microversion: 2.1 time: 0.209453 Nov 03 04:12:13.833118 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2055/4236] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:13 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:14.107712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:14.147749 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e0e7382-0391-4b77-8868-9ba14e127906 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.759093 Nov 03 04:12:14.175566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2182/4237] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:13 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:14.857453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:14.858606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:14.871412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:14.876390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:14.877266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:14.880180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:14.880886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:14.881578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:15.144107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:15.160635 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee3a3126-9c4a-487f-bce0-b0249fea2306 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1275 microversion: 2.1 time: 0.300969 Nov 03 04:12:15.162150 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2056/4238] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:14 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:15.182302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:15.183052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:15.201247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:15.207366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:15.208252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:15.209752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:15.212593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:15.213385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:15.806646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:15.823302 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dcbce9b5-f282-4e54-af69-cea3ec4f29e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.644794 Nov 03 04:12:15.828692 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2183/4239] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:15 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:16.199243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:16.200865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:16.228486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:16.229792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:16.232335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:16.234231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:16.236100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:16.237583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:16.623641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:16.639729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f56ffdeb-d09a-4d1b-8dc0-057eb231bb18 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.446043 Nov 03 04:12:16.640892 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2057/4240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:16 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:16.855615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:16.856970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:16.862935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:16.883929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:16.884466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:16.886939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:16.890486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:16.890809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:16.891414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:17.610016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:17.630621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cddb4c7b-4138-4b62-99b1-d198fd012a50 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.779184 Nov 03 04:12:17.637295 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2184/4241] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:16 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:17.673573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:17.677269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:17.687384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:17.689488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:17.690158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:17.692262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:17.692262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:17.692262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:18.108337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:18.136583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2de369c9-361a-4974-b40d-738b49548ee6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.468306 Nov 03 04:12:18.158120 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2058/4242] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:17 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:18.569511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-001fe9e8-79a4-46de-84bd-e44cfae62392 req-082751f5-d22e-4826-9546-316670a34765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ee051f-98cd-44b1-9f8f-0e2c1d907fa1", "name": "network-vif-plugged", "status": "completed", "tag": "7f73f7ab-8181-44dc-b7fc-0de3e0f23a72"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:18.601121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-001fe9e8-79a4-46de-84bd-e44cfae62392 req-082751f5-d22e-4826-9546-316670a34765 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:18.604393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-001fe9e8-79a4-46de-84bd-e44cfae62392 req-082751f5-d22e-4826-9546-316670a34765 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:18.605998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-001fe9e8-79a4-46de-84bd-e44cfae62392 req-082751f5-d22e-4826-9546-316670a34765 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:18.649221 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-001fe9e8-79a4-46de-84bd-e44cfae62392 req-082751f5-d22e-4826-9546-316670a34765 service nova] Creating event network-vif-plugged:7f73f7ab-8181-44dc-b7fc-0de3e0f23a72 for instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 on n-h2-854653-7 Nov 03 04:12:18.658915 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-001fe9e8-79a4-46de-84bd-e44cfae62392 req-082751f5-d22e-4826-9546-316670a34765 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331938 Nov 03 04:12:18.662837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:18.663144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2185/4243] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:18.663458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:18.678122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:18.688233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:18.689585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:18.691601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:18.693374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:18.694585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:19.013795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:19.024546 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5719bdde-ff77-48fb-b0ba-14fd61b40b45 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.367079 Nov 03 04:12:19.025203 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2059/4244] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:18 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:19.111483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cc4868de-f065-4ebf-92a5-8cf1a30a4b9d req-f112ee34-5520-4859-b35c-d846e0d5db5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dce2a8-211e-4cad-a50f-82480431c49c", "tag": "c50627a2-815d-4ebc-8a54-fbb46954f57b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:19.122857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cc4868de-f065-4ebf-92a5-8cf1a30a4b9d req-f112ee34-5520-4859-b35c-d846e0d5db5a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:19.123567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cc4868de-f065-4ebf-92a5-8cf1a30a4b9d req-f112ee34-5520-4859-b35c-d846e0d5db5a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:19.124270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cc4868de-f065-4ebf-92a5-8cf1a30a4b9d req-f112ee34-5520-4859-b35c-d846e0d5db5a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:19.139828 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cc4868de-f065-4ebf-92a5-8cf1a30a4b9d req-f112ee34-5520-4859-b35c-d846e0d5db5a service nova] Creating event network-changed:c50627a2-815d-4ebc-8a54-fbb46954f57b for instance f5dce2a8-211e-4cad-a50f-82480431c49c on n-h1-854653-7 Nov 03 04:12:19.147113 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cc4868de-f065-4ebf-92a5-8cf1a30a4b9d req-f112ee34-5520-4859-b35c-d846e0d5db5a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039961 Nov 03 04:12:19.148040 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2186/4245] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:19.167811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:19.168695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:19.188331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:19.189344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:19.190711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:19.192098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:19.193894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:19.194677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:19.528705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:19.541289 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad7f4fc6-c1ab-4068-a8e2-31d10bea6820 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.378432 Nov 03 04:12:19.543640 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2060/4246] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:19 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:20.050493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:20.052181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:20.074784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:20.083405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:20.084243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:20.088267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:20.089704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:20.092717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:20.425352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:20.515112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:20.522142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:20.530959 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80235f22-beac-4bc6-a87c-8f289ca365b3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1314 microversion: 2.1 time: 0.486900 Nov 03 04:12:20.567087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:20.567712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:20.569457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2187/4247] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:20 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:20.581846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:20.584935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:20.586564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:20.590417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:20.591077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:20.596290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:20.820251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:20.831301 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51c2c578-1ebd-46d2-a734-ec4a5c70544e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.266900 Nov 03 04:12:20.837172 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2061/4248] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:20 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:21.558878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:21.560044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:21.571164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:21.571998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:21.572642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:21.573555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:21.574028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:21.574470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:21.787362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:21.797651 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-af46edab-1915-4301-b1e0-6db29d4e8009 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1501 microversion: 2.1 time: 0.243494 Nov 03 04:12:21.798613 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2188/4249] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:21 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:21.824791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:21.828070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:21.835026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=12 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:21.838207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:21.838882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:21.839482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:21.840569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:21.841217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:21.841974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:21.861427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:21.865706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:21.871947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:21.873558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:21.874390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:21.875133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:21.875604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:21.877336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:21.902707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f4b08cd-c64c-43b3-af52-8597470ff135 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.081589 Nov 03 04:12:21.909102 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2062/4250] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:21 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:22.086240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:22.101292 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7a3a4cb-c3f0-495f-be91-22aa7c620540 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.247645 Nov 03 04:12:22.113191 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2189/4251] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:21 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:22.916723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:22.919142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:22.927244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:22.927823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:22.928442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:22.929370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:22.929823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:22.930248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:22.970898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-202d9c6d-a690-4af3-a6e8-24c838659578 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.057759 Nov 03 04:12:22.975241 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2063/4252] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:22 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:23.126564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:23.127933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:23.140891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:23.143372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:23.143923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:23.145855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:23.146812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:23.148108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:23.541243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:23.559612 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9152310-d0ff-4a0e-aa50-cba2b3b9810b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.432181 Nov 03 04:12:23.559612 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2190/4253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:23 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:23.706108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-599bb9c6-bde2-4d77-a0e6-10e7aa0e3ea7 tempest-ExtensionsTest-963046030 tempest-ExtensionsTest-963046030-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:23.709156 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-599bb9c6-bde2-4d77-a0e6-10e7aa0e3ea7 tempest-ExtensionsTest-963046030 tempest-ExtensionsTest-963046030-project] 10.222.0.30 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.269392 Nov 03 04:12:23.715943 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2064/4254] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Nov 3 04:12:23 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:23.720607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f38c7bff-422e-4148-8cb8-13b8e3b174c8 tempest-ExtensionsTest-963046030 tempest-ExtensionsTest-963046030-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:23.722785 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f38c7bff-422e-4148-8cb8-13b8e3b174c8 tempest-ExtensionsTest-963046030 tempest-ExtensionsTest-963046030-project] 10.222.0.30 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006926 Nov 03 04:12:23.723464 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2191/4255] 10.222.0.30 () {58 vars in 1134 bytes} [Thu Nov 3 04:12:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:12:23.982323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:23.987654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:24.003728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:24.004820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:24.006846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:24.010840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:24.011955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:24.013483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:24.087121 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89227edb-e7d5-4d7a-b168-ce0886f49414 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.105396 Nov 03 04:12:24.092931 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2065/4256] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:23 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:24.593645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:24.593645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:24.601367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:24.603725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:24.605412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:24.606451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:24.612791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:24.612791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:24.995456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:25.007314 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bb79d19-394e-4d60-9ad1-3b876098f702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.428174 Nov 03 04:12:25.024562 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2192/4257] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:24 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:25.102279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:25.105400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:25.138704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:25.139499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:25.140125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:25.141923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:25.146283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:25.149097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:25.283999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e33ad36a-abd5-4def-b36c-9056d487b6dc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.187122 Nov 03 04:12:25.286396 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2066/4258] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:25 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:26.031636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:26.032902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:26.049136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:26.050112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:26.050570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:26.053997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:26.054497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:26.057285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:26.299463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:26.305097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:26.325562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:26.337423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:26.337968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:26.339516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:26.339999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:26.340435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:26.412836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:26.432032 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e6a1f2ff-f44a-4899-935d-a943a09088b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.404105 Nov 03 04:12:26.434603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2193/4259] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:26 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:26.471978 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4832901b-a1ed-4a14-bc75-9f2572baa78e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.176465 Nov 03 04:12:26.476303 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2067/4260] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:26 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:27.346795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2527ac2b-9ad7-441e-90e3-24d3c552e9c1 req-6045aee3-790b-4b7c-af65-d5a9640b3955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dce2a8-211e-4cad-a50f-82480431c49c", "name": "network-vif-plugged", "status": "completed", "tag": "c50627a2-815d-4ebc-8a54-fbb46954f57b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:27.363615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2527ac2b-9ad7-441e-90e3-24d3c552e9c1 req-6045aee3-790b-4b7c-af65-d5a9640b3955 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:27.371038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2527ac2b-9ad7-441e-90e3-24d3c552e9c1 req-6045aee3-790b-4b7c-af65-d5a9640b3955 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:27.371628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2527ac2b-9ad7-441e-90e3-24d3c552e9c1 req-6045aee3-790b-4b7c-af65-d5a9640b3955 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:27.407898 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2527ac2b-9ad7-441e-90e3-24d3c552e9c1 req-6045aee3-790b-4b7c-af65-d5a9640b3955 service nova] Creating event network-vif-plugged:c50627a2-815d-4ebc-8a54-fbb46954f57b for instance f5dce2a8-211e-4cad-a50f-82480431c49c on n-h1-854653-7 Nov 03 04:12:27.424809 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2527ac2b-9ad7-441e-90e3-24d3c552e9c1 req-6045aee3-790b-4b7c-af65-d5a9640b3955 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081318 Nov 03 04:12:27.425786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2194/4261] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:27.462327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:27.464237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:27.475392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:27.476180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:27.485122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:27.491136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:27.492986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:27.494093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:27.494590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:27.495038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:27.510870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:27.511357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:27.512269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:27.513216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:27.514224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:27.514828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:27.585174 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5675f992-79ce-48d1-9e78-78cecdd3997f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.104533 Nov 03 04:12:27.589565 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2195/4262] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:27 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:27.735393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:27.743247 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5b4ac84-c753-4028-89a5-e39b66a32ccb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.285722 Nov 03 04:12:27.743820 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2068/4263] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:27 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:28.601669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:28.604649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:28.613293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:28.613778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:28.614215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:28.614917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:28.615472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:28.616302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:28.658477 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cfb0d54e-6107-42fb-a174-bc588f231ecd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.061411 Nov 03 04:12:28.659401 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2196/4264] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:28 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:28.768423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:28.769150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:28.775497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:28.780762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:28.781646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:28.787148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:28.787148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:28.787148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:28.787148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:28.941893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:28.965295 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-932bbf45-0b95-46ae-adbe-375058ffbca9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1317 microversion: 2.1 time: 0.197792 Nov 03 04:12:28.970239 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2069/4265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:28 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:29.670760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:29.673887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:29.682230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:29.682927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:29.683381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:29.684096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:29.684564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:29.684997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:29.731358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96e17738-b609-43a0-86a7-ec171abcb57a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.064641 Nov 03 04:12:29.732043 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2197/4266] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:29 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:29.988720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:29.990011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:29.998821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:29.999482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.000145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.001306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:30.001950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.002584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.155672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:30.159897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:30.164782 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d52a5bcd-a9c8-423b-8c4b-1907a88531d1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1506 microversion: 2.1 time: 0.180912 Nov 03 04:12:30.165569 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2070/4267] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:29 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:30.188533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:30.192882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:30.197459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:30.198149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.199062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.199932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:30.200550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.201168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.235792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:12:30.265440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:30.635063 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0001789c-1480-40fc-a65a-4740446ae594 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 204 len: 0 microversion: 2.1 time: 0.450565 Nov 03 04:12:30.641964 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2198/4268] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:12:30 2022] DELETE /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:12:30.648353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:30.648984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:30.656479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:30.657045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.657483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.658186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:30.658651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.659085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.744708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:30.747626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:30.759753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:30.760892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.761823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.764401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:30.765706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:30.769177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:30.814727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:30.819901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-752dcab1-af8f-431e-b442-562c6791cddb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.080318 Nov 03 04:12:30.823391 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2199/4269] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:30 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:12:30.825953 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-32206341-5aad-4fc7-82d4-745bdab04275 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1512 microversion: 2.1 time: 0.181739 Nov 03 04:12:30.826494 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2071/4270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:30 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:31.836555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:31.839412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:31.847731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:31.848423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:31.848874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:31.850311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:31.851102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:31.858417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:31.860277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:31.867125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:31.875989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:31.876717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:31.877526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:31.878415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:31.880339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:31.880982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:31.960199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-00af253b-1f96-49c9-82b2-76358efaa972 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 14 microversion: 2.1 time: 0.127829 Nov 03 04:12:31.961140 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2200/4271] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:31 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 03 04:12:32.098611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:32.106610 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6261188d-af1a-4711-8930-5f1299203bbe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1512 microversion: 2.1 time: 0.253568 Nov 03 04:12:32.107549 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2072/4272] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:31 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:32.980228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:32.986470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:33.023976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.024783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.028926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.033328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.037062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.037927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.132956 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-639b81e1-236f-46d5-875d-c2bfb201f651 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action" status: 200 len: 8206 microversion: 2.1 time: 0.163317 Nov 03 04:12:33.138462 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2073/4273] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:32 2022] POST /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1/action => generated 8206 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:33.160065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:33.160905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:33.180484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.181275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.183048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.183048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.186849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.187582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.242091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d6bbdc63-fe74-4863-b6f7-7e64ff648318 tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:33.256752 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d6bbdc63-fe74-4863-b6f7-7e64ff648318 tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] 10.222.0.30 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.549315 Nov 03 04:12:33.257368 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2201/4274] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:12:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:12:33.283728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:33.284773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:33.299755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.300945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.302370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.310968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.311475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.311930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.538040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:33.546662 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a1b31227-15f4-45ed-aeb7-6cb381dfe518 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1470 microversion: 2.1 time: 0.410872 Nov 03 04:12:33.556531 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2074/4275] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:33 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1470 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:33.799634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9886f7c8-e9d5-4ed9-93cc-842029bcfc3d req-6978e7f9-959c-4160-af59-ff98d96abe09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dce2a8-211e-4cad-a50f-82480431c49c", "name": "network-vif-deleted", "tag": "c50627a2-815d-4ebc-8a54-fbb46954f57b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:33.830337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9886f7c8-e9d5-4ed9-93cc-842029bcfc3d req-6978e7f9-959c-4160-af59-ff98d96abe09 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.832474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9886f7c8-e9d5-4ed9-93cc-842029bcfc3d req-6978e7f9-959c-4160-af59-ff98d96abe09 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.833035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9886f7c8-e9d5-4ed9-93cc-842029bcfc3d req-6978e7f9-959c-4160-af59-ff98d96abe09 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.850624 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9886f7c8-e9d5-4ed9-93cc-842029bcfc3d req-6978e7f9-959c-4160-af59-ff98d96abe09 service nova] Creating event network-vif-deleted:c50627a2-815d-4ebc-8a54-fbb46954f57b for instance f5dce2a8-211e-4cad-a50f-82480431c49c on n-h1-854653-7 Nov 03 04:12:33.856951 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9886f7c8-e9d5-4ed9-93cc-842029bcfc3d req-6978e7f9-959c-4160-af59-ff98d96abe09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062787 Nov 03 04:12:33.858345 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2075/4276] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:12:33.866620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:33.882166 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fe1bf51e-f13d-4140-b3ba-1e67f31cbbe0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.623681 Nov 03 04:12:33.889167 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2202/4277] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:33 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:33.909103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:33.909822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:33.917615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.918123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.918802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:33.919521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:33.919985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:33.920660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.113115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:34.123997 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64e2ca9f-3fb8-48a5-b22b-1c65ba395939 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.218067 Nov 03 04:12:34.123997 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2076/4278] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:33 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:34.152442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:34.152442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:34.155192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.155687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.156122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.157745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.158363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.158935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.324651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:34.338241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fc48e3a5-0083-4b67-ab0f-a0566491d31b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.192733 Nov 03 04:12:34.353055 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2203/4279] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:34 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:34.364408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:34.365645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:34.374265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.375404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.376125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.376917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.377509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.378008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.584043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:34.585142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:34.604060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.613430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.614065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.614844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.617818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.619617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.695768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:34.701832 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b55bae0-50bc-4e9a-8255-07f114ef49e8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.340623 Nov 03 04:12:34.704948 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2077/4280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:34 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:34.742630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:34.742630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:34.753023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.756138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.758481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.759055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lazy-loading 'fault' on Instance uuid f5dce2a8-211e-4cad-a50f-82480431c49c {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:12:34.760620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.761551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.763465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.763465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:34.764351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:34.765513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:34.862614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:34.878676 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1991fabb-da28-40c3-9fa8-d39de9979848 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 200 len: 1307 microversion: 2.1 time: 0.300065 Nov 03 04:12:34.881356 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2204/4281] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:34 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:35.009434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Locking {{(pid=127593) lock /opt/stack/nova/nova/compute/api.py:4845}} Nov 03 04:12:35.264280 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be8f80b8-17a5-4764-ad77-7869f74b705f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.533266 Nov 03 04:12:35.265366 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2078/4282] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:34 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:12:35.274604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:35.279682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:35.281427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:35.281951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:35.282572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:35.283278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:35.283739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:35.284172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:35.489569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97cccccc-5bdc-45af-b91e-328afd89310a tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1334923461", "imageRef": "3639401e-b52f-4cbc-83ef-ad26575e6577", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:35.509273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:35.561901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b319e0f6-0204-427a-b999-de5ea075a7fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.253769 Nov 03 04:12:35.578618 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2205/4283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:35 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:35.591048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:35.614133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:35.614308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-97cccccc-5bdc-45af-b91e-328afd89310a tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:12:35.615077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:35.615925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:35.650413 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] HTTP exception thrown: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 is locked Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Request method failure captured: Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action HTTP/1.1 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 15 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz5obLGYsXMsCiJUNlEVMAwYzv3C-HCNO0Tt8826NWpMmXJyEoO8CMK1fOCClxvGv3qCGmJzQGpCnm7T73M6XrIm_QO6IU_3Lp6iRrGGHKX7HvdUDVmitEpnJxOZuoElZFmmtIKxyH9aC10ikmqZlCQf9r4d9WkFnSoOO4Z-YziLQWM Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5da4e6e327d94557872a462ca9fa96f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5da4e6e327d94557872a462ca9fa96f8"}]}] Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d374eee04fe4433d862b7bc04a16a563 Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: {"os-stop": {}} Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 is locked Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '18905a6e-8634-481a-9183-7f5c5b15b546', 'body': {'os-stop': {}}} Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 is locked Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 is locked Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 is locked Nov 03 04:12:35.653210 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:35.660260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Returning 409 to user: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 is locked {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:35.661682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80023879-415f-45ad-8d69-0d6281553367 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 409 len: 107 microversion: 2.1 time: 0.077218 Nov 03 04:12:35.667281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2206/4284] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:35 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 107 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:12:35.674413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:35.675446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:35.685794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:35.686830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:35.687657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:35.688686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:35.689512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:35.690410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:35.931581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Unlocking {{(pid=127594) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 03 04:12:36.112591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-97cccccc-5bdc-45af-b91e-328afd89310a tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97cccccc-5bdc-45af-b91e-328afd89310a tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] Request method failure captured: Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 143 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-wu678N9x_0EFtZySNkimZrQGnJrZXmiRzXa5FJceAp2A3AN5Cp7SVzS9xV3JcqMtrGjsnw52Nv1DHkxp0rzbTRI6asX7qqnAxh8b0rvDfuHQ191gsNDsunqJso00qtDb5ImYUmAw-5KA4tWFbrx4hYz5sHavScSflnOCa7UyHiVA Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 26b592e7a6b349e1b0122209f8a0b3e6 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-FlavorsV2NegativeTest-1461009926 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b592e7a6b349e1b0122209f8a0b3e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_26b592e7a6b349e1b0122209f8a0b3e6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/26b592e7a6b349e1b0122209f8a0b3e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/26b592e7a6b349e1b0122209f8a0b3e6"}]}] Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-FlavorsV2NegativeTest-1461009926 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 26b592e7a6b349e1b0122209f8a0b3e6 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1461009926 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-FlavorsV2NegativeTest-1461009926-project Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3e8acb6c984a4c71b4d0c97154e0bad8 Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-FlavorsV2NegativeTest-1461009926-project Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1334923461", "imageRef": "3639401e-b52f-4cbc-83ef-ad26575e6577", "flavorRef": "452"}} Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: exception: Flavor's memory is too small for requested image. Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1334923461', 'imageRef': '3639401e-b52f-4cbc-83ef-ad26575e6577', 'flavorRef': '452'}}} Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:36.114915 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97cccccc-5bdc-45af-b91e-328afd89310a tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-97cccccc-5bdc-45af-b91e-328afd89310a tempest-FlavorsV2NegativeTest-1461009926 tempest-FlavorsV2NegativeTest-1461009926-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.634358 Nov 03 04:12:36.120706 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2079/4285] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:35 2022] POST /compute/v2.1/servers => generated 93 bytes in 636 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 03 04:12:36.130114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:36.131957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:36.164590 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3554dfa4-7fb2-4a22-b831-acfb8f474992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.495697 Nov 03 04:12:36.167212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.167810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.168332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.168903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2207/4286] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:35 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:12:36.173888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.173888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.174504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-12d1c6ce-00a8-4192-9731-a9b38cff5ce6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:36.178424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.202603 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:12:36.206590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12d1c6ce-00a8-4192-9731-a9b38cff5ce6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.207827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12d1c6ce-00a8-4192-9731-a9b38cff5ce6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.209574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-12d1c6ce-00a8-4192-9731-a9b38cff5ce6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c HTTP/1.1 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f5dce2a8-211e-4cad-a50f-82480431c49c'} Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:36.216851 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-008894f9-4d45-4623-bc93-2fef778c25e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 404 len: 111 microversion: 2.1 time: 0.096481 Nov 03 04:12:36.225576 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2080/4287] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:36 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:12:36.237403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:36.243645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:36.246826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.247330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.247768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.248637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.249147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.249579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.267996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-12d1c6ce-00a8-4192-9731-a9b38cff5ce6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Going to try to stop instance {{(pid=127594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:12:36.446404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:36.460223 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-629e7111-fa8a-41d3-99e9-6071cc188aa7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.225017 Nov 03 04:12:36.462864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2081/4288] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:36 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:36.559806 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-12d1c6ce-00a8-4192-9731-a9b38cff5ce6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.388964 Nov 03 04:12:36.562112 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2208/4289] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:36 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:12:36.572554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:36.573209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:36.587539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.587975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.589810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.592369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.592849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.593310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.801914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:36.811922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f5bab50-5bc1-4e65-95b5-d5feaf91d79c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.245389 Nov 03 04:12:36.812845 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2082/4290] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:36 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:36.849546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0e8e091-92b8-49ed-b7a3-e3dc3c9b3e8b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0e8e091-92b8-49ed-b7a3-e3dc3c9b3e8b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 163 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": 12345, "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 12345 Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:12:36.856226 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0e8e091-92b8-49ed-b7a3-e3dc3c9b3e8b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:36.862466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0e8e091-92b8-49ed-b7a3-e3dc3c9b3e8b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.014145 Nov 03 04:12:36.865097 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2209/4291] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:36 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:36.869327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:36.873790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:36.885653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.886177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.887813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:36.890105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:36.893342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:36.895075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:37.211852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:37.221576 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a60c3d6d-ec34-44ee-9e88-6accc352e013 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.358117 Nov 03 04:12:37.231930 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2083/4292] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:36 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:37.249219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:37.249219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:37.256087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:37.256592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:37.257052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:37.257829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:37.258292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:37.258723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:37.406007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:37.421337 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-79cd3880-0525-43f4-b463-47d8c9b6061c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.178691 Nov 03 04:12:37.422777 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2210/4293] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:37 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:37.835898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:37.836907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:37.857349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:37.857349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:37.857964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:37.858902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:37.859474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:37.860300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:38.126070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:38.143266 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-469623d3-9280-48e6-991d-e87d2102b841 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.311441 Nov 03 04:12:38.146554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2084/4294] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:37 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:39.177267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:39.180874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:39.210320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:39.212160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:39.215084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:39.216848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:39.217674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:39.220289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:39.515733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:39.542584 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07aab78f-89f4-422a-8593-bb5fe28f6a29 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.374579 Nov 03 04:12:39.544402 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2211/4295] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:39 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:40.577338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:40.579041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:40.587358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:40.587936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:40.588632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:40.589483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:40.590012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:40.590666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:40.786379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:40.795377 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a773b94d-2066-437f-9068-bfd66ebad2c4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.224144 Nov 03 04:12:40.796404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2085/4296] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:40 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:41.138061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a6a349b-3f92-439a-b771-6056fb304bb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2028162931", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "14634dc6-04e5-4e1b-ab71-00700b8186fb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:41.214069 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6a6a349b-3f92-439a-b771-6056fb304bb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Block Device 14634dc6-04e5-4e1b-ab71-00700b8186fb is not bootable. Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a6a349b-3f92-439a-b771-6056fb304bb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 358 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2028162931", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "14634dc6-04e5-4e1b-ab71-00700b8186fb", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: exception: Block Device 14634dc6-04e5-4e1b-ab71-00700b8186fb is not bootable. Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2028162931', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '14634dc6-04e5-4e1b-ab71-00700b8186fb'}], 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 14634dc6-04e5-4e1b-ab71-00700b8186fb is not bootable. Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:41.225850 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 14634dc6-04e5-4e1b-ab71-00700b8186fb is not bootable. Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 14634dc6-04e5-4e1b-ab71-00700b8186fb is not bootable. Nov 03 04:12:41.229876 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:41.235211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a6a349b-3f92-439a-b771-6056fb304bb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Block Device 14634dc6-04e5-4e1b-ab71-00700b8186fb is not bootable. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:41.241421 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a6a349b-3f92-439a-b771-6056fb304bb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.102218 Nov 03 04:12:41.241421 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2212/4297] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:41 2022] POST /compute/v2.1/servers => generated 110 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:41.248598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:41.249256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:41.258607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:41.259118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:41.259568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:41.260621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:41.261127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:41.262464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:41.441317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:41.454761 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f704d88-8846-4834-b043-d119ca264d31 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.211326 Nov 03 04:12:41.463258 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2086/4298] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:41 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:41.480221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:41.481980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:41.487553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:41.488098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:41.488880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:41.489845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:41.490645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:41.491450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:41.642304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:41.653110 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13f97004-1591-41b3-a123-ee9fb82654ac tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.176180 Nov 03 04:12:41.653896 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2213/4299] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:41 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:41.820827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:41.821481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:41.828798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:41.829325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:41.829774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:41.830481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:41.830941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:41.831375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:42.006154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:42.008380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:42.017663 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2d2a9b5-72bb-48f2-9666-ec9790d20fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.200746 Nov 03 04:12:42.029846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2087/4300] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:41 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:43.042068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:43.042857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:43.060205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:43.061294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:43.061999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:43.064438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:43.065118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:43.065740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:43.254302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:43.257645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=90,nova_cell1:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:43.266912 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87df70e9-8bd9-4cb4-9a56-2e2e7815d1b7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.228892 Nov 03 04:12:43.267926 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2214/4301] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:43 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:44.300562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:44.301362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:44.315872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:44.316419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:44.317083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:44.318453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:44.319074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:44.321196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:44.586433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:44.595658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ab1b5ee-53cf-46d2-a384-aac7277ba8ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.303567 Nov 03 04:12:44.596243 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2088/4302] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:44 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:44.642877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4831e2e4-07a3-4159-b1e9-211db7b8dc86 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-816978178", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9282dbed-69cc-4288-b866-d4c7962a81f1", "destination_type": "local"}, {"source_type": "volume", "uuid": "1294bfdf-9d13-4c3a-9558-42ab2c3c2cf1", "destination_type": "invalid"}], "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4831e2e4-07a3-4159-b1e9-211db7b8dc86 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 494 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-816978178", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9282dbed-69cc-4288-b866-d4c7962a81f1", "destination_type": "local"}, {"source_type": "volume", "uuid": "1294bfdf-9d13-4c3a-9558-42ab2c3c2cf1", "destination_type": "invalid"}], "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-816978178', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '1294bfdf-9d13-4c3a-9558-42ab2c3c2cf1', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi 'invalid' Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:44.648574 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4831e2e4-07a3-4159-b1e9-211db7b8dc86 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4831e2e4-07a3-4159-b1e9-211db7b8dc86 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011256 Nov 03 04:12:44.652430 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2215/4303] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:44 2022] POST /compute/v2.1/servers => generated 155 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:44.660920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:44.661591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:44.670856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:44.671365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:44.672373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:44.673133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:44.673602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:44.674056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:44.829384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:44.842615 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39bcac3a-7e39-4398-be44-1e3573cd638c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.186818 Nov 03 04:12:44.849821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2089/4304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:44 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:44.880261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:44.881221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:44.888771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:44.889523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:44.890189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:44.891160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:44.891771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:44.892351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:45.095308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:45.105515 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-efce2448-25f0-49ac-a423-f9bd528bad7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.233577 Nov 03 04:12:45.107200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2216/4305] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:44 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:45.364615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca3baa31-cb19-4e0a-8f3a-dd5a0b7f9849 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1129039915", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca3baa31-cb19-4e0a-8f3a-dd5a0b7f9849 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 492 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1129039915", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1129039915', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:45.369676 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca3baa31-cb19-4e0a-8f3a-dd5a0b7f9849 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca3baa31-cb19-4e0a-8f3a-dd5a0b7f9849 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014406 Nov 03 04:12:45.379074 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2090/4306] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:45 2022] POST /compute/v2.1/servers => generated 624 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:45.385516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:45.386709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:45.400166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:45.400682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:45.401166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:45.401898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:45.402536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:45.403367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:45.621650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:45.622651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:45.646985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:45.650561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:45.654385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:45.654385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:45.654385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:45.654854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:45.673049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:45.681473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1273db8-cd95-44ac-9e63-b6ad7d955947 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.300298 Nov 03 04:12:45.686906 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2217/4307] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:45 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:45.705050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:45.707738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:45.714438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:45.715161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:45.715792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:45.718109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:45.718826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:45.719425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:45.916793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:45.949319 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b87ab274-3dd8-4884-b38d-a4cc32031fb2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.311033 Nov 03 04:12:45.950143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:45.950268 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2091/4308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:45 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:45.950351 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0219286d-5a80-47f6-91c1-13f937a51c4d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.245528 Nov 03 04:12:45.950351 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2218/4309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:45 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:46.139996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8857d3df-6d4e-4c43-a531-195ca6075640 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8857d3df-6d4e-4c43-a531-195ca6075640 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 416 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:46.145984 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8857d3df-6d4e-4c43-a531-195ca6075640 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8857d3df-6d4e-4c43-a531-195ca6075640 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.011555 Nov 03 04:12:46.149968 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2092/4310] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:46 2022] POST /compute/v2.1/servers => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:46.166019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:46.166490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:46.173247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:46.173745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:46.174218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:46.174901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:46.175360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:46.175787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:46.485326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:46.490440 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4a773d22-3c8c-47c0-bd66-c59f70da17d2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.328210 Nov 03 04:12:46.492404 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2219/4311] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:46 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:46.521969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:46.522584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:46.532401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:46.532924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:46.536303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:46.538121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:46.538619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:46.539118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:46.725112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:46.733539 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5667a4a-c676-4920-be84-fa1c802f00af tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.215557 Nov 03 04:12:46.741967 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2093/4312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:46 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:46.973905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:46.975057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:46.982472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:46.986805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:46.986805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:46.986805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:46.986805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:46.986805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:47.134799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4816c657-2b83-4227-a58d-c768685d48c9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1072441489", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": -1, "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:47.151309 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-4816c657-2b83-4227-a58d-c768685d48c9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Flavor -1 could not be found. Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4816c657-2b83-4227-a58d-c768685d48c9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 206 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1072441489", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": -1, "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: exception: Flavor -1 could not be found. Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1072441489', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': -1, 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:47.155370 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Nov 03 04:12:47.160537 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:47.170371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4816c657-2b83-4227-a58d-c768685d48c9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:47.172352 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4816c657-2b83-4227-a58d-c768685d48c9 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.042048 Nov 03 04:12:47.181637 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2094/4313] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:47 2022] POST /compute/v2.1/servers => generated 73 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 04:12:47.208899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:47.224947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:47.226058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:47.227162 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e49df8bd-96c8-4d1b-8b23-46465d9f02ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.256694 Nov 03 04:12:47.230283 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2220/4314] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:46 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:47.240620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:47.243257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:47.244391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:47.246101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:47.249199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:47.250423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:47.471006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:47.482144 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40b16596-61be-4412-8854-e689f2ffb52c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.298831 Nov 03 04:12:47.497271 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2095/4315] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:47 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:47.506232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:47.506981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:47.520274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:47.520776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:47.521229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:47.521956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:47.522416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:47.522840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:47.853408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:47.864810 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3ad8a12-1a86-4918-aa84-11a295aad2f3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.362403 Nov 03 04:12:47.883634 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2221/4316] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:47 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:48.052564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58f0dc1c-838c-45d4-b8e8-bba80aa08011 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1063642986", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58f0dc1c-838c-45d4-b8e8-bba80aa08011 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 173 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1063642986", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1063642986', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi -1 Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:12:48.060060 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Nov 03 04:12:48.064098 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:48.070179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58f0dc1c-838c-45d4-b8e8-bba80aa08011 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:48.071575 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-58f0dc1c-838c-45d4-b8e8-bba80aa08011 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.023315 Nov 03 04:12:48.078930 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2096/4317] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:48 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:48.088553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:48.089218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:48.121032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:48.124001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:48.125344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:48.146719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:48.150106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:48.154046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:48.258597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:48.259352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:48.277281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:48.282269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:48.282737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:48.289952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:48.293214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:48.295123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:48.382812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:48.393054 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05d71a09-d7a9-4c4a-ba27-85b4b518be8d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.309667 Nov 03 04:12:48.394210 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2222/4318] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:48 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:48.417755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:48.418703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:48.426266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:48.427087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:48.427752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:48.428707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:48.429476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:48.430284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:48.884907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:48.905086 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c2fadfd-198c-4d67-b6ba-d4dc04538275 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1656 microversion: 2.1 time: 0.648738 Nov 03 04:12:48.907714 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2097/4319] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:48 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1656 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:48.941871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-322c7fe4-b0ae-4a56-9c3f-6fd25d191684 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:48.950877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-322c7fe4-b0ae-4a56-9c3f-6fd25d191684 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:48.951392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-322c7fe4-b0ae-4a56-9c3f-6fd25d191684 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:48.951849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-322c7fe4-b0ae-4a56-9c3f-6fd25d191684 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:49.028683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-322c7fe4-b0ae-4a56-9c3f-6fd25d191684 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Going to try to start instance {{(pid=127593) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 03 04:12:49.103140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:49.116462 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-900d9955-a4d6-44a2-a975-8a2db232e2e5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.702641 Nov 03 04:12:49.158102 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2223/4320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:48 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:49.328840 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-322c7fe4-b0ae-4a56-9c3f-6fd25d191684 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.390441 Nov 03 04:12:49.337835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:49.338470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:49.340934 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2098/4321] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:48 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:12:49.350927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:49.355232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:49.355791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:49.356497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:49.358843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:49.359645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:49.361119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:49.590086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-03fde2db-ef55-451c-bd86-8e70410d29b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1112627565", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:49.596797 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-03fde2db-ef55-451c-bd86-8e70410d29b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-03fde2db-ef55-451c-bd86-8e70410d29b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 216 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1112627565", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1112627565', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._validate_network_id( Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:49.599698 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:49.604515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-03fde2db-ef55-451c-bd86-8e70410d29b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:49.606332 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-03fde2db-ef55-451c-bd86-8e70410d29b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023136 Nov 03 04:12:49.612233 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2099/4322] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:49 2022] POST /compute/v2.1/servers => generated 123 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:49.620844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:49.621780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:49.629907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:49.631076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:49.631684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:49.633192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:49.633192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:49.633961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:49.721455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:49.741363 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e63d8d7d-f8e9-4ab9-8414-762dd81af17c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1665 microversion: 2.1 time: 0.406387 Nov 03 04:12:49.746908 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2224/4323] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:49 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1665 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:50.192433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:50.206342 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2eb00fbd-ca47-4e95-921d-31bacf609466 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.592534 Nov 03 04:12:50.217953 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2100/4324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:49 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:50.245442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:50.247169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:50.263752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:50.267361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:50.268193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:50.271031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:50.272615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:50.277166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:50.770612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:50.772152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:50.784738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:50.785477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:50.792288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:50.792288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:50.792288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:50.792288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:50.836119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:50.844819 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce01749a-c0f5-4c9a-9c86-c97f7ffa9679 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.609269 Nov 03 04:12:50.849926 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2225/4325] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:50 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:51.044061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba27382a-01ea-4cb9-8b02-cec0b0c9b626 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-403663594", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-key-547574562", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:51.186949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-ba27382a-01ea-4cb9-8b02-cec0b0c9b626 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] validate_networks() for [('4b8fa68c-7b16-4d7b-96b3-aa4d0316b388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:12:51.444509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:51.463820 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d507dc8b-68f0-4ba5-9a68-d8f9fa65fa1c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1665 microversion: 2.1 time: 0.698184 Nov 03 04:12:51.466867 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2101/4326] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:50 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1665 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:12:51.811136 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ba27382a-01ea-4cb9-8b02-cec0b0c9b626 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Invalid key_name provided. Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba27382a-01ea-4cb9-8b02-cec0b0c9b626 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 245 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-403663594", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-key-547574562", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid key_name provided. Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-403663594', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'key_name': 'tempest-key-547574562', 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-547574562 not found for user f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:51.813656 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:51.818214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba27382a-01ea-4cb9-8b02-cec0b0c9b626 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid key_name provided. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:51.835569 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ba27382a-01ea-4cb9-8b02-cec0b0c9b626 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.802140 Nov 03 04:12:51.842081 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2226/4327] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:51 2022] POST /compute/v2.1/servers => generated 70 bytes in 811 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 04:12:51.850216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:51.852852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:51.873539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:51.874048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:51.877961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:51.877961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:51.877961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:51.879266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:52.177539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:52.195697 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d8d03230-8670-4924-95d2-d33a1e5632b5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.353239 Nov 03 04:12:52.198151 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2102/4328] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:51 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:52.223534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:52.224221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:52.235946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:52.238012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:52.238504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:52.239260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:52.241490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:52.244083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:52.493977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:52.495161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:52.506374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:52.513389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:52.514254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:52.519865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:52.521857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:52.524995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:52.528359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:52.541862 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05e03473-a0d2-40ec-adc2-e24cdff2141a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.320764 Nov 03 04:12:52.543948 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2227/4329] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:52 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:52.832962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ef379e2-4003-4613-9e63-bcb5fe9d32f2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1578250975", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:53.002266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:53.014450 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06ebee2a-c30d-4a65-bdb7-43a9b8166318 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.524850 Nov 03 04:12:53.021883 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2103/4330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:52 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:53.048281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:53.049372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:53.064683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:53.068484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:53.069101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:53.070110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:53.072500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:53.073237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:53.798722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.security_group_api [None req-1ef379e2-4003-4613-9e63-bcb5fe9d32f2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Neutron security group does_not_exist not found {{(pid=127594) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Nov 03 04:12:53.799565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-1ef379e2-4003-4613-9e63-bcb5fe9d32f2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ef379e2-4003-4613-9e63-bcb5fe9d32f2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 258 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1578250975", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: exception: Unable to find security_group with name or id 'does_not_exist' Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1578250975', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Nov 03 04:12:53.808345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:53.819217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ef379e2-4003-4613-9e63-bcb5fe9d32f2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:53.823124 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ef379e2-4003-4613-9e63-bcb5fe9d32f2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.012473 Nov 03 04:12:53.823124 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2228/4331] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:52 2022] POST /compute/v2.1/servers => generated 106 bytes in 1020 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:12:53.827931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:53.828641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:53.843735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:53.844427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:53.846333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:53.848463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:53.854719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:53.855455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:53.867128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:53.884003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b2866a4-aec6-4f9d-82da-6b97e86c1781 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.839921 Nov 03 04:12:53.884829 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2104/4332] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:53 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:53.911385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:53.912525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:53.924741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:53.931307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:53.932026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:53.933806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:53.935030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:53.940026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:54.068249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:54.080458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5712db6a-9b10-4290-964f-8dc04c679878 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.257513 Nov 03 04:12:54.081344 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2229/4333] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:53 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:54.210873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Unlocking {{(pid=127593) unlock /opt/stack/nova/nova/compute/api.py:4874}} Nov 03 04:12:54.373354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:54.476956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:54.478272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:54.485740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:54.486500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:54.487299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:54.488204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:54.488818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:54.489430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:54.525480 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40731517-ebc1-472b-b5d0-aaf082c011a4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.618889 Nov 03 04:12:54.526135 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2105/4334] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:53 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:12:54.533501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:54.540958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:54.541248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:12:54.547352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:54.547863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:54.557907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:54.558690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:54.559177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:54.559622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:54.911708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:54.924102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e45d1d5-f15c-4d6a-9f8f-8d090f092d24 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.395545 Nov 03 04:12:54.925377 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2106/4335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:54 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:54.934020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:54.934766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:54.941796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:54.942503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:54.943116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:54.944083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:54.944770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:54.945451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:54.966931 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3240ca64-dcaa-495d-ab75-ea92a6497c79 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "DELETE /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 204 len: 0 microversion: 2.42 time: 0.859520 Nov 03 04:12:54.966931 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2230/4336] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:12:54 2022] DELETE /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 03 04:12:54.979802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ac56c6d-37b7-4fd7-ba78-ff4451f2d044 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:54.980420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0ac56c6d-37b7-4fd7-ba78-ff4451f2d044 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:54.996740 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-0ac56c6d-37b7-4fd7-ba78-ff4451f2d044 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae could not be found. Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ac56c6d-37b7-4fd7-ba78-ff4451f2d044 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae HTTP/1.1 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae could not be found. Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae'} Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae could not be found. Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae could not be found. Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:55.000943 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae could not be found. Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ac56c6d-37b7-4fd7-ba78-ff4451f2d044 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:55.007653 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0ac56c6d-37b7-4fd7-ba78-ff4451f2d044 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae" status: 404 len: 111 microversion: 2.1 time: 0.039449 Nov 03 04:12:55.009820 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2231/4337] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:12:54 2022] DELETE /compute/v2.1/servers/e9a8a3e9-d1fb-4c23-884b-587ac9ac89ae => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:12:55.017822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:55.025345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:55.036002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:55.036515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:55.036963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:55.037807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:55.038443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:55.038618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:55.435220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:55.447777 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0365bc36-5d60-456a-8572-0466e72adb96 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.519649 Nov 03 04:12:55.453332 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2107/4338] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:54 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:55.470023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:55.473045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:55.493296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:55.495005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:55.496529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:55.497942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:55.499761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:55.501986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:55.647331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:55.674355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:55.717894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:55.724639 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7fa03d0-da20-48f2-a5f2-8ef85b15b415 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2960 microversion: 2.42 time: 0.709241 Nov 03 04:12:55.725114 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2232/4339] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:12:55 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2960 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:12:55.787370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:55.789173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:55.808495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:55.809464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:55.810919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:55.814428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:55.815303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:55.816036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:55.988300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:56.035379 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07b5ff1e-19ae-4693-be24-feeca80c909e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.580667 Nov 03 04:12:56.041229 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2108/4340] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:55 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:56.066194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:56.080488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:56.111579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.114554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.117650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:56.125456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.137908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.150561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:56.258256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:56.269036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:12:56.272419 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e577c749-111c-4917-b18b-4d9e76af2d62 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.517351 Nov 03 04:12:56.273543 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2233/4341] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:55 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:56.306660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:56.309082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:56.319492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.320214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.320828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:56.322021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.322709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.323317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:56.747136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:56.761114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3e1c667-7af1-4337-b937-caa16384caca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.468229 Nov 03 04:12:56.770539 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2234/4342] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:56 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:56.783684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:56.797571 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1ecdfca-c104-4437-abc1-ae57851c1b8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.738684 Nov 03 04:12:56.799176 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2109/4343] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:56 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:56.800447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:56.801130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:56.807669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:56.808206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:56.818714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.819206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.819648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:56.820359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.829696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.830191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:56.831787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.832550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.847817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:56.848828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:56.849356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:56.850630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:57.186228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e811abbb-8145-46bb-ba76-0d28bedcba9f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.385764 Nov 03 04:12:57.187640 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2110/4344] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:12:56 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:12:57.199062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7be56f3-42ff-408a-bcae-9029b2c37c0f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:57.202120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7be56f3-42ff-408a-bcae-9029b2c37c0f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Failed to fetch instance by id 9223372036854775808 {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 03 04:12:57.202865 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f7be56f3-42ff-408a-bcae-9029b2c37c0f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7be56f3-42ff-408a-bcae-9029b2c37c0f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 9223372036854775808 could not be found. Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '9223372036854775808'} Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:12:57.206479 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:12:57.210562 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:12:57.210562 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:12:57.210562 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:12:57.210562 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Nov 03 04:12:57.210562 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:12:57.214087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7be56f3-42ff-408a-bcae-9029b2c37c0f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:12:57.215901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7be56f3-42ff-408a-bcae-9029b2c37c0f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.026990 Nov 03 04:12:57.219050 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2111/4345] 10.222.0.30 () {58 vars in 1188 bytes} [Thu Nov 3 04:12:57 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:12:57.226455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:57.228114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:57.241643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:57.242466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:57.243107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:57.244056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:57.244714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:57.245456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:57.579136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:57.596829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:57.600138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:57.603112 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1afd5576-fdc5-4c69-a909-755fcc4bd341 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2960 microversion: 2.42 time: 0.833665 Nov 03 04:12:57.606485 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2235/4346] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:12:56 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2960 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:12:57.628735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:57.629402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:57.644421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:57.644933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:57.645411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:57.646139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:57.654193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:57.654193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:57.930925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:57.945150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5d25a7e6-dfcd-47c4-b4f1-bb15401e0cf0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1674 microversion: 2.1 time: 0.721998 Nov 03 04:12:57.957624 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2112/4347] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:57 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1674 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:58.436148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:58.441666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1975329786", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "67e5b85f-4010-4f46-ba0a-653e66da87d8"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:12:58.450077 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7493ea58-0704-4cbf-80cb-f72884946435 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.840822 Nov 03 04:12:58.450077 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2236/4348] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:57 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:58.478274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:58.478912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:58.488168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:58.490521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:58.497223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:58.498275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:58.498921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:58.500123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:58.573647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] validate_networks() for [('67e5b85f-4010-4f46-ba0a-653e66da87d8', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:12:59.229208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:59.253058 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-604fdf3a-7f52-42c2-a5f9-509e46d68396 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.778598 Nov 03 04:12:59.273319 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2237/4349] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:58 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:12:59.284421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:59.285082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:59.309654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:59.310071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:59.310527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:59.311260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:59.316414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:59.318126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:59.833164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:59.850783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:59.852881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:12:59.854309 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90d3c1ef-3af7-4d72-8145-2469fb639e2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2939 microversion: 2.42 time: 0.587872 Nov 03 04:12:59.858393 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2238/4350] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:12:59 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2939 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:12:59.883639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:12:59.900935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:12:59.925353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:59.933847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:59.937238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:12:59.938273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:12:59.939461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:12:59.940526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:00.683475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:00.700661 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-62bc5ed8-dbfe-4baa-b3c5-cbd13bbfd3c9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1654 microversion: 2.1 time: 0.839997 Nov 03 04:13:00.702041 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2239/4351] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:12:59 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1654 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:00.708756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a18eb95d-3704-4b10-90c6-7e92765be1e8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:00.709509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a18eb95d-3704-4b10-90c6-7e92765be1e8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Failed to fetch instance by id -1 {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 03 04:13:00.717788 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a18eb95d-3704-4b10-90c6-7e92765be1e8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance -1 could not be found. Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a18eb95d-3704-4b10-90c6-7e92765be1e8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance -1 could not be found. Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '-1'} Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:00.719679 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:00.724598 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:00.724598 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:00.724598 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Nov 03 04:13:00.724598 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:00.726408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a18eb95d-3704-4b10-90c6-7e92765be1e8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance -1 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:00.738189 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a18eb95d-3704-4b10-90c6-7e92765be1e8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.034879 Nov 03 04:13:00.739013 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2240/4352] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Nov 3 04:13:00 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:13:00.743776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1a16d4c4-3265-4da0-9d46-9b7ffcaeb278 req-eb80fff0-eda1-476d-8ad9-bc6bb67dac98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-unplugged", "status": "completed", "tag": "d57f7b42-2265-4a50-9d27-23ee5674ab49"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:00.763453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a16d4c4-3265-4da0-9d46-9b7ffcaeb278 req-eb80fff0-eda1-476d-8ad9-bc6bb67dac98 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:00.764207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a16d4c4-3265-4da0-9d46-9b7ffcaeb278 req-eb80fff0-eda1-476d-8ad9-bc6bb67dac98 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:00.765820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a16d4c4-3265-4da0-9d46-9b7ffcaeb278 req-eb80fff0-eda1-476d-8ad9-bc6bb67dac98 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:00.791556 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1a16d4c4-3265-4da0-9d46-9b7ffcaeb278 req-eb80fff0-eda1-476d-8ad9-bc6bb67dac98 service nova] Creating event network-vif-unplugged:d57f7b42-2265-4a50-9d27-23ee5674ab49 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:00.806782 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1a16d4c4-3265-4da0-9d46-9b7ffcaeb278 req-eb80fff0-eda1-476d-8ad9-bc6bb67dac98 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066176 Nov 03 04:13:00.807995 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2241/4353] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:00.817952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:00.818840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:00.835026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:00.838546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:00.839222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:00.840500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:00.842576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:00.845617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:01.177005 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d32494c8-2ab7-4507-bd95-8468524bb32b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.367351 Nov 03 04:13:01.178894 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2242/4354] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:00 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:13:01.198907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:13:01.199468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:13:01.200692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:13:01.201714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:13:01.202875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:13:01.215338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:01.221116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:01.233225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:01.234044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:01.235064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:01.242858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:01.243650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:01.245495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:01.247498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:01.252749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:01.254212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:01.259111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:01.259111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:01.259111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:01.327687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:13:01.353628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for user 324a1dfe0c4843bd917eb6ecd6cc2c4c and project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:13:01.406313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:13:01.411400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:13:01.619796 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e83926d-8ce8-4a93-b30f-24b3ad847252 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.421461 Nov 03 04:13:01.622689 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2113/4355] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:13:01.643493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:01.650923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:01.669722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:01.673923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:01.674658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:01.675576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:01.676207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:01.681060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:02.226401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:02.240077 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a81dbe1-a897-471a-a099-c0af670dc180 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 1.060144 Nov 03 04:13:02.241318 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2243/4356] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:01 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:02.250110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7d25d64-48ee-498f-88d6-6818dedb8d85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'create', calling method: .version_select at 0x7ff7f91659d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-116340486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGUJyY6nJt8E18Yp12paKI1Y2mtyz81eIhDKF8htlXx3w4GjrG3+rmA1tucyk1fE/osCM8Y1Robm0lth9AeqehbWVjwrf2G1LoWM+DPbQQ7jbL9o3tfBbehn6de7lsI+A=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:02.276970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-c7d25d64-48ee-498f-88d6-6818dedb8d85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:13:02.285135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-c7d25d64-48ee-498f-88d6-6818dedb8d85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for user a3c6e4b088224f33aa607e2a27ed798b and project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:13:02.396947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:02.410312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:02.414104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:02.420177 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7d25d64-48ee-498f-88d6-6818dedb8d85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.175315 Nov 03 04:13:02.423629 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2244/4357] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:13:02 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:02.425477 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-21899da5-ad71-4c85-ac69-f310d8c49af2 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2918 microversion: 2.42 time: 0.801678 Nov 03 04:13:02.427036 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2114/4358] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:01 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2918 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:02.434663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:02.435628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:02.465101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e70166b9-c2a6-46c6-b5f7-21ac0b3a4b01 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:02.467242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:02.468705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e70166b9-c2a6-46c6-b5f7-21ac0b3a4b01 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:02.470901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:02.474473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:02.478627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:02.478627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:02.478627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:02.493284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:02.671542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e70166b9-c2a6-46c6-b5f7-21ac0b3a4b01 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:02.680290 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e70166b9-c2a6-46c6-b5f7-21ac0b3a4b01 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1208 microversion: 2.1 time: 0.242089 Nov 03 04:13:02.683151 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2115/4359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:02 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1208 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:02.711721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:02.719103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:02.746696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:02.747177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:02.747617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:02.748328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:02.754239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:02.755715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.097682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:03.110031 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-44d6c08f-0ce9-4d38-82b7-dc7ea49121ac tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.686693 Nov 03 04:13:03.128088 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2245/4360] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:02 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:03.168091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-609aadbf-a56b-4617-947a-cfc2cd57ec21 req-78085d8f-7b57-44e1-aa69-eeb73e4f2ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-unplugged", "status": "completed", "tag": "d8cd675f-fa80-4884-90b6-51a8b0db55fe"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:03.192313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-609aadbf-a56b-4617-947a-cfc2cd57ec21 req-78085d8f-7b57-44e1-aa69-eeb73e4f2ea0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.197944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-609aadbf-a56b-4617-947a-cfc2cd57ec21 req-78085d8f-7b57-44e1-aa69-eeb73e4f2ea0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.197944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-609aadbf-a56b-4617-947a-cfc2cd57ec21 req-78085d8f-7b57-44e1-aa69-eeb73e4f2ea0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.216618 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-609aadbf-a56b-4617-947a-cfc2cd57ec21 req-78085d8f-7b57-44e1-aa69-eeb73e4f2ea0 service nova] Creating event network-vif-unplugged:d8cd675f-fa80-4884-90b6-51a8b0db55fe for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:03.231899 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-609aadbf-a56b-4617-947a-cfc2cd57ec21 req-78085d8f-7b57-44e1-aa69-eeb73e4f2ea0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078392 Nov 03 04:13:03.234953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2246/4361] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:03.242435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5f887397-c9d9-42b2-a28c-1d02b7315193 req-1b51a825-588e-4211-8d95-aaed3842ecd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-deleted", "tag": "eedff35b-d301-494c-bd23-ff6295754bea"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:03.266587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5f887397-c9d9-42b2-a28c-1d02b7315193 req-1b51a825-588e-4211-8d95-aaed3842ecd7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.267416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5f887397-c9d9-42b2-a28c-1d02b7315193 req-1b51a825-588e-4211-8d95-aaed3842ecd7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.268012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5f887397-c9d9-42b2-a28c-1d02b7315193 req-1b51a825-588e-4211-8d95-aaed3842ecd7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.290868 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5f887397-c9d9-42b2-a28c-1d02b7315193 req-1b51a825-588e-4211-8d95-aaed3842ecd7 service nova] Creating event network-vif-deleted:eedff35b-d301-494c-bd23-ff6295754bea for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:03.307118 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5f887397-c9d9-42b2-a28c-1d02b7315193 req-1b51a825-588e-4211-8d95-aaed3842ecd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070550 Nov 03 04:13:03.308292 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2247/4362] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:03.326387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:03.327902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:03.355193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.355978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.356738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.358509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.359193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.360115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.395986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:03.417763 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee8ec5be-c574-40a3-8f86-18d0571a3289 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.731621 Nov 03 04:13:03.420697 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2116/4363] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:02 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:03.451155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cfa8ca1d-f608-4795-89c5-1279c6d7c281 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:03.458656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cfa8ca1d-f608-4795-89c5-1279c6d7c281 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: e2799419-f0cd-4faa-a53f-a53c1e9f6c77] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:03.465302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-cfa8ca1d-f608-4795-89c5-1279c6d7c281 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance e2799419-f0cd-4faa-a53f-a53c1e9f6c77 could not be found. Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cfa8ca1d-f608-4795-89c5-1279c6d7c281 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/e2799419-f0cd-4faa-a53f-a53c1e9f6c77/action HTTP/1.1 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 19 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: {"forceDelete": {}} Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e2799419-f0cd-4faa-a53f-a53c1e9f6c77 could not be found. Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e2799419-f0cd-4faa-a53f-a53c1e9f6c77', 'body': {'forceDelete': {}}} Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2799419-f0cd-4faa-a53f-a53c1e9f6c77 could not be found. Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2799419-f0cd-4faa-a53f-a53c1e9f6c77 could not be found. Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:03.477125 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:03.482150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:03.482150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:03.482150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2799419-f0cd-4faa-a53f-a53c1e9f6c77 could not be found. Nov 03 04:13:03.482150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:03.483580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cfa8ca1d-f608-4795-89c5-1279c6d7c281 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance e2799419-f0cd-4faa-a53f-a53c1e9f6c77 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:03.485259 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cfa8ca1d-f608-4795-89c5-1279c6d7c281 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/e2799419-f0cd-4faa-a53f-a53c1e9f6c77/action" status: 404 len: 111 microversion: 2.1 time: 0.039591 Nov 03 04:13:03.491046 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2117/4364] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:03 2022] POST /compute/v2.1/servers/e2799419-f0cd-4faa-a53f-a53c1e9f6c77/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:03.503964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:03.506452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:03.534451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.539628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.540593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.543226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.543888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.545545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.659464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:03.677344 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13b6edbb-3c30-4176-9cae-a2c604a8bb0a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.367393 Nov 03 04:13:03.680185 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2248/4365] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:03 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:03.686289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:03.691312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:03.708922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.710813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.713774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:03.714693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:03.715131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:03.715567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.306070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:04.321547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:04.323807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:04.343737 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-28c3fa87-5ad8-4442-8b54-6e65a2b76276 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2757 microversion: 2.42 time: 0.850683 Nov 03 04:13:04.346204 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2118/4366] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:03 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2757 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:04.347389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:04.357207 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fd1f5d86-373c-45e0-9120-93104bd8b225 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.677734 Nov 03 04:13:04.358901 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2249/4367] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:03 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:04.367106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:04.375903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:04.386425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:04.396614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:04.428988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.429993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.432832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.433358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.434120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.434745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.441644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.443908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.446996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.447872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.448602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.449634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.855910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:04.870102 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2b9c7f78-aae1-4ba5-aa94-e4e785d8dc3d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1260 microversion: 2.1 time: 0.509278 Nov 03 04:13:04.870730 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2250/4368] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:04 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1260 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:04.900003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:04.903661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:04.939741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:04.943831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.944579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.945238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.950263 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c7d4214-faf7-4c9e-b85a-5cada96e398e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.601199 Nov 03 04:13:04.953310 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2119/4369] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:04 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:04.957316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.958127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.958740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.983188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:04.985034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:04.993336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.995665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.996309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:04.997284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:04.998508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:04.999219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:05.501973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:05.519999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-49ea958d-969e-44dd-8d6b-b143395938aa tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.638247 Nov 03 04:13:05.521465 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2251/4370] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:04 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:05.538707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7b59164d-1af0-43d7-960e-76cfa32c0f60 req-f428abf5-7947-4243-be66-33e47d33befd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-unplugged", "status": "completed", "tag": "e2124eb9-5b67-4fcf-b22c-8fd60bdb7205"}, {"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-unplugged", "status": "completed", "tag": "62e1cfcf-1c83-430f-9fd5-f159a52d8e46"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:05.555395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b59164d-1af0-43d7-960e-76cfa32c0f60 req-f428abf5-7947-4243-be66-33e47d33befd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:05.556082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b59164d-1af0-43d7-960e-76cfa32c0f60 req-f428abf5-7947-4243-be66-33e47d33befd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:05.556622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7b59164d-1af0-43d7-960e-76cfa32c0f60 req-f428abf5-7947-4243-be66-33e47d33befd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:05.572078 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7b59164d-1af0-43d7-960e-76cfa32c0f60 req-f428abf5-7947-4243-be66-33e47d33befd service nova] Creating event network-vif-unplugged:e2124eb9-5b67-4fcf-b22c-8fd60bdb7205 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:05.572702 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7b59164d-1af0-43d7-960e-76cfa32c0f60 req-f428abf5-7947-4243-be66-33e47d33befd service nova] Creating event network-vif-unplugged:62e1cfcf-1c83-430f-9fd5-f159a52d8e46 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:05.579696 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7b59164d-1af0-43d7-960e-76cfa32c0f60 req-f428abf5-7947-4243-be66-33e47d33befd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.056798 Nov 03 04:13:05.580406 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2252/4371] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:05.587076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:05.588088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:05.602194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:05.603064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:05.603975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:05.604976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:05.605650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:05.606262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:06.023501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:06.034466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:06.045046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:06.049531 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b696645-4bf4-48a7-94c4-1d5c40373425 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2663 microversion: 2.42 time: 0.464504 Nov 03 04:13:06.053949 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2253/4372] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:05 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2663 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:06.055848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9b1d4387-3145-45d6-8ad6-6c7af7a38d70 req-d8b149bf-e57c-43fe-a6a6-80d120909ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-deleted", "tag": "d57f7b42-2265-4a50-9d27-23ee5674ab49"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:06.056321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:06.083832 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61e271b6-4660-45ff-adec-0c411b273703 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 1.105129 Nov 03 04:13:06.084426 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2120/4373] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:04 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:06.098174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5db6bc9-ab47-4ec0-93e4-16a11566fa81 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:06.099427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9b1d4387-3145-45d6-8ad6-6c7af7a38d70 req-d8b149bf-e57c-43fe-a6a6-80d120909ef4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:06.099971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9b1d4387-3145-45d6-8ad6-6c7af7a38d70 req-d8b149bf-e57c-43fe-a6a6-80d120909ef4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:06.100414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9b1d4387-3145-45d6-8ad6-6c7af7a38d70 req-d8b149bf-e57c-43fe-a6a6-80d120909ef4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:06.121624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:06.127831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5db6bc9-ab47-4ec0-93e4-16a11566fa81 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: e177b384-c72a-4faa-bcd3-30d2f2b2113f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:06.143784 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-b5db6bc9-ab47-4ec0-93e4-16a11566fa81 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance e177b384-c72a-4faa-bcd3-30d2f2b2113f could not be found. Nov 03 04:13:06.145637 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9b1d4387-3145-45d6-8ad6-6c7af7a38d70 req-d8b149bf-e57c-43fe-a6a6-80d120909ef4 service nova] Creating event network-vif-deleted:d57f7b42-2265-4a50-9d27-23ee5674ab49 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5db6bc9-ab47-4ec0-93e4-16a11566fa81 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/e177b384-c72a-4faa-bcd3-30d2f2b2113f/action HTTP/1.1 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 39 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: {"os-getConsoleOutput": {"length": 10}} Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e177b384-c72a-4faa-bcd3-30d2f2b2113f could not be found. Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e177b384-c72a-4faa-bcd3-30d2f2b2113f', 'body': {'os-getConsoleOutput': {'length': 10}}} Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e177b384-c72a-4faa-bcd3-30d2f2b2113f could not be found. Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e177b384-c72a-4faa-bcd3-30d2f2b2113f could not be found. Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:06.156503 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e177b384-c72a-4faa-bcd3-30d2f2b2113f could not be found. Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5db6bc9-ab47-4ec0-93e4-16a11566fa81 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance e177b384-c72a-4faa-bcd3-30d2f2b2113f could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:06.160608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5db6bc9-ab47-4ec0-93e4-16a11566fa81 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/e177b384-c72a-4faa-bcd3-30d2f2b2113f/action" status: 404 len: 111 microversion: 2.1 time: 0.073363 Nov 03 04:13:06.161167 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9b1d4387-3145-45d6-8ad6-6c7af7a38d70 req-d8b149bf-e57c-43fe-a6a6-80d120909ef4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106716 Nov 03 04:13:06.161261 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2121/4374] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:06 2022] POST /compute/v2.1/servers/e177b384-c72a-4faa-bcd3-30d2f2b2113f/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:06.161350 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2254/4375] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:06.171888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:06.172002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:06.172002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:06.172342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:06.185309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:06.187659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:06.188316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:06.190481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:06.192170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:06.192885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:06.193793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:06.195775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:06.197914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:06.201178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:06.203878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:06.204680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:06.472652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:06.500049 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64724041-510d-459e-803c-17c7b986b63e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1266 microversion: 2.1 time: 0.335987 Nov 03 04:13:06.513795 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2122/4376] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:06 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:06.522493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:06.523393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:06.531240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:06.532546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:06.533213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:06.534110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:06.536207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:06.536845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:07.334866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:07.348371 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-456161d7-ad1f-4c1d-a15c-05be48f0582e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 1.186777 Nov 03 04:13:07.369282 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2255/4377] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:06 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:07.388535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:07.389200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:07.402257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:07.402257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:07.402257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:07.407787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:07.409626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:07.410412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:07.468091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:07.482561 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6cb89951-183d-40b9-9e19-0015c121e978 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.968715 Nov 03 04:13:07.482561 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2123/4378] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:06 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:07.485879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:07.486758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:07.493591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:07.494370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:07.494976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:07.495999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:07.496769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:07.497833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.219688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:08.228998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:08.240275 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65514a12-d001-4884-b604-ce5eba409fc9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.759029 Nov 03 04:13:08.240725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:08.248962 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2124/4379] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:07 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:08.249113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:08.249113 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-94f0e500-3799-4cd3-aadd-99a5fe35ba2d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 2502 microversion: 2.42 time: 0.893475 Nov 03 04:13:08.252095 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2256/4380] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:07 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 2502 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:08.254685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:08.258608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:08.259050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:08.277334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:08.277452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:08.277452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:08.277452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.278067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:08.280728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:08.282286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.292546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:08.294846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:08.300115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.300115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:08.300115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:08.300115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.395014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:08.411830 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0607e9cf-f741-4a69-ba71-ea0d9c732b10 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1266 microversion: 2.1 time: 0.157048 Nov 03 04:13:08.412794 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2257/4381] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:08 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:08.422150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1e4333bc-d55b-49c5-b2b6-6142fce9176c req-dd438f79-0fb0-416f-9ecc-fd3b573e55c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-deleted", "tag": "62e1cfcf-1c83-430f-9fd5-f159a52d8e46"}, {"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-deleted", "tag": "e2124eb9-5b67-4fcf-b22c-8fd60bdb7205"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:08.463088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1e4333bc-d55b-49c5-b2b6-6142fce9176c req-dd438f79-0fb0-416f-9ecc-fd3b573e55c9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:08.463605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1e4333bc-d55b-49c5-b2b6-6142fce9176c req-dd438f79-0fb0-416f-9ecc-fd3b573e55c9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:08.464393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1e4333bc-d55b-49c5-b2b6-6142fce9176c req-dd438f79-0fb0-416f-9ecc-fd3b573e55c9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.482177 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1e4333bc-d55b-49c5-b2b6-6142fce9176c req-dd438f79-0fb0-416f-9ecc-fd3b573e55c9 service nova] Creating event network-vif-deleted:62e1cfcf-1c83-430f-9fd5-f159a52d8e46 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:08.482961 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1e4333bc-d55b-49c5-b2b6-6142fce9176c req-dd438f79-0fb0-416f-9ecc-fd3b573e55c9 service nova] Creating event network-vif-deleted:e2124eb9-5b67-4fcf-b22c-8fd60bdb7205 for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:08.495158 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1e4333bc-d55b-49c5-b2b6-6142fce9176c req-dd438f79-0fb0-416f-9ecc-fd3b573e55c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078808 Nov 03 04:13:08.496371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2258/4382] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:08.610476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:08.622064 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52a8a6fa-d003-43a0-9f39-ea083f71feee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.375969 Nov 03 04:13:08.622669 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2125/4383] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:08 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:08.653797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d2312fe-1586-4dfe-8d4f-97b38117fbef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:08.653797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d2312fe-1586-4dfe-8d4f-97b38117fbef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: ceca07be-ea60-4047-a678-b00722ffc363] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:08.659986 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3d2312fe-1586-4dfe-8d4f-97b38117fbef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance ceca07be-ea60-4047-a678-b00722ffc363 could not be found. Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d2312fe-1586-4dfe-8d4f-97b38117fbef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ceca07be-ea60-4047-a678-b00722ffc363 HTTP/1.1 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ceca07be-ea60-4047-a678-b00722ffc363 could not be found. Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ceca07be-ea60-4047-a678-b00722ffc363'} Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceca07be-ea60-4047-a678-b00722ffc363 could not be found. Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceca07be-ea60-4047-a678-b00722ffc363 could not be found. Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:08.672135 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceca07be-ea60-4047-a678-b00722ffc363 could not be found. Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d2312fe-1586-4dfe-8d4f-97b38117fbef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance ceca07be-ea60-4047-a678-b00722ffc363 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d2312fe-1586-4dfe-8d4f-97b38117fbef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/ceca07be-ea60-4047-a678-b00722ffc363" status: 404 len: 111 microversion: 2.1 time: 0.030137 Nov 03 04:13:08.677349 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2259/4384] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:08 2022] GET /compute/v2.1/servers/ceca07be-ea60-4047-a678-b00722ffc363 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:08.688193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:08.688193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:08.691465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:08.692183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:08.692959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.693855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:08.694965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:08.695889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:08.701607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:09.008910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:09.018720 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8dd7ba56-f525-4231-878b-23cf6c3404a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.339725 Nov 03 04:13:09.026645 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2126/4385] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:08 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:09.045611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:09.045718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:09.054268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:09.055094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:09.055756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:09.056674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:09.057389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:09.058023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:09.231574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-944535761", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "e67356e8-3cab-4ccf-ac60-1788afa4c2a2"}], "key_name": "tempest-TestNetworkBasicOps-116340486", "security_groups": [{"name": "tempest-secgroup-smoke-519886538"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:09.485762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:09.499210 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1d57e68-ee32-4f65-87ba-520d16019c45 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.459243 Nov 03 04:13:09.500088 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2260/4386] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:09 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:09.518506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:09.519301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:09.538510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:09.545198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:09.546042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:09.547035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:09.547722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:09.548385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:09.732359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] validate_networks() for [('e67356e8-3cab-4ccf-ac60-1788afa4c2a2', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:13:09.827370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:09.837630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:09.839226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:09.840700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-841bf1aa-7222-4cc8-82ea-a826bffac076 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.339218 Nov 03 04:13:09.841793 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2261/4387] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:09 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:09.847194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:09.848092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:09.854376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:09.855120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:09.855774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:09.856682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:09.857371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:09.858028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:10.120223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:10.131247 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ade2c29-f968-40f8-9bf0-13e9952736d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.287460 Nov 03 04:13:10.132344 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2262/4388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:09 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:10.153293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee671a32-aea1-403e-a331-fa829fc42db5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-888317364", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee671a32-aea1-403e-a331-fa829fc42db5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 237 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-888317364", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-888317364', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.177810 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee671a32-aea1-403e-a331-fa829fc42db5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee671a32-aea1-403e-a331-fa829fc42db5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.043998 Nov 03 04:13:10.181950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2263/4389] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:13:10 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:13:10.189387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:10.189931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:10.204621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:10.209294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:10.210252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:10.211283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:10.211985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:10.212686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:10.604027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:10.615347 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a73f64f9-2095-419a-8f57-376f563efc35 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.431368 Nov 03 04:13:10.619345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2264/4390] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:10 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:10.630626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e56054e1-8a91-4d94-81e7-c1c2c2a88af2 req-c4f1de1d-7017-4136-8fb4-f3cd4322bdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb913d3-fdda-46d0-a9a8-439a2ac2f55b", "name": "network-vif-deleted", "tag": "d8cd675f-fa80-4884-90b6-51a8b0db55fe"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:10.654649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e56054e1-8a91-4d94-81e7-c1c2c2a88af2 req-c4f1de1d-7017-4136-8fb4-f3cd4322bdd8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:10.655500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e56054e1-8a91-4d94-81e7-c1c2c2a88af2 req-c4f1de1d-7017-4136-8fb4-f3cd4322bdd8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:10.656616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e56054e1-8a91-4d94-81e7-c1c2c2a88af2 req-c4f1de1d-7017-4136-8fb4-f3cd4322bdd8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:10.682290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e56054e1-8a91-4d94-81e7-c1c2c2a88af2 req-c4f1de1d-7017-4136-8fb4-f3cd4322bdd8 service nova] Creating event network-vif-deleted:d8cd675f-fa80-4884-90b6-51a8b0db55fe for instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b on n-h2-854653-7 Nov 03 04:13:10.689121 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e56054e1-8a91-4d94-81e7-c1c2c2a88af2 req-c4f1de1d-7017-4136-8fb4-f3cd4322bdd8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068233 Nov 03 04:13:10.690640 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2265/4391] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:10.698719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:10.705816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:10.715012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:10.718216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:10.722211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:10.723932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:10.727346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:10.728061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.119051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:13:11.119546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:13:11.120007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:13:11.120655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:13:11.121336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:13:11.150631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.150631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.150631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.150631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.150631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.150631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.151376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:11.160746 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bfd1bd8a-8991-4265-9a3a-2acc9f4e483a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.468425 Nov 03 04:13:11.161580 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2266/4392] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:10 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:11.173886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:11.174887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:11.180787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:11.184278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:13:11.190904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.190904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.190904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.192082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.192082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.195561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.216589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for user a3c6e4b088224f33aa607e2a27ed798b and project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:13:11.250976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:13:11.253324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:13:11.305077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:11.330658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:11.354703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:11.359207 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1fddc4e-3ee9-4a40-8669-991c6b8c8f9c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.191309 Nov 03 04:13:11.363511 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2267/4393] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:11 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:11.381146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:11.381146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:11.400240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.401539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.402553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.403749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.404404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.405715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.418155 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41eebc79-9db0-4bee-a385-5c1ed68f73e8 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.190751 Nov 03 04:13:11.424951 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2127/4394] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:13:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:13:11.438920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-daf65bc7-bf32-449c-b3eb-7a3cdd72d27f req-dcccc390-d000-440f-b33b-bdcb669f8d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f664e16-567c-49fd-a90f-dc44a6bbb6f0", "tag": "80ed2213-9abc-4dd8-b25d-d29a030cf123"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:11.476276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-daf65bc7-bf32-449c-b3eb-7a3cdd72d27f req-dcccc390-d000-440f-b33b-bdcb669f8d21 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.478245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-daf65bc7-bf32-449c-b3eb-7a3cdd72d27f req-dcccc390-d000-440f-b33b-bdcb669f8d21 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.478909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-daf65bc7-bf32-449c-b3eb-7a3cdd72d27f req-dcccc390-d000-440f-b33b-bdcb669f8d21 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.512730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-daf65bc7-bf32-449c-b3eb-7a3cdd72d27f req-dcccc390-d000-440f-b33b-bdcb669f8d21 service nova] Creating event network-changed:80ed2213-9abc-4dd8-b25d-d29a030cf123 for instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 on n-h1-854653-7 Nov 03 04:13:11.520883 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-daf65bc7-bf32-449c-b3eb-7a3cdd72d27f req-dcccc390-d000-440f-b33b-bdcb669f8d21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093646 Nov 03 04:13:11.523350 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2128/4395] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:11.536682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-afbdc4d9-116b-4d90-958f-bd49c6834117 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-130678272", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-afbdc4d9-116b-4d90-958f-bd49c6834117 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 234 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-130678272", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-130678272', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'notvalid' Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.560621 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Nov 03 04:13:11.565783 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:11.571377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-afbdc4d9-116b-4d90-958f-bd49c6834117 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:11.572942 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-afbdc4d9-116b-4d90-958f-bd49c6834117 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.046890 Nov 03 04:13:11.574184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2129/4396] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:13:11 2022] POST /compute/v2.1/servers => generated 133 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:13:11.586748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e435396-237c-4eaf-aaf2-c5174b160d59 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:11.587814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7e435396-237c-4eaf-aaf2-c5174b160d59 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:11.836912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7e435396-237c-4eaf-aaf2-c5174b160d59 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:11.847936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7e435396-237c-4eaf-aaf2-c5174b160d59 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1247 microversion: 2.1 time: 0.272485 Nov 03 04:13:11.861861 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2130/4397] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:11 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1247 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:11.882382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:11.882382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:11.893339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.894391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.895578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:11.898259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:11.898833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:11.899987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:12.215102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:12.224897 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47ded4c1-bce7-4865-8726-12e63dabc459 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.361452 Nov 03 04:13:12.230860 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2131/4398] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:11 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:12.253690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:12.262727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:12.267619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:12.285563 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-52781bfa-5094-4af9-9283-460518870c50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.916079 Nov 03 04:13:12.286648 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2268/4399] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:11 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:12.287866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:12.290672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:12.291394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:12.292355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:12.293366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:12.294041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:12.388583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:12.390201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:12.402591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:12.413516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:12.413516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:12.413516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:12.413516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:12.413516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:12.413516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:12.729894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:12.754038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:12.756610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:12.758330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d04d7c40-7379-4aaf-8ba1-66e804bc51af tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.373676 Nov 03 04:13:12.759520 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2269/4400] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:12 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:12.809065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:12.831198 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcf82ea7-8c0c-4ea1-9845-bb9466f0e9be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.571491 Nov 03 04:13:12.833830 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2132/4401] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:12 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:12.857435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc9c74a6-1dc9-401e-b337-2c654190eec7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:12.858935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc9c74a6-1dc9-401e-b337-2c654190eec7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: c543ed31-dbf0-4944-b89f-5868063e5488] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:12.868143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-cc9c74a6-1dc9-401e-b337-2c654190eec7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance c543ed31-dbf0-4944-b89f-5868063e5488 could not be found. Nov 03 04:13:12.878489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c87880b5-b04a-42bf-a1fc-2b700f56439f tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:12.879546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c87880b5-b04a-42bf-a1fc-2b700f56439f tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc9c74a6-1dc9-401e-b337-2c654190eec7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/c543ed31-dbf0-4944-b89f-5868063e5488/action HTTP/1.1 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 13 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: {"pause": {}} Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance c543ed31-dbf0-4944-b89f-5868063e5488 could not be found. Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'c543ed31-dbf0-4944-b89f-5868063e5488', 'body': {'pause': {}}} Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c543ed31-dbf0-4944-b89f-5868063e5488 could not be found. Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c543ed31-dbf0-4944-b89f-5868063e5488 could not be found. Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:12.879675 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:12.885081 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:12.885081 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:12.885081 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c543ed31-dbf0-4944-b89f-5868063e5488 could not be found. Nov 03 04:13:12.885081 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:12.885081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc9c74a6-1dc9-401e-b337-2c654190eec7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance c543ed31-dbf0-4944-b89f-5868063e5488 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:12.885081 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc9c74a6-1dc9-401e-b337-2c654190eec7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/c543ed31-dbf0-4944-b89f-5868063e5488/action" status: 404 len: 111 microversion: 2.1 time: 0.028539 Nov 03 04:13:12.885081 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2270/4402] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:12 2022] POST /compute/v2.1/servers/c543ed31-dbf0-4944-b89f-5868063e5488/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:12.891257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:12.893707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:12.955293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:12.961073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:12.961073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:12.961073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:12.961073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:12.961631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.343942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c87880b5-b04a-42bf-a1fc-2b700f56439f tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:13.358651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c87880b5-b04a-42bf-a1fc-2b700f56439f tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1247 microversion: 2.1 time: 0.480286 Nov 03 04:13:13.359300 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2133/4403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:12 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1247 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:13.367385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:13.368030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:13.388661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.389733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.390214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.390919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.396401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.397189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.504506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:13.529299 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fcfc1651-0f31-4a38-8d2c-7efc627e637f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.640985 Nov 03 04:13:13.531249 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2271/4404] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:12 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:13.560213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:13.561754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:13.585091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.585881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.587576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.590404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.591146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.592540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.935722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:13.944672 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ec18d94-2dcc-44c1-b46f-631b1a775561 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.390026 Nov 03 04:13:13.951392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2272/4405] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:13 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:13.955107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:13.964915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:13.971795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4cba77d7-e45a-40e0-bf80-5eed25761ebf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.608081 Nov 03 04:13:13.972381 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2134/4406] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:13 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:13.973798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:13.976984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:13.977792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:13.984478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.985491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.990917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.996105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.996105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.996503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.996595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.996595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.996781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:13.996863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:13.996942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:13.996942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:14.120229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:14.137981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:14.140244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:14.141502 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18194c4f-de66-4482-9e1d-5b45fcc56e89 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.188872 Nov 03 04:13:14.149414 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2273/4407] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:13 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:14.327304 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-521c751b-cdbf-407f-b69d-33cff7c3f9ee tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 202 len: 0 microversion: 2.1 time: 0.350358 Nov 03 04:13:14.327304 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2135/4408] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:13 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:13:14.333682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:14.334930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:14.344675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:14.345779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:14.346360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:14.347100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:14.347559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:14.350909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:14.383244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:14.388467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:14.393291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:14.405423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:14.405987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:14.406757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:14.407428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:14.408031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:14.568826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:14.587118 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5fc07f1-1c05-45e4-9e6b-0bccea07f6a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1299 microversion: 2.1 time: 0.208065 Nov 03 04:13:14.602207 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2136/4409] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:14 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:14.654127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:14.664343 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d91e3100-ba84-450b-aa8b-8ff94dc5c291 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1511 microversion: 2.1 time: 0.334887 Nov 03 04:13:14.665991 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2274/4410] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:14 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:14.999985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:15.000968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:15.010773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.011421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.011871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.012607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.013113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.013884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.176546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:15.177426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:15.185894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.186693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.187470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.188360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.189328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.190207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.282538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:15.293159 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b85814e-20d3-47e8-a260-c76306c43aba tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.299018 Nov 03 04:13:15.296259 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2137/4411] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:14 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:15.411544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:15.413820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:15.425943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:15.430023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:15.436914 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d97d768c-8f02-4022-9d6a-d4afca581da1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.261999 Nov 03 04:13:15.437798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2275/4412] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:15 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:13:15.615787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:15.616416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:15.662490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.667975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.668451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.669231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.669706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.670666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.694481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:15.694481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:15.708587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.709118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.709565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.710286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:15.710744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:15.711175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:15.818561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:15.834158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d48b616d-bf18-4bdc-80ba-5d18b320b5c0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1305 microversion: 2.1 time: 0.222345 Nov 03 04:13:15.845647 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2138/4413] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:15 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1305 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:16.078786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:16.094579 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f14158ba-5c79-482d-8c17-5d0b7e4c5859 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1511 microversion: 2.1 time: 0.408752 Nov 03 04:13:16.095994 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2276/4414] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:15 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:16.318006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:16.318755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:16.337742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:16.338510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:16.339149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:16.339883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:16.340353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:16.340785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:16.469608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:16.470502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:16.486953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:16.487748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:16.488370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:16.489414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:16.490041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:16.490647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:16.732312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:16.745573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:16.749150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:16.751733 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-117d69a9-5624-4a4a-b188-a75c911f9180 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.286673 Nov 03 04:13:16.753498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2277/4415] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:16 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:13:16.849330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:16.865770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:16.867388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:16.882932 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1e1fd3a-6261-4852-ac73-e3f46878fe53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.568806 Nov 03 04:13:16.886938 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2139/4416] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:16 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:16.891151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:16.920624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:16.921210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:16.922935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:16.924036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:16.925189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.122383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:17.124126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:17.131875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.132772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.133446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.134928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.135572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.136196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.415006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:17.428627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-39166dfc-259c-4762-839a-2d9890a53347 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1372 microversion: 2.1 time: 0.572667 Nov 03 04:13:17.443625 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2278/4417] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:16 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1372 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:17.664846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:17.675302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b9aa132-75ca-48e7-af7f-87651b6a4f62 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1491 microversion: 2.1 time: 0.557468 Nov 03 04:13:17.676001 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2140/4418] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:17 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1491 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:17.726638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:17.727297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:17.736026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.737392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.738263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.739400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.740079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.741674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.772977 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Cannot 'pause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state paused Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action HTTP/1.1 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 13 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: {"pause": {}} Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: exception: Cannot 'pause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state paused Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'pause': {}}} Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 in vm_state paused. Cannot pause while the instance is in this state. Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state paused Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:17.775699 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state paused Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 409 to user: Cannot 'pause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state paused {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9be68cc5-3a4e-4c0c-8782-4005ec3ecd58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 409 len: 143 microversion: 2.1 time: 0.073007 Nov 03 04:13:17.786908 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2279/4419] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:17 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 143 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:13:17.787535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:17.787535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:17.795733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:17.797678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.798217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.798677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.799429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:17.799616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.800093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.800532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.816439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.817224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.819064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:17.819889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:17.821877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:17.822603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:18.025059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:18.056461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:18.060686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:18.065904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b473f7ea-18ce-4d79-8768-d6da5e5dbc5b tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.286972 Nov 03 04:13:18.081040 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2141/4420] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:17 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:18.091529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:18.091529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:18.115013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:18.117573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:18.117573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:18.117573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:18.117573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:18.117573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:18.122184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e017b4bc-4dd0-4c74-894a-0490c6d8f9b3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 202 len: 0 microversion: 2.1 time: 0.333137 Nov 03 04:13:18.123821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2280/4421] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:17 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:13:18.134902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:18.141625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:18.153692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:18.156806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:18.158718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:18.159791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:18.160147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:18.162745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:18.623064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:18.642329 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82094faf-2950-4d12-aa06-d8ad2c67b20e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.570661 Nov 03 04:13:18.645191 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2142/4422] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:18 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:18.679622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-129a2df6-bbef-4049-985c-ae5ab6f1febb req-479398d2-a839-4c3a-ac6e-47242c8f2505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4749567-23cb-4bdd-be2c-7adb77fed29a", "tag": "e3300983-7b1f-455c-ba55-56d9a03f3c66"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:18.707635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-129a2df6-bbef-4049-985c-ae5ab6f1febb req-479398d2-a839-4c3a-ac6e-47242c8f2505 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:18.708132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-129a2df6-bbef-4049-985c-ae5ab6f1febb req-479398d2-a839-4c3a-ac6e-47242c8f2505 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:18.708578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-129a2df6-bbef-4049-985c-ae5ab6f1febb req-479398d2-a839-4c3a-ac6e-47242c8f2505 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:18.749077 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-129a2df6-bbef-4049-985c-ae5ab6f1febb req-479398d2-a839-4c3a-ac6e-47242c8f2505 service nova] Creating event network-changed:e3300983-7b1f-455c-ba55-56d9a03f3c66 for instance c4749567-23cb-4bdd-be2c-7adb77fed29a on n-h2-854653-7 Nov 03 04:13:18.749249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:18.754636 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-667356d1-4341-4162-b08d-6822661f2245 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1498 microversion: 2.1 time: 0.626215 Nov 03 04:13:18.756486 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-129a2df6-bbef-4049-985c-ae5ab6f1febb req-479398d2-a839-4c3a-ac6e-47242c8f2505 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090892 Nov 03 04:13:18.758473 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2143/4423] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:18.763302 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2281/4424] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:18 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1498 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:18.770062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:18.774835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:18.782132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:18.782965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:18.783635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:18.784731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:18.785702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:18.786402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:19.101319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:19.101910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:19.117799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:19.117799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:19.117799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:19.120075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:19.120804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:19.133326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:19.324835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:19.335025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:19.336478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:19.337688 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b789f6af-0f9e-425b-b336-0cc9b5abb657 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.242009 Nov 03 04:13:19.347860 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2282/4425] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:19 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:19.400059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:19.412113 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d01005b1-aa18-474f-8dd1-f762cd7d5657 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1372 microversion: 2.1 time: 0.652107 Nov 03 04:13:19.429125 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2144/4426] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:18 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1372 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:19.668185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:19.668812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:19.675545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:19.676037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:19.676482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:19.677492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:19.677969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:19.678574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:19.778319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:19.779109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:19.788934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:19.789652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:19.793915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:19.797851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:19.797851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:19.797851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.052660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:20.068900 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dbb23b21-eb5b-43c6-8220-ef8f8f73093f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.404727 Nov 03 04:13:20.088559 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2283/4427] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:19 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:20.167819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:20.195037 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae9cf857-fee8-4dde-8183-0b7d6ae48b83 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.417324 Nov 03 04:13:20.201277 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2145/4428] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:19 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:20.226979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:20.227780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:20.242901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.243417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.243866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.246685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.252397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.253073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.371873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:20.372498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:20.384637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.385162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.389978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.390815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.391301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.406238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.583707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:20.587963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:20.595914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:20.598240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:20.599751 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e879cca8-9ea2-492d-83eb-4a6d2ad7932e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.234018 Nov 03 04:13:20.625377 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2146/4429] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:20 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:20.632037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:20.639091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:20.639637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:20.651037 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bf70330-9855-46b3-ac4a-5c5da8968bdf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.427835 Nov 03 04:13:20.651920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.652080 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2284/4430] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:20 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:20.652836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.653495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.655889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.656697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.657975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.678887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:20.681199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:20.698007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.704876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.705660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.706442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.706940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.711544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.769999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c/action HTTP/1.1 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 28 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: {"reboot": {"type": "SOFT"}} Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f5dce2a8-211e-4cad-a50f-82480431c49c', 'body': {'reboot': {'type': 'SOFT'}}} Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:20.777678 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dfa61fae-2d88-4c95-827f-fece94f552d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c/action" status: 404 len: 111 microversion: 2.1 time: 0.104793 Nov 03 04:13:20.781883 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2285/4431] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:20 2022] POST /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c/action => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:20.788761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:20.789416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:20.806169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.806868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.807320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:20.808048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:20.808521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:20.808962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.098005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:21.109158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d0a2816-6053-4d72-9dee-ee19a266c161 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1372 microversion: 2.1 time: 0.482218 Nov 03 04:13:21.114994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2147/4432] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:20 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1372 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:21.124952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:21.125751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:21.140244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.140948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.145330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.146247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.146839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.147399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.197262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:21.300618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:21.312378 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8a09b565-76b0-4ea8-949c-358bb717da0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.527448 Nov 03 04:13:21.331508 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2286/4433] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:20 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:21.343136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b14b8023-272a-4154-a04e-41ee1537f32d req-a9c04c1d-9e05-459e-83fc-84ebc7d1120e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f664e16-567c-49fd-a90f-dc44a6bbb6f0", "name": "network-vif-plugged", "status": "completed", "tag": "80ed2213-9abc-4dd8-b25d-d29a030cf123"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:21.366926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:21.374707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b14b8023-272a-4154-a04e-41ee1537f32d req-a9c04c1d-9e05-459e-83fc-84ebc7d1120e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.375192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b14b8023-272a-4154-a04e-41ee1537f32d req-a9c04c1d-9e05-459e-83fc-84ebc7d1120e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.375729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b14b8023-272a-4154-a04e-41ee1537f32d req-a9c04c1d-9e05-459e-83fc-84ebc7d1120e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.377704 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80230655-664b-4b44-b476-b521558a107d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.261305 Nov 03 04:13:21.378539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2148/4434] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:21 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:21.386121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:21.387736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:21.395426 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b14b8023-272a-4154-a04e-41ee1537f32d req-a9c04c1d-9e05-459e-83fc-84ebc7d1120e service nova] Creating event network-vif-plugged:80ed2213-9abc-4dd8-b25d-d29a030cf123 for instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 on n-h1-854653-7 Nov 03 04:13:21.396631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.397605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.398218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.400091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.400743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.401859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.408079 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b14b8023-272a-4154-a04e-41ee1537f32d req-a9c04c1d-9e05-459e-83fc-84ebc7d1120e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075046 Nov 03 04:13:21.408687 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2287/4435] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:21.636422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:21.636422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:21.645970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.646355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.647029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.648483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.649285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.649918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.833586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:21.838038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:21.848645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:21.849824 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af8d3cdf-55d8-4310-9d8b-4bd9e59c8d28 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.470006 Nov 03 04:13:21.850943 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2149/4436] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:21 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:21.851082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:21.852799 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85aa2cb4-b8f1-438a-bcdf-114467b196b1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.224401 Nov 03 04:13:21.853393 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2288/4437] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:21 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:21.874918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ffac3ad-e2ed-4fa8-bd96-4e815dab8afd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:21.877355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ffac3ad-e2ed-4fa8-bd96-4e815dab8afd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 2190f30d-5349-4178-9c6a-55a55ec64b66] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:21.883384 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-5ffac3ad-e2ed-4fa8-bd96-4e815dab8afd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 2190f30d-5349-4178-9c6a-55a55ec64b66 could not be found. Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ffac3ad-e2ed-4fa8-bd96-4e815dab8afd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/2190f30d-5349-4178-9c6a-55a55ec64b66/action HTTP/1.1 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 28 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: {"reboot": {"type": "SOFT"}} Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 2190f30d-5349-4178-9c6a-55a55ec64b66 could not be found. Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '2190f30d-5349-4178-9c6a-55a55ec64b66', 'body': {'reboot': {'type': 'SOFT'}}} Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2190f30d-5349-4178-9c6a-55a55ec64b66 could not be found. Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2190f30d-5349-4178-9c6a-55a55ec64b66 could not be found. Nov 03 04:13:21.885109 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2190f30d-5349-4178-9c6a-55a55ec64b66 could not be found. Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ffac3ad-e2ed-4fa8-bd96-4e815dab8afd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 2190f30d-5349-4178-9c6a-55a55ec64b66 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ffac3ad-e2ed-4fa8-bd96-4e815dab8afd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/2190f30d-5349-4178-9c6a-55a55ec64b66/action" status: 404 len: 111 microversion: 2.1 time: 0.016931 Nov 03 04:13:21.890368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2150/4438] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:21 2022] POST /compute/v2.1/servers/2190f30d-5349-4178-9c6a-55a55ec64b66/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:21.896719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:21.897638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:21.904998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.905583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.906036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:21.906750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:21.907211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:21.907823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.064192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:22.073894 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7c5c148-80e0-424e-b921-8dbf64b7061b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.181179 Nov 03 04:13:22.075224 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2289/4439] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:21 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:22.102145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:22.103110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:22.112033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.112935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.114486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.116045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.116723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.117418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.140989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:22.141651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:22.150516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.151642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.152531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.154093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.155375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.157335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.822724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:22.828621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:22.835180 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a916a77f-7e9d-479b-83fb-e4eddd8a375a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.736116 Nov 03 04:13:22.837043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1cb6bf9c-5d08-4421-b94c-78b3cb878f43 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1372 microversion: 2.1 time: 0.701257 Nov 03 04:13:22.838356 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2290/4440] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:22 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1372 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:22.843819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:22.844685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:22.851468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.852455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.853188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.854129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.854807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.855450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.866427 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2151/4441] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:22 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:22.881193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:22.882277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:22.890212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.891056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.891729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:22.892779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:22.893489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:22.904680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.136156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:23.154992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:23.156467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:23.164422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-359c402b-9fc8-4bb6-860c-5be6a9571d40 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.287929 Nov 03 04:13:23.177553 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2152/4442] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:22 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:13:23.200513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:23.203430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:23.216196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.216977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.217626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.218504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.219314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.219911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.229216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:23.244689 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f654a7b-a039-49a3-a945-5a9b2f2fdc5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1308 microversion: 2.1 time: 0.404992 Nov 03 04:13:23.245353 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2291/4443] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:22 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:23.267528 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c/action HTTP/1.1 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 65 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f5dce2a8-211e-4cad-a50f-82480431c49c', 'body': {'rebuild': {'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1'}}} Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 03 04:13:23.271800 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:13:23.276746 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.280367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:23.283993 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60d34d84-7ea5-43a4-b989-d6087c3ef205 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c/action" status: 404 len: 111 microversion: 2.1 time: 0.105345 Nov 03 04:13:23.289034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2153/4444] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:23 2022] POST /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c/action => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:23.297548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:23.298186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:23.312646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.312646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.312646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.312646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.312646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.312646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.499906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:23.508394 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8958ddd8-7e07-47c9-9ed7-a94770d01445 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.217447 Nov 03 04:13:23.509342 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2292/4445] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:23 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:23.532557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:23.533293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:23.541778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=18 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:23.544511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.555980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.556645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.557582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.558231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.558827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.749081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:23.758684 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71f6a101-3bec-4ab5-a7d1-1971b641684e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.230567 Nov 03 04:13:23.759759 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2154/4446] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:23 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:23.795862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d9a1c70-9d0e-48fd-9b9b-0fd15d73fb5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:23.800014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d9a1c70-9d0e-48fd-9b9b-0fd15d73fb5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 22427ef4-f433-4892-b6e6-cf13a2210686] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:23.809772 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4d9a1c70-9d0e-48fd-9b9b-0fd15d73fb5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 22427ef4-f433-4892-b6e6-cf13a2210686 could not be found. Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d9a1c70-9d0e-48fd-9b9b-0fd15d73fb5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/22427ef4-f433-4892-b6e6-cf13a2210686/action HTTP/1.1 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 65 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 22427ef4-f433-4892-b6e6-cf13a2210686 could not be found. Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '22427ef4-f433-4892-b6e6-cf13a2210686', 'body': {'rebuild': {'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1'}}} Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22427ef4-f433-4892-b6e6-cf13a2210686 could not be found. Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:13:23.812276 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22427ef4-f433-4892-b6e6-cf13a2210686 could not be found. Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22427ef4-f433-4892-b6e6-cf13a2210686 could not be found. Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d9a1c70-9d0e-48fd-9b9b-0fd15d73fb5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 22427ef4-f433-4892-b6e6-cf13a2210686 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d9a1c70-9d0e-48fd-9b9b-0fd15d73fb5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/22427ef4-f433-4892-b6e6-cf13a2210686/action" status: 404 len: 111 microversion: 2.1 time: 0.023067 Nov 03 04:13:23.816995 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2293/4447] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:23 2022] POST /compute/v2.1/servers/22427ef4-f433-4892-b6e6-cf13a2210686/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:23.822822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:23.823455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:23.826415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:23.830435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.830988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.831924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.833155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.833977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.834822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.863299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:23.864148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:23.879606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.880378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.882283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.884644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:23.885380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:23.886420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:23.954190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:24.235326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:24.247804 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9e22d328-1edd-4d1f-8859-1edadd450a42 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.428705 Nov 03 04:13:24.252227 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2155/4448] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:23 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:24.278806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:24.288615 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf13d53e-a196-4e3e-aa28-0a9e0e1c518e tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1372 microversion: 2.1 time: 0.431939 Nov 03 04:13:24.299207 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2294/4449] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:23 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1372 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:24.299345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:24.299707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:24.313871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:24.317944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:24.321488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.323970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.325782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.326773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.327541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.328940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.332097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.333492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.337677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.338493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.338966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.339563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.423636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:24.433847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:24.440579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:24.441864 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cae7d822-9ece-453b-bb94-2ac1eceb6e64 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.178177 Nov 03 04:13:24.445250 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2156/4450] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:24 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:24.456310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:24.459269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:24.471049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.472692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.473193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.475595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.476131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.476580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.697374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:24.706837 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a19b41d0-c1a0-49e7-8e3b-90906b1b2f9a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1489 microversion: 2.1 time: 0.408269 Nov 03 04:13:24.707772 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2295/4451] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:24 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1489 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:24.714205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a54701f4-2ecc-4f82-a87e-af707f254f18 req-e293a4db-4d03-40c4-b95d-8e90b99327dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4749567-23cb-4bdd-be2c-7adb77fed29a", "name": "network-vif-plugged", "status": "completed", "tag": "e3300983-7b1f-455c-ba55-56d9a03f3c66"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:24.723814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a54701f4-2ecc-4f82-a87e-af707f254f18 req-e293a4db-4d03-40c4-b95d-8e90b99327dc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.724804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a54701f4-2ecc-4f82-a87e-af707f254f18 req-e293a4db-4d03-40c4-b95d-8e90b99327dc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.725474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a54701f4-2ecc-4f82-a87e-af707f254f18 req-e293a4db-4d03-40c4-b95d-8e90b99327dc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.741143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a54701f4-2ecc-4f82-a87e-af707f254f18 req-e293a4db-4d03-40c4-b95d-8e90b99327dc service nova] Creating event network-vif-plugged:e3300983-7b1f-455c-ba55-56d9a03f3c66 for instance c4749567-23cb-4bdd-be2c-7adb77fed29a on n-h2-854653-7 Nov 03 04:13:24.749458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a54701f4-2ecc-4f82-a87e-af707f254f18 req-e293a4db-4d03-40c4-b95d-8e90b99327dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038396 Nov 03 04:13:24.750598 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2296/4452] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:24.757535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:24.758672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:24.768262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.768584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:24.769717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.770564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.772195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.772878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.777396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.789172 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-393accb0-18b0-4e64-80cd-a305901aa224 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.341360 Nov 03 04:13:24.789762 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2157/4453] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:24 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:24.814503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca5481b2-daff-48d5-a4b8-97ba451facbd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:24.815379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ca5481b2-daff-48d5-a4b8-97ba451facbd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 9e8aba98-1849-423a-8e7d-a35d6451699a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:24.834451 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ca5481b2-daff-48d5-a4b8-97ba451facbd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 9e8aba98-1849-423a-8e7d-a35d6451699a could not be found. Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca5481b2-daff-48d5-a4b8-97ba451facbd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/9e8aba98-1849-423a-8e7d-a35d6451699a/action HTTP/1.1 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 15 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: {"restore": {}} Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 9e8aba98-1849-423a-8e7d-a35d6451699a could not be found. Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '9e8aba98-1849-423a-8e7d-a35d6451699a', 'body': {'restore': {}}} Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e8aba98-1849-423a-8e7d-a35d6451699a could not be found. Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e8aba98-1849-423a-8e7d-a35d6451699a could not be found. Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:24.841437 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:24.849714 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:24.849714 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:24.849714 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e8aba98-1849-423a-8e7d-a35d6451699a could not be found. Nov 03 04:13:24.849714 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:24.849714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca5481b2-daff-48d5-a4b8-97ba451facbd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 9e8aba98-1849-423a-8e7d-a35d6451699a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:24.849714 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca5481b2-daff-48d5-a4b8-97ba451facbd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/9e8aba98-1849-423a-8e7d-a35d6451699a/action" status: 404 len: 111 microversion: 2.1 time: 0.034363 Nov 03 04:13:24.849714 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2158/4454] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:24 2022] POST /compute/v2.1/servers/9e8aba98-1849-423a-8e7d-a35d6451699a/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:24.853184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:24.854421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:24.862407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.862895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.863333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:24.864046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:24.864676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:24.865303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.056401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:25.071171 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ddd9ed0-7778-41f2-8799-e5abee089802 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.222249 Nov 03 04:13:25.072008 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2159/4455] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:24 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:25.100846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:25.101846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:25.116839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.117682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.118375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.119371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.119911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.120440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.138973 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d5b7c56-5b00-45e8-9f4a-cd2eaad91049 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0/action" status: 202 len: 0 microversion: 2.1 time: 0.386384 Nov 03 04:13:25.140005 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2297/4456] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:24 2022] POST /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:13:25.151908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:25.152973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:25.168859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.169414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.173263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.174321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.175837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.179118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.410531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:25.443747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:25.453887 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d64aed85-4dca-4915-a7ee-53fc85887845 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1494 microversion: 2.1 time: 0.309254 Nov 03 04:13:25.454821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2298/4457] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:25 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1494 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:25.457682 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d7cd1917-f444-4fe2-8da1-afde1330b0c4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.361165 Nov 03 04:13:25.460847 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2160/4458] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:25 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:25.463102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:25.463406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:25.470990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.471583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.472684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.473951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.474859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.475590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.503793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:25.505002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:25.528109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.530982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.532562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.535921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.537312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.539130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.730599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:25.749730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:25.751575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:25.755814 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e983b4ab-537f-4fa0-8aee-a12dcde51d5f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.274372 Nov 03 04:13:25.781349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2161/4459] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:25 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:13:25.787445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:25.788107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:25.805824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.806339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.806795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.807537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.808002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.808432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.815492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:25.826859 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e876c936-beba-4523-abe0-7eb5b35fedb4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1372 microversion: 2.1 time: 0.369652 Nov 03 04:13:25.828347 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2299/4460] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:25 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1372 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:25.851442 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Cannot 'restore' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action HTTP/1.1 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 15 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: {"restore": {}} Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'restore' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'restore': {}}} Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 in vm_state active. Cannot restore while the instance is in this state. Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:25.853611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:25.860880 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:25.860880 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:25.860880 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:25.860880 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:25.860880 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:25.860880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 409 to user: Cannot 'restore' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:25.860880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87b4c947-f538-4fe6-9ad9-1257f82b320f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 409 len: 145 microversion: 2.1 time: 0.073477 Nov 03 04:13:25.867866 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2162/4461] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:25 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 145 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:13:25.872734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:25.874295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:25.881175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.881748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.882445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:25.883354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:25.884139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:25.884776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.058040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:26.067242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cd58b65b-d63e-40be-a7c2-86361f726b17 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.198344 Nov 03 04:13:26.068347 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2300/4462] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:25 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:26.094003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:26.094628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:26.100849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.101533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.101975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.102681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.103136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.103564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.283961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:26.297514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-face5237-a97a-41d5-849d-fcf48ff7df34 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.207702 Nov 03 04:13:26.298777 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2163/4463] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:26 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:26.325303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b5778c0-0f22-425b-adb9-bc57001fd89c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:26.329583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b5778c0-0f22-425b-adb9-bc57001fd89c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 49a073f7-616a-45e1-a423-a83309ffc91d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:26.332999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-8b5778c0-0f22-425b-adb9-bc57001fd89c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 49a073f7-616a-45e1-a423-a83309ffc91d could not be found. Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b5778c0-0f22-425b-adb9-bc57001fd89c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/49a073f7-616a-45e1-a423-a83309ffc91d/action HTTP/1.1 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 14 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: {"resume": {}} Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 49a073f7-616a-45e1-a423-a83309ffc91d could not be found. Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '49a073f7-616a-45e1-a423-a83309ffc91d', 'body': {'resume': {}}} Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49a073f7-616a-45e1-a423-a83309ffc91d could not be found. Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49a073f7-616a-45e1-a423-a83309ffc91d could not be found. Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:26.349847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:26.365291 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:26.365291 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:26.365291 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49a073f7-616a-45e1-a423-a83309ffc91d could not be found. Nov 03 04:13:26.365291 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:26.365291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b5778c0-0f22-425b-adb9-bc57001fd89c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 49a073f7-616a-45e1-a423-a83309ffc91d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:26.365291 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b5778c0-0f22-425b-adb9-bc57001fd89c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/49a073f7-616a-45e1-a423-a83309ffc91d/action" status: 404 len: 111 microversion: 2.1 time: 0.031863 Nov 03 04:13:26.365291 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2301/4464] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:26 2022] POST /compute/v2.1/servers/49a073f7-616a-45e1-a423-a83309ffc91d/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:26.372298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:26.373797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:26.388850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.389614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.390370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.391262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.391896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.394858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.483358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:26.484022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:26.498235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.499426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.501274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.503671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.504304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.504758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.907384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:26.918240 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a91d41c9-d86a-437f-8d2c-117065c0cd2d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.550575 Nov 03 04:13:26.925340 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2164/4465] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:26 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:26.937715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:26.938348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:26.950099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.950603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.951579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:26.952299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:26.967437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:26.972052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.066284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:27.074821 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-830134d7-5311-48bb-8e6b-313ed0728447 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 200 len: 1474 microversion: 2.1 time: 0.596337 Nov 03 04:13:27.075410 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2302/4466] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:26 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 1474 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:27.088772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:27.089427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:27.098857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.099849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.100487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.101413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.102042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.102729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.127121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:27.146329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:27.149746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:27.151961 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55795e01-8199-48cd-8a0f-aecd0e5b4219 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.224560 Nov 03 04:13:27.152704 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2165/4467] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:26 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:27.159187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:27.160040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:27.168808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.169617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.170249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.171172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.171638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.172109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.208642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:27.370220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:27.384294 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ea4b1231-c568-411c-b7da-c7aedb3cc85a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1543 microversion: 2.1 time: 0.298972 Nov 03 04:13:27.386022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2303/4468] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:27 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1543 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:27.392976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-508615051"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:27.396607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:27.427546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.427546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.427546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.427546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.427546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.427546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.508871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:27.525035 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-300128c2-7f2c-4eab-add4-8a31175f93d4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.364678 Nov 03 04:13:27.526197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2166/4469] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:27 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:27.534142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:27.534898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:27.543331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.544352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.545574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.546659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.548692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.549485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.943228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:27.955579 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4056e9bf-7d4d-4e3a-98b1-1e763ceaa9cc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1543 microversion: 2.1 time: 0.426322 Nov 03 04:13:27.958428 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2167/4470] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:27 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1543 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:27.968339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:27.969832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:27.984900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.990050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.990050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:27.990791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:27.994463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:27.994998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:28.057426 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Cannot 'resume' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action HTTP/1.1 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 14 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: {"resume": {}} Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'resume' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'resume': {}}} Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 in vm_state active. Cannot resume while the instance is in this state. Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:28.059534 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:28.064223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:28.064223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:28.064223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:28.064223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:28.064223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:28.064223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:13:28.064223 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:28.066782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 409 to user: Cannot 'resume' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:28.068017 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccc3e52e-f36f-4aa6-b7ca-96cbe08056b4 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 409 len: 144 microversion: 2.1 time: 0.108496 Nov 03 04:13:28.076607 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2168/4471] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:27 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 144 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:13:28.078580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:28.079436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:28.087428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:28.088305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:28.089007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:28.089983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:28.090678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:28.091659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:28.135300 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ceace0e-4825-4e63-8cc4-a50ef1862ca4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0/action" status: 202 len: 0 microversion: 2.1 time: 0.747692 Nov 03 04:13:28.141529 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2304/4472] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:27 2022] POST /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0/action => generated 0 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:13:28.155016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-461c7863-a4b0-4bfd-a702-0f2aca647f09 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8766c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:28.256390 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-461c7863-a4b0-4bfd-a702-0f2aca647f09 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.107939 Nov 03 04:13:28.259137 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2305/4473] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:28 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:28.280477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:28.292146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:28.314030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:28.314850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:28.317729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:28.318678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:28.321972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:28.321972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:28.510556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:28.519891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc482041-4b35-409c-a43a-70f199fff2e1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.446753 Nov 03 04:13:28.522049 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2169/4474] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:28 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:28.531065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:28.555672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:28.556642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:28.563532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:28.570213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:28.572132 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8791986-0f03-4889-8384-9eddc95dc475 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.311392 Nov 03 04:13:28.573851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:28.574785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:28.575419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:28.577777 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2306/4475] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:28 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:28.577913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:28.577913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:28.581504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:28.866425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:28.876056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f61e741e-4ad7-4f04-82df-f334b5374b58 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.330981 Nov 03 04:13:28.877531 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2170/4476] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:28 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:29.114747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a3ab6ac-5092-4975-8b45-e8f732b0e8bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a3ab6ac-5092-4975-8b45-e8f732b0e8bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 160 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": "", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4b8fa68c-7b16-4d7b-96b3-aa4d0316b388"}]}} Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'body': {'server': {'name': '', 'imageRef': '9282dbed-69cc-4288-b866-d4c7962a81f1', 'flavorRef': '452', 'networks': [{'uuid': '4b8fa68c-7b16-4d7b-96b3-aa4d0316b388'}]}}} Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi '' Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:13:29.128880 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a3ab6ac-5092-4975-8b45-e8f732b0e8bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a3ab6ac-5092-4975-8b45-e8f732b0e8bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010541 Nov 03 04:13:29.133791 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2307/4477] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:13:29 2022] POST /compute/v2.1/servers => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:13:29.135235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:29.135665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:29.146732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:29.147370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:29.147891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:29.148618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:29.149132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:29.149569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:29.274825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7604e201-498c-4dc8-8d64-5a61befacf63 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd492160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:29.350744 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7604e201-498c-4dc8-8d64-5a61befacf63 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.080121 Nov 03 04:13:29.360427 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2308/4478] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:29 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:29.483794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:29.499179 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-766a9117-1216-4372-9ffe-97adafd9e618 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.366785 Nov 03 04:13:29.531733 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2171/4479] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:29 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:29.534583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:29.535307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:29.545733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:29.547275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:29.547735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:29.550673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:29.552145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:29.552602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:29.607072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:29.608863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:29.632669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:29.633256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:29.633704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:29.634429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:29.634889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:29.635319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:29.923917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:29.933854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:29.936006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:29.937269 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d57b5a8d-d027-4051-b6a4-c71400c9b87c tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1604 microversion: 2.42 time: 0.334545 Nov 03 04:13:29.937828 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2172/4480] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:29 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:13:30.110923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:30.119614 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-869662d8-46b9-4349-8eb9-833f06a63843 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.592509 Nov 03 04:13:30.120428 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2309/4481] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:29 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:30.143674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a538cde9-5d90-4e9a-8c24-f6574b8c9190 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:30.144845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a538cde9-5d90-4e9a-8c24-f6574b8c9190 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 19c2abcb-0f6a-47a0-999c-2f4023805c85] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:30.151219 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a538cde9-5d90-4e9a-8c24-f6574b8c9190 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 19c2abcb-0f6a-47a0-999c-2f4023805c85 could not be found. Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a538cde9-5d90-4e9a-8c24-f6574b8c9190 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/19c2abcb-0f6a-47a0-999c-2f4023805c85/action HTTP/1.1 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 14 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: {"shelve": {}} Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 19c2abcb-0f6a-47a0-999c-2f4023805c85 could not be found. Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '19c2abcb-0f6a-47a0-999c-2f4023805c85', 'body': {'shelve': {}}} Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c2abcb-0f6a-47a0-999c-2f4023805c85 could not be found. Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c2abcb-0f6a-47a0-999c-2f4023805c85 could not be found. Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:30.153411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:30.158134 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:30.158134 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:30.158134 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c2abcb-0f6a-47a0-999c-2f4023805c85 could not be found. Nov 03 04:13:30.158134 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:30.159985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a538cde9-5d90-4e9a-8c24-f6574b8c9190 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 19c2abcb-0f6a-47a0-999c-2f4023805c85 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:30.161070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a538cde9-5d90-4e9a-8c24-f6574b8c9190 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/19c2abcb-0f6a-47a0-999c-2f4023805c85/action" status: 404 len: 111 microversion: 2.1 time: 0.021680 Nov 03 04:13:30.163634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2173/4482] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:30 2022] POST /compute/v2.1/servers/19c2abcb-0f6a-47a0-999c-2f4023805c85/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:13:30.179696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:30.180553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:30.188154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:30.188154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:30.188154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:30.188408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:30.188681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:30.189409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:30.372741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1375c4d3-1c80-4263-822f-002db484eb34 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f90f9ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:30.458053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1375c4d3-1c80-4263-822f-002db484eb34 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.094114 Nov 03 04:13:30.461003 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2174/4483] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:30 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:30.480879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:30.491144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-284e8772-3f3b-4bd0-b483-bec825c40c5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.315165 Nov 03 04:13:30.491727 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2310/4484] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:30 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:30.516561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:30.517201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:30.523290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:30.523790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:30.524232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:30.525115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:30.525570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:30.525995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:30.964331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:30.964960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:30.966581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:30.977405 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-883390f3-09fb-42ea-a1c7-d358cca6084c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.465695 Nov 03 04:13:30.982041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:30.983343 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2175/4485] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:30 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:30.984134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:30.985140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:30.986094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:30.986773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:30.987441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:31.010546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:31.011452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:31.036752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:31.037506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:31.037992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:31.040835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:31.040835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:31.040835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:31.078361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:31.078861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:31.079309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:31.079775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lazy-loading 'fault' on Instance uuid efb913d3-fdda-46d0-a9a8-439a2ac2f55b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:13:31.087270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lazy-loading 'flavor' on Instance uuid 5d5654b4-009d-4bff-b1f3-d835ea94a615 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:13:31.179084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:31.191086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:31.196875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1627221c9ae94184ada95f548d62e413', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a83b4960f4427bb66fa9b086479fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:31.202075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-efe5049c-93fe-43d0-8687-15fc1847536e tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 200 len: 1371 microversion: 2.42 time: 0.241747 Nov 03 04:13:31.204535 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2311/4486] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:30 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:13:31.478962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c356080f-0490-4c47-b375-4b340ba1ee88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd62c1f0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:31.595277 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c356080f-0490-4c47-b375-4b340ba1ee88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.123536 Nov 03 04:13:31.610325 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2312/4487] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:31 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:31.799234 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bdc1da29-57b0-420e-82fb-a7b88571531c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 202 len: 0 microversion: 2.1 time: 0.793097 Nov 03 04:13:31.800567 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2176/4488] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:31 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:13:31.817384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:31.818365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:31.834496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:31.837036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:31.841312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:31.842184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:31.842753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:31.843421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:31.981791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-36880b53-f70e-4a28-aaaa-d91a59329620 req-273081a2-ff9f-4c07-9f44-93f9efa9e6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4749567-23cb-4bdd-be2c-7adb77fed29a", "tag": "e3300983-7b1f-455c-ba55-56d9a03f3c66"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:32.021957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-36880b53-f70e-4a28-aaaa-d91a59329620 req-273081a2-ff9f-4c07-9f44-93f9efa9e6d7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:32.022468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-36880b53-f70e-4a28-aaaa-d91a59329620 req-273081a2-ff9f-4c07-9f44-93f9efa9e6d7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:32.025424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-36880b53-f70e-4a28-aaaa-d91a59329620 req-273081a2-ff9f-4c07-9f44-93f9efa9e6d7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:32.042645 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-36880b53-f70e-4a28-aaaa-d91a59329620 req-273081a2-ff9f-4c07-9f44-93f9efa9e6d7 service nova] Creating event network-changed:e3300983-7b1f-455c-ba55-56d9a03f3c66 for instance c4749567-23cb-4bdd-be2c-7adb77fed29a on n-h2-854653-7 Nov 03 04:13:32.052458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-36880b53-f70e-4a28-aaaa-d91a59329620 req-273081a2-ff9f-4c07-9f44-93f9efa9e6d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085262 Nov 03 04:13:32.053557 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2177/4489] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:32.235092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:32.236410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:32.243666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:32.244460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:32.249777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:32.249777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:32.249777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:32.249777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:32.261640 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] HTTP exception thrown: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Request method failure captured: Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b HTTP/1.1 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz1KvVT36DI9pD8RSyoh_n3OV-jViQvVOeilu1WDB3xsptMCbe2pb6aZrWAi7y95n4g68Snb7ZR1sfUVPG155th2fQalBmRtWeTqffrPkKeqV761z335Z5B49vcFpUu5pA120OAD3Gcfr38wxLCooOQly5OGdJ54EcgmSvdEJzS5k5c Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.42 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a4a83b4960f4427bb66fa9b086479fbf Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a4a83b4960f4427bb66fa9b086479fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a4a83b4960f4427bb66fa9b086479fbf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a4a83b4960f4427bb66fa9b086479fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a4a83b4960f4427bb66fa9b086479fbf"}]}] Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a4a83b4960f4427bb66fa9b086479fbf Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TaggedBootDevicesTest_v242-167196753-project Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 1627221c9ae94184ada95f548d62e413 Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TaggedBootDevicesTest_v242-167196753-project Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'efb913d3-fdda-46d0-a9a8-439a2ac2f55b'} Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:32.264999 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:32.269867 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:13:32.271503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Returning 404 to user: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:32.272944 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-520de71f-3877-4db0-b419-0153d330d9d3 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 404 len: 111 microversion: 2.42 time: 0.042409 Nov 03 04:13:32.285161 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2178/4490] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:32 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:13:32.285161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e1600f13-bee7-40f8-98e6-15791623a1c1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '.version_select at 0x7ff7f9516280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:32.361269 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e1600f13-bee7-40f8-98e6-15791623a1c1 tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883373805" status: 204 len: 0 microversion: 2.42 time: 0.082576 Nov 03 04:13:32.365629 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2179/4491] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 04:13:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883373805 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:13:32.440860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:32.443208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:32.454699 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dcff8a01-3a5a-489c-8b0e-6cd0ef30a9ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.645673 Nov 03 04:13:32.469217 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2313/4492] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:31 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:32.619618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fda8ad66-74b7-4eba-a7cb-5f14c621b360 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8446040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:32.711940 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fda8ad66-74b7-4eba-a7cb-5f14c621b360 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.087909 Nov 03 04:13:32.712559 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2180/4493] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:32 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:33.479482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:33.480597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:33.494845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:33.496394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:33.498239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:33.499364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:33.503069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:33.505309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:33.729494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fedf96e5-e123-4e70-b2cf-28a5ae5f945d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f98a70d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:33.781577 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fedf96e5-e123-4e70-b2cf-28a5ae5f945d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.063570 Nov 03 04:13:33.789243 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2181/4494] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:33 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:33.958109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:33.968860 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d122f187-42a2-40b7-8c27-f6e2143f1895 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.494297 Nov 03 04:13:33.981387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2314/4495] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:33 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:34.798552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41d31108-2709-49ec-bf44-23e7a8e53694 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8449550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:34.854884 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41d31108-2709-49ec-bf44-23e7a8e53694 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.061175 Nov 03 04:13:34.857277 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2182/4496] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:34 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:34.995435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:34.996605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:35.023258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:35.023754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:35.024572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:35.025738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:35.026326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:35.026771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:35.187542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4c4371ee-e1d7-4566-9ed4-4d1084b2f07a req-a2981dd1-fa76-491c-993a-133e2dc5535a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f664e16-567c-49fd-a90f-dc44a6bbb6f0", "name": "network-vif-plugged", "status": "completed", "tag": "80ed2213-9abc-4dd8-b25d-d29a030cf123"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:35.198765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4c4371ee-e1d7-4566-9ed4-4d1084b2f07a req-a2981dd1-fa76-491c-993a-133e2dc5535a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:35.214373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4c4371ee-e1d7-4566-9ed4-4d1084b2f07a req-a2981dd1-fa76-491c-993a-133e2dc5535a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:35.217606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4c4371ee-e1d7-4566-9ed4-4d1084b2f07a req-a2981dd1-fa76-491c-993a-133e2dc5535a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:35.239856 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4c4371ee-e1d7-4566-9ed4-4d1084b2f07a req-a2981dd1-fa76-491c-993a-133e2dc5535a service nova] Creating event network-vif-plugged:80ed2213-9abc-4dd8-b25d-d29a030cf123 for instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 on n-h1-854653-7 Nov 03 04:13:35.246195 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4c4371ee-e1d7-4566-9ed4-4d1084b2f07a req-a2981dd1-fa76-491c-993a-133e2dc5535a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062545 Nov 03 04:13:35.247618 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2183/4497] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:35.439157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:35.460727 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6742bb41-3a43-42d9-8c1a-810dddabc431 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.469451 Nov 03 04:13:35.461468 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2315/4498] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:34 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:35.876286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1025cab0-3fc6-411d-ac81-7999a3feef39 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f89a9820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:36.052363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1025cab0-3fc6-411d-ac81-7999a3feef39 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.183092 Nov 03 04:13:36.054550 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2184/4499] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:35 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:36.485497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:36.486715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:36.502060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:36.503544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:36.504707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:36.506879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:36.510627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:36.512336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:37.069184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1fec821f-c08c-4a5a-8459-8b657603feff tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8449790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:37.235038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:37.244689 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-087115a7-1daa-4d6e-94a0-f206c6d76702 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.764037 Nov 03 04:13:37.245251 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2316/4500] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:36 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:38.285074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:38.285074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:38.285074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:38.285074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:38.285074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:38.285074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:38.286288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:38.286704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:38.564491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:38.584326 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee089a45-94ce-44e9-b977-fc0beecc81bb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.318707 Nov 03 04:13:38.588711 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2317/4501] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:38 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:39.615747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:39.617377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:39.639442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:39.641186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:39.641186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:39.641888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:39.643819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:39.644525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:40.166145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:40.174867 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-49b5cc7e-2667-48aa-8bf7-cf35a3dd4a9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.562917 Nov 03 04:13:40.180905 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2318/4502] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:39 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:40.191852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:40.199328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:40.209776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:40.210245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:40.210684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:40.215773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:40.217785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:40.220088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:40.249663 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] HTTP exception thrown: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Request method failure captured: Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b HTTP/1.1 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1KvVT36DI9pD8RSyoh_n3OV-jViQvVOeilu1WDB3xsptMCbe2pb6aZrWAi7y95n4g68Snb7ZR1sfUVPG155th2fQalBmRtWeTqffrPkKeqV761z335Z5B49vcFpUu5pA120OAD3Gcfr38wxLCooOQly5OGdJ54EcgmSvdEJzS5k5c Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.42 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a4a83b4960f4427bb66fa9b086479fbf Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a4a83b4960f4427bb66fa9b086479fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a4a83b4960f4427bb66fa9b086479fbf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a4a83b4960f4427bb66fa9b086479fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a4a83b4960f4427bb66fa9b086479fbf"}]}] Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a4a83b4960f4427bb66fa9b086479fbf Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TaggedBootDevicesTest_v242-167196753-project Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 1627221c9ae94184ada95f548d62e413 Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TaggedBootDevicesTest_v242-167196753-project Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'efb913d3-fdda-46d0-a9a8-439a2ac2f55b'} Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:40.251899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.256836 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.259559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Returning 404 to user: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:40.260641 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a0041f68-7bf4-4a8d-b67a-8f310696570f tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "DELETE /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 404 len: 111 microversion: 2.42 time: 0.078523 Nov 03 04:13:40.261443 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2319/4503] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:13:40 2022] DELETE /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:13:40.270631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:40.271352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] [instance: efb913d3-fdda-46d0-a9a8-439a2ac2f55b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:40.273772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:40.280089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:40.280959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:40.281504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:40.282456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:40.283112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:40.283752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:40.316766 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] HTTP exception thrown: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Request method failure captured: Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b HTTP/1.1 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz1KvVT36DI9pD8RSyoh_n3OV-jViQvVOeilu1WDB3xsptMCbe2pb6aZrWAi7y95n4g68Snb7ZR1sfUVPG155th2fQalBmRtWeTqffrPkKeqV761z335Z5B49vcFpUu5pA120OAD3Gcfr38wxLCooOQly5OGdJ54EcgmSvdEJzS5k5c Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.42 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a4a83b4960f4427bb66fa9b086479fbf Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a4a83b4960f4427bb66fa9b086479fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a4a83b4960f4427bb66fa9b086479fbf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a4a83b4960f4427bb66fa9b086479fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a4a83b4960f4427bb66fa9b086479fbf"}]}] Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a4a83b4960f4427bb66fa9b086479fbf Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-167196753 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TaggedBootDevicesTest_v242-167196753-project Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 1627221c9ae94184ada95f548d62e413 Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TaggedBootDevicesTest_v242-167196753-project Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'efb913d3-fdda-46d0-a9a8-439a2ac2f55b'} Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.318758 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. Nov 03 04:13:40.324137 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:13:40.326597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] Returning 404 to user: Instance efb913d3-fdda-46d0-a9a8-439a2ac2f55b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:13:40.328317 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a5931656-b708-4af5-9304-e51f0f588c8d tempest-TaggedBootDevicesTest_v242-167196753 tempest-TaggedBootDevicesTest_v242-167196753-project] 10.222.0.30 "GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b" status: 404 len: 111 microversion: 2.42 time: 0.061671 Nov 03 04:13:40.329467 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2320/4504] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:13:40 2022] GET /compute/v2.1/servers/efb913d3-fdda-46d0-a9a8-439a2ac2f55b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:13:41.200094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:41.202194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:41.212981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:41.218281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:41.219170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:41.219620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:41.220088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:41.220582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:41.868982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:41.877242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-266a2a52-5fb2-4b84-8ada-d09efd9787d7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.682383 Nov 03 04:13:41.901661 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2321/4505] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:41 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:42.906824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:42.907472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:42.948504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:42.953124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:42.953124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:42.953124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:42.953124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:42.953124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:43.385551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:43.394813 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-887158b4-1ff3-4ad3-8118-89de6356af97 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.493793 Nov 03 04:13:43.398371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2322/4506] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:42 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:44.425485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:44.426941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:44.449302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:44.457704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:44.459075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:44.460697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:44.462460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:44.463738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:44.784504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:44.795290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-844baedd-0315-4dc0-8024-afe550b3c5fb tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.372944 Nov 03 04:13:44.795906 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2323/4507] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:44 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:45.195098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:45.239272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:45.820927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:45.822209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:45.852269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:45.861325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:45.862754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:45.864506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:45.870583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:45.872712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:47.102888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:47.120010 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75c1d9cb-973d-4313-bdb7-3118102f7cb6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 1.302464 Nov 03 04:13:47.120987 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2324/4508] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:45 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:48.149126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:48.150572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:48.163828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:48.164748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:48.165609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:48.167837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:48.168583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:48.170540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:48.609229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:48.626244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-676de2a7-9d3e-4cdd-8285-980dd815556b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.482169 Nov 03 04:13:48.626871 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2325/4509] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:48 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:49.657537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:49.658858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:49.672996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:49.675756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:49.676456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:49.677499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:49.680182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:49.680887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:49.967988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:50.001293 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e080e32-2ff9-4beb-bc66-3286ef1c71be tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1533 microversion: 2.1 time: 0.349206 Nov 03 04:13:50.008200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2326/4510] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:49 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1533 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:51.034853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:51.036293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:51.054915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:51.057775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:51.057775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:51.057775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:51.060501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:51.061229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:51.402553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:51.432432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a0e1b3e-f4f5-45bc-94a9-4c857fb7461f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1533 microversion: 2.1 time: 0.399449 Nov 03 04:13:51.434398 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2327/4511] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:51 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1533 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:52.361871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:52.384923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:52.451154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:52.457488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:52.461410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:52.464392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:52.468515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:52.475037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:52.867041 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20a78e6c-3535-4e13-b419-f1879f0d6759 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.513700 Nov 03 04:13:52.867696 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2328/4512] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:52 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:13:52.881698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:52.882685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:52.891312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:52.892044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:52.896812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:52.896812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:52.896812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:52.896812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:53.341872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:53.352457 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-857a1120-4d44-4473-9bd2-fe0ee0f8152c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1533 microversion: 2.1 time: 0.479740 Nov 03 04:13:53.358906 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2329/4513] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:52 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1533 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:53.368665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:53.370763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:53.416649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:53.417959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:53.423160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:53.427253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:53.428812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:53.429722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:53.928065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:53.935289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:13:53.944390 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d724e3e-1ce6-48bb-b423-31b3fbe91cf5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1671 microversion: 2.1 time: 0.581649 Nov 03 04:13:53.946422 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2330/4514] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:53 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1671 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:54.387674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:54.388295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:54.399490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:54.400921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:54.414570 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1fec821f-c08c-4a5a-8459-8b657603feff tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 17.349421 Nov 03 04:13:54.425639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:54.426065 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2185/4515] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:37 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 17362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:54.427110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:54.427768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:54.428387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:54.496248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:54.499462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:54.528721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:54.530551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:54.533742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:54.540090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:54.540090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:54.540090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:54.673719 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10aed528-dc96-41d1-bada-713915fed0a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a/action" status: 200 len: 24568 microversion: 2.1 time: 0.181822 Nov 03 04:13:54.680294 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2186/4516] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:13:54 2022] POST /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a/action => generated 24568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:13:54.975055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:54.975768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:55.023891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:55.025357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:55.025843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:55.030032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:55.033909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:55.036119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:55.294730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:55.303713 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c6d3fd6a-fa0c-44a3-9d85-70a17d7c7a1b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.920596 Nov 03 04:13:55.322050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2331/4517] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:54 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:55.334737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5791ec87-50a6-4ebf-9d18-bba766fa25b8 req-ed74e131-1d3b-44b3-ac70-bf7aeec62c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5654b4-009d-4bff-b1f3-d835ea94a615", "name": "network-vif-plugged", "status": "completed", "tag": "eda54677-27f1-4356-ba50-c78608583439"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:13:55.367850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5791ec87-50a6-4ebf-9d18-bba766fa25b8 req-ed74e131-1d3b-44b3-ac70-bf7aeec62c02 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:55.369218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5791ec87-50a6-4ebf-9d18-bba766fa25b8 req-ed74e131-1d3b-44b3-ac70-bf7aeec62c02 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:55.370987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5791ec87-50a6-4ebf-9d18-bba766fa25b8 req-ed74e131-1d3b-44b3-ac70-bf7aeec62c02 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:55.401079 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5791ec87-50a6-4ebf-9d18-bba766fa25b8 req-ed74e131-1d3b-44b3-ac70-bf7aeec62c02 service nova] Creating event network-vif-plugged:eda54677-27f1-4356-ba50-c78608583439 for instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 on n-h1-854653-7 Nov 03 04:13:55.414627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5791ec87-50a6-4ebf-9d18-bba766fa25b8 req-ed74e131-1d3b-44b3-ac70-bf7aeec62c02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090281 Nov 03 04:13:55.416558 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2332/4518] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:13:55.432080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a1b90d7-1815-4d0b-a532-4d0b4ed6e34e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f850cc10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:55.459652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:55.468764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f0556743-546c-466f-b95b-ac62548d0d5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1671 microversion: 2.1 time: 0.497892 Nov 03 04:13:55.469939 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2187/4519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:54 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1671 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:55.711853 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1a1b90d7-1815-4d0b-a532-4d0b4ed6e34e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1413 microversion: 2.1 time: 0.283066 Nov 03 04:13:55.720636 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2333/4520] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:55 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1413 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:56.339490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:56.340297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:56.387326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:56.388263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:56.394078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:56.395206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:56.399111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:56.405169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:56.498581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:56.500497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:56.515223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:56.525277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:56.527945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:56.529750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:56.530443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:56.531072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:57.020546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:57.035929 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c0482ed-2157-432f-a66f-676ffeae389e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.542638 Nov 03 04:13:57.039032 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2334/4521] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:56 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:57.045644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b714242-d378-4232-913d-d47ba4fd023f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd597310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:57.073346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:57.083869 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c13951b-3aab-425e-8716-69b812aea061 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.749173 Nov 03 04:13:57.089388 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2188/4522] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:56 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:13:58.115298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:58.116073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:58.142433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:58.143480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:58.144515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:58.145534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:58.146215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:58.146979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:58.611314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:58.626041 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b8c07fc-9111-47d4-adbe-83bcb819e8e0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.515453 Nov 03 04:13:58.649620 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2189/4523] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:58 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:13:59.662677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:13:59.664474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:13:59.683492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:59.685344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:59.685992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:59.687038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:13:59.687747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:13:59.688353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:13:59.977062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:13:59.988534 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-640b32b4-8846-459f-9bb1-346373086c1c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.330645 Nov 03 04:13:59.989590 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2190/4524] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:13:59 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:00.701291 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b714242-d378-4232-913d-d47ba4fd023f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1422 microversion: 2.1 time: 3.661022 Nov 03 04:14:00.706936 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2335/4525] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:13:57 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1422 bytes in 3670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:00.722885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d4e4540-886e-4458-86ff-ad906f977779 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8451b80>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:00.802731 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0d4e4540-886e-4458-86ff-ad906f977779 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 200 len: 1422 microversion: 2.1 time: 0.084653 Nov 03 04:14:00.803569 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2191/4526] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:14:00 2022] GET /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:00.824914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-310ea765-e1df-44f5-8e42-8847ba9ec0a8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd5978b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:01.016023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:01.016914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:01.030239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:01.030858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:01.031319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:01.032046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:01.036997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:01.037637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:01.989814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:02.036948 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b6b1492a-bc4f-4290-8f0b-c869abd7e99f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 1.025004 Nov 03 04:14:02.037579 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2192/4527] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:01 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:03.075064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:03.076778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:03.097004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:03.097634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:03.098171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:03.098986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:03.104751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:03.106149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:03.332165 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-310ea765-e1df-44f5-8e42-8847ba9ec0a8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 204 len: 0 microversion: 2.1 time: 2.518420 Nov 03 04:14:03.334944 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2336/4528] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:00 2022] DELETE /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 0 bytes in 2520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:14:03.353077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:03.354698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:03.404026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:03.406265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:03.406740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:03.415652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:03.415652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:03.415652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:03.453809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:03.470357 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e2f3c8b-c932-49bc-a590-c9d8cdc41f6e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.406222 Nov 03 04:14:03.472024 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2193/4529] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:03 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:03.498487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:14:03.870274 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20caf9f4-ea2b-4bcd-a89b-7db4fbb75761 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 204 len: 0 microversion: 2.1 time: 0.532756 Nov 03 04:14:03.872738 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2337/4530] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:14:03 2022] DELETE /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:14:04.138067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2086958407", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "67e5b85f-4010-4f46-ba0a-653e66da87d8"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:04.247867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] validate_networks() for [('67e5b85f-4010-4f46-ba0a-653e66da87d8', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:14:04.499170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:04.500567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:04.517112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:04.518945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:04.519600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:04.526400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:04.526400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:04.526400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:05.112091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:05.126837 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-747899d7-260c-425e-9ef0-c4485e88174a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.633894 Nov 03 04:14:05.127859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2338/4531] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:04 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:05.233899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-16a85740-dbdf-4d80-8a27-f7bd46fc8fc7 req-c31d3f57-89da-4937-9468-68e8b61c793c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f664e16-567c-49fd-a90f-dc44a6bbb6f0", "name": "network-vif-unplugged", "status": "completed", "tag": "80ed2213-9abc-4dd8-b25d-d29a030cf123"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:05.260482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-16a85740-dbdf-4d80-8a27-f7bd46fc8fc7 req-c31d3f57-89da-4937-9468-68e8b61c793c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:05.263705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-16a85740-dbdf-4d80-8a27-f7bd46fc8fc7 req-c31d3f57-89da-4937-9468-68e8b61c793c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:05.264284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-16a85740-dbdf-4d80-8a27-f7bd46fc8fc7 req-c31d3f57-89da-4937-9468-68e8b61c793c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:05.288045 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-16a85740-dbdf-4d80-8a27-f7bd46fc8fc7 req-c31d3f57-89da-4937-9468-68e8b61c793c service nova] Creating event network-vif-unplugged:80ed2213-9abc-4dd8-b25d-d29a030cf123 for instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 on n-h1-854653-7 Nov 03 04:14:05.302729 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-16a85740-dbdf-4d80-8a27-f7bd46fc8fc7 req-c31d3f57-89da-4937-9468-68e8b61c793c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074161 Nov 03 04:14:05.304378 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2339/4532] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:14:05.917236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:14:05.917813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:14:05.918451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:14:05.919061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:14:05.919664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:14:05.933524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:05.934640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:05.935249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:05.936333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:05.937247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:05.937847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:05.964233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:14:05.973226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for user 324a1dfe0c4843bd917eb6ecd6cc2c4c and project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:14:05.992009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:14:05.996846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:14:06.134571 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed0498e1-b718-40cb-a7d7-509cb61fa348 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.000278 Nov 03 04:14:06.137595 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2194/4533] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:14:06.152526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-439c3cd9-5091-419c-bd93-45ed5aba0f4f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:06.154050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-439c3cd9-5091-419c-bd93-45ed5aba0f4f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:06.157943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:06.158859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:06.170505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:06.171310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:06.173429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:06.174541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:06.175277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:06.176265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:07.022673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-439c3cd9-5091-419c-bd93-45ed5aba0f4f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:07.056571 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-439c3cd9-5091-419c-bd93-45ed5aba0f4f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1208 microversion: 2.1 time: 0.911429 Nov 03 04:14:07.058759 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2340/4534] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:06 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1208 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:07.317830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:07.334650 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c5fc85c-58e3-4d89-9ff2-ef88c61c8f09 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 1.183529 Nov 03 04:14:07.335965 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2195/4535] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:06 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:08.097301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:08.100346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:08.124274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:08.125929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:08.131739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:08.131739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:08.131739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:08.133434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:08.260248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:08.299171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0cd4029a-b817-4f97-9e0d-a762de700f08 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1204 microversion: 2.1 time: 0.211547 Nov 03 04:14:08.301531 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2341/4536] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:08 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1204 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:08.362413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:08.371408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:08.372964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:08.373760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:08.374423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:08.375304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:08.376085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:08.376682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:08.739175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-04ea4102-7679-4707-9503-fb433a55021a req-aad57307-0349-46aa-8622-9e713132be14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f664e16-567c-49fd-a90f-dc44a6bbb6f0", "name": "network-vif-deleted", "tag": "80ed2213-9abc-4dd8-b25d-d29a030cf123"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:08.745862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:08.767808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1fa55da2-572b-4a8e-9820-25ce014a95b8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.410234 Nov 03 04:14:08.770054 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2196/4537] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:08 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:08.797322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-04ea4102-7679-4707-9503-fb433a55021a req-aad57307-0349-46aa-8622-9e713132be14 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:08.797322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-04ea4102-7679-4707-9503-fb433a55021a req-aad57307-0349-46aa-8622-9e713132be14 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:08.797322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-04ea4102-7679-4707-9503-fb433a55021a req-aad57307-0349-46aa-8622-9e713132be14 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:08.832228 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-04ea4102-7679-4707-9503-fb433a55021a req-aad57307-0349-46aa-8622-9e713132be14 service nova] Creating event network-vif-deleted:80ed2213-9abc-4dd8-b25d-d29a030cf123 for instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 on n-h1-854653-7 Nov 03 04:14:08.862009 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-04ea4102-7679-4707-9503-fb433a55021a req-aad57307-0349-46aa-8622-9e713132be14 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136688 Nov 03 04:14:08.863390 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2342/4538] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:14:09.333219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:09.334134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:09.347748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:09.348799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:09.349403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:09.354303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:09.355466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:09.356441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:09.531544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:09.560204 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e638c662-2662-40b0-ad6b-483852758790 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1260 microversion: 2.1 time: 0.232737 Nov 03 04:14:09.566455 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2197/4539] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:09 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:09.798447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:09.799197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:09.806512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:09.807347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:09.808848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:09.809192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:09.809582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:09.810251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:10.006750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:10.008979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-915ded32-e6c2-480c-b120-9c967d30f7dc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.217414 Nov 03 04:14:10.009985 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2343/4540] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:09 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:10.594259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:10.594259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:10.603815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:10.604539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:10.605071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:10.606001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:10.606663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:10.607499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:10.802961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Calling method '.version_select at 0x7ff7fd532b80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:10.805481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:10.806031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:10.806486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:10.821689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:10.840593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:10.841255 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-413a9300-7329-4216-a928-798d74920a31 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1266 microversion: 2.1 time: 0.255326 Nov 03 04:14:10.841949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:10.842083 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2198/4541] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:10 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:10.842744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:10.856063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:10.856868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:10.858328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:10.867757 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-979be845-347e-429e-ad25-23a270446d66 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285 tempest-PortsAdminExtendedAttrsIpV6TestJSON-882323285-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.269015 Nov 03 04:14:10.868830 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2344/4542] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:14:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:14:11.034264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:11.035306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:11.046072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:11.050543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:11.051552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:11.052950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:11.055563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:11.056129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:11.427784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:11.439676 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f899adc-4f04-4e33-b6cf-498606d804ba tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.409959 Nov 03 04:14:11.444969 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2199/4543] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:11 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:11.867800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:11.869111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:11.876706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:11.878565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:11.879263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:11.879884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:11.880766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:11.881486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:11.882083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:12.252145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:12.270805 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72c9cb00-6ccd-4520-bcba-66e27731a7c8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1266 microversion: 2.1 time: 0.400832 Nov 03 04:14:12.274662 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2345/4544] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:11 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1266 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:12.477472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:12.478377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:12.487463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:12.488376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:12.489091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:12.490533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:12.491245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:12.492130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:13.021710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:13.034497 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5929e085-6be6-4c93-8ef0-83c8eea8caed tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.568457 Nov 03 04:14:13.039460 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2200/4545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:12 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:13.297610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:13.298443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:13.318552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:13.319106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:13.319532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:13.321108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:13.329442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:13.329442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:13.916836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:13.927016 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7d52b7f-2abc-43fe-ad55-720ab7828bd4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.633386 Nov 03 04:14:13.929575 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2346/4546] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:13 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:14.067999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:14.068870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:14.090039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:14.090548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:14.091088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:14.091753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:14.092211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:14.092918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:14.314933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26791559-5795-4066-9b1b-9f84202db2cb tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'create', calling method: .version_select at 0x7ff7f85171f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-123228859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDliWh3Loep+Pbv988lrM2ydXFdz+yrmxr2xVSuhM5Rnjh0OIaoqs9cDpggJFYP3ql9yYusYmT3a8dXFrxApmfOt/Jm31AV8822Wo8DtdRjyMWAtbgz7Av7WAcWtLNtA3A=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:14.361120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-26791559-5795-4066-9b1b-9f84202db2cb tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:14:14.369841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-26791559-5795-4066-9b1b-9f84202db2cb tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for user a3c6e4b088224f33aa607e2a27ed798b and project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:14:14.477693 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-26791559-5795-4066-9b1b-9f84202db2cb tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.176876 Nov 03 04:14:14.478629 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2347/4547] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:14:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:14:14.493891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:14.509851 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-646b4e27-666c-42a9-82bc-d71d3f0437b6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.444633 Nov 03 04:14:14.512872 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2201/4548] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:14 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:14.952975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:14.953931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:14.964475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:14.967507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:14.969139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:14.972730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:14.973532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:14.974202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:15.359396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:15.377638 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-860e150e-cfc7-445f-8496-6ad5e5661b65 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.429475 Nov 03 04:14:15.379064 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2348/4549] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:14 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:15.536406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:15.538215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:15.560214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b3a9347f-7921-4ffa-b77b-5eaa30c89c3a req-b969c217-4ec7-43c2-9d3a-1efe36f76fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77f4b73-22b8-46b1-bd3d-a3d3f37d6358", "tag": "0b669029-a6d6-4789-80da-f6901f27e9f4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:15.561064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:15.563745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:15.564496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:15.565642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:15.567937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:15.569051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:15.584346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b3a9347f-7921-4ffa-b77b-5eaa30c89c3a req-b969c217-4ec7-43c2-9d3a-1efe36f76fcc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:15.587739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b3a9347f-7921-4ffa-b77b-5eaa30c89c3a req-b969c217-4ec7-43c2-9d3a-1efe36f76fcc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:15.588901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b3a9347f-7921-4ffa-b77b-5eaa30c89c3a req-b969c217-4ec7-43c2-9d3a-1efe36f76fcc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:15.644012 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b3a9347f-7921-4ffa-b77b-5eaa30c89c3a req-b969c217-4ec7-43c2-9d3a-1efe36f76fcc service nova] Creating event network-changed:0b669029-a6d6-4789-80da-f6901f27e9f4 for instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 on n-h2-854653-7 Nov 03 04:14:15.667244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b3a9347f-7921-4ffa-b77b-5eaa30c89c3a req-b969c217-4ec7-43c2-9d3a-1efe36f76fcc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109297 Nov 03 04:14:15.683371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2349/4550] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:14:15.960210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:16.001772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:16.412298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:16.413799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:16.427330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:16.428085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:16.428729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:16.429768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:16.430502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:16.431848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:16.513744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:16.519414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=89 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:16.534899 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83611eb6-0bdc-400b-b536-c5fe84cc13ae tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 1.004302 Nov 03 04:14:16.536769 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2202/4551] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:15 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:16.798192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:16.806872 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-add1140e-ba86-4cd5-b410-d851e8f9878f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.408496 Nov 03 04:14:16.807532 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2350/4552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:16 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:17.561182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:17.562527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:17.577756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:17.581039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:17.583993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:17.584655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:17.589439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:17.589439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:17.589439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:17.835275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:17.836535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:17.844580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:17.845285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:17.845897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:17.846794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:17.847427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:17.848022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:17.950531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:17.961508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff812e4e-9b3b-406f-8cfb-7a58fec046f5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.406262 Nov 03 04:14:17.965197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2203/4553] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:17 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:18.274777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:18.294975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8cec6f7-5f5f-41db-a486-ffcb47c46c53 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.463469 Nov 03 04:14:18.299850 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2351/4554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:17 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:19.011393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:19.016817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:19.034239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:19.037547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:19.038249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:19.039019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:19.039496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:19.039928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:19.335385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:19.335385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:19.347935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:19.351758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:19.351758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:19.351758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:19.351758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:19.351758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:19.577895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:19.604295 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85551853-a9db-4812-9c72-00bed6efd5a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1528 microversion: 2.1 time: 0.605531 Nov 03 04:14:19.604295 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2204/4555] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:18 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1528 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:19.799605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:19.818950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-621fc36b-63a6-49f7-be8c-f8f6523b3117 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.495295 Nov 03 04:14:19.826748 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2352/4556] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:19 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:20.625100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:20.627304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:20.647402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:20.648339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:20.659847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:20.661420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:20.667139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:20.667139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:20.843629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:20.844450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:20.852826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:20.854068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:20.855385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:20.856367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:20.858092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:20.858545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:20.879345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:21.182943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:21.196984 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6f86f3b-284c-45cd-b6cf-c68a63beddd2 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1510 microversion: 2.1 time: 0.579672 Nov 03 04:14:21.197912 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2205/4557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:20 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:21.424230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:21.433589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92f35010-ff81-4d6a-a0e1-277caef78e55 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.593796 Nov 03 04:14:21.434176 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2353/4558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:20 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:21.741560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-749350276", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "380a6480-a03c-408f-824c-db54ad5b3c61"}], "key_name": "tempest-TestNetworkBasicOps-123228859", "security_groups": [{"name": "tempest-secgroup-smoke-677213995"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:22.042262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] validate_networks() for [('380a6480-a03c-408f-824c-db54ad5b3c61', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:14:22.221656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:22.222630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:22.231664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:22.232265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:22.232803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:22.233617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:22.234147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:22.234914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:22.843105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:22.861970 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2405341b-3cd0-4527-89a8-cb20ab81e591 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1510 microversion: 2.1 time: 0.644531 Nov 03 04:14:22.862603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2354/4559] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:22 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1510 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:22.875660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:22.876944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:22.884525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:22.897335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:22.898044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:22.898913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:22.899686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:22.905338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:23.288660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:14:23.288660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:14:23.288660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:14:23.288660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:14:23.288660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:14:23.294225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:23.294814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:23.295325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:23.296349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:23.296880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:23.297444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:23.297952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:23.306140 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a2356a4-dbcf-4fb5-bae2-466c85a8d5fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.440444 Nov 03 04:14:23.309436 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2355/4560] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:22 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:23.315119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f3f7009d-2456-4d1e-ad2b-568a26fc0756 req-327f504b-9342-4423-b406-3d71593fb583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77f4b73-22b8-46b1-bd3d-a3d3f37d6358", "name": "network-vif-plugged", "status": "completed", "tag": "0b669029-a6d6-4789-80da-f6901f27e9f4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:23.318653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:14:23.329207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f3f7009d-2456-4d1e-ad2b-568a26fc0756 req-327f504b-9342-4423-b406-3d71593fb583 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:23.329803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f3f7009d-2456-4d1e-ad2b-568a26fc0756 req-327f504b-9342-4423-b406-3d71593fb583 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:23.332202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f3f7009d-2456-4d1e-ad2b-568a26fc0756 req-327f504b-9342-4423-b406-3d71593fb583 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:23.342747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for user a3c6e4b088224f33aa607e2a27ed798b and project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:14:23.343490 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f3f7009d-2456-4d1e-ad2b-568a26fc0756 req-327f504b-9342-4423-b406-3d71593fb583 service nova] Creating event network-vif-plugged:0b669029-a6d6-4789-80da-f6901f27e9f4 for instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 on n-h2-854653-7 Nov 03 04:14:23.348613 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f3f7009d-2456-4d1e-ad2b-568a26fc0756 req-327f504b-9342-4423-b406-3d71593fb583 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037370 Nov 03 04:14:23.349816 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2356/4561] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:14:23.368574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:14:23.672427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:14:23.724350 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f658e50-e120-4bd4-a958-a1241792fcc9 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.987619 Nov 03 04:14:23.733169 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2206/4562] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:14:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:14:23.739870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e74d787-006a-4a34-a7ce-56a8b4fab7c7 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:23.743561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e74d787-006a-4a34-a7ce-56a8b4fab7c7 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:23.883191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e74d787-006a-4a34-a7ce-56a8b4fab7c7 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:23.883191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e74d787-006a-4a34-a7ce-56a8b4fab7c7 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1247 microversion: 2.1 time: 0.117174 Nov 03 04:14:23.883191 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2357/4563] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:23 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1247 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:23.890389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:23.891083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:23.900592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:23.901194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:23.901606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:23.902505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:23.903027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:23.903465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:24.147733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:24.156264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a44c40f-0664-4ad8-b5c8-83d23df10467 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1510 microversion: 2.1 time: 0.269932 Nov 03 04:14:24.157691 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2207/4564] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:23 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:24.334342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:24.334342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:24.345917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:24.346422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:24.346876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:24.347610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:24.348081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:24.348517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:24.711551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:24.723378 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-26ef9efa-3558-4d52-84ce-866f05802673 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1308 microversion: 2.1 time: 0.395344 Nov 03 04:14:24.723978 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2358/4565] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:24 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:24.878143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43556dce-bd33-45b4-ba0a-1012d754666c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:24.878767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43556dce-bd33-45b4-ba0a-1012d754666c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:24.990804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-43556dce-bd33-45b4-ba0a-1012d754666c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:25.000339 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43556dce-bd33-45b4-ba0a-1012d754666c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1247 microversion: 2.1 time: 0.126333 Nov 03 04:14:25.006404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2208/4566] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:24 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1247 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:25.183478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:25.184230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:25.190626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.191118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.191557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.192264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.192718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.193188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.352163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:25.370236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0e147b13-ffe7-44b4-80ac-5205c64dc39e req-32738ce6-6287-403f-acb4-47006cf4ecca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5654b4-009d-4bff-b1f3-d835ea94a615", "name": "network-vif-unplugged", "status": "completed", "tag": "eda54677-27f1-4356-ba50-c78608583439"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:25.391243 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab142bfb-baac-405e-b975-012c11c275f1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1453 microversion: 2.1 time: 0.211579 Nov 03 04:14:25.393276 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2359/4567] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:25 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:25.395689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0e147b13-ffe7-44b4-80ac-5205c64dc39e req-32738ce6-6287-403f-acb4-47006cf4ecca service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.403388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0e147b13-ffe7-44b4-80ac-5205c64dc39e req-32738ce6-6287-403f-acb4-47006cf4ecca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.404206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0e147b13-ffe7-44b4-80ac-5205c64dc39e req-32738ce6-6287-403f-acb4-47006cf4ecca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.420998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:25.422234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:25.427997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_external_events [req-0e147b13-ffe7-44b4-80ac-5205c64dc39e req-32738ce6-6287-403f-acb4-47006cf4ecca service nova] Unable to find a host for instance 5d5654b4-009d-4bff-b1f3-d835ea94a615. Dropping event network-vif-unplugged {{(pid=127593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 03 04:14:25.430119 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0e147b13-ffe7-44b4-80ac-5205c64dc39e req-32738ce6-6287-403f-acb4-47006cf4ecca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.065612 Nov 03 04:14:25.431196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.431929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.432702 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2209/4568] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 03 04:14:25.435832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.436586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.438405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.438872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.613779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:25.629671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1aa28f22-b7e4-4892-9955-d8a9c7d88048 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1453 microversion: 2.1 time: 0.214818 Nov 03 04:14:25.630813 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2360/4569] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:25 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:25.707039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:25.709377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:25.730661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.731162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.740598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.748512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.750225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.754033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:25.754953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:25.756827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.770822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.771654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.774711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.775652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.776371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.777540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.814551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lazy-loading 'flavor' on Instance uuid 5d5654b4-009d-4bff-b1f3-d835ea94a615 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:14:25.854627 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Cannot 'shelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state shelved_offloaded Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action HTTP/1.1 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 14 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: {"shelve": {}} Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'shelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state shelved_offloaded Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'shelve': {}}} Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:14:25.856469 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state shelved_offloaded Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state shelved_offloaded Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 409 to user: Cannot 'shelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state shelved_offloaded {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:14:25.865535 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2892ce85-fac5-4375-a012-76ee156f6d04 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 409 len: 155 microversion: 2.1 time: 0.161550 Nov 03 04:14:25.871323 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2210/4570] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:14:25 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 155 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:14:25.883361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:25.886918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:25.898945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.899771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.900409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:25.901397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:25.902197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:25.902822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.000589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127593) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 03 04:14:26.067158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:26.076055 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b37d1535-8200-44f0-a3cc-2ee383445248 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1488 microversion: 2.1 time: 0.327253 Nov 03 04:14:26.076706 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2361/4571] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:25 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1488 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:26.082441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:26.082695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:26.089639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:26.090168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:26.090614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.091379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:26.092018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:26.092642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.167841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:26.178850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85c5cdc7-39a3-45d3-8ca2-64fbb2bdee6a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1299 microversion: 2.1 time: 0.100646 Nov 03 04:14:26.196709 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2362/4572] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:26 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:26.210264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1279c3ae-ed38-40d0-aa58-a7ca31dab8a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:26.218639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1279c3ae-ed38-40d0-aa58-a7ca31dab8a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:26.222003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1279c3ae-ed38-40d0-aa58-a7ca31dab8a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:26.222003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1279c3ae-ed38-40d0-aa58-a7ca31dab8a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.268350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1279c3ae-ed38-40d0-aa58-a7ca31dab8a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Going to try to stop instance {{(pid=127594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:14:26.465811 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c9de7aaa-fe90-4b46-a2a1-0e127880bb5a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 202 len: 0 microversion: 2.1 time: 0.592634 Nov 03 04:14:26.468509 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2211/4573] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:14:25 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:14:26.492986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:26.494104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:26.506089 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1279c3ae-ed38-40d0-aa58-a7ca31dab8a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358/action" status: 202 len: 0 microversion: 2.1 time: 0.301964 Nov 03 04:14:26.510210 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2363/4574] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:14:26 2022] POST /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:14:26.511861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:26.513205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:26.524756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.525892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:26.528254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:26.528996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.561727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:26.561727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:26.586305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:26.589676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:26.590025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.590758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:26.591235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:26.591718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:26.779432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:26.788443 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a252145c-3ba3-4622-844b-ff7d3d05c7a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1461 microversion: 2.1 time: 0.314294 Nov 03 04:14:26.789677 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2212/4575] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:26 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1461 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:26.907596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:26.919465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33f8ec43-c67b-41c6-a338-b7b6c57ff021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.407320 Nov 03 04:14:26.920272 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2364/4576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:26 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:27.216125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:27.216997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:27.226513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:27.228085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:27.228677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:27.231568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:27.232529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:27.233416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:27.400143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:27.420828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d0c2fc4b-baa8-4859-b88c-10fbf93e58b1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1317 microversion: 2.1 time: 0.209702 Nov 03 04:14:27.422539 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2213/4577] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:27 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:27.813445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:27.814165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:27.832540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:27.833203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:27.833718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:27.834540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:27.837553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:27.840674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:27.943182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:27.945256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:27.956345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:27.957490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:27.959769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:27.960519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:27.961000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:27.968673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:28.375667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:28.383523 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7279b353-5e33-4e47-9fc1-2489d79a7f46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1461 microversion: 2.1 time: 0.574233 Nov 03 04:14:28.397358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:28.397826 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2365/4578] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:27 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1461 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:28.404575 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5477c4a6-75bb-4fa9-b6ad-06cc90b2e2fb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.465163 Nov 03 04:14:28.406108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2214/4579] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:27 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:28.451941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:28.451941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:28.455486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:28.465822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:28.466627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:28.467374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:28.467832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:28.468253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:28.575277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:28.587473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc589934-b3f6-4ec6-a103-e38501a20cdf tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1305 microversion: 2.1 time: 0.145792 Nov 03 04:14:28.589367 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2366/4580] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:28 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:29.422975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:29.432865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:29.433053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:29.433053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:29.438364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:29.440838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:29.442842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:29.443723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:29.444170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:29.444705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:29.444844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:29.445239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:29.445805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:29.456586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:29.459962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:29.459962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:30.117366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:30.126391 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f247fc19-ac7b-4242-86f1-900bbc50432d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.702936 Nov 03 04:14:30.134254 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2367/4581] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:29 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:30.154859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:30.155699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:30.175227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:30.175735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:30.176190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:30.177693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:30.178702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:30.179153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:30.403590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:30.421610 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4bced493-ea15-4661-ac81-cc4da6a6cea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 1.013330 Nov 03 04:14:30.422405 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2215/4582] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:29 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:30.664347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:30.675053 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73904723-f10d-4ca3-b9f1-a05ce6ff3061 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.538310 Nov 03 04:14:30.675950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2368/4583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:30 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:31.168216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:31.175017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:31.191195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:31.191890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:31.192509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:31.207496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:31.208089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:31.214031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:31.457775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:31.458716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:31.467719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:31.468931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:31.469446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:31.470684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:31.471167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:31.471798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:31.858603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:31.873512 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4cc6fbe6-5837-4b4a-9a59-312731f8cd88 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.709366 Nov 03 04:14:31.888451 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2216/4584] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:31 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:31.902295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:31.903274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:31.913551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:31.913551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:31.913551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:31.913551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:31.913551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:31.913551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:32.424994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:32.443512 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb462b04-9944-4ed9-8e4e-b3db55299aef tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.990482 Nov 03 04:14:32.444923 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2369/4585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:31 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:32.595502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:32.614218 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ab62d7d-1fab-4dcf-af7f-04df6f4ba2f5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.723893 Nov 03 04:14:32.616202 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2217/4586] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:31 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:32.800261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-48285581-9a7f-4b8e-aa28-87fc3e11412d req-f180d21e-2b6d-47b4-9b74-c32517343521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396aba47-cab1-42b8-aeea-1a43bbe07bdc", "tag": "abe289e3-c4a7-42ea-9cb1-5f38f2c9b971"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:32.812782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48285581-9a7f-4b8e-aa28-87fc3e11412d req-f180d21e-2b6d-47b4-9b74-c32517343521 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:32.813587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48285581-9a7f-4b8e-aa28-87fc3e11412d req-f180d21e-2b6d-47b4-9b74-c32517343521 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:32.813979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48285581-9a7f-4b8e-aa28-87fc3e11412d req-f180d21e-2b6d-47b4-9b74-c32517343521 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:32.826004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-48285581-9a7f-4b8e-aa28-87fc3e11412d req-f180d21e-2b6d-47b4-9b74-c32517343521 service nova] Creating event network-changed:abe289e3-c4a7-42ea-9cb1-5f38f2c9b971 for instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc on n-h1-854653-7 Nov 03 04:14:32.831011 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-48285581-9a7f-4b8e-aa28-87fc3e11412d req-f180d21e-2b6d-47b4-9b74-c32517343521 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035261 Nov 03 04:14:32.832222 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2370/4587] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:14:32.908564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:32.909602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:32.917995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:32.918565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:32.919076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:32.920167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:32.920817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:32.922650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:33.306656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:33.470298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:33.471013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:33.483140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:33.485971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:33.489689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:33.489689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:33.489689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:33.489689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:33.528507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:33.807736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:33.819229 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b4389bb-26b9-4704-a108-20ab2e3f2332 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.914847 Nov 03 04:14:33.845370 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2218/4588] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:32 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:33.850766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:33.853069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:33.856027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:33.877498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:33.878481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:33.883374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:33.884644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:33.887480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:33.892519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:34.537588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:34.586256 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f931217-7b36-4e0d-98f8-594b900d3f19 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 1.121178 Nov 03 04:14:34.597788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2371/4589] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:33 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:34.707532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:34.724989 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-867397d5-4a81-4ded-af8b-f82768cd6820 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.877374 Nov 03 04:14:34.729197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2219/4590] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:33 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:34.851746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:34.852380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:34.886069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:34.887078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:34.887878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:34.890159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:34.892924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:34.893735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:35.264273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:35.291765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28478668-e0a9-4ee8-bb5c-718d8ed3b3eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.432397 Nov 03 04:14:35.309038 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2372/4591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:34 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:35.634761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:35.636582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:35.639401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:35.648297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:35.649735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:35.673761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:35.674613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:35.679911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:35.680369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:35.761222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:35.761854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:35.776599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:35.781498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:35.783090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:35.783927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:35.784417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:35.789313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:36.671400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:36.673722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:36.684111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:36.707865 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e7c6672-a373-4b74-9b95-4572cf96f6be tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.953567 Nov 03 04:14:36.708921 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2373/4592] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:35 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:36.720192 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e95de234-6cbe-401d-8772-0d102a3e0126 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 1.096912 Nov 03 04:14:36.728375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:36.729837 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2220/4593] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:35 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:36.737211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:36.757746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:36.758517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:36.763087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:36.765439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:36.772049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:36.772775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:37.637284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:37.659030 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c111556a-3a45-40aa-8494-f904afd85d3b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.936207 Nov 03 04:14:37.659655 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2374/4594] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:36 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:37.741957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:37.743774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:37.762182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:37.765844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:37.769606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:37.770937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:37.771777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:37.772391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:37.939717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1145936444", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "7acae962-25a6-439e-baa0-a7ea8c1ce2c9"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:38.007296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] validate_networks() for [('7acae962-25a6-439e-baa0-a7ea8c1ce2c9', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:14:38.351437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:38.366088 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72e6242c-138e-4125-baef-8f61bbec3f13 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.627676 Nov 03 04:14:38.368413 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2375/4595] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:37 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:38.379190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:38.380159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:38.395447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:38.397383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:38.397903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:38.400459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:38.400945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:38.403421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:38.703798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:38.713113 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-94b05b4e-eacf-45cc-95fd-b256c40e5e38 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.342256 Nov 03 04:14:38.741173 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2376/4596] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:38 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:38.747684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:38.748500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:38.754961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:38.755896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:38.756731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:38.757701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:38.758353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:38.758954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:39.086275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:39.100196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-071c05a1-952a-4610-ae46-4d5d0788668e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.357504 Nov 03 04:14:39.101387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2377/4597] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:38 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:39.377760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:14:39.378984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:14:39.379840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:14:39.380421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:14:39.381088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:14:39.396640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:39.397548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:39.406383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:39.409693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:39.410358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:39.411293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:39.411796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:39.412582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:39.413047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:39.413795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:39.414238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:39.416689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:39.417095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:39.417271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:39.474969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Getting quotas for project b201c36deaa948b7a3f24424163a52d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:14:39.482074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Getting quotas for user 46a45724be7940dfb595b9db8e828e41 and project b201c36deaa948b7a3f24424163a52d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:14:39.498788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:14:39.504131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:14:39.715069 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8882b4a9-44c6-450d-b2e4-db18edd68927 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.019006 Nov 03 04:14:39.722004 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2221/4598] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:14:39.727611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15b0649a-cf31-402a-bcd8-0017d1371dbe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:39.729633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15b0649a-cf31-402a-bcd8-0017d1371dbe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:39.802160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:39.825257 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7fadbbf8-12af-4278-a726-b85079e2dbf6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.433210 Nov 03 04:14:39.833626 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2378/4599] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:39 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:39.839460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:39.840142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:39.871675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:39.872582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:39.877441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:39.877441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:39.877441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:39.877441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:39.896345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-15b0649a-cf31-402a-bcd8-0017d1371dbe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:39.907032 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15b0649a-cf31-402a-bcd8-0017d1371dbe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1218 microversion: 2.1 time: 0.180672 Nov 03 04:14:39.913737 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2222/4600] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:39 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1218 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:40.131683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:40.132941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:40.145782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:40.146763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:40.148612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:40.149855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:40.151737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:40.152730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:40.390470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:40.420133 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9491edbc-7f82-4b1d-b358-061d85fe1cc6 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.584162 Nov 03 04:14:40.424578 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2379/4601] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:39 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:40.638915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:40.651330 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2412bf90-59cc-4863-b4d1-a71a059c2e44 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.522149 Nov 03 04:14:40.652544 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2223/4602] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:40 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:40.862440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:40.863387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:40.886522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:40.890911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:40.894682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:40.898508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:40.899404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:40.901312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:40.942937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-16ee3892-873c-4343-aa33-18620a7b53a0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:40.945843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-16ee3892-873c-4343-aa33-18620a7b53a0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:41.069084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-16ee3892-873c-4343-aa33-18620a7b53a0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:41.086968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-16ee3892-873c-4343-aa33-18620a7b53a0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1218 microversion: 2.1 time: 0.149256 Nov 03 04:14:41.109863 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2224/4603] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:40 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:41.452413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:41.453072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:41.468289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:41.468809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:41.469308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:41.470039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:41.470488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:41.470923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:41.876326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:41.899014 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bceed372-a873-4c42-bb6a-845370ccb7b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 1.039681 Nov 03 04:14:41.932389 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2380/4604] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:40 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:41.952053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:41.952842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:41.965788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:41.966294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:41.968404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:41.968404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:41.968404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:41.968404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:42.110380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:42.134421 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f1cc165-eda0-4dbf-ba55-79425780d6cc tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.688944 Nov 03 04:14:42.158123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2225/4605] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:41 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:42.172069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:42.173146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:42.211032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:42.211901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:42.213848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:42.215042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:42.224082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:42.227057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:42.798103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:42.808768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-98f4a112-c8a5-43c7-a5aa-5e1b90169896 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1222 microversion: 2.1 time: 0.647824 Nov 03 04:14:42.831764 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2226/4606] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:42 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1222 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:42.930379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:42.930995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:42.937292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:42.937791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:42.938240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:42.938953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:42.939418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:42.939851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:43.274851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:43.308397 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b67428b-76f2-4723-9ed4-e9a0a85a4c48 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 1.364474 Nov 03 04:14:43.309058 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2381/4607] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:41 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:43.317546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:43.325829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:43.331372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:43.333090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:43.333812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:43.360772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:43.361944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:43.362444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:43.362894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:43.586524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:43.601378 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b576b38-409e-413d-9b6b-223a2bc5b490 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.674692 Nov 03 04:14:43.602601 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2227/4608] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:42 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:43.858470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:43.860628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:43.881221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:43.882081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:43.890591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:43.891868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:43.892587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:43.893320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:43.940053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:43.953901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e5b06dc-5254-4a05-8435-0f871203f23f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.640038 Nov 03 04:14:43.962354 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2382/4609] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:43 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:44.094550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:44.104240 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3a9e841-1580-4404-baa4-1a4791792040 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1270 microversion: 2.1 time: 0.251488 Nov 03 04:14:44.115287 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2228/4610] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:43 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1270 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:44.341909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:44.343285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:44.358350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:44.360907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:44.361833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:44.363763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:44.365889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:44.366869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:44.635663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:44.637297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:44.649817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:44.652605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:44.654831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:44.671942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:44.673240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:44.676782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:45.504851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:45.521320 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-86c322c7-8d22-415c-aa2c-5fd299022826 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.891358 Nov 03 04:14:45.523964 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2229/4611] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:44 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:45.536459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:45.537959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:45.546849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:45.557281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:45.558705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:45.561465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:45.583499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:45.583499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:45.583499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:45.583986 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fcc2c2bc-6123-4083-80a6-191a5b12d5ac tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 1.235928 Nov 03 04:14:45.583986 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2383/4612] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:44 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:45.583986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c034120e-a749-409c-9ed7-c395e830a692 req-d6c9e1a5-cfb2-4e68-ae01-a90463b27516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396aba47-cab1-42b8-aeea-1a43bbe07bdc", "name": "network-vif-plugged", "status": "completed", "tag": "abe289e3-c4a7-42ea-9cb1-5f38f2c9b971"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:45.674476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c034120e-a749-409c-9ed7-c395e830a692 req-d6c9e1a5-cfb2-4e68-ae01-a90463b27516 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:45.676605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c034120e-a749-409c-9ed7-c395e830a692 req-d6c9e1a5-cfb2-4e68-ae01-a90463b27516 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:45.679587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c034120e-a749-409c-9ed7-c395e830a692 req-d6c9e1a5-cfb2-4e68-ae01-a90463b27516 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:45.701796 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c034120e-a749-409c-9ed7-c395e830a692 req-d6c9e1a5-cfb2-4e68-ae01-a90463b27516 service nova] Creating event network-vif-plugged:abe289e3-c4a7-42ea-9cb1-5f38f2c9b971 for instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc on n-h1-854653-7 Nov 03 04:14:45.711239 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c034120e-a749-409c-9ed7-c395e830a692 req-d6c9e1a5-cfb2-4e68-ae01-a90463b27516 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138055 Nov 03 04:14:45.713511 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2384/4613] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:14:45.719855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:45.720927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:45.730620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:45.731191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:45.732172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:45.739426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:45.740401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:45.742267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:45.974126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:46.001235 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0f0d2ef-c396-4f2f-89ce-897e5990f49c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1276 microversion: 2.1 time: 0.284418 Nov 03 04:14:46.006398 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2385/4614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:45 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:46.158373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:46.169420 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ab74b8f6-231d-4920-8b44-383826e45227 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.643382 Nov 03 04:14:46.174185 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2230/4615] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:45 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:46.556673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:46.556673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:46.564555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:46.565345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:46.570470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:46.571491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:46.572823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:46.573500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:46.606553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:46.607159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:46.617889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:46.622955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:46.623678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:46.624456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:46.624944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:46.637688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:47.382872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:47.392132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:47.392674 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73fff422-ddc2-4c4f-becd-b45a12654da3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.843816 Nov 03 04:14:47.418068 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b2362de-cafe-4582-9858-bcbdf66b0b50 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.804365 Nov 03 04:14:47.418068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2231/4617] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:46 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:47.418068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:47.418327 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2386/4617] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:46 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:47.418418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:47.419757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:47.420586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:47.430084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:47.430848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:47.432630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:47.433579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:47.438134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:47.438784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:47.439664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:47.456251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:47.457293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:47.457293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:47.459275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:47.461696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:47.462380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:48.601063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:48.604051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:48.615016 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c90507b-c85b-444f-8aaa-33402d4e6b47 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 1.204803 Nov 03 04:14:48.616089 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2232/4618] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:47 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:48.630110 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f5db75c-9771-4329-addc-e32f7d8c515c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 1.201315 Nov 03 04:14:48.630110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2387/4619] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:47 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:48.630110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:48.630110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:48.648561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:48.652389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:48.652977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:48.653580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:48.654673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:48.655645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:48.656316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:48.656926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:48.671996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:48.672518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:48.673748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:48.674838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:48.675478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:48.675942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:48.990589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:48.990589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:48.994276 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58373f4c-bbb6-46b4-ad9e-56bbbd4817da tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1372 microversion: 2.1 time: 0.367668 Nov 03 04:14:49.013907 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2388/4620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:48 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1372 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:49.080309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:49.090231 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e780963-6369-4070-b216-84b00dc3ed13 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.458053 Nov 03 04:14:49.090866 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2233/4621] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:48 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:49.673327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:49.674882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:49.676063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:49.678799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:49.686745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:49.705217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:49.705217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:49.705217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:49.705217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:49.705217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:49.705217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:49.705860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:49.707742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:49.709810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:49.713561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:49.717731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:49.718431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:50.188622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:50.218110 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d3440754-0dd3-4e53-8f50-944b79f5a22b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.555356 Nov 03 04:14:50.218283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2389/4622] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:49 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:50.218415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:50.239980 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f67ddab-4ee5-4986-a714-5ee7e695528e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.585666 Nov 03 04:14:50.247439 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2234/4623] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:49 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:50.247439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:50.248132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:50.265366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:50.266131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:50.267124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:50.267856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:50.268480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:50.268867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:50.698362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:50.708627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-086f43bf-b318-432c-96e8-7d99fda356b5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1544 microversion: 2.1 time: 0.506690 Nov 03 04:14:50.716832 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2390/4624] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:50 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1544 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:50.722955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:50.732012 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a4757e42-84a0-4291-9612-bbcfdd70a16e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.489670 Nov 03 04:14:50.745858 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2235/4625] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:50 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:50.750132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:50.762504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:50.762504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:50.762504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:50.762504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:50.762504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:50.762504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:50.762504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:50.966113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:50.974046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-38e9e63c-2166-43d6-b05c-6fcef6e54aa0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1544 microversion: 2.1 time: 0.235034 Nov 03 04:14:50.975272 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2391/4626] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:50 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1544 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:51.232368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:51.233184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:51.240046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:51.242008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:51.242678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:51.243346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:51.244259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:51.244886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:51.245513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:51.272871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:51.275828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:51.290320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:51.291390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:51.291841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:51.309204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:51.309711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:51.310163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:51.573091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:51.575248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:51.584329 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a2fce7e-1fd4-4786-8a1c-b46cecc556ba tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.356563 Nov 03 04:14:51.585593 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2236/4627] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:51 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:51.587088 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13a5958d-203a-4543-9dca-4924d4dd198f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.317283 Nov 03 04:14:51.587721 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2392/4628] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:51 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:51.644418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-432837b7-196f-4c5a-8900-d3dcd88fdfe0 req-588b46eb-4fa8-40a7-91c0-991dcba2ef56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6870a06-4391-4f7f-9730-ad8fe574d8d8", "tag": "946eb81a-7db6-4a2f-98c9-978e60c65b98"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:51.657382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-432837b7-196f-4c5a-8900-d3dcd88fdfe0 req-588b46eb-4fa8-40a7-91c0-991dcba2ef56 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:51.660715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-432837b7-196f-4c5a-8900-d3dcd88fdfe0 req-588b46eb-4fa8-40a7-91c0-991dcba2ef56 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:51.660715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-432837b7-196f-4c5a-8900-d3dcd88fdfe0 req-588b46eb-4fa8-40a7-91c0-991dcba2ef56 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:51.680298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-432837b7-196f-4c5a-8900-d3dcd88fdfe0 req-588b46eb-4fa8-40a7-91c0-991dcba2ef56 service nova] Creating event network-changed:946eb81a-7db6-4a2f-98c9-978e60c65b98 for instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 on n-h1-854653-7 Nov 03 04:14:51.690501 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-432837b7-196f-4c5a-8900-d3dcd88fdfe0 req-588b46eb-4fa8-40a7-91c0-991dcba2ef56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055118 Nov 03 04:14:51.692092 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2237/4629] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:14:51.760458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:51.761298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:51.770672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:51.771680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:51.772375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:51.773335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:51.774022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:51.774677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:52.023919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:52.036358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-70728308-d449-4ff7-9eda-3fab4235454c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1498 microversion: 2.1 time: 0.281290 Nov 03 04:14:52.037735 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2393/4630] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:51 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1498 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:52.614662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:52.616097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:52.620731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:52.621376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:52.628013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:52.628556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:52.629008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:52.629742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:52.630202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:52.630939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:52.632437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:52.632937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:52.633410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:52.648419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:52.651569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:52.654950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:53.006245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:53.021608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c80c2c7-c68a-40a1-9293-1db7c3d5fe26 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.411376 Nov 03 04:14:53.026367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:53.033220 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2238/4631] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:52 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:53.045904 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5c532be-199f-44c8-9c9e-60f0d3fac534 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.430206 Nov 03 04:14:53.046942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2394/4632] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:52 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:53.069741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:53.071149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:53.078230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:53.078804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:53.079270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:53.080041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:53.081698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:53.082151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:53.250059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:53.258556 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-569a0fcf-48cf-4a52-8dbf-c274a9ddfb67 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 200 len: 1475 microversion: 2.1 time: 0.196600 Nov 03 04:14:53.259684 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2239/4633] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:53 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 1475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:53.282443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-861461972"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:14:53.285149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:53.291118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:53.291601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:53.292030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:53.292904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:53.293391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:53.293813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:53.865880 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ba60ae2d-c7f6-424f-9675-7779eec86ac4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358/action" status: 202 len: 0 microversion: 2.1 time: 0.583001 Nov 03 04:14:53.866900 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2395/4634] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:14:53 2022] POST /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:14:53.887959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70b5f0f2-0be2-415e-99f1-89a1c7d54847 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f89a9ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:53.955550 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70b5f0f2-0be2-415e-99f1-89a1c7d54847 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.076077 Nov 03 04:14:53.963649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2240/4635] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:14:53 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:54.051450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:54.052801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:54.070195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:54.071270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:54.079687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:54.081648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:54.083663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:54.086034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:54.088059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:54.093382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:54.093382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:54.093866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:54.093866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:54.101543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:54.106522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:54.107241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:54.868949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:54.873267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:14:54.881993 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c77f2a12-29a1-4baa-9436-5874801463fe tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.815561 Nov 03 04:14:54.884779 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2241/4636] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:54 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:14:54.922624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:54.941059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-655356e9-dafa-4d30-b755-db06de049255 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.896287 Nov 03 04:14:54.942249 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2396/4637] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:54 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:54.977984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b98744f-7870-4a5e-adda-32eeee8e72a5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f89a9280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:55.039622 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b98744f-7870-4a5e-adda-32eeee8e72a5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.065428 Nov 03 04:14:55.041632 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2242/4638] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:14:54 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:55.908440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:55.910001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:55.920289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:55.920988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:55.921939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:55.922658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:55.923311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:55.924038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:55.966491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:55.967614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:55.975251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:55.976030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:55.976638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:55.977785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:55.979061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:55.980127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:56.282500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:56.296691 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cdd81a9c-b35e-4be0-bc12-7fbde22e5001 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.334038 Nov 03 04:14:56.297701 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2243/4639] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:55 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:56.318332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:56.330206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-323c5072-0f9f-4b42-bc6a-e222dbaaf861 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.426182 Nov 03 04:14:56.331374 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2397/4640] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:55 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:56.334518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d39c9ef-7351-4c22-b9fc-c74c1a468a27 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8432700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:56.436158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d39c9ef-7351-4c22-b9fc-c74c1a468a27 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.104172 Nov 03 04:14:56.436158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2244/4641] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:14:56 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:57.325825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:57.327135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:57.334490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:57.335255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:57.335875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:57.336772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:57.337803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:57.338431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:57.356703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:57.357900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:57.378465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:57.382821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:57.383530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:57.384512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:57.385286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:57.385990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:57.628993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:57.643673 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30a2d549-070e-47de-b309-c8377a93a92b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.321569 Nov 03 04:14:57.667574 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2398/4642] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:57 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:57.686586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-115b180d-b8a5-4106-8c1a-039c70fdf52c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8510d30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:57.760318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:57.782346 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-431c3e1a-1c31-4655-bf9e-9247733b0b9c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.431454 Nov 03 04:14:57.797040 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2245/4643] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:57 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:57.797249 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-115b180d-b8a5-4106-8c1a-039c70fdf52c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.114981 Nov 03 04:14:57.797249 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2399/4644] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:14:57 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:58.684052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:58.688050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:58.699757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:58.704945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:58.705739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:58.706706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:58.707452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:58.708492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:58.806929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05119b47-9c44-44ac-abe0-7f5be094b4bf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84ddd30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:58.919142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05119b47-9c44-44ac-abe0-7f5be094b4bf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.114457 Nov 03 04:14:58.922963 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2400/4645] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:14:58 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:58.947420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:14:58.950696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:14:58.967745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:58.971165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:58.975199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:58.976552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:14:58.977315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:14:58.979098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:14:59.264509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:59.282085 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-057e2fe5-74bd-4c3e-b90e-198fa5133182 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.608917 Nov 03 04:14:59.285472 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2246/4646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:58 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:59.453305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:14:59.467060 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9aee8c20-bf0c-495a-808b-47a73efd7f5f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.539619 Nov 03 04:14:59.467684 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2401/4647] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:14:58 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:14:59.948223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-021d6e47-8f83-4c06-94d6-08cf7f18cc70 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8b97310>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:00.024256 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-021d6e47-8f83-4c06-94d6-08cf7f18cc70 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.091590 Nov 03 04:15:00.026780 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2247/4648] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:14:59 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:00.277324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:00.279295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:00.293764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:00.300588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:00.305356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:00.305356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:00.305356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:00.306297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:00.312382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:00.313541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:00.340561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:00.342188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:00.345292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:00.346414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:00.349822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:00.350535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:01.000015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:01.022412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15c16ceb-4ae9-48d7-9dc7-d4b9b8d8af2b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.746500 Nov 03 04:15:01.026484 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2402/4649] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:00 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:01.035453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:01.037535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:01.053386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:01.054548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:01.055232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:01.056234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:01.057136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:01.058918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:01.103514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:01.118707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d64dd3a4-c4cb-4b1f-8482-7494aaa111f6 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.810171 Nov 03 04:15:01.128688 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2248/4650] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:00 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:01.140529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6de1e33e-c232-4dbc-bae9-3b067c3c5551 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8442e50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:01.233980 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6de1e33e-c232-4dbc-bae9-3b067c3c5551 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.103793 Nov 03 04:15:01.236418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2249/4651] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:01 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:01.248143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:01.249598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:01.264713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:01.267974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:01.269190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:01.272289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:01.273194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:01.278110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:01.450671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:01.460240 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d012b82c-edd6-411a-9ee5-c62f2357a072 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.432380 Nov 03 04:15:01.460851 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2403/4652] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:01 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:01.716131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:01.733944 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ab282351-ead8-4269-8e30-ca125816bd4d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.496000 Nov 03 04:15:01.740006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2250/4653] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:01 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:01.770488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:01.771251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:01.802703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:01.806347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:01.807000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:01.808798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:01.809761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:01.812445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:02.170162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:02.173592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:02.190784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:02.195653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:02.196655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:02.197703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:02.199335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:02.201526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:02.391159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:02.418679 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f52fbea7-2841-46d6-a8c9-0de8c2690ab9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.652537 Nov 03 04:15:02.421887 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2404/4654] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:01 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:02.429628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-74d0b569-bff9-45fd-8891-73579d6eea58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84c7670>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:02.542582 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-74d0b569-bff9-45fd-8891-73579d6eea58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.119334 Nov 03 04:15:02.544281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2405/4655] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:02 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:02.550379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f02deba4-ffe1-4426-a8a9-f4e81cdfe4ce req-14d0882a-78c1-46d1-aebb-c03200a10d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77f4b73-22b8-46b1-bd3d-a3d3f37d6358", "name": "network-vif-plugged", "status": "completed", "tag": "0b669029-a6d6-4789-80da-f6901f27e9f4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:02.584861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f02deba4-ffe1-4426-a8a9-f4e81cdfe4ce req-14d0882a-78c1-46d1-aebb-c03200a10d8a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:02.588393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f02deba4-ffe1-4426-a8a9-f4e81cdfe4ce req-14d0882a-78c1-46d1-aebb-c03200a10d8a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:02.590422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f02deba4-ffe1-4426-a8a9-f4e81cdfe4ce req-14d0882a-78c1-46d1-aebb-c03200a10d8a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:02.626284 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f02deba4-ffe1-4426-a8a9-f4e81cdfe4ce req-14d0882a-78c1-46d1-aebb-c03200a10d8a service nova] Creating event network-vif-plugged:0b669029-a6d6-4789-80da-f6901f27e9f4 for instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 on n-h2-854653-7 Nov 03 04:15:02.636088 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f02deba4-ffe1-4426-a8a9-f4e81cdfe4ce req-14d0882a-78c1-46d1-aebb-c03200a10d8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089941 Nov 03 04:15:02.637788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2406/4656] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:02.645293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:02.646430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:02.653763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:02.654513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:02.655118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:02.656006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:02.656780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:02.657501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:02.688891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:02.695123 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3332a25-67ec-406c-8f72-416b0df9c357 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.551129 Nov 03 04:15:02.704067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2251/4657] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:02 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:02.713854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:02.726896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:02.746470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:02.760984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:02.764321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:02.765456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:02.775349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:02.775819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:03.138007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:03.144325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:03.146775 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-479440c2-c4f4-42af-a732-b53f776f91f9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.507536 Nov 03 04:15:03.165472 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2407/4658] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:02 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:03.265188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:03.273288 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e94bedb-9184-407a-9c29-3f3a62378e25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.565158 Nov 03 04:15:03.273883 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2252/4659] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:02 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:03.452849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-604547024", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "d4690854-61c6-4734-9947-73292066365c"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:03.560633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a766651e-7f33-41fe-baa9-5da645428106 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f83b93a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:03.599782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] validate_networks() for [('d4690854-61c6-4734-9947-73292066365c', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:15:03.739122 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a766651e-7f33-41fe-baa9-5da645428106 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.183579 Nov 03 04:15:03.740020 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2253/4660] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:03 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:03.751279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:03.751918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:03.793669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:03.794105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:03.794562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:03.795295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:03.796057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:03.796185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:04.588074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:04.604965 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-22efd3ac-c50b-4b5c-882b-6ea73db9b2f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.859120 Nov 03 04:15:04.610293 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2254/4661] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:03 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:04.621771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:04.623854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:04.638155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:04.638982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:04.641780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:04.642973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:04.643672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:04.644356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:05.176898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:05.194154 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a296a5ef-3dc3-4aec-b038-fcd2116d4985 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.581344 Nov 03 04:15:05.195850 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2255/4662] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:04 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:05.203955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2f82b65-2a0c-4fc8-9772-b739f3fb31a2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8945700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:05.280316 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2f82b65-2a0c-4fc8-9772-b739f3fb31a2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.082197 Nov 03 04:15:05.283940 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2256/4663] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:05 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:05.291990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6843e61b-7619-45a0-b1c1-f05e2557e398 req-cfbcf233-fabe-4158-8d9d-12bd05f1e0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5654b4-009d-4bff-b1f3-d835ea94a615", "name": "network-vif-plugged", "status": "completed", "tag": "eda54677-27f1-4356-ba50-c78608583439"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:05.312754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6843e61b-7619-45a0-b1c1-f05e2557e398 req-cfbcf233-fabe-4158-8d9d-12bd05f1e0ea service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:05.312754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6843e61b-7619-45a0-b1c1-f05e2557e398 req-cfbcf233-fabe-4158-8d9d-12bd05f1e0ea service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:05.312754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6843e61b-7619-45a0-b1c1-f05e2557e398 req-cfbcf233-fabe-4158-8d9d-12bd05f1e0ea service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:05.323501 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6843e61b-7619-45a0-b1c1-f05e2557e398 req-cfbcf233-fabe-4158-8d9d-12bd05f1e0ea service nova] Creating event network-vif-plugged:eda54677-27f1-4356-ba50-c78608583439 for instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 on n-h1-854653-7 Nov 03 04:15:05.329408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6843e61b-7619-45a0-b1c1-f05e2557e398 req-cfbcf233-fabe-4158-8d9d-12bd05f1e0ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044163 Nov 03 04:15:05.330367 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2257/4664] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:05.416631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:15:05.417852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:15:05.418511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:15:05.419112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:15:05.429351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:15:05.471273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:05.471939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:05.473242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:05.474598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:05.476495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:05.477776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:05.513273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:15:05.525385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for user d374eee04fe4433d862b7bc04a16a563 and project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:15:05.558774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:15:05.561988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:15:05.637895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:05.639311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:05.676614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:05.681380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:05.685339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:05.686303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:05.696637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:05.697032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:05.744064 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc6b510d-ee73-40df-81bd-a390ce63a190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.299067 Nov 03 04:15:05.747758 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2408/4665] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:15:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:15:05.762734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-484535f7-4ff3-4107-a3eb-c64ff4a35491 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:05.765116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-484535f7-4ff3-4107-a3eb-c64ff4a35491 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:05.942547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-484535f7-4ff3-4107-a3eb-c64ff4a35491 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:05.950934 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-484535f7-4ff3-4107-a3eb-c64ff4a35491 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1214 microversion: 2.1 time: 0.195868 Nov 03 04:15:05.957465 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2409/4666] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:05 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:06.210205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:06.225471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:06.225471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:06.236439 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94174c23-59b2-4117-a274-6993bc220195 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.610458 Nov 03 04:15:06.241233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:06.241730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:06.244774 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2258/4667] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:05 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:06.257916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:06.260211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:06.267060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:06.267060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:06.299539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f585ac77-2c70-474d-bfe5-6cf338f1f10c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84321f0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:06.367664 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f585ac77-2c70-474d-bfe5-6cf338f1f10c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.067999 Nov 03 04:15:06.369696 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2259/4668] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:06 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:06.983955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b474690-0f13-4c1d-8448-521ae70f8ceb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:06.985153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b474690-0f13-4c1d-8448-521ae70f8ceb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:07.552640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b474690-0f13-4c1d-8448-521ae70f8ceb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:07.565415 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b474690-0f13-4c1d-8448-521ae70f8ceb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1214 microversion: 2.1 time: 0.585655 Nov 03 04:15:07.577007 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2260/4669] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:06 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1214 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:07.582626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:07.587818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:07.591005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:07.596333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c990b849-a6ff-48b1-9882-76776568c51d tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 1.380252 Nov 03 04:15:07.610863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:07.611366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:07.611797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:07.612563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:07.613062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:07.614023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:07.614979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2410/4670] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:06 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:07.624189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9d616832-5539-4d36-a8d8-66e8bd17b22b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84a04c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:08.307095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:08.324003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-045e8abf-8d92-4c22-843b-aab2b3158d4f tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.753915 Nov 03 04:15:08.329179 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2261/4671] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:07 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:08.345440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ceda0c61-d718-41b3-a25a-23e15995cec1 req-3c9aac1e-8fcf-4724-a490-6e599b3ffc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6870a06-4391-4f7f-9730-ad8fe574d8d8", "name": "network-vif-plugged", "status": "completed", "tag": "946eb81a-7db6-4a2f-98c9-978e60c65b98"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:08.428865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ceda0c61-d718-41b3-a25a-23e15995cec1 req-3c9aac1e-8fcf-4724-a490-6e599b3ffc16 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:08.434711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ceda0c61-d718-41b3-a25a-23e15995cec1 req-3c9aac1e-8fcf-4724-a490-6e599b3ffc16 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:08.437442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ceda0c61-d718-41b3-a25a-23e15995cec1 req-3c9aac1e-8fcf-4724-a490-6e599b3ffc16 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:08.479113 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ceda0c61-d718-41b3-a25a-23e15995cec1 req-3c9aac1e-8fcf-4724-a490-6e599b3ffc16 service nova] Creating event network-vif-plugged:946eb81a-7db6-4a2f-98c9-978e60c65b98 for instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 on n-h1-854653-7 Nov 03 04:15:08.490909 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ceda0c61-d718-41b3-a25a-23e15995cec1 req-3c9aac1e-8fcf-4724-a490-6e599b3ffc16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160290 Nov 03 04:15:08.491816 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2262/4672] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:08.590866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:08.592104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:08.601701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:08.602582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:08.603299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:08.604267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:08.604959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:08.606639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:08.748366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:08.761852 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eede52de-03a0-467c-987d-e9f66723b5a1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1266 microversion: 2.1 time: 0.175182 Nov 03 04:15:08.769668 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2263/4673] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:08 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:08.781590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:08.782577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:08.798107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:08.798107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:08.798107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:08.798879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:08.799587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:08.800798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:09.235384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:09.263202 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ffca225f-d8b2-4586-936c-e5fe4a39dea3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.491801 Nov 03 04:15:09.263807 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2264/4674] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:08 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:09.354759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:09.355395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:09.370471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:09.377724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:09.378248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:09.379022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:09.379694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:09.384426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:09.846718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:09.856043 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-882a38a9-1908-49fd-bdb2-3bc5ea4bb4f5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1318 microversion: 2.1 time: 0.506000 Nov 03 04:15:09.856916 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2265/4675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:09 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:09.863890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:09.863890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:09.900494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:09.925867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:09.927544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:09.931556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:09.932990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:09.934292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:10.055978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:10.065456 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8db45286-83bb-4cb3-9de4-ba0e6b08b3a2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1284 microversion: 2.1 time: 0.207022 Nov 03 04:15:10.067519 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2266/4676] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:09 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:10.292965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:10.297097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:10.314567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:10.317709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:10.319705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:10.322714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:10.323212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:10.326339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:10.569574 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9d616832-5539-4d36-a8d8-66e8bd17b22b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 2.949537 Nov 03 04:15:10.580887 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2411/4677] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:07 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 2965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:10.638778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:10.641925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:10.649106 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5f8058a2-e1b1-44e2-8976-933fd655cfff tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1519 microversion: 2.1 time: 0.360909 Nov 03 04:15:10.650136 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2267/4678] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:10 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1519 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:10.892809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:10.894282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:10.929710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:10.937048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:10.937614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:10.938915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:10.940952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:10.941494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:11.094017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:11.095437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:11.157575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:11.160907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:11.165912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:11.167736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:11.176834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:11.177437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:11.464297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:11.493937 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dcf0c73d-200b-43c6-babe-036a20cae913 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1507 microversion: 2.1 time: 0.609782 Nov 03 04:15:11.498690 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2412/4679] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:10 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1507 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:11.520637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:11.521345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:11.550013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:11.552551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:11.566941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:11.572130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:11.573452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:11.574980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:11.616335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:11.641081 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36c94451-978b-4203-8a3a-8e86d677ece0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1314 microversion: 2.1 time: 0.553385 Nov 03 04:15:11.642986 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2268/4680] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:11 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:11.651820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c1447e3-21cc-4c8e-92a2-d7255156d130 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8432670>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:11.772633 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c1447e3-21cc-4c8e-92a2-d7255156d130 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.127146 Nov 03 04:15:11.784311 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2269/4681] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:11 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:11.791217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:11.802341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:11.813180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:11.814039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:11.819405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:11.821199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:11.822446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:11.823052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:11.900157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:11.942225 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c17f6c8-6d3c-438b-9f54-32820603ceb9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1507 microversion: 2.1 time: 0.420340 Nov 03 04:15:11.943388 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2413/4682] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:11 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1507 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:11.973703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:11.982786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:12.001702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.002206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.002681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.003388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.004017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.004510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.138725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:15:12.139443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:15:12.145926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:15:12.145926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:15:12.145926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:15:12.197124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:12.214035 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72278d70-3dce-441e-9700-c2208a18a65e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.431607 Nov 03 04:15:12.215646 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2270/4683] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:11 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:12.246515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:12.250111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:12.263873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.264748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.267578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.285879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.286849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.288802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.431139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:12.444535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.445348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.446574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.456934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.456934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.456934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.489144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-06b6402d-98c7-46dc-9daf-7c5b191fba78 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "POST /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8/action" status: 202 len: 1109 microversion: 2.1 time: 0.527083 Nov 03 04:15:12.489712 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2414/4684] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:11 2022] POST /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8/action => generated 1109 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 03 04:15:12.524985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:12.525869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:12.534499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.535182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.535702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.536497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.537053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.537563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.622271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:12.650364 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f5d0d09-6b4d-4e02-92fb-883de7cb1057 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.411274 Nov 03 04:15:12.657807 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2271/4685] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:12 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:12.686116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:12.687914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:12.698149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.698949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.699602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.700601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:12.701368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:12.701970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:12.974356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:13.023040 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1dd5188-70de-4fbd-bb3b-fa01de115fe9 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.506028 Nov 03 04:15:13.024691 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2415/4686] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:12 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:13.032181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:13.032181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:13.044473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:13.045547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:13.046277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:13.047240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:13.047880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:13.048472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:13.133751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:13.151502 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65f8fef1-bb4c-4c70-a778-b5aa36c86335 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1314 microversion: 2.1 time: 0.475780 Nov 03 04:15:13.154221 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2272/4687] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:12 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:13.160267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b444082a-8b43-41f9-a08e-a99cd3e69706 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8428790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:13.217582 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b444082a-8b43-41f9-a08e-a99cd3e69706 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.061943 Nov 03 04:15:13.218243 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2273/4688] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:13 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:13.293045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:13.302955 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e82c364-637d-4823-ac9e-793dd0c967c1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.277030 Nov 03 04:15:13.303599 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2416/4689] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:13 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:13.325955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee6316be-53d9-43f2-9b04-741f3996bc6b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:13.335794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ee6316be-53d9-43f2-9b04-741f3996bc6b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 0404da80-6a0c-4f85-ac9c-05d690fe04c0 has no mapping to a cell. Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee6316be-53d9-43f2-9b04-741f3996bc6b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/0404da80-6a0c-4f85-ac9c-05d690fe04c0/action HTTP/1.1 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 15 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: {"os-stop": {}} Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 0404da80-6a0c-4f85-ac9c-05d690fe04c0 has no mapping to a cell. Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '0404da80-6a0c-4f85-ac9c-05d690fe04c0', 'body': {'os-stop': {}}} Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 0404da80-6a0c-4f85-ac9c-05d690fe04c0 has no mapping to a cell. Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:13.415268 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0404da80-6a0c-4f85-ac9c-05d690fe04c0 has no mapping to a cell. Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0404da80-6a0c-4f85-ac9c-05d690fe04c0 has no mapping to a cell. Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee6316be-53d9-43f2-9b04-741f3996bc6b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 0404da80-6a0c-4f85-ac9c-05d690fe04c0 has no mapping to a cell. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee6316be-53d9-43f2-9b04-741f3996bc6b tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/0404da80-6a0c-4f85-ac9c-05d690fe04c0/action" status: 404 len: 117 microversion: 2.1 time: 0.094993 Nov 03 04:15:13.427353 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2274/4690] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:13 2022] POST /compute/v2.1/servers/0404da80-6a0c-4f85-ac9c-05d690fe04c0/action => generated 117 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:13.429602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:13.430385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:13.436365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:13.436861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:13.437328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:13.438026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:13.438486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:13.438913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:13.585868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-901f45a0-8539-4cbc-a55b-88bdf6c548b0 req-f979db0f-b1b2-4463-9490-0dee93cf18bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a", "tag": "27d270b3-1634-4a21-b2e4-f2aa37a307f6"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:13.615040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-901f45a0-8539-4cbc-a55b-88bdf6c548b0 req-f979db0f-b1b2-4463-9490-0dee93cf18bf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:13.615854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-901f45a0-8539-4cbc-a55b-88bdf6c548b0 req-f979db0f-b1b2-4463-9490-0dee93cf18bf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:13.616580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-901f45a0-8539-4cbc-a55b-88bdf6c548b0 req-f979db0f-b1b2-4463-9490-0dee93cf18bf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:13.633934 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-901f45a0-8539-4cbc-a55b-88bdf6c548b0 req-f979db0f-b1b2-4463-9490-0dee93cf18bf service nova] Creating event network-changed:27d270b3-1634-4a21-b2e4-f2aa37a307f6 for instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a on n-h2-854653-7 Nov 03 04:15:13.641950 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-901f45a0-8539-4cbc-a55b-88bdf6c548b0 req-f979db0f-b1b2-4463-9490-0dee93cf18bf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060201 Nov 03 04:15:13.643473 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2275/4691] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:15:13.671660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:13.680580 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-29b6f4b9-6ddf-4d1d-b794-791bedf67954 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.255041 Nov 03 04:15:13.681786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2417/4692] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:13 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:13.715300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:13.716209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:13.732457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:13.735102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:13.735872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:13.736863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:13.740151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:13.740901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.009277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:14.018057 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af166b5a-fca4-4591-908f-a639b2020e39 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.307253 Nov 03 04:15:14.018788 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2276/4693] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:13 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:14.042958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73ffb02c-daca-4b70-bcf5-aa54bdf860a3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:14.044660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73ffb02c-daca-4b70-bcf5-aa54bdf860a3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 8d78736c-a795-4c9e-90f5-02f93ba6767c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:14.052565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-73ffb02c-daca-4b70-bcf5-aa54bdf860a3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 8d78736c-a795-4c9e-90f5-02f93ba6767c could not be found. Nov 03 04:15:14.052786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73ffb02c-daca-4b70-bcf5-aa54bdf860a3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/8d78736c-a795-4c9e-90f5-02f93ba6767c/action HTTP/1.1 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 15 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: {"suspend": {}} Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8d78736c-a795-4c9e-90f5-02f93ba6767c could not be found. Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8d78736c-a795-4c9e-90f5-02f93ba6767c', 'body': {'suspend': {}}} Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d78736c-a795-4c9e-90f5-02f93ba6767c could not be found. Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d78736c-a795-4c9e-90f5-02f93ba6767c could not be found. Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:14.056469 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:14.064191 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:14.064191 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:14.064191 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d78736c-a795-4c9e-90f5-02f93ba6767c could not be found. Nov 03 04:15:14.064191 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:14.064512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:14.065244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.067289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73ffb02c-daca-4b70-bcf5-aa54bdf860a3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 8d78736c-a795-4c9e-90f5-02f93ba6767c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:14.068267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.068561 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73ffb02c-daca-4b70-bcf5-aa54bdf860a3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/8d78736c-a795-4c9e-90f5-02f93ba6767c/action" status: 404 len: 111 microversion: 2.1 time: 0.031276 Nov 03 04:15:14.068730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.069520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.069917 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2418/4694] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:14 2022] POST /compute/v2.1/servers/8d78736c-a795-4c9e-90f5-02f93ba6767c/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:14.075459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.076890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.087997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:14.088912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:14.098400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.099339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.099986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.100877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.101674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.102809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.465917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:14.479517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:14.487548 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-acec07b5-7784-4eef-92db-71d3bbb34da7 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.412887 Nov 03 04:15:14.497383 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b88d4e11-162c-4dbd-8c35-e468b5ea85ed tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.443754 Nov 03 04:15:14.497383 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2277/4695] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:14 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:14.497687 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2419/4696] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:14 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:14.501465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08767b13-f387-4288-a0fb-6d747c50ad62 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f94280d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:14.506463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:14.509902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:14.537451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.540787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.544748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.545601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.546091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.546544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.599328 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08767b13-f387-4288-a0fb-6d747c50ad62 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.103424 Nov 03 04:15:14.599912 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2420/4697] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:14 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:14.607740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:14.624187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:14.633719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:14.635464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.639709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.639709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:14.639709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:14.639709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:14.639709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:15.053829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:15.063909 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6bb4aaa1-408e-4667-bf01-3abd4106f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.461816 Nov 03 04:15:15.073849 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2421/4698] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:14 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:15.080106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:15.095524 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e59a1541-4557-49a2-8991-29f7662fec0b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1314 microversion: 2.1 time: 0.601031 Nov 03 04:15:15.109930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:15.110794 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2278/4699] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:14 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:15.111137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:15.125584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:15.127365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:15.127365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:15.127579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:15.127999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:15.128436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:15.155890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lazy-loading 'flavor' on Instance uuid 5d5654b4-009d-4bff-b1f3-d835ea94a615 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:15:15.489764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:15.535637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:15.536545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:15.566117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:15.566117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:15.566117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:15.566117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:15.566117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:15.566117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:15.570892 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d88a8e8a-d589-4d1e-867a-0c4a5fcaa728 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 202 len: 0 microversion: 2.1 time: 0.464998 Nov 03 04:15:15.590116 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2422/4700] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:15 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:15:15.610281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:15.612474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:15.628647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:15.631111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:15.632461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:15.635425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:15.636120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:15.636755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:15.950794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:16.079439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:16.088132 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a99b054a-37f7-4328-8cfc-5efb8847ec2e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.559289 Nov 03 04:15:16.105465 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2279/4701] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:15 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:16.119898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2666015-7893-471a-91e0-ae4a2d67897c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8945940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:16.146587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:16.159526 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-be273a2b-06aa-467d-9b55-0ca975febcce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1514 microversion: 2.1 time: 0.567044 Nov 03 04:15:16.173660 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2423/4702] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:15 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1514 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:16.184609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:16.188347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:16.205344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:16.205344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:16.205344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:16.205344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:16.208556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:16.209376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:16.237360 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2666015-7893-471a-91e0-ae4a2d67897c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.130328 Nov 03 04:15:16.239348 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2280/4703] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:16 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:16.723259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:16.741578 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-837a8a1f-cf6b-4fa7-8c22-4ba159941a69 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1314 microversion: 2.1 time: 0.564354 Nov 03 04:15:16.743784 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2424/4704] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:16 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:17.122903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:17.124536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:17.139773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.140279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.140784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.142083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.142729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.143420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.221191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:17.225047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:17.257741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.259298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.262279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.263287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.268189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.270714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.327056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:17.562178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:17.615264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:17.629496 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7058631c-aff7-4bdf-a818-aad0ab701cea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.510782 Nov 03 04:15:17.630806 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2281/4705] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:17 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:17.637084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c36f82d4-8835-487b-99c9-8a93e6f40f84 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8451dc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:17.678078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:17.708481 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a7b6827-ea13-4c58-8523-dea08e85d632 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1497 microversion: 2.1 time: 0.501878 Nov 03 04:15:17.708481 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2425/4706] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:17 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1497 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:17.717095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:17.717888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:17.728406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.729181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.733635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.733635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.733635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.733635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.739790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c36f82d4-8835-487b-99c9-8a93e6f40f84 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.107747 Nov 03 04:15:17.740792 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2282/4707] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:17 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:17.770945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:17.771678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:17.785480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.786459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.790447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.790447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.790447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.790447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.838084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lazy-loading 'flavor' on Instance uuid 5d5654b4-009d-4bff-b1f3-d835ea94a615 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:15:17.879976 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Cannot 'suspend' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state suspended Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action HTTP/1.1 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 15 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: {"suspend": {}} Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: exception: Cannot 'suspend' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state suspended Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'suspend': {}}} Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 in vm_state suspended. Cannot suspend while the instance is in this state. Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Nov 03 04:15:17.887828 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state suspended Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state suspended Nov 03 04:15:17.892170 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:17.897451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 409 to user: Cannot 'suspend' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state suspended {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:17.899081 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-874ec080-37c0-402f-bdb6-7f8ac3b0098f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 409 len: 148 microversion: 2.1 time: 0.189287 Nov 03 04:15:17.903024 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2426/4708] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:17 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 148 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:15:17.919535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:17.921501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:17.949743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.950410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.952000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:17.953833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:17.954512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:17.957335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:18.295071 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23d9c1ec-88cb-4293-bb75-41c71bc72f6f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 202 len: 0 microversion: 2.1 time: 0.389432 Nov 03 04:15:18.296042 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2427/4709] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:17 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:15:18.304520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:18.308392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:18.326954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:18.330276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:18.331572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:18.332559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:18.334680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:18.335658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:18.350354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:18.380339 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b26792c1-8cde-4465-a9df-50a9e629bb86 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1314 microversion: 2.1 time: 0.613263 Nov 03 04:15:18.380944 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2283/4710] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:17 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:18.659161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:18.660147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:18.666914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=81 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:18.677223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:18.681419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:18.682145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:18.685095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:18.686965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:18.687649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:19.823908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:19.836572 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1bee3de5-0637-4fac-a526-a07d4b060cb3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1503 microversion: 2.1 time: 1.535511 Nov 03 04:15:19.838284 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2428/4711] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:18 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1503 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:19.845766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-724981a7-d59d-49ff-ba54-34d63a5280ae tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8495f70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:19.861678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:19.873710 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48f0839d-bf3a-4c14-bce6-833cf8eeaad3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 1.218520 Nov 03 04:15:19.891422 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2284/4712] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:18 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:19.910084 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-724981a7-d59d-49ff-ba54-34d63a5280ae tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.070081 Nov 03 04:15:19.911431 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2429/4713] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:19 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:19.932764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:19.934480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:19.941890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:19.942652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:19.943296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:19.944187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:19.944749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:19.945977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:19.955421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1edac616-043e-4192-85b7-1d183f178ac4 req-4c458e44-d883-4f87-986c-dc75715a6cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a", "name": "network-vif-plugged", "status": "completed", "tag": "27d270b3-1634-4a21-b2e4-f2aa37a307f6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:19.968646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1edac616-043e-4192-85b7-1d183f178ac4 req-4c458e44-d883-4f87-986c-dc75715a6cd0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:19.969757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1edac616-043e-4192-85b7-1d183f178ac4 req-4c458e44-d883-4f87-986c-dc75715a6cd0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:19.970224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1edac616-043e-4192-85b7-1d183f178ac4 req-4c458e44-d883-4f87-986c-dc75715a6cd0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:19.983181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1edac616-043e-4192-85b7-1d183f178ac4 req-4c458e44-d883-4f87-986c-dc75715a6cd0 service nova] Creating event network-vif-plugged:27d270b3-1634-4a21-b2e4-f2aa37a307f6 for instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a on n-h2-854653-7 Nov 03 04:15:19.989909 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1edac616-043e-4192-85b7-1d183f178ac4 req-4c458e44-d883-4f87-986c-dc75715a6cd0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039989 Nov 03 04:15:19.990667 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2430/4714] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:20.467616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:20.495820 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84663035-e57c-480e-b32a-5151f0b54307 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1314 microversion: 2.1 time: 0.569623 Nov 03 04:15:20.513150 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2285/4715] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:19 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:20.882277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:20.884122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:20.909796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:20.915728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:20.922054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:20.922811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:20.923545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:20.924628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:20.925308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:20.925909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:20.939142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:20.948980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:20.948980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:20.948980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:20.948980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:20.948980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:21.377433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:21.384705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:21.387730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c9afdb4-4316-440a-9441-dc57cc8cd5d8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.487345 Nov 03 04:15:21.404059 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2286/4716] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:20 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:21.404059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a108e37f-d117-49e4-adea-f038445b5eca tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8ba1820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:21.421782 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0ba2a89-2619-47f8-b230-d3a7466f2ea1 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1503 microversion: 2.1 time: 0.555438 Nov 03 04:15:21.422600 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2431/4717] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:20 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1503 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:21.482805 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a108e37f-d117-49e4-adea-f038445b5eca tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1413 microversion: 2.1 time: 0.093187 Nov 03 04:15:21.491092 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2287/4718] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:21 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:21.522877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:21.523964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:21.533642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:21.534361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:21.542544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:21.542544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:21.542544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:21.542544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:21.844797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:21.858935 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b1f498d-c410-4d9b-96c5-2f978b234cc7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1314 microversion: 2.1 time: 0.340998 Nov 03 04:15:21.865223 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2432/4719] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:21 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:22.412915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:22.413688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:22.435280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.437708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.438367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:22.439311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.440623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.443963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:22.452206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:22.452206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:22.462555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.463289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.463906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:22.464788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.465464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.466056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:22.785090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:22.790938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:22.797916 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8d793e33-5509-4d7f-a85d-267c0cbad841 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.390472 Nov 03 04:15:22.800631 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2288/4720] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:22 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:22.800902 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-460bab9c-2bda-4efd-8982-01ca5a3a2e8f tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.352909 Nov 03 04:15:22.800902 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2433/4721] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:22 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:22.805424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb8faafe-9826-463e-8910-dbda9112cff4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8ba1820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:22.837653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:22.838534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:22.845711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.848509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.849266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:22.859744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.859744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.859744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:22.891364 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb8faafe-9826-463e-8910-dbda9112cff4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1422 microversion: 2.1 time: 0.090898 Nov 03 04:15:22.914730 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2289/4722] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:22 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:22.924424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:22.925563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:22.933704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.936235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.936235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:22.936235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:22.936829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:22.937492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:23.286181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:23.289839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:23.299998 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff779c04-fce6-46bd-9b49-c15be6041162 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1502 microversion: 2.1 time: 0.379843 Nov 03 04:15:23.300850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0305abab-3750-400e-9948-34278ddfe010 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.471888 Nov 03 04:15:23.301477 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2434/4723] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:22 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:23.313947 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2290/4724] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:22 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1502 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:23.325052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e14b08d1-e9e1-497f-9a8b-51bfab7b3300 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84aa5e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:23.337654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94c31d3f-2c0d-4ab6-b1c0-a42130d16960 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:23.338607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-94c31d3f-2c0d-4ab6-b1c0-a42130d16960 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 68f1490d-e81f-47a3-9b0f-c51e655154d3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:23.344660 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-94c31d3f-2c0d-4ab6-b1c0-a42130d16960 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 68f1490d-e81f-47a3-9b0f-c51e655154d3 could not be found. Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94c31d3f-2c0d-4ab6-b1c0-a42130d16960 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/68f1490d-e81f-47a3-9b0f-c51e655154d3/action HTTP/1.1 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 15 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: {"unpause": {}} Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 68f1490d-e81f-47a3-9b0f-c51e655154d3 could not be found. Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '68f1490d-e81f-47a3-9b0f-c51e655154d3', 'body': {'unpause': {}}} Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f1490d-e81f-47a3-9b0f-c51e655154d3 could not be found. Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f1490d-e81f-47a3-9b0f-c51e655154d3 could not be found. Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:23.347817 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:23.365883 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:23.365883 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:23.365883 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f1490d-e81f-47a3-9b0f-c51e655154d3 could not be found. Nov 03 04:15:23.365883 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:23.381618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94c31d3f-2c0d-4ab6-b1c0-a42130d16960 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 68f1490d-e81f-47a3-9b0f-c51e655154d3 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:23.381618 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94c31d3f-2c0d-4ab6-b1c0-a42130d16960 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/68f1490d-e81f-47a3-9b0f-c51e655154d3/action" status: 404 len: 111 microversion: 2.1 time: 0.054658 Nov 03 04:15:23.381618 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2291/4725] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:23 2022] POST /compute/v2.1/servers/68f1490d-e81f-47a3-9b0f-c51e655154d3/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:23.395270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:23.395822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:23.400845 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e14b08d1-e9e1-497f-9a8b-51bfab7b3300 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 200 len: 1422 microversion: 2.1 time: 0.090042 Nov 03 04:15:23.403396 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2435/4726] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:15:23 2022] GET /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:23.409559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:23.422353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:23.427765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:23.428344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:23.428792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:23.430075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:23.430520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:23.433211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:23.437987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:23.439393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:23.439845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:23.440579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:23.445882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:23.446615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:24.156376 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.network.security_group_api [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Removing security group c18f86e9-8300-4d11-bafe-5351ce0ce814 from port 27d270b3-1634-4a21-b2e4-f2aa37a307f6 Nov 03 04:15:24.315207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:24.340474 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bae545c5-b4e2-41b3-ad4a-e89b271fb2ce tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.933758 Nov 03 04:15:24.347504 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2436/4727] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:23 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:24.362202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-37a30584-1257-4dcd-99e8-69040c338abf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84aa310>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:24.871426 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14801b53-0ad5-4beb-884f-192c98c52f2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a/action" status: 202 len: 0 microversion: 2.1 time: 1.489053 Nov 03 04:15:24.874562 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2292/4728] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:23 2022] POST /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a/action => generated 0 bytes in 1491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:15:24.883413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:24.884272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:24.895667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:24.897855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:24.897855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:24.897855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:24.898976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:24.899579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:24.928689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:25.229185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:25.248753 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51629f75-5710-457c-ba3f-36b8bfc87940 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.371176 Nov 03 04:15:25.252292 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2293/4729] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:24 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:25.265355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:25.266290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:25.283203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.285360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.286016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:25.287055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.287209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.287621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:25.603316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:25.612162 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f19a2c3b-ea72-4a77-b272-e12d37b68438 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.356329 Nov 03 04:15:25.629605 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2294/4730] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:25 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:25.646336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:25.647404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:25.666281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.666768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.667202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:25.670014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.675671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.676678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:25.823133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:25.837429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-029a5127-840f-4116-8867-62b168d274fe tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1460 microversion: 2.1 time: 0.206072 Nov 03 04:15:25.839909 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2295/4731] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:25 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1460 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:25.850079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-355ae0ce-d125-4c36-abb4-51655caf2612 req-4b1a4d81-5282-4581-b089-2d7cd9b1faa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a", "tag": "27d270b3-1634-4a21-b2e4-f2aa37a307f6"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:25.861917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-355ae0ce-d125-4c36-abb4-51655caf2612 req-4b1a4d81-5282-4581-b089-2d7cd9b1faa5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.864340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-355ae0ce-d125-4c36-abb4-51655caf2612 req-4b1a4d81-5282-4581-b089-2d7cd9b1faa5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.864977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-355ae0ce-d125-4c36-abb4-51655caf2612 req-4b1a4d81-5282-4581-b089-2d7cd9b1faa5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:25.887049 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-355ae0ce-d125-4c36-abb4-51655caf2612 req-4b1a4d81-5282-4581-b089-2d7cd9b1faa5 service nova] Creating event network-changed:27d270b3-1634-4a21-b2e4-f2aa37a307f6 for instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a on n-h2-854653-7 Nov 03 04:15:25.894445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-355ae0ce-d125-4c36-abb4-51655caf2612 req-4b1a4d81-5282-4581-b089-2d7cd9b1faa5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052313 Nov 03 04:15:25.895063 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2296/4732] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:25.905425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5796ec52-dd0f-445d-80c7-e3d2116f3134 req-6446a6be-6cb1-4397-8810-e345fd97d74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77f4b73-22b8-46b1-bd3d-a3d3f37d6358", "name": "network-vif-unplugged", "status": "completed", "tag": "0b669029-a6d6-4789-80da-f6901f27e9f4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:25.934252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5796ec52-dd0f-445d-80c7-e3d2116f3134 req-6446a6be-6cb1-4397-8810-e345fd97d74b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.938233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5796ec52-dd0f-445d-80c7-e3d2116f3134 req-6446a6be-6cb1-4397-8810-e345fd97d74b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.938233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5796ec52-dd0f-445d-80c7-e3d2116f3134 req-6446a6be-6cb1-4397-8810-e345fd97d74b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:25.948398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5796ec52-dd0f-445d-80c7-e3d2116f3134 req-6446a6be-6cb1-4397-8810-e345fd97d74b service nova] Creating event network-vif-unplugged:0b669029-a6d6-4789-80da-f6901f27e9f4 for instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 on n-h2-854653-7 Nov 03 04:15:25.953862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5796ec52-dd0f-445d-80c7-e3d2116f3134 req-6446a6be-6cb1-4397-8810-e345fd97d74b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057143 Nov 03 04:15:25.955072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2297/4733] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:25.960713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:25.962384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:25.969722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.970513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.971190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:25.972123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:25.972750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:25.973486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.006959 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Cannot 'unpause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action HTTP/1.1 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 15 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: {"unpause": {}} Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'unpause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'unpause': {}}} Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 in vm_state active. Cannot unpause while the instance is in this state. Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:26.013487 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 409 to user: Cannot 'unpause' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55f8b661-d4c5-47c3-8c58-bce82ea462ca tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 409 len: 145 microversion: 2.1 time: 0.058718 Nov 03 04:15:26.022130 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2298/4734] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:25 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:15:26.027550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:26.028718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:26.056114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.056841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.064513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.065553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.066226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.066851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.440986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:26.461921 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e08a842-6db7-47c5-9b39-4ed2a2b93ed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.444593 Nov 03 04:15:26.466743 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2299/4735] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:26 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:26.476044 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-37a30584-1257-4dcd-99e8-69040c338abf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 204 len: 0 microversion: 2.1 time: 2.127094 Nov 03 04:15:26.479862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:26.480759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:26.482413 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2437/4736] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:24 2022] DELETE /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 0 bytes in 2129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:15:26.488813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.489576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.490240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.492031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.492804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.493477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.495969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:26.500692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:26.514632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.515170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.524861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.526417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.526934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.527377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.747125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:26.761564 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7882f2a2-0dd5-4c29-8594-f6ecda63acaf tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.293167 Nov 03 04:15:26.774022 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2300/4737] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:26 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:26.774022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:26.774022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:26.781372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:26.795923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.797974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.797974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.797974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.798248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.798546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.799173 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b2ee10f1-9b53-4d8f-99d8-b2dbca639efe tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.314247 Nov 03 04:15:26.800074 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2438/4738] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:26 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:26.807016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:26.811649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:26.831591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.833441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.836422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.838609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:26.839185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:26.841467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:26.886907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:15:27.138950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:27.147456 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6898b85f-57dd-4587-8d8a-56b5568e1c2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.345947 Nov 03 04:15:27.153803 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2439/4739] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:26 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:27.166216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:27.167205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:27.175887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.176380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.176847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.177581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.178089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.178652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.370541 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-45efe162-f982-4988-abdd-419acc5111e3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 204 len: 0 microversion: 2.1 time: 0.607001 Nov 03 04:15:27.375248 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2301/4740] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:15:26 2022] DELETE /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:15:27.392102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:27.394937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:27.408569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.409348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.411872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.412615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.413105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.426807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.491080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:27.506354 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e25381b-5f6b-4bee-8a35-ddc3e0101cf3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.351269 Nov 03 04:15:27.514012 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2440/4741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:27 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:27.538452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7cf97e80-dbb8-44ee-84ce-f07978ce3c0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:27.540055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7cf97e80-dbb8-44ee-84ce-f07978ce3c0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 430a51b3-0cb4-49f9-8d09-29f6c15ea98f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:27.553775 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7cf97e80-dbb8-44ee-84ce-f07978ce3c0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 430a51b3-0cb4-49f9-8d09-29f6c15ea98f could not be found. Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7cf97e80-dbb8-44ee-84ce-f07978ce3c0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/430a51b3-0cb4-49f9-8d09-29f6c15ea98f/action HTTP/1.1 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 18 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: {"unshelve": null} Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 430a51b3-0cb4-49f9-8d09-29f6c15ea98f could not be found. Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '430a51b3-0cb4-49f9-8d09-29f6c15ea98f', 'body': {'unshelve': None}} Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430a51b3-0cb4-49f9-8d09-29f6c15ea98f could not be found. Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430a51b3-0cb4-49f9-8d09-29f6c15ea98f could not be found. Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:27.558609 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430a51b3-0cb4-49f9-8d09-29f6c15ea98f could not be found. Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7cf97e80-dbb8-44ee-84ce-f07978ce3c0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 430a51b3-0cb4-49f9-8d09-29f6c15ea98f could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:27.563623 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7cf97e80-dbb8-44ee-84ce-f07978ce3c0c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/430a51b3-0cb4-49f9-8d09-29f6c15ea98f/action" status: 404 len: 111 microversion: 2.1 time: 0.024315 Nov 03 04:15:27.566805 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2441/4742] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:27 2022] POST /compute/v2.1/servers/430a51b3-0cb4-49f9-8d09-29f6c15ea98f/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:27.575564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:27.594065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:27.603088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.603795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.604316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.605159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.605706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.606220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.845609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:27.868039 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2416eb0d-7ef1-4c92-a4f2-717041e8d7eb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.489621 Nov 03 04:15:27.873552 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2302/4743] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:27 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:27.880523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1248935828", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "67e5b85f-4010-4f46-ba0a-653e66da87d8"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:27.909880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:27.922411 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-563e85e8-7d3d-4498-bf3d-7e0522a9d2a8 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.350259 Nov 03 04:15:27.923609 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2442/4744] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:27 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:27.930545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:27.931456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:27.938358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.939638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.940343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.941328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:27.942052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:27.942714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:27.973746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] validate_networks() for [('67e5b85f-4010-4f46-ba0a-653e66da87d8', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:15:28.236183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:28.253583 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f37a8a2e-41ab-4fe4-9d24-25a14dbb95db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.328573 Nov 03 04:15:28.254445 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2443/4745] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:27 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:28.260908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:28.261663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:28.278808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:28.282321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:28.283313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:28.284256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:28.284922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:28.285548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:28.347700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:15:28.408087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:28.842107 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d80d4c51-01c1-4b24-83bd-e4257502ec77 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "DELETE /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 204 len: 0 microversion: 2.1 time: 0.586185 Nov 03 04:15:28.842757 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2444/4746] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:15:28 2022] DELETE /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:15:28.850367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:28.854593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:28.885332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:28.899537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:28.899537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:28.899537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:28.899537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:28.899537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.190357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:29.199384 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04149167-68ad-401d-8a5b-39500762b2af tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.355277 Nov 03 04:15:29.200338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2445/4747] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:28 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:29.205405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:29.206021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:29.212194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.212689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.213678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.213949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.214418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.214847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.227221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:15:29.228273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:15:29.229037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:15:29.229608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:15:29.230242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:15:29.246087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.252838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.252838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.252838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.252838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.252838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.293091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:15:29.302781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for user 324a1dfe0c4843bd917eb6ecd6cc2c4c and project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:15:29.321418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:15:29.325633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:15:29.467098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:29.481622 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-29511536-9780-4558-9f25-fb028743f269 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.280086 Nov 03 04:15:29.482383 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2446/4748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:29 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:29.487500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:29.488552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:29.501095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.508210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.508210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.508210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.508210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.508210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.556800 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f3dc0c0-b838-457d-8f81-0d968f92fa03 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681953 Nov 03 04:15:29.561823 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2303/4749] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:15:29.567888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:29.571325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:29.585693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.586664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.587746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.588494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.590535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.591229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.714270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:29.731111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4da04954-9e55-4cbe-94e2-bad098389133 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1550 microversion: 2.1 time: 0.247586 Nov 03 04:15:29.731787 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2447/4750] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:29 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1550 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:29.737328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-892669856", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "d4690854-61c6-4734-9947-73292066365c"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:29.847842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] validate_networks() for [('d4690854-61c6-4734-9947-73292066365c', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:15:29.855862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:29.867563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1d5b569-c913-49dc-9ece-d43c128728d1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.301826 Nov 03 04:15:29.869591 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2304/4751] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:29 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:29.875799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:29.881920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:29.895170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.895923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.905620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.906768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:29.907482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:29.908663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:29.947356 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Cannot 'unshelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action HTTP/1.1 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 18 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: {"unshelve": null} Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: exception: Cannot 'unshelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'unshelve': None}} Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 in vm_state active. Cannot unshelve while the instance is in this state. Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 03 04:15:29.949180 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 409 to user: Cannot 'unshelve' instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 while it is in vm_state active {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:29.954265 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aa6a0904-bd17-4fbd-bb79-2d28ab105df3 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action" status: 409 len: 146 microversion: 2.1 time: 0.081697 Nov 03 04:15:29.955266 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2305/4752] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:15:29 2022] POST /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615/action => generated 146 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:15:29.962011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9ed38bc-1f10-497f-a340-061d11e95405 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:29.962888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9ed38bc-1f10-497f-a340-061d11e95405 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:30.066885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9ed38bc-1f10-497f-a340-061d11e95405 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:30.077654 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9ed38bc-1f10-497f-a340-061d11e95405 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1208 microversion: 2.1 time: 0.121568 Nov 03 04:15:30.078357 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2306/4753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:29 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1208 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:30.090285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:30.091829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:30.105283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:30.106119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:30.106944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:30.108523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:30.109236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:30.113824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:30.652900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:30.674574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d220bb6-875b-461f-bbaf-6b3b1c81f952 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.592755 Nov 03 04:15:30.680014 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2307/4754] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:30 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:30.712182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7bd8490a-dc02-4a9c-ab7c-07d7612ce8ff req-77556547-8984-4f61-894b-4c67af12a4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77f4b73-22b8-46b1-bd3d-a3d3f37d6358", "name": "network-vif-deleted", "tag": "0b669029-a6d6-4789-80da-f6901f27e9f4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:30.742536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7bd8490a-dc02-4a9c-ab7c-07d7612ce8ff req-77556547-8984-4f61-894b-4c67af12a4ca service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:30.743283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7bd8490a-dc02-4a9c-ab7c-07d7612ce8ff req-77556547-8984-4f61-894b-4c67af12a4ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:30.745694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7bd8490a-dc02-4a9c-ab7c-07d7612ce8ff req-77556547-8984-4f61-894b-4c67af12a4ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:30.781101 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7bd8490a-dc02-4a9c-ab7c-07d7612ce8ff req-77556547-8984-4f61-894b-4c67af12a4ca service nova] Creating event network-vif-deleted:0b669029-a6d6-4789-80da-f6901f27e9f4 for instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 on n-h2-854653-7 Nov 03 04:15:30.793782 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7bd8490a-dc02-4a9c-ab7c-07d7612ce8ff req-77556547-8984-4f61-894b-4c67af12a4ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106472 Nov 03 04:15:30.793782 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2308/4755] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:30.797839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:30.799435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:30.808226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:30.809967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:30.810686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:30.812049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:30.812689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:30.813489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:31.126823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:15:31.128365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:15:31.129216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:15:31.130000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:15:31.130599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:15:31.148036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:31.149170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:31.153184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:31.153184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:31.153184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:31.154203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:31.200372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:15:31.210989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Getting quotas for user d374eee04fe4433d862b7bc04a16a563 and project 5da4e6e327d94557872a462ca9fa96f8. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:15:31.241819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:15:31.250258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:15:31.370640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:31.383431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6abc51eb-19cf-47bf-abbf-335414c30f25 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.589973 Nov 03 04:15:31.384158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2309/4756] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:30 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:31.396418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:31.398389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:31.414138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:31.415166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:31.415930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:31.416888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:31.418108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:31.420799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:31.456281 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a325989b-ae8c-41d2-a0a8-11ecbcf6b3f4 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723316 Nov 03 04:15:31.457291 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2448/4757] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:15:31.462759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:31.471838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:31.498076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:31.503803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:31.507016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:31.507016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:31.507016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:31.507016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:32.264361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:32.271504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:32.275432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ccef174-319b-48ff-8fb7-044da7f2c405 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.816375 Nov 03 04:15:32.277367 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2449/4758] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:31 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:32.286405 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1fc925d9-49f6-412f-a7a2-3dc5c27cd630 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1550 microversion: 2.1 time: 0.900431 Nov 03 04:15:32.289114 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2310/4759] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:31 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1550 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:32.297673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:32.298537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:32.313925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4236d30f-f0cd-41ca-a931-97c0565f6146 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-207863779_updated"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:32.317222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4236d30f-f0cd-41ca-a931-97c0565f6146 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 4d5faceb-48d6-4820-836c-e943b158342a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:32.317527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:32.318025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:32.318468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:32.319254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:32.319750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:32.320191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:32.324279 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-4236d30f-f0cd-41ca-a931-97c0565f6146 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 4d5faceb-48d6-4820-836c-e943b158342a could not be found. Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4236d30f-f0cd-41ca-a931-97c0565f6146 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: request: PUT /compute/v2.1/servers/4d5faceb-48d6-4820-836c-e943b158342a HTTP/1.1 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 80 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-207863779_updated"}} Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 4d5faceb-48d6-4820-836c-e943b158342a could not be found. Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '4d5faceb-48d6-4820-836c-e943b158342a', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-207863779_updated'}}} Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5faceb-48d6-4820-836c-e943b158342a could not be found. Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Nov 03 04:15:32.326315 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5faceb-48d6-4820-836c-e943b158342a could not be found. Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5faceb-48d6-4820-836c-e943b158342a could not be found. Nov 03 04:15:32.330757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:32.335071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4236d30f-f0cd-41ca-a931-97c0565f6146 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 4d5faceb-48d6-4820-836c-e943b158342a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:32.336280 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4236d30f-f0cd-41ca-a931-97c0565f6146 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "PUT /compute/v2.1/servers/4d5faceb-48d6-4820-836c-e943b158342a" status: 404 len: 111 microversion: 2.1 time: 0.046729 Nov 03 04:15:32.337237 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2311/4760] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:15:32 2022] PUT /compute/v2.1/servers/4d5faceb-48d6-4820-836c-e943b158342a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:32.342442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ea0b31e-e80e-42dc-97bd-dcbe0795ead1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:32.347412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ea0b31e-e80e-42dc-97bd-dcbe0795ead1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:32.426502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ea0b31e-e80e-42dc-97bd-dcbe0795ead1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:32.434360 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ea0b31e-e80e-42dc-97bd-dcbe0795ead1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1214 microversion: 2.1 time: 0.095737 Nov 03 04:15:32.437723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2312/4761] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:32 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:32.456607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9dbcf1e2-83ce-49f7-960c-2fb1a51e7965 req-91086188-8385-4f6b-af33-4df13227cbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396aba47-cab1-42b8-aeea-1a43bbe07bdc", "name": "network-vif-deleted", "tag": "abe289e3-c4a7-42ea-9cb1-5f38f2c9b971"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:32.477115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9dbcf1e2-83ce-49f7-960c-2fb1a51e7965 req-91086188-8385-4f6b-af33-4df13227cbac service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:32.477781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9dbcf1e2-83ce-49f7-960c-2fb1a51e7965 req-91086188-8385-4f6b-af33-4df13227cbac service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:32.478354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9dbcf1e2-83ce-49f7-960c-2fb1a51e7965 req-91086188-8385-4f6b-af33-4df13227cbac service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:32.506653 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9dbcf1e2-83ce-49f7-960c-2fb1a51e7965 req-91086188-8385-4f6b-af33-4df13227cbac service nova] Creating event network-vif-deleted:abe289e3-c4a7-42ea-9cb1-5f38f2c9b971 for instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc on n-h1-854653-7 Nov 03 04:15:32.509503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:32.512415 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9dbcf1e2-83ce-49f7-960c-2fb1a51e7965 req-91086188-8385-4f6b-af33-4df13227cbac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067652 Nov 03 04:15:32.517227 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2313/4762] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:32.523974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:32.524942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:32.532891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:32.533072 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f246609a-428f-4dc9-ab65-f2a838b6d9a7 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1260 microversion: 2.1 time: 0.241969 Nov 03 04:15:32.534370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:32.535229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:32.536148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:32.537291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:32.537988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:32.539799 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2450/4763] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:32 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:32.809200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:32.827219 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-17685e01-00c9-4db8-80e5-d6a58c51de41 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.305134 Nov 03 04:15:32.827219 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2314/4764] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:32 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:32.853198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:32.854109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:32.864778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:32.865623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:32.866295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:32.867441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:32.867680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:32.868430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.182064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:33.192856 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02629d40-9056-44bf-ab31-c66216bba129 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.344085 Nov 03 04:15:33.193462 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2451/4765] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:32 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:33.219349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9f05424-e17e-4ca7-94c2-edfd73ba8904 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9f05424-e17e-4ca7-94c2-edfd73ba8904 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: request: PUT /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 HTTP/1.1 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 280 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:33.232828 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:33.237413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c9f05424-e17e-4ca7-94c2-edfd73ba8904 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:33.251840 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c9f05424-e17e-4ca7-94c2-edfd73ba8904 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "PUT /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 400 len: 619 microversion: 2.1 time: 0.036586 Nov 03 04:15:33.253079 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2315/4766] 10.222.0.30 () {60 vars in 1257 bytes} [Thu Nov 3 04:15:33 2022] PUT /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:15:33.279551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:33.280105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:33.296259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:33.298531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:33.298531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.300791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:33.301864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:33.311538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.311901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:33.311901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:33.316749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:33.317706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:33.318325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.321029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:33.321738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:33.322352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.340431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:33.656307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:33.669927 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b2d5fcc-0783-4e93-b416-3b7a075709dd tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.412650 Nov 03 04:15:33.672126 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2452/4767] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:33 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:33.685585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:33.686333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:33.695771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:33.701077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:33.703896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.703896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:33.703896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:33.703896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.785211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:33.792612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:33.793430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:33.794118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lazy-loading 'fault' on Instance uuid 396aba47-cab1-42b8-aeea-1a43bbe07bdc {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:15:33.968409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:33.980922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8406c947-7771-4d09-8bac-5a3b7de08b1d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.678693 Nov 03 04:15:33.998345 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2316/4768] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:33 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:34.004661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:34.006708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:34.039796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.040387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.040856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:34.041798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.042106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.042544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:34.054053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:34.072080 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-31096952-15d5-425f-821f-a7ff7d09db8a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 200 len: 1337 microversion: 2.1 time: 0.398727 Nov 03 04:15:34.074602 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2453/4769] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:33 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 1337 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:34.110039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:34.115160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:34.127881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.134581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.137809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:34.139031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.139738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.141142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:34.163339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:34.172793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f0c75d9-f8bd-4731-bf2a-f75c91f902c1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1210 microversion: 2.1 time: 0.172945 Nov 03 04:15:34.173425 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2317/4770] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:33 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1210 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:34.178295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:34.178672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:34.197667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.198174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.198627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:34.199349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.201664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.202126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:34.311386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:34.328475 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-34d14ab7-e600-44fd-a195-fa6f5a693529 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1266 microversion: 2.1 time: 0.234498 Nov 03 04:15:34.346474 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2454/4771] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:34 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:34.538984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:34.551839 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ab3ac175-1c1f-4e9e-8771-6af7527063a5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.377338 Nov 03 04:15:34.552432 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2318/4772] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:34 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:34.575958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b4c9f13-a794-4640-bff9-3a5c711c8b9a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b4c9f13-a794-4640-bff9-3a5c711c8b9a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: request: PUT /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 HTTP/1.1 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 24 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: {"server": {"name": ""}} Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615', 'body': {'server': {'name': ''}}} Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise error Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi '' Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 04:15:34.580441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 03 04:15:34.586583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:34.588588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b4c9f13-a794-4640-bff9-3a5c711c8b9a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:34.590043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b4c9f13-a794-4640-bff9-3a5c711c8b9a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "PUT /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 400 len: 108 microversion: 2.1 time: 0.018069 Nov 03 04:15:34.594838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2455/4773] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:15:34 2022] PUT /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:15:34.600380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:34.601090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:34.617869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.619241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.619241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:34.619550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:34.620089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:34.620529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.005380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:35.006028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:35.035526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.036043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.036527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.037272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.037744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.045353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.418300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:35.427214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf0b944e-ec25-4dee-99b4-cd5f091ec0a0 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1506 microversion: 2.1 time: 0.831400 Nov 03 04:15:35.427855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2319/4774] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:34 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1506 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:35.437746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:35.445231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: 396aba47-cab1-42b8-aeea-1a43bbe07bdc] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:35.458320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.459086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.460017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.461675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.462347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.464090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] HTTP exception thrown: Instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc could not be found. Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Request method failure captured: Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc HTTP/1.1 Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-4IAnl34rYSGAvJa3J4yoQ-n2hDnCMkkjhXn9Ras4udVoEU5J6m7fIgorWFF9gYuH9ADZRItivaL2F5b7w6sj_0mhSRrCf-wu3WsGwuPM-BoDOcEf8p5Yqz2kDxhsSBUgYS89GPYNnmpbhDb08w1fGA4dlcS5AXUtRTursOXrOAuA Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 85363c2a53b549da92c7e3f9b09294bc Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkBasicOps-394395558 Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85363c2a53b549da92c7e3f9b09294bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85363c2a53b549da92c7e3f9b09294bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85363c2a53b549da92c7e3f9b09294bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85363c2a53b549da92c7e3f9b09294bc"}]}] Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkBasicOps-394395558 Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 85363c2a53b549da92c7e3f9b09294bc Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkBasicOps-394395558 Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkBasicOps-394395558-project Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a3c6e4b088224f33aa607e2a27ed798b Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkBasicOps-394395558-project Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc could not be found. Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '396aba47-cab1-42b8-aeea-1a43bbe07bdc'} Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc could not be found. Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:35.502677 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc could not be found. Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc could not be found. Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Returning 404 to user: Instance 396aba47-cab1-42b8-aeea-1a43bbe07bdc could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:35.507439 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-674d555e-5884-40da-996f-f7a72f903cd3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc" status: 404 len: 111 microversion: 2.1 time: 0.073022 Nov 03 04:15:35.521415 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2320/4775] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:35 2022] GET /compute/v2.1/servers/396aba47-cab1-42b8-aeea-1a43bbe07bdc => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:35.526975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:35.527593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:35.530576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:35.538811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.539637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.540224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.540598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.541083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.541510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.553541 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae708ee9-7085-4bf8-a011-afbc9f49c79c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.552888 Nov 03 04:15:35.555185 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2456/4776] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:34 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:35.570019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:35.570868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:35.589560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.591606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.593575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.595510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:35.597641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:35.606118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:35.806227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:35.815211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19e58b08-4e16-4b3f-a6d7-2695701272ab tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1272 microversion: 2.1 time: 0.292581 Nov 03 04:15:35.837637 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2321/4777] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:35 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1272 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:36.584913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:36.587117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:36.594048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:36.607517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:36.608303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:36.609585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:36.610291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:36.610976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:36.641150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:36.651207 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-00147032-c1aa-49fe-98cc-4f280bfa5e4b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 1.092901 Nov 03 04:15:36.658723 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2457/4778] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:35 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:36.767188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-39b7edae-0926-4b5c-8fe5-b394d0ba7a49 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '.version_select at 0x7ff7f843e700>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:36.868081 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-39b7edae-0926-4b5c-8fe5-b394d0ba7a49 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-123228859" status: 202 len: 0 microversion: 2.1 time: 0.104764 Nov 03 04:15:36.868798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2458/4779] 10.222.0.30 () {58 vars in 1254 bytes} [Thu Nov 3 04:15:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-123228859 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:15:36.876401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:36.882557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:36.906815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:36.907330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:36.907781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:36.915065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:36.915656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:36.916935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:37.590063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:37.599518 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7da7caf-dce5-4359-90fd-879307a30a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1272 microversion: 2.1 time: 0.728986 Nov 03 04:15:37.602578 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2459/4780] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:36 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1272 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:37.687141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:37.687888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:37.699297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:37.700286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:37.700969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:37.702816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:37.703777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:37.704631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:38.214851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:38.228591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-25e1ed30-dcf7-4596-bcc5-01b1025fa124 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 1.648220 Nov 03 04:15:38.229560 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2322/4781] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:36 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:38.628194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:38.628857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:38.642040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:38.642982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:38.643652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:38.644733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:38.645420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:38.646049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:38.821718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:38.831299 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ada27d41-7e6e-405c-9470-368e45907d9c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1272 microversion: 2.1 time: 0.208250 Nov 03 04:15:38.832405 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2323/4782] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:38 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:38.888981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:38.898211 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b0b15f7-79ed-4075-b75b-24de83e3b773 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 1.216790 Nov 03 04:15:38.917604 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2460/4783] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:37 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:39.252866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:39.254119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:39.265264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:39.278633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:39.279456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:39.283388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:39.284165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:39.284812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:39.285527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:39.803043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:39.820234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5ffdae17-4997-4a6c-84be-eb479e908ab9 req-393c629d-890f-4add-923d-92e8bd1c0bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5031d1f0-da10-45db-a3a0-a7b979e21098", "tag": "7a76f64d-5f6a-47c4-8811-a785f7520732"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:39.826715 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd6c52ce-1874-45a9-acc7-c2b67ad0abe7 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1514 microversion: 2.1 time: 0.578247 Nov 03 04:15:39.827317 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2324/4784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:39 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1514 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:39.855601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:39.858072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5ffdae17-4997-4a6c-84be-eb479e908ab9 req-393c629d-890f-4add-923d-92e8bd1c0bd1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:39.863080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:39.868208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5ffdae17-4997-4a6c-84be-eb479e908ab9 req-393c629d-890f-4add-923d-92e8bd1c0bd1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:39.868208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5ffdae17-4997-4a6c-84be-eb479e908ab9 req-393c629d-890f-4add-923d-92e8bd1c0bd1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:39.880488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:39.882679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:39.883175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:39.883612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:39.884323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:39.884783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:39.894368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:39.896871 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5ffdae17-4997-4a6c-84be-eb479e908ab9 req-393c629d-890f-4add-923d-92e8bd1c0bd1 service nova] Creating event network-changed:7a76f64d-5f6a-47c4-8811-a785f7520732 for instance 5031d1f0-da10-45db-a3a0-a7b979e21098 on n-h1-854653-7 Nov 03 04:15:39.906658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5ffdae17-4997-4a6c-84be-eb479e908ab9 req-393c629d-890f-4add-923d-92e8bd1c0bd1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090946 Nov 03 04:15:39.909418 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2461/4785] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:39.931188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:39.938126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:39.946768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:39.951356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:39.960769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:39.960769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:39.960769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:39.960769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:41.025147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:41.039515 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad89288d-349a-453e-bc52-42ac3adfc1e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 1.112986 Nov 03 04:15:41.069940 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2462/4786] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:39 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:41.077538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:41.078517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:41.084549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:41.086922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:41.087700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:41.088335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:41.089273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:41.093071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:41.093071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:41.114732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:41.122844 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a53d3c32-dd70-4992-a228-e0b604e8af24 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 1.272214 Nov 03 04:15:41.125624 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2325/4787] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:39 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:41.178223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:41.227465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:41.691597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:41.696450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:41.705244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae0ff81e-f042-4289-b2fc-d418ffe68ae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1520 microversion: 2.1 time: 0.633865 Nov 03 04:15:41.706159 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2463/4788] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:41 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1520 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:42.065524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:42.066556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:42.094951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:42.095453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:42.095907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:42.096632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:42.097122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:42.097565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:42.150226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:42.150849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:42.172329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:42.176294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:42.176931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:42.179522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:42.182705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:42.183400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:42.433839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:42.563921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:42.582060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:42.585754 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7f497df-b2fe-4b33-9f9b-8e571a990a8d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.524932 Nov 03 04:15:42.586003 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-434e72a3-e91c-433b-8850-def265d44c79 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.438861 Nov 03 04:15:42.587778 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2464/4789] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:42 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:42.590946 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2326/4790] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:42 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:42.610516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dbd48bea-4560-416e-ac45-1351c289b7a9 req-70ced643-dae0-42be-b79d-99ca482193a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4556c668-4529-40a6-ade2-62ecba063d93", "tag": "7961b8e6-ee70-4f70-905e-8b94bc479c43"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:42.636768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbd48bea-4560-416e-ac45-1351c289b7a9 req-70ced643-dae0-42be-b79d-99ca482193a5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:42.638870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbd48bea-4560-416e-ac45-1351c289b7a9 req-70ced643-dae0-42be-b79d-99ca482193a5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:42.640306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbd48bea-4560-416e-ac45-1351c289b7a9 req-70ced643-dae0-42be-b79d-99ca482193a5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:42.698633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dbd48bea-4560-416e-ac45-1351c289b7a9 req-70ced643-dae0-42be-b79d-99ca482193a5 service nova] Creating event network-changed:7961b8e6-ee70-4f70-905e-8b94bc479c43 for instance 4556c668-4529-40a6-ade2-62ecba063d93 on n-h1-854653-7 Nov 03 04:15:42.709877 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dbd48bea-4560-416e-ac45-1351c289b7a9 req-70ced643-dae0-42be-b79d-99ca482193a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120522 Nov 03 04:15:42.715383 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2465/4791] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:42.737248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:42.738245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:42.762528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:42.763200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:42.763837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:42.764713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:42.765611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:42.766282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:43.609229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:43.610156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:43.634424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:43.637732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:43.638875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:43.642058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:43.644567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:43.647102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.044109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:44.059006 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e005a5f3-fa8b-4e03-b224-cdba55067fe1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1520 microversion: 2.1 time: 1.328320 Nov 03 04:15:44.060029 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2327/4792] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:42 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1520 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:44.068748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:44.070289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:44.079221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.080176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.081082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.082542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.083307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.084224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.510959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:44.524651 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b735dff-0a30-47b2-bccb-d321886c4b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.919589 Nov 03 04:15:44.525282 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2466/4793] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:43 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:44.540434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:44.541248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:44.558116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.558629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.559074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.559809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.560291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.565408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.593292 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c HTTP/1.1 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f5dce2a8-211e-4cad-a50f-82480431c49c'} Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:44.595344 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.600543 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.604031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:44.605888 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b2591b6-0875-4cf9-beb1-e135a2872175 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 404 len: 111 microversion: 2.1 time: 0.075087 Nov 03 04:15:44.607017 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2467/4794] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:15:44 2022] DELETE /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:44.612473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8dc2da0e-d1b9-4091-a6f4-965d9fcbd6aa req-59c0c9a0-59bc-4bec-acae-fe73994ca120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6870a06-4391-4f7f-9730-ad8fe574d8d8", "name": "network-vif-unplugged", "status": "completed", "tag": "946eb81a-7db6-4a2f-98c9-978e60c65b98"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:44.627093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dc2da0e-d1b9-4091-a6f4-965d9fcbd6aa req-59c0c9a0-59bc-4bec-acae-fe73994ca120 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.627779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dc2da0e-d1b9-4091-a6f4-965d9fcbd6aa req-59c0c9a0-59bc-4bec-acae-fe73994ca120 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.628435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8dc2da0e-d1b9-4091-a6f4-965d9fcbd6aa req-59c0c9a0-59bc-4bec-acae-fe73994ca120 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.644888 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8dc2da0e-d1b9-4091-a6f4-965d9fcbd6aa req-59c0c9a0-59bc-4bec-acae-fe73994ca120 service nova] Creating event network-vif-unplugged:946eb81a-7db6-4a2f-98c9-978e60c65b98 for instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 on n-h1-854653-7 Nov 03 04:15:44.652206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8dc2da0e-d1b9-4091-a6f4-965d9fcbd6aa req-59c0c9a0-59bc-4bec-acae-fe73994ca120 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043798 Nov 03 04:15:44.653609 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2468/4795] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:44.659430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:44.660414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: f5dce2a8-211e-4cad-a50f-82480431c49c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:44.668358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.669809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.670659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.671579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.672220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.672820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.701582 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c HTTP/1.1 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f5dce2a8-211e-4cad-a50f-82480431c49c'} Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:44.714770 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance f5dce2a8-211e-4cad-a50f-82480431c49c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1808b125-d4ce-4576-bc52-21807b151c2a tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c" status: 404 len: 111 microversion: 2.1 time: 0.055717 Nov 03 04:15:44.720441 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2469/4796] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:44 2022] GET /compute/v2.1/servers/f5dce2a8-211e-4cad-a50f-82480431c49c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:44.725837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:44.726587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:44.733403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.734150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.735034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.736112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:44.736741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:44.737409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:44.792419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:15:44.942846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:44.983041 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff7cc2d1-5850-4b73-8a38-a4ddbda302c2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.920660 Nov 03 04:15:44.985583 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2328/4797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:44 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:45.004871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:45.006007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:45.020895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.021767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:45.023313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:45.024486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.025429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:45.026273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:45.065801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:15:45.212187 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2ebe0e9-47b7-40f7-952e-f384cafd1873 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 204 len: 0 microversion: 2.1 time: 0.498793 Nov 03 04:15:45.213541 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2470/4798] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:15:44 2022] DELETE /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:15:45.226122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5c2b1535-422f-4f93-a5b8-e5a5d594bc9a req-af68de70-ce8a-46a5-9e74-020c9884367d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4749567-23cb-4bdd-be2c-7adb77fed29a", "tag": "e3300983-7b1f-455c-ba55-56d9a03f3c66"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:45.252441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5c2b1535-422f-4f93-a5b8-e5a5d594bc9a req-af68de70-ce8a-46a5-9e74-020c9884367d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.261404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5c2b1535-422f-4f93-a5b8-e5a5d594bc9a req-af68de70-ce8a-46a5-9e74-020c9884367d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:45.261404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5c2b1535-422f-4f93-a5b8-e5a5d594bc9a req-af68de70-ce8a-46a5-9e74-020c9884367d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:45.283709 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5c2b1535-422f-4f93-a5b8-e5a5d594bc9a req-af68de70-ce8a-46a5-9e74-020c9884367d service nova] Creating event network-changed:e3300983-7b1f-455c-ba55-56d9a03f3c66 for instance c4749567-23cb-4bdd-be2c-7adb77fed29a on n-h2-854653-7 Nov 03 04:15:45.297340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5c2b1535-422f-4f93-a5b8-e5a5d594bc9a req-af68de70-ce8a-46a5-9e74-020c9884367d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079269 Nov 03 04:15:45.297340 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2471/4799] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:45.303518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:45.304957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:45.324501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.325773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:45.326768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:45.328095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.329712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:45.330159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:45.498334 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-761c9b0b-31fd-4da3-b7e0-462cdf3b1616 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 204 len: 0 microversion: 2.1 time: 0.507300 Nov 03 04:15:45.498334 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2329/4800] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:15:44 2022] DELETE /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:15:45.507295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:45.511432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:45.530165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.532833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:45.533591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:45.537359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.539100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:45.540560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:45.957186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:45.967772 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0147422-3e8e-43b6-9333-fb3437c84dc8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1520 microversion: 2.1 time: 0.669011 Nov 03 04:15:45.968348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2472/4801] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:45 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1520 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:45.987344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:45.988785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:45.998818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:45.999628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:46.011660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:46.011660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:46.011660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:46.011660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:46.019796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:46.036729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8ea6029-5ae1-4522-8932-0ac3c1f8a541 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1668 microversion: 2.1 time: 0.535525 Nov 03 04:15:46.037366 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2330/4802] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:45 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1668 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:46.048119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:46.048731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:46.069174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:46.069833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:46.070149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:46.070885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:46.071472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:46.074971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:46.515326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:46.524088 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8d41eee-0b4b-46e1-83d6-3f2095dbb7e0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.485075 Nov 03 04:15:46.525123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2331/4803] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:46 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:46.530227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:46.530769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:46.530943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:46.537098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:46.537860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:46.538481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:46.539365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:46.539999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:46.540587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:46.540942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-def7283b-a982-4d62-8477-9d1c61656b46 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.564866 Nov 03 04:15:46.546075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:46.546942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2473/4804] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:45 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:46.993998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:46.994758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:47.016342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:47.016932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:47.021836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:47.027335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:47.029476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:47.029942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:47.489319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:47.501895 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d120351-e8a8-41d9-87ec-a8e51bd38d52 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.975499 Nov 03 04:15:47.502490 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2332/4805] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:46 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:47.512377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:47.513002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:47.526381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:47.526890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:47.532396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:47.533322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:47.534009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:47.534443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:48.309222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:48.317624 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18fea331-0891-4053-94e3-e41e3b3c0de1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1520 microversion: 2.1 time: 1.329388 Nov 03 04:15:48.318222 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2474/4806] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:46 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1520 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:48.329325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:48.336678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:48.345739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:48.346246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:48.346690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:48.347410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:48.347872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:48.348305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:48.593440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:48.604795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f7d5d2d-98e5-4324-b61b-fc464265aec1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1549 microversion: 2.1 time: 1.100840 Nov 03 04:15:48.605605 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2333/4807] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:47 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1549 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:48.611850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:48.613187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:48.621129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:48.621911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:48.623502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:48.624297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:48.624766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:48.625260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:48.639665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:48.653134 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e57713d-80a0-417c-a758-42b1418d98be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.327131 Nov 03 04:15:48.654115 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2475/4808] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:48 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:48.687753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7956c672-5dd6-49cc-a774-6adedc7fb73f req-7d8d1db4-1b21-4384-9656-0f0343e8176d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6870a06-4391-4f7f-9730-ad8fe574d8d8", "name": "network-vif-plugged", "status": "completed", "tag": "946eb81a-7db6-4a2f-98c9-978e60c65b98"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:48.709160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7956c672-5dd6-49cc-a774-6adedc7fb73f req-7d8d1db4-1b21-4384-9656-0f0343e8176d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:48.710866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7956c672-5dd6-49cc-a774-6adedc7fb73f req-7d8d1db4-1b21-4384-9656-0f0343e8176d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:48.711324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7956c672-5dd6-49cc-a774-6adedc7fb73f req-7d8d1db4-1b21-4384-9656-0f0343e8176d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:48.731171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7956c672-5dd6-49cc-a774-6adedc7fb73f req-7d8d1db4-1b21-4384-9656-0f0343e8176d service nova] Creating event network-vif-plugged:946eb81a-7db6-4a2f-98c9-978e60c65b98 for instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 on n-h1-854653-7 Nov 03 04:15:48.735307 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7956c672-5dd6-49cc-a774-6adedc7fb73f req-7d8d1db4-1b21-4384-9656-0f0343e8176d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077612 Nov 03 04:15:48.736957 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2476/4809] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:48.743983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:48.744893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:48.752300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:48.752993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:48.754799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:48.756009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:48.757256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:48.757726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.098071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:49.107424 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1599dd9a-c0d8-4b42-bc9f-16f0144fda8c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.500572 Nov 03 04:15:49.108105 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2334/4810] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:48 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:49.118496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6e2ce908-3e10-436b-bbab-dd7d1dad42ca req-2b0fd896-e1af-438a-8d7f-7bf5affde69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4749567-23cb-4bdd-be2c-7adb77fed29a", "name": "network-vif-deleted", "tag": "e3300983-7b1f-455c-ba55-56d9a03f3c66"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:49.138607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6e2ce908-3e10-436b-bbab-dd7d1dad42ca req-2b0fd896-e1af-438a-8d7f-7bf5affde69e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.138607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6e2ce908-3e10-436b-bbab-dd7d1dad42ca req-2b0fd896-e1af-438a-8d7f-7bf5affde69e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.138607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6e2ce908-3e10-436b-bbab-dd7d1dad42ca req-2b0fd896-e1af-438a-8d7f-7bf5affde69e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.152072 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6e2ce908-3e10-436b-bbab-dd7d1dad42ca req-2b0fd896-e1af-438a-8d7f-7bf5affde69e service nova] Creating event network-vif-deleted:e3300983-7b1f-455c-ba55-56d9a03f3c66 for instance c4749567-23cb-4bdd-be2c-7adb77fed29a on n-h2-854653-7 Nov 03 04:15:49.160419 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6e2ce908-3e10-436b-bbab-dd7d1dad42ca req-2b0fd896-e1af-438a-8d7f-7bf5affde69e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046729 Nov 03 04:15:49.161104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:49.161734 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2335/4811] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:49.182923 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f9e14b13-3ccf-4fdd-b276-f683a21e38eb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.443985 Nov 03 04:15:49.186776 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2477/4812] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:48 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:49.346437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:49.347346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:49.359787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.360487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.361512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.362495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.363189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.363978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.629352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:49.630141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:49.638224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.639332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.639952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.640859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.641512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.642000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.679774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.680676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.681415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.682087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lazy-loading 'fault' on Instance uuid c4749567-23cb-4bdd-be2c-7adb77fed29a {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:15:49.799438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:49.810647 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e5b6ded-27a8-444f-a99d-4e755256ec64 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 200 len: 1337 microversion: 2.1 time: 0.185969 Nov 03 04:15:49.812662 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2478/4813] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:49 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 1337 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:49.818486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:49.819121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:49.836220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.836751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.837350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.838167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:49.838663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:49.839101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:49.898428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:49.916204 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4338aabf-3bcf-4e66-9b2f-6170d59ec80b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1520 microversion: 2.1 time: 0.574652 Nov 03 04:15:49.932119 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2336/4814] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:49 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1520 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:50.130668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:50.131426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:50.138226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.138792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.139219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:50.139932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.140396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.140827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:50.188231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:50.198662 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-292029cf-6e94-47db-b482-ca597f66aed5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.384462 Nov 03 04:15:50.199521 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2479/4815] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:49 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:50.218904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:50.219915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:50.226403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.226969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.227728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:50.228281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.228806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.229338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:50.514295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:50.523048 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84c564f4-3e9d-4ffd-8867-b57678810210 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1512 microversion: 2.1 time: 0.396349 Nov 03 04:15:50.523630 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2337/4816] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:50 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:50.629048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:50.638614 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e61aefa-8880-4e03-80e5-10e9d49579da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.423888 Nov 03 04:15:50.639378 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2480/4817] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:50 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:50.837635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:50.838423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: c4749567-23cb-4bdd-be2c-7adb77fed29a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:50.840694 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:15:50.840977 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a (ip 10.222.0.30) !!! Nov 03 04:15:50.854674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.858456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.858456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:50.858860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.859227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.860016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:50.893446 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] HTTP exception thrown: Instance c4749567-23cb-4bdd-be2c-7adb77fed29a could not be found. Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Request method failure captured: Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a HTTP/1.1 Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-4IAnl34rYSGAvJa3J4yoQ-n2hDnCMkkjhXn9Ras4udVoEU5J6m7fIgorWFF9gYuH9ADZRItivaL2F5b7w6sj_0mhSRrCf-wu3WsGwuPM-BoDOcEf8p5Yqz2kDxhsSBUgYS89GPYNnmpbhDb08w1fGA4dlcS5AXUtRTursOXrOAuA Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 85363c2a53b549da92c7e3f9b09294bc Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkBasicOps-394395558 Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85363c2a53b549da92c7e3f9b09294bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85363c2a53b549da92c7e3f9b09294bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85363c2a53b549da92c7e3f9b09294bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85363c2a53b549da92c7e3f9b09294bc"}]}] Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkBasicOps-394395558 Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 85363c2a53b549da92c7e3f9b09294bc Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkBasicOps-394395558 Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkBasicOps-394395558-project Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a3c6e4b088224f33aa607e2a27ed798b Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkBasicOps-394395558-project Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance c4749567-23cb-4bdd-be2c-7adb77fed29a could not be found. Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'c4749567-23cb-4bdd-be2c-7adb77fed29a'} Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4749567-23cb-4bdd-be2c-7adb77fed29a could not be found. Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4749567-23cb-4bdd-be2c-7adb77fed29a could not be found. Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:50.898386 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4749567-23cb-4bdd-be2c-7adb77fed29a could not be found. Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:15:50.904105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Returning 404 to user: Instance c4749567-23cb-4bdd-be2c-7adb77fed29a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:50.904895 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ed49871-111b-41ee-80b0-f5eac9c5548a tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a" status: 404 len: 111 microversion: 2.1 time: 0.071380 Nov 03 04:15:50.911246 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2338/4818] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:50 2022] GET /compute/v2.1/servers/c4749567-23cb-4bdd-be2c-7adb77fed29a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:50.943174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:50.944466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:50.951277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.951590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.952048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:50.953659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:50.954517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:50.954978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.203984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:51.212294 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c00a960c-dc1e-43ad-bdb7-968a1f59a4f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1520 microversion: 2.1 time: 0.275064 Nov 03 04:15:51.216083 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2481/4819] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:50 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:51.221249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:51.221865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:51.228577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:51.229106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:51.229843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.230552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:51.231238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:51.231672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.264700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b0ffd1b8-c767-4311-be0a-4402a38d0bcc req-79b85f88-a6c9-43a6-a720-f478e8728ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d5654b4-009d-4bff-b1f3-d835ea94a615", "name": "network-vif-deleted", "tag": "eda54677-27f1-4356-ba50-c78608583439"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:51.281527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b0ffd1b8-c767-4311-be0a-4402a38d0bcc req-79b85f88-a6c9-43a6-a720-f478e8728ca5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:51.282253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b0ffd1b8-c767-4311-be0a-4402a38d0bcc req-79b85f88-a6c9-43a6-a720-f478e8728ca5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:51.282855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b0ffd1b8-c767-4311-be0a-4402a38d0bcc req-79b85f88-a6c9-43a6-a720-f478e8728ca5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.308732 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b0ffd1b8-c767-4311-be0a-4402a38d0bcc req-79b85f88-a6c9-43a6-a720-f478e8728ca5 service nova] Creating event network-vif-deleted:eda54677-27f1-4356-ba50-c78608583439 for instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 on n-h1-854653-7 Nov 03 04:15:51.322658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b0ffd1b8-c767-4311-be0a-4402a38d0bcc req-79b85f88-a6c9-43a6-a720-f478e8728ca5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061760 Nov 03 04:15:51.323639 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2482/4820] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:15:51.328869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c874fd81-1681-4d82-b394-5461ebb3d202 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '.version_select at 0x7ff7f8495af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:51.414719 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c874fd81-1681-4d82-b394-5461ebb3d202 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-116340486" status: 202 len: 0 microversion: 2.1 time: 0.089602 Nov 03 04:15:51.415420 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2483/4821] 10.222.0.30 () {58 vars in 1254 bytes} [Thu Nov 3 04:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-116340486 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:15:51.547785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:51.549061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:51.561145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:51.561976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:51.566024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.570017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:51.570017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:51.570017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.623371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:51.648858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:51.663986 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93cc4a7c-a457-4475-a1aa-601d32ca3d2c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.441828 Nov 03 04:15:51.668074 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2339/4822] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:51 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:51.674042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:51.675715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:51.683900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:51.684759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:51.686288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.688855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:51.689635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:51.690525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:51.705842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:51.714880 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f92aa51-4122-4164-9d82-755b74a6ee7e tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1470 microversion: 2.1 time: 0.171718 Nov 03 04:15:51.719083 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2484/4823] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:51 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1470 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:52.035637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:52.045370 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d48bf397-4082-4f44-96a1-444c4cbcf3a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.375724 Nov 03 04:15:52.046524 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2340/4824] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:51 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:52.238066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:52.239191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:52.250582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:52.251668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:52.252793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:52.253749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:52.254415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:52.255039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:52.694209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:52.694835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:52.702124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:52.703438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:52.704015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:52.704962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:52.705682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:52.706186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:52.876022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:52.888866 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28e74099-1b9a-43d0-b65c-acacb6a845f0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1520 microversion: 2.1 time: 0.656908 Nov 03 04:15:52.891064 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2485/4825] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:52 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1520 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:52.902004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:52.902980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:52.918708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:52.920080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:52.921939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:52.929008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:52.929797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:52.930409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:53.019251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:53.022727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:53.023252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:53.024692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lazy-loading 'fault' on Instance uuid 5d5654b4-009d-4bff-b1f3-d835ea94a615 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:15:53.152777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52ea9e0295e4b2a8eefa7ac31bf3ddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '643105f36872458fa8c9e8d70089b9d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:53.160362 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69750b38-aa1f-4abd-8f1d-cedd9e32f7d5 tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 200 len: 1306 microversion: 2.1 time: 0.267840 Nov 03 04:15:53.160946 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2486/4826] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:52 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 1306 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:53.167391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:53.168122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:53.174697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:53.175540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:53.176183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:53.177196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:53.178008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:53.179287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:53.503002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:53.512480 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da4cb55a-1368-4c47-b623-19ab18b9114f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.822081 Nov 03 04:15:53.513564 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2341/4827] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:52 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:53.583584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:53.593034 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ded2546c-efd8-46e7-938c-21dbfc91d798 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.429668 Nov 03 04:15:53.595229 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2487/4828] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:53 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:53.920494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:53.921912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:53.934178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:53.935756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:53.936513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:53.937540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:53.938208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:53.938836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:54.184928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:54.187809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] [instance: 5d5654b4-009d-4bff-b1f3-d835ea94a615] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:54.205430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:54.210646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:54.211605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:54.219499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:54.222162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:54.237649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:54.276768 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] HTTP exception thrown: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 could not be found. Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Request method failure captured: Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 HTTP/1.1 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz-De77nK09jTZkbLwmI8hg2xnhtg8K6oBtWo9yqsh4SRdlfQb-JgEGfW6EBsr_MsB0Y3zG7k1-EQEEfRRyjckZ31O9FUlnUhAKEnB_H4IZ-vv-UfZ13-y_y0MyVSmIvgwTbYh7DMdOPwJ-2OYAmRwRw2ykFJ1CLJ8V0_kQxSV4EYjc Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_643105f36872458fa8c9e8d70089b9d9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/643105f36872458fa8c9e8d70089b9d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/643105f36872458fa8c9e8d70089b9d9"}]}] Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 643105f36872458fa8c9e8d70089b9d9 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-200483345 Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f52ea9e0295e4b2a8eefa7ac31bf3ddf Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-200483345-project Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 could not be found. Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5d5654b4-009d-4bff-b1f3-d835ea94a615'} Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 could not be found. Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 could not be found. Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:15:54.280561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 could not be found. Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] Returning 404 to user: Instance 5d5654b4-009d-4bff-b1f3-d835ea94a615 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-47170774-8e98-4136-869f-6e53bf882f7c tempest-ServersNegativeTestJSON-200483345 tempest-ServersNegativeTestJSON-200483345-project] 10.222.0.30 "GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615" status: 404 len: 111 microversion: 2.1 time: 0.107747 Nov 03 04:15:54.292425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2488/4829] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:54 2022] GET /compute/v2.1/servers/5d5654b4-009d-4bff-b1f3-d835ea94a615 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:15:54.431313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:54.441517 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bbcbb17c-00ad-4c42-8267-36fc83cce1ae tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1505 microversion: 2.1 time: 0.525660 Nov 03 04:15:54.444270 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2342/4830] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:53 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:54.471288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:54.472066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:54.486395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:54.487081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:54.487620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:54.488502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:54.489003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:54.490094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:54.537954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:54.539315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:54.548220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:54.552447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:54.553287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:54.556675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:54.558078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:54.558760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:55.410416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:55.421438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:55.430572 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-39f58564-fb8d-43d0-9e1a-14468dc86839 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 200 len: 1505 microversion: 2.1 time: 0.963415 Nov 03 04:15:55.433260 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2489/4831] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:54 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 1505 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:55.457492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-75b0b6a9-c507-4b9f-83be-9aa63858a362 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 0.925036 Nov 03 04:15:55.460934 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2343/4832] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:54 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:15:55.474108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-698c2e2f-9d7e-46a8-ab99-7a9f43339654 req-fae47ff1-cba0-4dbe-b429-5802dc812c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5031d1f0-da10-45db-a3a0-a7b979e21098", "name": "network-vif-plugged", "status": "completed", "tag": "7a76f64d-5f6a-47c4-8811-a785f7520732"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:55.474463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:55.475512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:55.482278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:55.483034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:55.483962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:55.485350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:55.486022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:55.486657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:55.498356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-698c2e2f-9d7e-46a8-ab99-7a9f43339654 req-fae47ff1-cba0-4dbe-b429-5802dc812c59 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:55.499447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-698c2e2f-9d7e-46a8-ab99-7a9f43339654 req-fae47ff1-cba0-4dbe-b429-5802dc812c59 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:55.502565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-698c2e2f-9d7e-46a8-ab99-7a9f43339654 req-fae47ff1-cba0-4dbe-b429-5802dc812c59 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:55.530838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-698c2e2f-9d7e-46a8-ab99-7a9f43339654 req-fae47ff1-cba0-4dbe-b429-5802dc812c59 service nova] Creating event network-vif-plugged:7a76f64d-5f6a-47c4-8811-a785f7520732 for instance 5031d1f0-da10-45db-a3a0-a7b979e21098 on n-h1-854653-7 Nov 03 04:15:55.551457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-698c2e2f-9d7e-46a8-ab99-7a9f43339654 req-fae47ff1-cba0-4dbe-b429-5802dc812c59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088714 Nov 03 04:15:55.553030 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2344/4833] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:55.585367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:55.585983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:55.612886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:55.613416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:55.613861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:55.622899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:55.623410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:55.626156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:55.696819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:15:56.333613 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c9719b4-20e9-406a-906c-6ab99c29a76b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 204 len: 0 microversion: 2.1 time: 0.779025 Nov 03 04:15:56.341415 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2345/4834] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:15:55 2022] DELETE /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:15:56.483315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:56.484876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:56.503687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:56.506084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:56.507187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:56.508261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:56.508970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:56.509627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:56.576336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:56.592174 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ef2b303-2ae8-4682-97d4-ceb6b1bb5311 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 1.157353 Nov 03 04:15:56.593390 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2490/4835] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:55 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:56.600951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-556684473", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "7acae962-25a6-439e-baa0-a7ea8c1ce2c9"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:56.670911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] validate_networks() for [('7acae962-25a6-439e-baa0-a7ea8c1ce2c9', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:15:57.595426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:57.605448 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7602046a-8b60-4e73-98b4-228974fd021f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 1.126415 Nov 03 04:15:57.606792 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2346/4836] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:56 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:57.611909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5104cf47-b2a9-4e9c-8b7e-cda0be10a45d req-9ab3bf0e-b8d1-4e58-afca-8efdacc64556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4556c668-4529-40a6-ade2-62ecba063d93", "name": "network-vif-plugged", "status": "completed", "tag": "7961b8e6-ee70-4f70-905e-8b94bc479c43"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:15:57.626071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5104cf47-b2a9-4e9c-8b7e-cda0be10a45d req-9ab3bf0e-b8d1-4e58-afca-8efdacc64556 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:57.628276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5104cf47-b2a9-4e9c-8b7e-cda0be10a45d req-9ab3bf0e-b8d1-4e58-afca-8efdacc64556 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:57.628276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5104cf47-b2a9-4e9c-8b7e-cda0be10a45d req-9ab3bf0e-b8d1-4e58-afca-8efdacc64556 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:57.643395 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5104cf47-b2a9-4e9c-8b7e-cda0be10a45d req-9ab3bf0e-b8d1-4e58-afca-8efdacc64556 service nova] Creating event network-vif-plugged:7961b8e6-ee70-4f70-905e-8b94bc479c43 for instance 4556c668-4529-40a6-ade2-62ecba063d93 on n-h1-854653-7 Nov 03 04:15:57.649918 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5104cf47-b2a9-4e9c-8b7e-cda0be10a45d req-9ab3bf0e-b8d1-4e58-afca-8efdacc64556 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041735 Nov 03 04:15:57.653032 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2347/4837] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:15:57.658995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:57.660005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:57.672208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:57.672714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:57.673336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:57.674068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:57.674533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:57.675126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:58.202797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:58.213966 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-841867da-de8c-4c37-ae61-d22e9cfa6ad3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1308 microversion: 2.1 time: 0.561520 Nov 03 04:15:58.242781 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2348/4838] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:57 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:58.460721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:15:58.464188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:15:58.464935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:15:58.466242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:15:58.467711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:15:58.500899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:58.501912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:58.504226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:58.506049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:58.508893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:58.509607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:58.568286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Getting quotas for project b201c36deaa948b7a3f24424163a52d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:15:58.579440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Getting quotas for user 46a45724be7940dfb595b9db8e828e41 and project b201c36deaa948b7a3f24424163a52d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:15:58.613681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:15:58.617042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:15:58.636975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:58.637982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:58.648231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:58.651421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:58.652159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:58.653201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:58.662943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:58.663781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:58.852271 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-11d5dc51-926a-4953-9f66-c492b40449c4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.257500 Nov 03 04:15:58.852945 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2491/4839] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:15:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:15:58.865597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9865943f-5ef7-49e3-8cd6-cb120d4406f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:58.866443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9865943f-5ef7-49e3-8cd6-cb120d4406f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:59.285389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9865943f-5ef7-49e3-8cd6-cb120d4406f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:59.310527 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9865943f-5ef7-49e3-8cd6-cb120d4406f3 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1217 microversion: 2.1 time: 0.448121 Nov 03 04:15:59.326716 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2492/4840] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:58 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1217 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:15:59.340403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:15:59.350140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:15:59.364335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:59.364335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:59.364335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:59.364335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:15:59.364335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:15:59.364335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:15:59.650763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:15:59.654206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:15:59.666036 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-694292a6-5b8e-4458-9c2e-9b691e564048 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1314 microversion: 2.1 time: 1.032799 Nov 03 04:15:59.668507 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2349/4841] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:58 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:00.011588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e144c36f-3550-4cc6-9c1b-414289b80905 req-05c8ca67-1251-4d75-bf16-f24200a0e844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6870a06-4391-4f7f-9730-ad8fe574d8d8", "name": "network-vif-deleted", "tag": "946eb81a-7db6-4a2f-98c9-978e60c65b98"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:00.043752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e144c36f-3550-4cc6-9c1b-414289b80905 req-05c8ca67-1251-4d75-bf16-f24200a0e844 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.044318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e144c36f-3550-4cc6-9c1b-414289b80905 req-05c8ca67-1251-4d75-bf16-f24200a0e844 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.044797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e144c36f-3550-4cc6-9c1b-414289b80905 req-05c8ca67-1251-4d75-bf16-f24200a0e844 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.067839 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e144c36f-3550-4cc6-9c1b-414289b80905 req-05c8ca67-1251-4d75-bf16-f24200a0e844 service nova] Creating event network-vif-deleted:946eb81a-7db6-4a2f-98c9-978e60c65b98 for instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 on n-h1-854653-7 Nov 03 04:16:00.094798 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e144c36f-3550-4cc6-9c1b-414289b80905 req-05c8ca67-1251-4d75-bf16-f24200a0e844 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078540 Nov 03 04:16:00.106160 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2350/4842] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:16:00.127127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:00.159701 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2792f95-ff97-44e1-bcab-7a18ca901b6d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1488 microversion: 2.1 time: 0.827527 Nov 03 04:16:00.160424 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2493/4843] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:15:59 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1488 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:00.188219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:00.188853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:00.213338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.213338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.213581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.214335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.214814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.215110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.305005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lazy-loading 'flavor' on Instance uuid 5031d1f0-da10-45db-a3a0-a7b979e21098 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:16:00.341847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:00.342584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:00.366329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.369347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.369347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.369347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.369347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.369347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.542163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:00.552378 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53c668c4-8811-47a6-af1a-66d139a4829a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1221 microversion: 2.1 time: 0.215328 Nov 03 04:16:00.553567 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2494/4844] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:00 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1221 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:00.695421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:00.696049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:00.707989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.708487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.710581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.714237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.715126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.717988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.762722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-86d6132e-92a2-4500-9cd4-f25b034b00c5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098/action" status: 202 len: 0 microversion: 2.1 time: 0.578894 Nov 03 04:16:00.763373 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2351/4845] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:16:00 2022] POST /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:16:00.782994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:00.797703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:00.826455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.833453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.834607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:00.836024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:00.837599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:00.838650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:01.486713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:01.519727 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1740eef0-a23d-446c-b25e-909225526a41 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1502 microversion: 2.1 time: 0.827034 Nov 03 04:16:01.523005 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2495/4846] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:00 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1502 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:01.577424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:01.578733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:01.605520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:01.607655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:01.608730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:01.612137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:01.613346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:01.614533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:01.639725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:01.661849 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57b5e517-db0e-44fe-9572-507e39e5c0d8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1496 microversion: 2.1 time: 0.885480 Nov 03 04:16:01.667284 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2352/4847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:00 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1496 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:01.691552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:01.697762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:01.709739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:01.710465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:01.711249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:01.712166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:01.712820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:01.737922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:02.010297 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d3d19ea8-43ba-4c92-9251-544db6ab374e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93/action" status: 202 len: 0 microversion: 2.1 time: 0.444956 Nov 03 04:16:02.011635 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2496/4848] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:16:01 2022] POST /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:16:02.024953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:02.036872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:02.057921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:02.058433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:02.063469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:02.064433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:02.066234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:02.077690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:02.354972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:02.368690 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7227d32c-5a0c-4132-920c-8ccec878c761 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1269 microversion: 2.1 time: 0.678048 Nov 03 04:16:02.373633 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2353/4849] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:01 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1269 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:02.695316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:02.696053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:02.703753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:02.706301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:02.706758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:02.707482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:02.707941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:02.708378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:02.817651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:02.829330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7170d785-55e0-4dcb-8a8a-5029142805a3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1507 microversion: 2.1 time: 0.811661 Nov 03 04:16:02.830191 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2497/4850] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:02 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1507 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:03.176768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:03.191908 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f95e730-078a-4be1-8239-5fd7e79f0d06 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 200 len: 1479 microversion: 2.1 time: 0.504328 Nov 03 04:16:03.195148 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2354/4851] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:02 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 1479 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:03.240726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-341254986"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:03.247454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:03.258892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:03.260429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:03.261060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:03.262029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:03.262981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:03.263679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:03.395938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:03.397965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:03.412834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:03.416472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:03.416472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:03.416472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:03.416472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:03.416472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:03.875616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:03.889822 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-98a5b0bc-87a0-4c49-b7f2-d349518a18c2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1275 microversion: 2.1 time: 0.498416 Nov 03 04:16:03.891314 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2355/4852] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:03 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1275 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:03.923322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:03.925070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:03.925483 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33de477b-b862-49e7-bf3c-bfeb32dbdc2a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098/action" status: 202 len: 0 microversion: 2.1 time: 0.703158 Nov 03 04:16:03.929204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2498/4853] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:16:03 2022] POST /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:16:03.947334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:03.947828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:03.948277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:03.949001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:03.949499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:03.950902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5741601-350c-4dda-9bd7-ecc80ab9c859 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8474e50>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:03.956341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:04.022034 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b5741601-350c-4dda-9bd7-ecc80ab9c859 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.086426 Nov 03 04:16:04.025592 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2499/4854] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:03 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:04.692096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:04.707089 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42f1032c-353f-4f40-99cb-e71a01b3cdc1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1487 microversion: 2.1 time: 0.813113 Nov 03 04:16:04.708084 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2356/4855] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:03 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1487 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:04.736721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:04.737398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:04.739467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:04.748085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:04.748872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:04.749545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:04.750440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:04.751061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:04.751652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:04.800759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lazy-loading 'flavor' on Instance uuid 4556c668-4529-40a6-ade2-62ecba063d93 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:16:04.919933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:04.921458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:04.947473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:04.948068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:04.954507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:04.955519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:04.956169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:04.958460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:04.959548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:05.453960 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c29978e7-4a1d-4631-882a-09bc55945589 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93/action" status: 202 len: 0 microversion: 2.1 time: 0.722151 Nov 03 04:16:05.457432 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2500/4856] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:16:04 2022] POST /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:16:05.470674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:05.472878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30df234f-2a22-4de6-a73f-c96391850c14 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84aa3a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:05.490586 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aa7fe284-7003-42f2-8288-ce4ca64e565b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.570776 Nov 03 04:16:05.493430 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2357/4857] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:04 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:05.514823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:05.515481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:05.543159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:05.543159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:05.543159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:05.543159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:05.543159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:05.548456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:05.577585 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30df234f-2a22-4de6-a73f-c96391850c14 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.118408 Nov 03 04:16:05.579179 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2501/4858] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:05 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:06.073345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:06.085998 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8956c531-62d4-4004-83c7-16548bb29d1f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1493 microversion: 2.1 time: 0.584690 Nov 03 04:16:06.087916 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2358/4859] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:05 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1493 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:06.520123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:06.523992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:06.541780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:06.542279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:06.542720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:06.543444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:06.543903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:06.544336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:06.594930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ce1143c-4501-41f5-a4b0-c1f4c67460c3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8b97310>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:06.684187 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ce1143c-4501-41f5-a4b0-c1f4c67460c3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.093163 Nov 03 04:16:06.685179 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2359/4860] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:06 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:06.935268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:06.946952 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-81da0f3d-b045-431d-aa3d-ca3816ec7033 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.431669 Nov 03 04:16:06.948265 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2502/4861] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:06 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:07.116189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:07.116822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:07.131638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:07.132923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:07.135823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:07.136804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:07.137506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:07.138117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:07.594082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:07.609147 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1237eb90-1cf7-4747-9041-3cfc4d132368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1493 microversion: 2.1 time: 0.499870 Nov 03 04:16:07.622425 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2360/4862] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:07 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1493 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:07.705839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac9c9f9d-3fe5-481e-b1c5-d425be1067a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84078b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:07.797002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac9c9f9d-3fe5-481e-b1c5-d425be1067a9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.099178 Nov 03 04:16:07.798576 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2503/4863] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:07 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:07.972945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:07.974004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:07.989080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:07.990304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:07.991163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:07.993910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:07.994528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:08.010637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7fdbb66e-eb43-42fd-b188-40c74eeb3460 req-e1c82311-c232-4950-9e5e-9053dba4b886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3459bc-8d10-4cb7-9f01-daa77c4a59b5", "tag": "2f966733-7844-4633-9607-9fb1d584e31f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:08.016158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:08.036988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7fdbb66e-eb43-42fd-b188-40c74eeb3460 req-e1c82311-c232-4950-9e5e-9053dba4b886 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:08.037804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7fdbb66e-eb43-42fd-b188-40c74eeb3460 req-e1c82311-c232-4950-9e5e-9053dba4b886 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:08.039027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7fdbb66e-eb43-42fd-b188-40c74eeb3460 req-e1c82311-c232-4950-9e5e-9053dba4b886 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:08.066743 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7fdbb66e-eb43-42fd-b188-40c74eeb3460 req-e1c82311-c232-4950-9e5e-9053dba4b886 service nova] Creating event network-changed:2f966733-7844-4633-9607-9fb1d584e31f for instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 on n-h2-854653-7 Nov 03 04:16:08.080117 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7fdbb66e-eb43-42fd-b188-40c74eeb3460 req-e1c82311-c232-4950-9e5e-9053dba4b886 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080574 Nov 03 04:16:08.080785 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2504/4864] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:16:08.643165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:08.643893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:08.646692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:08.654439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:08.655096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:08.655391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:08.665272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:08.665957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:08.666429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:09.096348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:09.110878 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f785a4d8-6813-4c36-93ab-18b87371eadc tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 1.141034 Nov 03 04:16:09.111868 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2361/4865] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:07 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:09.122007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-05f93085-6c7f-40ac-bc1f-4195f78102ad tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f83e2280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:09.197761 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-05f93085-6c7f-40ac-bc1f-4195f78102ad tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.084498 Nov 03 04:16:09.199508 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2362/4866] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:09 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:09.233713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:09.245742 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-edb4372c-53ec-49ec-896e-83db220daed7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1514 microversion: 2.1 time: 0.607236 Nov 03 04:16:09.251209 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2505/4867] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:08 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1514 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:10.139706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:10.142195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:10.148864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:10.149625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:10.150299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:10.151020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:10.151660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:10.152279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:10.214817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b177a864-fd0b-4faf-80bd-03305d93dbcd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f845fa60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:10.226634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:10.294470 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b177a864-fd0b-4faf-80bd-03305d93dbcd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.083817 Nov 03 04:16:10.305205 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2506/4868] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:10 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:10.331734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:10.338531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:10.354244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:10.355913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:10.356956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:10.358156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:10.359683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:10.365970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:10.488474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:10.535660 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1cf153ff-fa58-491b-96f3-5d1194e32555 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.400685 Nov 03 04:16:10.543943 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2363/4869] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:10 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:10.668675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:10.677976 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e12bb6a4-143a-465c-b315-76afe86f82d6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1514 microversion: 2.1 time: 0.367359 Nov 03 04:16:10.679593 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2507/4870] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:10 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:11.312946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42ecb1ae-bd71-4b85-a568-d061d2b12f25 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8457040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:11.410700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42ecb1ae-bd71-4b85-a568-d061d2b12f25 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.101908 Nov 03 04:16:11.412144 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2364/4871] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:11 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:11.564019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:11.564649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:11.579567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:11.580075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:11.584216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:11.586628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:11.591437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:11.592197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:11.704448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:11.705475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:11.710083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:11.724495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:11.730923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:11.730923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:11.735235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:11.735985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:11.736771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:12.451720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:12.464432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b6d5c2c-39ec-4fd1-88ff-ac3a3f1d734b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1514 microversion: 2.1 time: 0.761994 Nov 03 04:16:12.466189 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2365/4872] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:11 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1514 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:12.472584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bbd79f46-0096-49df-b9f7-fec1d5c6dc09 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f99b4280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:12.552070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bbd79f46-0096-49df-b9f7-fec1d5c6dc09 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1439 microversion: 2.1 time: 0.084734 Nov 03 04:16:12.554121 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2366/4873] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:12 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1439 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:12.712170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:12.728417 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3faba4c-e2ec-4586-a946-1a1303118a21 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 1.168816 Nov 03 04:16:12.735279 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2508/4874] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:11 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:13.498552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:13.500028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:13.520636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:13.521561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:13.526027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:13.527529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:13.528508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:13.531776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:13.569536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96b528e4-519f-4452-82b8-048693811acf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f849d790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:14.000649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:14.014005 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-92128d27-581a-4095-a243-9441ff1acfdf tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.524401 Nov 03 04:16:14.015369 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2367/4875] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:13 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:14.022664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:14.029894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:14.045152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:14.047095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:14.048384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:14.052083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:14.053067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:14.053703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:14.438505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:14.451999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b1968f6-0a7a-4ae7-a702-406dea79d668 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.435115 Nov 03 04:16:14.460800 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2368/4876] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:14 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:15.043663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:15.044355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:15.067964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:15.072067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:15.075383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:15.078791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:15.079491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:15.081376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:15.152613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:16.841367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:16.868876 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52b010f3-2d74-404d-a078-a3ffe53e5607 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 1.825058 Nov 03 04:16:16.885058 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2369/4877] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:15 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:16.892029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:16.896687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:16.930693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:16.937221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:16.939993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:16.941289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:16.946310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:16.947005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:17.505868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:17.534306 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-621c169a-54b5-4f2e-aa21-b17f60f1f539 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.661282 Nov 03 04:16:17.536330 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2370/4878] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:16 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:17.545518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e018e14a-a46f-4832-998a-d27d526e3e09 req-e3580c47-7f14-4779-9059-aa2c98ae047a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5031d1f0-da10-45db-a3a0-a7b979e21098", "name": "network-vif-plugged", "status": "completed", "tag": "7a76f64d-5f6a-47c4-8811-a785f7520732"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:17.562326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e018e14a-a46f-4832-998a-d27d526e3e09 req-e3580c47-7f14-4779-9059-aa2c98ae047a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:17.563649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e018e14a-a46f-4832-998a-d27d526e3e09 req-e3580c47-7f14-4779-9059-aa2c98ae047a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:17.564358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e018e14a-a46f-4832-998a-d27d526e3e09 req-e3580c47-7f14-4779-9059-aa2c98ae047a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:17.585292 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e018e14a-a46f-4832-998a-d27d526e3e09 req-e3580c47-7f14-4779-9059-aa2c98ae047a service nova] Creating event network-vif-plugged:7a76f64d-5f6a-47c4-8811-a785f7520732 for instance 5031d1f0-da10-45db-a3a0-a7b979e21098 on n-h1-854653-7 Nov 03 04:16:17.592722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e018e14a-a46f-4832-998a-d27d526e3e09 req-e3580c47-7f14-4779-9059-aa2c98ae047a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053561 Nov 03 04:16:17.593809 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2371/4879] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:16:17.901798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:17.903606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:17.938653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:17.941331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:17.942051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:17.945916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:17.948431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:17.952779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:18.874075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:18.892770 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf40d37d-b3f3-472e-be01-4c41a11a8cbc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.996426 Nov 03 04:16:18.901751 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2372/4880] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:17 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:18.922780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:18.929585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:18.962595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:18.963392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:18.964019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:18.967341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:18.968561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:18.973693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:19.846682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:19.854999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed4db6d3-251f-49ff-9742-eb4efba4f02a tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.951626 Nov 03 04:16:19.859758 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2373/4881] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:18 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:19.925009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:19.931251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:19.938293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:19.938819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:19.939278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:19.940041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:19.944166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:19.949611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:20.407511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:20.417590 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f24b0e76-4bab-4e84-a1fd-0245bf9dda73 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.498050 Nov 03 04:16:20.426112 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2374/4882] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:19 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:20.711986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-805ff572-a833-41c7-8ebd-9a79a2b30e6c req-ea8a4db1-b054-45ef-bbce-89d24ea91082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4556c668-4529-40a6-ade2-62ecba063d93", "name": "network-vif-plugged", "status": "completed", "tag": "7961b8e6-ee70-4f70-905e-8b94bc479c43"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:20.732151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-805ff572-a833-41c7-8ebd-9a79a2b30e6c req-ea8a4db1-b054-45ef-bbce-89d24ea91082 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:20.732881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-805ff572-a833-41c7-8ebd-9a79a2b30e6c req-ea8a4db1-b054-45ef-bbce-89d24ea91082 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:20.733559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-805ff572-a833-41c7-8ebd-9a79a2b30e6c req-ea8a4db1-b054-45ef-bbce-89d24ea91082 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:20.779978 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-805ff572-a833-41c7-8ebd-9a79a2b30e6c req-ea8a4db1-b054-45ef-bbce-89d24ea91082 service nova] Creating event network-vif-plugged:7961b8e6-ee70-4f70-905e-8b94bc479c43 for instance 4556c668-4529-40a6-ade2-62ecba063d93 on n-h1-854653-7 Nov 03 04:16:20.797335 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-805ff572-a833-41c7-8ebd-9a79a2b30e6c req-ea8a4db1-b054-45ef-bbce-89d24ea91082 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090972 Nov 03 04:16:20.798218 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2375/4883] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:16:20.890416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:20.892063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:20.913903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:20.915582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:20.918351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:20.919306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:20.920255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:20.922345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:21.579699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=11 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:21.682266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:21.726547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-62988d20-0b91-4031-99ee-b664e17b9902 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.831275 Nov 03 04:16:21.726547 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2376/4884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:20 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:21.745912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:21.756193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:21.792952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:21.793565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:21.798370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:21.799148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:21.810027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:21.810856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:22.720703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:24.342353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:24.357987 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e2cf0c7-b7a1-4074-a8e4-894f4dc08449 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 2.630296 Nov 03 04:16:24.360672 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2377/4885] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:21 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 2640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:24.379777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:24.384376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:24.401751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:24.405974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:24.410604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:24.412201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:24.412912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:24.413611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:25.246548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:25.263557 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3c08ca67-52d4-45e2-9915-654f66cf6689 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 0.898915 Nov 03 04:16:25.264570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2378/4886] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:24 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:25.287378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1ebe21f7-7385-4db9-8847-455e8d43b7a5 req-dc114289-a06a-481c-beac-acb5924099bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3459bc-8d10-4cb7-9f01-daa77c4a59b5", "name": "network-vif-plugged", "status": "completed", "tag": "2f966733-7844-4633-9607-9fb1d584e31f"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:25.305827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ebe21f7-7385-4db9-8847-455e8d43b7a5 req-dc114289-a06a-481c-beac-acb5924099bd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:25.308118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ebe21f7-7385-4db9-8847-455e8d43b7a5 req-dc114289-a06a-481c-beac-acb5924099bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:25.308739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ebe21f7-7385-4db9-8847-455e8d43b7a5 req-dc114289-a06a-481c-beac-acb5924099bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:25.351008 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1ebe21f7-7385-4db9-8847-455e8d43b7a5 req-dc114289-a06a-481c-beac-acb5924099bd service nova] Creating event network-vif-plugged:2f966733-7844-4633-9607-9fb1d584e31f for instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 on n-h2-854653-7 Nov 03 04:16:25.363494 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1ebe21f7-7385-4db9-8847-455e8d43b7a5 req-dc114289-a06a-481c-beac-acb5924099bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096889 Nov 03 04:16:25.366491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2379/4887] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:16:25.399488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:25.406531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:25.432033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:25.432560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:25.434415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:25.439692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:25.439954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:25.453910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:26.222442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:26.268097 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-21da5669-de3b-4cc4-8971-4903ddf34b1b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.879205 Nov 03 04:16:26.274115 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2380/4888] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:25 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:26.298670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:26.300541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:26.364543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:26.367866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:26.370184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:26.371635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:26.386152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:26.388191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:27.841188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:27.915420 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df05fbc8-98bf-48ab-809f-281e9b8b4d86 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1317 microversion: 2.1 time: 1.624076 Nov 03 04:16:27.923518 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2381/4889] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:26 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1317 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:27.949882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ec3e007-b00b-422f-b4b5-b5a5ad8a21bc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'create', calling method: .version_select at 0x7ff7f8b4ddc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-344547053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAPktMEa+zLIl6uRYoFk9c0m/6OiBhqlCRwHtCaR9Fg2N0gXO7zhOg+++S63Jx/0XawTF/1T/CDETkXbC7cIuw+TBah/iovW9BMnXs4gGsO59tLP+4KYvvUB0eAo0JA=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:28.008249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7ec3e007-b00b-422f-b4b5-b5a5ad8a21bc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:16:28.025767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7ec3e007-b00b-422f-b4b5-b5a5ad8a21bc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for user a3c6e4b088224f33aa607e2a27ed798b and project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:16:28.279754 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ec3e007-b00b-422f-b4b5-b5a5ad8a21bc tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.359098 Nov 03 04:16:28.289305 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2382/4890] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:16:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:16:28.336245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:28.337488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:28.377306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:28.387005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:28.391596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:28.392672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:28.393503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:28.394226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:28.716911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:28.739477 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36188d82-a4a3-4e80-ab3b-5f4076040d3d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.442763 Nov 03 04:16:28.739477 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2383/4891] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:28 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:28.945692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:28.946382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:28.959722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:28.960230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:28.968339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:28.969272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:28.969772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:28.970230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:30.201618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:30.224061 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7effbf52-5e2e-4f52-97a2-be6761f37221 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1507 microversion: 2.1 time: 1.281976 Nov 03 04:16:30.245929 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2384/4892] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:28 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1507 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:30.270370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:30.281869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:30.305097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:30.305791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:30.306690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:30.307712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:30.310033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:30.315219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:30.799460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:30.820793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dad814d0-a0a9-432e-a24c-6d517e813551 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.573637 Nov 03 04:16:30.821420 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2385/4893] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:30 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:30.844010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:30.848624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:30.887579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:30.888111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:30.894196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:30.897164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:30.911238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:30.914610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:31.563848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:31.580940 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-518bd0eb-61ad-4698-b539-ef1fe2f655df tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1507 microversion: 2.1 time: 0.758339 Nov 03 04:16:31.585760 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2386/4894] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:30 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1507 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:31.611050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:31.614213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:31.633834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:31.638704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:31.639222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:31.639993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:31.648927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:31.649569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:31.974312 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40a7fcc1-af19-4204-a6af-16951b633f0c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "PUT /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1079 microversion: 2.1 time: 0.367749 Nov 03 04:16:31.976238 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2387/4895] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:16:31 2022] PUT /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1079 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:31.988027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:31.995032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:32.012572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:32.013564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:32.014026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:32.014751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:32.026348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:32.027085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:32.081734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:32.509512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:32.518955 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e2bc7ad-2b68-481f-a8c9-c36dd3d2138d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.541626 Nov 03 04:16:32.519551 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2388/4896] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:31 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:32.555900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:32.556528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:32.593529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:32.594121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:32.594483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:32.595209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:32.595674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:32.596093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:34.612198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:34.638040 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9a9fb9a-7ebb-4c13-b8fc-927d1d3ec477 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1505 microversion: 2.1 time: 2.072194 Nov 03 04:16:34.712990 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2389/4897] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:32 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1505 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:34.732840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:34.745008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:34.793510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:34.795174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:34.795671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:34.797820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:34.798302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:34.798729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:36.005705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:36.018975 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0196a645-a04a-4ac0-b57a-ff52681c494f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 1.304734 Nov 03 04:16:36.031105 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2390/4898] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:34 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:36.055357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:36.068616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:36.108692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:36.109710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:36.110273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:36.111340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:36.111880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:36.112370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:37.339696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:37.359663 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-744da7e4-2185-44b4-947c-25fbe1757af5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1505 microversion: 2.1 time: 1.321656 Nov 03 04:16:37.365571 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2391/4899] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:36 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1505 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:37.383978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:37.384953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:37.406815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:37.409086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:37.410909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:37.412034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:37.415252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:37.416245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:37.858408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:37.904729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e1bda138-6716-4c1c-adb6-4c1640cdc6e9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.527697 Nov 03 04:16:37.905939 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2392/4900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:37 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:37.912056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:37.918410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:37.946247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:37.947290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:37.947987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:37.949492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:37.950574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:37.953214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:38.064255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:38.663384 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96b528e4-519f-4452-82b8-048693811acf tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1448 microversion: 2.1 time: 25.097715 Nov 03 04:16:38.672707 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2509/4901] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:13 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1448 bytes in 25099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:38.678286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-014f3152-a31b-44a4-9e9c-fa83e15f930a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f849dd30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:38.712832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:16:38.715748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:16:38.720495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:16:38.720495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:16:38.720495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:16:38.750679 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-014f3152-a31b-44a4-9e9c-fa83e15f930a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 200 len: 1448 microversion: 2.1 time: 0.076486 Nov 03 04:16:38.751587 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2510/4902] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:16:38 2022] GET /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 1448 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:38.766460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1ef45b3-2bba-440b-af26-ffba51db2c35 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f844a3a0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:39.076264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:39.096597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:39.097136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:39.098226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:39.100823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:39.101445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:39.101889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:39.157089 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-caf29ebb-cbaa-43f2-86fe-0abf4999d94b tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "POST /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5/action" status: 202 len: 1111 microversion: 2.1 time: 1.249848 Nov 03 04:16:39.173800 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2393/4903] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:16:37 2022] POST /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5/action => generated 1111 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 03 04:16:39.180767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:39.181426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:39.188545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:39.189273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:39.190016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:39.192813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:39.192813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:39.192813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:39.377302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:39.386356 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a75222a-7e1d-4812-b73d-ee19db6e3562 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.211327 Nov 03 04:16:39.403881 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2394/4904] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:39 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:39.418792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:39.420274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:39.432106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:39.432997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:39.433354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:39.434820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:39.435699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:39.435699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:39.777047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:39.791157 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1549c602-4138-4c76-aa3e-1b3a1c8aa2a5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.380792 Nov 03 04:16:39.810705 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2395/4905] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:39 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:40.416792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:40.417756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:40.428079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:40.428728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:40.429316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:40.430278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:40.431163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:40.431814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:40.617552 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1ef45b3-2bba-440b-af26-ffba51db2c35 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 204 len: 0 microversion: 2.1 time: 1.854779 Nov 03 04:16:40.618613 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2511/4906] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:38 2022] DELETE /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 0 bytes in 1856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:16:40.626668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:40.627191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:40.640965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:40.641502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:40.641954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:40.642716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:40.643138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:40.643576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:40.705719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:16:41.052387 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a02cdeb4-4632-4d2b-b980-a5c52a608371 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 204 len: 0 microversion: 2.1 time: 0.429250 Nov 03 04:16:41.059541 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2512/4907] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:16:40 2022] DELETE /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:16:41.063814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-283976601", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "6de15b72-ddf8-4728-a3a8-fa5255a3514b"}], "key_name": "tempest-TestNetworkBasicOps-344547053", "security_groups": [{"name": "tempest-secgroup-smoke-6800441"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:41.377929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] validate_networks() for [('6de15b72-ddf8-4728-a3a8-fa5255a3514b', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:16:41.446485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:41.454295 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d85d87f-3ecb-4020-8ef1-af86e635d604 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1506 microversion: 2.1 time: 1.042730 Nov 03 04:16:41.454887 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2396/4908] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:40 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1506 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:41.460271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:41.461137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:41.467382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:41.468084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:41.468976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:41.470028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:41.470770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:41.471693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:41.958951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:41.973562 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e251f6a0-e725-4409-b507-654a5e026d36 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.514774 Nov 03 04:16:41.974194 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2397/4909] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:41 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:41.981686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1223361182", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "67e5b85f-4010-4f46-ba0a-653e66da87d8"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:42.102842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] validate_networks() for [('67e5b85f-4010-4f46-ba0a-653e66da87d8', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:16:42.993990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:16:42.994448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:16:42.994809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:16:42.995179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:16:42.995597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:16:43.032327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:43.032949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:43.037625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:43.039815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:43.040244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:43.041328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:43.104787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:16:43.116440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Getting quotas for user a3c6e4b088224f33aa607e2a27ed798b and project 85363c2a53b549da92c7e3f9b09294bc. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:16:43.158344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:16:43.163629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:16:43.364818 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-074f8ce8-1b8a-4ef8-848e-c0b5df5c7d69 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.308724 Nov 03 04:16:43.376784 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2513/4910] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:16:41 2022] POST /compute/v2.1/servers => generated 403 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:16:43.383056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:43.383873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:43.392855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:43.393331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:43.396062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:43.398249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:43.398877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:43.400370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:44.210124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:44.219086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:16:44.219570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:16:44.219984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:16:44.221129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:16:44.223221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:16:44.227123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:44.244398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:44.246736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:44.248548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:44.249474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:44.251207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:44.251730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:44.260092 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ffc2d81d-77af-4f6c-834b-326f5b94026c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1506 microversion: 2.1 time: 0.878293 Nov 03 04:16:44.260092 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2514/4911] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:43 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1506 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:44.281297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-170c0dd8-907c-4208-a0e7-c3c92a7ccfe9 req-a80b15c8-159a-48cd-aa02-19547de8cd5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4556c668-4529-40a6-ade2-62ecba063d93", "name": "network-vif-unplugged", "status": "completed", "tag": "7961b8e6-ee70-4f70-905e-8b94bc479c43"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:44.293745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:16:44.306928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-170c0dd8-907c-4208-a0e7-c3c92a7ccfe9 req-a80b15c8-159a-48cd-aa02-19547de8cd5f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:44.309001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for user 324a1dfe0c4843bd917eb6ecd6cc2c4c and project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:16:44.310858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-170c0dd8-907c-4208-a0e7-c3c92a7ccfe9 req-a80b15c8-159a-48cd-aa02-19547de8cd5f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:44.313908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-170c0dd8-907c-4208-a0e7-c3c92a7ccfe9 req-a80b15c8-159a-48cd-aa02-19547de8cd5f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:44.324582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:16:44.327368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:16:44.345573 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-170c0dd8-907c-4208-a0e7-c3c92a7ccfe9 req-a80b15c8-159a-48cd-aa02-19547de8cd5f service nova] Creating event network-vif-unplugged:7961b8e6-ee70-4f70-905e-8b94bc479c43 for instance 4556c668-4529-40a6-ade2-62ecba063d93 on n-h1-854653-7 Nov 03 04:16:44.361324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-170c0dd8-907c-4208-a0e7-c3c92a7ccfe9 req-a80b15c8-159a-48cd-aa02-19547de8cd5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096090 Nov 03 04:16:44.366602 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2515/4912] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:16:44.376964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:44.379893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:44.392650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:44.395109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:44.395691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:44.396641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:44.397341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:44.397980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:44.505822 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c719da5-056a-448f-b77b-ee8b1e631077 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.530311 Nov 03 04:16:44.508940 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2398/4913] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:16:44.526941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f78a4200-b35c-4a93-bb1c-5c92e95a8086 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:44.527913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f78a4200-b35c-4a93-bb1c-5c92e95a8086 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:44.752474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f78a4200-b35c-4a93-bb1c-5c92e95a8086 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:44.760272 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f78a4200-b35c-4a93-bb1c-5c92e95a8086 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1247 microversion: 2.1 time: 0.243273 Nov 03 04:16:44.761449 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2399/4914] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:44 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1247 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:44.768421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5901e894-d82b-4abb-a12c-85c5cd404efa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:44.773809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5901e894-d82b-4abb-a12c-85c5cd404efa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:44.928555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5901e894-d82b-4abb-a12c-85c5cd404efa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:44.936372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5901e894-d82b-4abb-a12c-85c5cd404efa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1208 microversion: 2.1 time: 0.173636 Nov 03 04:16:44.943044 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2400/4915] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:44 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1208 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:45.074510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:45.093158 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7beaf0bb-2e38-42d5-8dc5-ae18014b8964 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.722675 Nov 03 04:16:45.099671 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2516/4916] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:44 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:45.284500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:45.285446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:45.314466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:45.318719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:45.322603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:45.323657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:45.326078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:45.327342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:45.729653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-76c8966d-4d80-4421-965c-dbdf92daf162 req-a27db439-5e68-432a-bcc1-6c432182029c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5031d1f0-da10-45db-a3a0-a7b979e21098", "name": "network-vif-deleted", "tag": "7a76f64d-5f6a-47c4-8811-a785f7520732"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:45.757319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-76c8966d-4d80-4421-965c-dbdf92daf162 req-a27db439-5e68-432a-bcc1-6c432182029c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:45.758061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-76c8966d-4d80-4421-965c-dbdf92daf162 req-a27db439-5e68-432a-bcc1-6c432182029c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:45.760359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-76c8966d-4d80-4421-965c-dbdf92daf162 req-a27db439-5e68-432a-bcc1-6c432182029c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:45.799492 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-76c8966d-4d80-4421-965c-dbdf92daf162 req-a27db439-5e68-432a-bcc1-6c432182029c service nova] Creating event network-vif-deleted:7a76f64d-5f6a-47c4-8811-a785f7520732 for instance 5031d1f0-da10-45db-a3a0-a7b979e21098 on n-h1-854653-7 Nov 03 04:16:45.805737 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-76c8966d-4d80-4421-965c-dbdf92daf162 req-a27db439-5e68-432a-bcc1-6c432182029c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080415 Nov 03 04:16:45.806341 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2517/4917] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:16:45.811738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:45.812577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:45.823570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:45.823570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:45.823570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:45.823570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:45.823570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:45.823570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:45.865208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:45.874999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-965e0043-a475-45a9-8426-bd52f8212488 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1506 microversion: 2.1 time: 0.594763 Nov 03 04:16:45.876321 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2401/4918] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:45 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:45.941159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:45.961272 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73e2ad95-0c32-4fa5-8f3e-8237af482474 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1251 microversion: 2.1 time: 0.153200 Nov 03 04:16:45.962006 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2518/4919] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:45 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1251 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:45.965822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:45.967314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:45.983805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:45.985126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:45.985961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:45.986941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:45.989812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:45.990487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:46.123973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:46.124677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:46.161216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:46.172661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:46.174461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:46.175475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:46.177645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:46.180114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:46.185719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:46.199062 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bf106fd8-73fc-460c-8e55-50b2664adc4e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1212 microversion: 2.1 time: 0.236078 Nov 03 04:16:46.213943 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2402/4920] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:45 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1212 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:46.391403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a78edf38-9bcb-4b7a-9b77-6aedd3116fa3 req-f591c1af-f64f-4dde-a677-4a84ef1c6e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5031d1f0-da10-45db-a3a0-a7b979e21098", "name": "network-vif-unplugged", "status": "completed", "tag": "7a76f64d-5f6a-47c4-8811-a785f7520732"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:46.416444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a78edf38-9bcb-4b7a-9b77-6aedd3116fa3 req-f591c1af-f64f-4dde-a677-4a84ef1c6e98 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:46.417929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a78edf38-9bcb-4b7a-9b77-6aedd3116fa3 req-f591c1af-f64f-4dde-a677-4a84ef1c6e98 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:46.419780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a78edf38-9bcb-4b7a-9b77-6aedd3116fa3 req-f591c1af-f64f-4dde-a677-4a84ef1c6e98 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:46.442875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a78edf38-9bcb-4b7a-9b77-6aedd3116fa3 req-f591c1af-f64f-4dde-a677-4a84ef1c6e98 service nova] Creating event network-vif-unplugged:7a76f64d-5f6a-47c4-8811-a785f7520732 for instance 5031d1f0-da10-45db-a3a0-a7b979e21098 on n-h1-854653-7 Nov 03 04:16:46.487597 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a78edf38-9bcb-4b7a-9b77-6aedd3116fa3 req-f591c1af-f64f-4dde-a677-4a84ef1c6e98 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093342 Nov 03 04:16:46.490766 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2403/4921] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:16:46.715204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:46.725456 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-812e8dae-f0c1-4f4a-b4cf-1f72ec535f79 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.605471 Nov 03 04:16:46.729575 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2519/4922] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:46 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:46.908874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:46.910060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:46.924230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:46.927049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:46.929097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:46.931555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:46.935225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:46.936118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:46.987115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:46.988901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:47.000058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.001683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.004775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:47.006248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.007821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.009443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:47.272749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:47.312639 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3e39b292-ba8d-43aa-9446-592b6a58b3d1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1243 microversion: 2.1 time: 0.327285 Nov 03 04:16:47.318466 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2520/4923] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:46 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1243 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:47.336697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:47.338745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:47.353546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.358177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.358827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:47.360100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.360827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.364355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:47.478900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:47.490420 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12cadfb0-c7d4-4a0b-8c87-36600453529a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 200 len: 1509 microversion: 2.1 time: 0.595474 Nov 03 04:16:47.493751 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2404/4924] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:46 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 1509 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:47.520831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:47.521802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:47.557463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.563749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.564232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:47.570750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.571258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.571708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:47.631935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:47.640949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-22d76cad-5cb7-414c-9387-ffa5096ec5a4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1204 microversion: 2.1 time: 0.321096 Nov 03 04:16:47.651895 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2521/4925] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:47 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1204 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:47.759270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:47.760197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:47.776774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.777720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.778375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:47.779951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:47.781584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:47.782908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.366760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:48.377846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a2b5caf7-332b-4f08-b844-f34460bd057c tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.622219 Nov 03 04:16:48.393057 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2522/4926] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:47 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:48.393057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:48.393057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:48.399181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:48.399646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.400937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.401681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.402768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.403799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.405044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.414368 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ea768cab-9d61-4c1e-b3e8-d933c4f23992 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.894646 Nov 03 04:16:48.430281 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2405/4927] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:47 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:48.465103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:48.465959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:48.476205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.477051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.478049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.478941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.480200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.481229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.501064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:48.565514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:48.588312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a16d850c-83b2-4012-825d-e86699e9b94c tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1307 microversion: 2.1 time: 0.204983 Nov 03 04:16:48.601891 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2523/4928] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:48 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1307 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:48.665853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:48.666814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:48.699190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.705653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.705653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.705653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.705653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.705653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.763834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:48.778631 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d93f40c9-5159-409f-aefa-8fe028d622dd tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.320942 Nov 03 04:16:48.779235 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2406/4929] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:48 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:48.801354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:48.802004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:48.815326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.817788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.818414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.819307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:48.820417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:48.821088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:48.823155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:48.830380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2661ef75-9999-4cc8-bf4d-cf461b5fd820 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1260 microversion: 2.1 time: 0.169532 Nov 03 04:16:48.832558 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2524/4930] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:48 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:49.402842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:49.403798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:49.417643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:49.419050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:49.419521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:49.420412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:49.420825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:49.426213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.164968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:50.192925 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8822a82d-e6b9-4875-b5bb-356f75be7ddb tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.794097 Nov 03 04:16:50.213463 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2525/4931] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:49 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:50.220331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:50.221200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:50.227489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:50.228294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:50.228911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.229836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:50.230477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:50.231085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.390526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:50.403422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ebeee0df-38d8-4992-84b2-3710bebbe014 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 1.606430 Nov 03 04:16:50.423342 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2407/4932] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:48 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:50.435350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:50.436363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:50.443989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:50.444856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:50.445590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.446556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:50.447272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:50.447940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.479712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:50.492172 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c697f3de-5af9-41fb-b932-afc8db909bb5 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1305 microversion: 2.1 time: 0.275940 Nov 03 04:16:50.492788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2526/4933] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:50 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1305 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:50.506878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:50.509406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:50.519806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:50.520348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:50.520805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.527030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:50.527568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:50.528027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.593245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:50.605440 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10544e84-7395-4329-b7df-d8ed0ce2f638 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1266 microversion: 2.1 time: 0.180362 Nov 03 04:16:50.608668 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2408/4934] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:50 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:50.846356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:50.863229 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fad2176c-f963-4803-9b16-6b66b48e5606 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.361835 Nov 03 04:16:50.863229 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2527/4935] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:50 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:50.890473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26c0d853-d8ad-4ff3-a58c-83a029df924b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:50.900541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c0d853-d8ad-4ff3-a58c-83a029df924b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:50.901044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c0d853-d8ad-4ff3-a58c-83a029df924b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:50.901493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c0d853-d8ad-4ff3-a58c-83a029df924b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:50.977163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-26c0d853-d8ad-4ff3-a58c-83a029df924b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Going to try to stop instance {{(pid=127593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:16:51.208222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26c0d853-d8ad-4ff3-a58c-83a029df924b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.332003 Nov 03 04:16:51.211157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2409/4936] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:16:50 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:16:51.220815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:51.221319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:51.235888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:51.238416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:51.242200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:51.251078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:51.251707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:51.252913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:51.253287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:51.253844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:51.262924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:51.265925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:51.273492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:51.273492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:51.273492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:51.273492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:51.740049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:51.744761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:51.756486 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f3bb98e-8b2a-4d20-a7bb-41b648e1f6f0 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.540875 Nov 03 04:16:51.757114 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2528/4937] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:51 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:51.793331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:51.793331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:51.818344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:51.818855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:51.819316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:51.820037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:51.828152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:51.828901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:52.055712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:52.076415 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20387523-7aee-477e-9435-1df90bcdaa48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1305 microversion: 2.1 time: 0.296094 Nov 03 04:16:52.079170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:52.079689 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2529/4938] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:51 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1305 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:52.088918 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6c60dd0-f354-4b05-88f5-dcee4a02a206 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.862742 Nov 03 04:16:52.089565 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2410/4939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:51 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:52.098057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:52.098861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:52.160040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:52.163742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:52.167353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:52.168444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:52.169558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:52.171642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:52.779875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:52.780523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:52.790323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:52.802960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:52.803746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:52.805196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3ae05c4-030e-4767-a362-d2ac1ffa4cbd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.723575 Nov 03 04:16:52.808673 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2530/4940] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:52 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:52.819469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:52.819469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:52.819469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:52.820143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:53.107996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:53.109782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:53.115114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:53.120159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:53.121183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:53.122199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:53.123178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:53.124071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:53.124773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:53.163993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:53.712864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:53.750139 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bd945f49-218f-4f87-ae5c-08f8ea5e4092 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.974250 Nov 03 04:16:53.752163 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2411/4941] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:52 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:53.759693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:53.760442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:53.769417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:53.770195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:53.770876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:53.771836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:53.772879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:53.773576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:53.977094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:53.993211 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20ecf700-1d68-48c3-9e5a-8d6e736590b6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.893065 Nov 03 04:16:53.994280 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2531/4942] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:53 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:54.001825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:54.002681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:54.010450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:54.011630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:54.012259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:54.013254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:54.013892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:54.014589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:54.269984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:54.313980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:54.322823 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-242d92d2-6016-495a-aa9b-86c9adabe6db tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.569267 Nov 03 04:16:54.328588 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2412/4943] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:53 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:54.781831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:54.783678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:54.797267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:54.798118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:54.803586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:54.808150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:54.809171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:54.811297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:54.943925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:16:54.972374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:55.065050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-46cca299-c32b-4d0f-947a-fd0b26d7f993 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 1.065578 Nov 03 04:16:55.075183 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2532/4944] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:53 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:55.101285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:55.103532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:55.125228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:55.126084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:55.127549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:55.129503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:55.132740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:55.133977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:55.482255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:55.495457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26c65699-4569-41d5-85cf-1d0d6562e51f tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.719329 Nov 03 04:16:55.496067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2413/4945] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:54 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:55.509098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:55.509935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:55.522991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:55.523505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:55.526864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:55.528782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:55.529309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:55.529758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:55.814662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:55.828961 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-34ef8258-4650-4b52-8bc7-4dda393df885 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.752366 Nov 03 04:16:55.851953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2533/4946] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:55 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:55.974217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:56.000510 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-75fcf4c7-7cce-4910-9a58-cbf985e67786 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.498247 Nov 03 04:16:56.002208 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2414/4947] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:55 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:56.102265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:56.108764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:56.116541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:56.120433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:56.125209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:56.125209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:56.128690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:56.129231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:56.527331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:56.563414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-307b2455-35d7-402c-a766-5c46691ff5ab tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.462453 Nov 03 04:16:56.567153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2534/4948] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:56 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:56.585057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:56.593153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:56.620652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:56.625450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:56.625945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:56.626789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:56.627270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:56.627719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:56.742376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c83faef9-fc3c-47a2-8934-2ebf64df11a9 req-66fddce5-52f2-4c7d-a740-31e532b18496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825bef4c-2420-47aa-94be-e2b287f1a09b", "tag": "6052fe58-754d-4e78-aa92-7a20c800504e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:56.759831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c83faef9-fc3c-47a2-8934-2ebf64df11a9 req-66fddce5-52f2-4c7d-a740-31e532b18496 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:56.760755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c83faef9-fc3c-47a2-8934-2ebf64df11a9 req-66fddce5-52f2-4c7d-a740-31e532b18496 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:56.761695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c83faef9-fc3c-47a2-8934-2ebf64df11a9 req-66fddce5-52f2-4c7d-a740-31e532b18496 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:56.798986 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c83faef9-fc3c-47a2-8934-2ebf64df11a9 req-66fddce5-52f2-4c7d-a740-31e532b18496 service nova] Creating event network-changed:6052fe58-754d-4e78-aa92-7a20c800504e for instance 825bef4c-2420-47aa-94be-e2b287f1a09b on n-h1-854653-7 Nov 03 04:16:56.808829 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c83faef9-fc3c-47a2-8934-2ebf64df11a9 req-66fddce5-52f2-4c7d-a740-31e532b18496 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.571396 Nov 03 04:16:56.810665 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2415/4949] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:16:56.871341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:56.872159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:56.905760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:56.912069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:56.912069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:56.912069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:56.913363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:56.914680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:57.324657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:57.338587 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd59be15-d823-40c3-b300-a373afd5a4b2 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.767155 Nov 03 04:16:57.340576 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2535/4950] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:56 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:57.347751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:57.348633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:57.362981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:57.364508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:57.365041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:57.366326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:57.367037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:57.368535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:57.440057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:57.458505 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-245afdb9-e12a-4915-8722-524d53944b81 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.594414 Nov 03 04:16:57.461143 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2416/4951] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:56 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:16:57.590896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:57.592305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:57.600546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:57.601510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:57.602134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:57.603101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:57.611358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:57.621002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:57.926582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:57.945435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:57.970640 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-58cdf307-11cc-45b6-a156-f4c676b70f33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.384109 Nov 03 04:16:57.971498 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2417/4952] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:57 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:57.988115 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-548d04b7-a460-464a-aa3e-7f6d2cf342ea tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.644952 Nov 03 04:16:57.989190 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2536/4953] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:57 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:58.369344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:58.370107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:58.384875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:58.388541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:58.388541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:58.392313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:58.394296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:58.396380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:58.484040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:58.485137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:58.499744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:58.506510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:58.508940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:58.510734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:58.513322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:58.516744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:58.718134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:58.728712 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa1b419c-a3ea-47b8-853a-548d14252a9e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.364829 Nov 03 04:16:58.745991 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2418/4954] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:58 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:58.783423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:58.810169 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-317d9a30-a4d6-48ee-a37b-4d3b61e03c66 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.330123 Nov 03 04:16:58.814551 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2537/4955] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:58 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:58.848943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-14dd15d4-b9f0-498e-a780-42eb734d7076 req-ca2ccf26-1651-45a6-b5b3-6986026347d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c01ebb-5afe-4dc4-8868-5e840ec89e87", "tag": "f7de82db-abba-46b0-915c-03c631032f57"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:16:58.859421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-14dd15d4-b9f0-498e-a780-42eb734d7076 req-ca2ccf26-1651-45a6-b5b3-6986026347d5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:58.859913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-14dd15d4-b9f0-498e-a780-42eb734d7076 req-ca2ccf26-1651-45a6-b5b3-6986026347d5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:58.860347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-14dd15d4-b9f0-498e-a780-42eb734d7076 req-ca2ccf26-1651-45a6-b5b3-6986026347d5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:58.879950 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-14dd15d4-b9f0-498e-a780-42eb734d7076 req-ca2ccf26-1651-45a6-b5b3-6986026347d5 service nova] Creating event network-changed:f7de82db-abba-46b0-915c-03c631032f57 for instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 on n-h1-854653-7 Nov 03 04:16:58.887265 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-14dd15d4-b9f0-498e-a780-42eb734d7076 req-ca2ccf26-1651-45a6-b5b3-6986026347d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044538 Nov 03 04:16:58.889067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2419/4956] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:16:58.998965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:58.999594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:59.014295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:59.018197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:59.020915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.021463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.021916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:59.022775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.027629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.028294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.028627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.029868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:59.030809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.031444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.032245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:59.037556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:59.438864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:59.449298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-094c1b0b-1569-43e4-a306-962a6c5a9fd8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.439190 Nov 03 04:16:59.452090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2420/4957] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:59 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:59.465822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:16:59.473942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c62fc674-4827-4710-a735-4fe2e9ffd061 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.478802 Nov 03 04:16:59.474849 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2538/4958] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:58 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:16:59.759250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:59.759880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:59.767107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.767607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.768047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:59.769056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.769496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.769921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:59.837002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:16:59.838298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:16:59.850827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.850827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.850827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:16:59.851294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:16:59.851941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:16:59.852818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:00.095261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:00.110459 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-397f24cc-86c9-46ab-8816-577e8bef6213 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.358453 Nov 03 04:17:00.111056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2421/4959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:59 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:00.175431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:00.197166 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-74d9ed4b-2a1c-41b3-802e-859218573ca1 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.363806 Nov 03 04:17:00.197899 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2539/4960] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:16:59 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:00.475206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:00.476076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:00.489121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:00.491431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:00.497312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:00.498290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:00.499415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:00.500000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:00.500692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:00.501882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:00.513373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:00.515427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:00.517206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:00.518212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:00.519789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:00.521277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:00.898896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:00.914059 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ca58e13-3ebe-4d87-b073-c4799db84e08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.442080 Nov 03 04:17:00.926297 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2422/4961] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:00 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:00.959712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:00.973101 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd140460-3b43-4f0b-82ce-3ca538170e0b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.478101 Nov 03 04:17:00.973810 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2540/4962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:00 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:01.139584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:01.140495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:01.146862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:01.147461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:01.148022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:01.149005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:01.149744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:01.150428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:01.182625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:01.226137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:01.227067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:01.239728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:01.245003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:01.245003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:01.245003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:01.245003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:01.245003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:01.427575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:01.438487 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6516051-4184-41bd-bf7e-e03edfbbf7e7 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1679 microversion: 2.1 time: 0.303069 Nov 03 04:17:01.444656 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2423/4963] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:01 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:01.602086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:01.615885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ea67454-97e5-4cc7-a80a-20840495a434 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.394119 Nov 03 04:17:01.617134 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2541/4964] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:01 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:01.942972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:01.943647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:01.962005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:01.964354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:01.966340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:01.969530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:01.972477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:01.973275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:02.000261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:02.001577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:02.008407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:02.018668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:02.019458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:02.022840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:02.022840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:02.022840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:02.022840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:02.586310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:02.595913 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9cbc17b-a9d2-4e19-9783-50bbd16a3154 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1516 microversion: 2.1 time: 0.657451 Nov 03 04:17:02.600582 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2424/4965] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:01 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1516 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:02.611759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:02.614272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:02.625412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:02.628901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:02.629704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:02.632514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:02.633296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:02.636794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:02.805415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:02.832018 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03cf016a-2f6c-4c88-9562-f45214f141f3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.837112 Nov 03 04:17:02.835781 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2542/4966] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:01 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:02.847318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:02.848006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:02.855995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:02.856564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:02.857428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:02.858186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:02.859041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:02.859798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:03.557056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:03.566809 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-311889c6-b999-49ad-ba2b-8229103da139 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1656 microversion: 2.1 time: 0.964734 Nov 03 04:17:03.567858 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2425/4967] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:02 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1656 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:03.744926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:03.755509 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7f7e420e-d380-417f-9c3b-b0667d69e6bd tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.916075 Nov 03 04:17:03.758711 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2543/4968] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:02 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:03.765570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:03.766645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:03.774712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:03.776404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:03.778972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:03.780077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:03.780908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:03.781760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:03.859426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f066c30-f171-4540-bba4-fac9b12c174a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:03.866283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f066c30-f171-4540-bba4-fac9b12c174a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:03.866780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f066c30-f171-4540-bba4-fac9b12c174a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:03.867225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f066c30-f171-4540-bba4-fac9b12c174a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:03.890601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f066c30-f171-4540-bba4-fac9b12c174a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Going to try to start instance {{(pid=127593) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 03 04:17:04.211885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:04.224981 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d40cdfa8-75ad-411e-a015-91b5b95c0f11 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1522 microversion: 2.1 time: 0.463441 Nov 03 04:17:04.239521 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2544/4969] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:03 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1522 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:04.248011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:04.253436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:04.257994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:04.258730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:04.261841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:04.262904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:04.263551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:04.265396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:04.294697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:04.435051 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f066c30-f171-4540-bba4-fac9b12c174a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.841809 Nov 03 04:17:04.443322 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2426/4970] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:17:03 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:17:04.444791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:04.445557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:04.458820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:04.459329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:04.459778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:04.460507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:04.460972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:04.461456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:04.708584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:04.720172 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb4d4b78-ae8e-4c31-b3ae-fe7cb58bb631 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.478992 Nov 03 04:17:04.729425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2545/4971] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:04 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:04.786868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:04.790852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:04.793073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:04.804411 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc74240d-1e1d-482f-a4b2-202628f9a6a5 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1665 microversion: 2.1 time: 0.364309 Nov 03 04:17:04.816737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:04.817570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2427/4972] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:04 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1665 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:04.818179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:04.820329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:04.822868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:04.823369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:04.823818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:05.261229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:05.262168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:05.280610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:05.281139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:05.281598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:05.282316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:05.283006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:05.283455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:05.306578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:05.318746 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4a919b48-7593-412b-9bf6-2141a2064da6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.540589 Nov 03 04:17:05.321039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2546/4973] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:04 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:05.764196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:05.768311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:05.772565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:05.773608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:05.774879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:05.775932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:05.776715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:05.777348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:05.817416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:05.845053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-007395ac-65b2-439b-acff-c8ef3698ed5e tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1522 microversion: 2.1 time: 0.587548 Nov 03 04:17:05.850142 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2428/4974] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:05 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:05.882973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:05.883858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:05.897578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:05.898202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:05.900154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:05.901162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:05.901825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:05.903278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:06.167829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:06.178723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-31b65e2b-23ee-410e-8cf8-8650c7364809 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.419493 Nov 03 04:17:06.179518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2547/4975] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:05 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:06.300396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:06.313364 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af066c1f-0842-4de5-8dd3-626d8fd95e14 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1665 microversion: 2.1 time: 0.444757 Nov 03 04:17:06.316172 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2429/4976] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:05 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1665 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:06.348078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:06.361241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:06.361241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:06.361241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:06.361241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:06.361241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:06.361241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:06.364865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:06.616423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:06.626103 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f95fb336-77b4-4c1a-8fd5-a985a918e98d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.282518 Nov 03 04:17:06.642649 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2548/4977] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:06 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:06.881616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:06.883266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:06.890744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:06.891738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:06.892362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:06.894098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:06.894747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:06.895631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:07.114272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:07.153585 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-685dbec6-48ab-4e0a-a149-9e2e54d1f760 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1522 microversion: 2.1 time: 0.277793 Nov 03 04:17:07.172529 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2430/4978] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:06 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:07.202951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:07.204564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:07.224564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:07.226838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:07.226838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:07.228864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:07.231369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:07.233381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:07.349688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:07.353789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:07.379129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:07.379360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:07.385211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:07.386233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:07.386716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:07.387152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:07.780720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:07.794510 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2f81d39-3f69-45bb-90ba-e872611c9920 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.595465 Nov 03 04:17:07.812862 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2549/4979] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:07 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:07.835602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:07.840711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:07.858553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:07.860284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:07.865472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:07.866887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:07.870403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:07.873316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:07.897193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:07.911442 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-873358a5-72d9-4bda-b1d5-a255e3aaec61 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.574253 Nov 03 04:17:07.923345 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2431/4980] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:07 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:07.932509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6ba4fde9-7f32-49bd-a948-974519d701e8 req-d262f7f1-4803-4676-af2a-3095d68090c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825bef4c-2420-47aa-94be-e2b287f1a09b", "name": "network-vif-plugged", "status": "completed", "tag": "6052fe58-754d-4e78-aa92-7a20c800504e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:07.944517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ba4fde9-7f32-49bd-a948-974519d701e8 req-d262f7f1-4803-4676-af2a-3095d68090c8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:07.945777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ba4fde9-7f32-49bd-a948-974519d701e8 req-d262f7f1-4803-4676-af2a-3095d68090c8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:07.946420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ba4fde9-7f32-49bd-a948-974519d701e8 req-d262f7f1-4803-4676-af2a-3095d68090c8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.016051 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6ba4fde9-7f32-49bd-a948-974519d701e8 req-d262f7f1-4803-4676-af2a-3095d68090c8 service nova] Creating event network-vif-plugged:6052fe58-754d-4e78-aa92-7a20c800504e for instance 825bef4c-2420-47aa-94be-e2b287f1a09b on n-h1-854653-7 Nov 03 04:17:08.034792 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6ba4fde9-7f32-49bd-a948-974519d701e8 req-d262f7f1-4803-4676-af2a-3095d68090c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108904 Nov 03 04:17:08.035688 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2432/4981] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:08.100507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:08.101611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:08.116557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.121389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.122024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.125707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.127098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.135317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.506356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:08.515611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a8cd797a-94c6-4909-90d7-5fb99d3f75ce tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.697052 Nov 03 04:17:08.537825 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2550/4982] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:07 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:08.542948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:08.551516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:08.565596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.566103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.566562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.567300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.567776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.568218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.781108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:08.795687 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f246041a-dfa6-417c-85f7-e0f4248f6ded tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.758564 Nov 03 04:17:08.797670 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2433/4983] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:08 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:08.831025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:08.838905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:08.840115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:08.842697 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78ffd1fe-f282-470a-b27c-436ec4801d80 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1522 microversion: 2.1 time: 0.303533 Nov 03 04:17:08.844698 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2551/4984] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:08 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:08.850391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.861769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:08.862429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.862556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:08.862661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.862661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.862661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.862661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.864003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.866942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.867832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:08.869633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:08.870391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:08.871066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:09.230786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:09.244240 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2366d178-c7b2-439d-a6ce-3aacb9a48479 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1308 microversion: 2.1 time: 0.421886 Nov 03 04:17:09.244841 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2434/4985] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:08 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:09.282122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:09.301856 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04f209f6-a48a-466c-8b09-07d71d0b4fbb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.446883 Nov 03 04:17:09.308602 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2552/4986] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:08 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:09.335784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:09.341034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:09.350009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:09.352701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:09.353512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:09.354432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:09.356064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:09.359026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:09.553389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:09.555245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:09.574883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:09.576387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:09.580467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:09.583899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:09.584845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:09.585674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:09.638541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:09.654408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-49279057-008f-4460-9da9-8e12a465c3f1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.324892 Nov 03 04:17:09.689138 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2435/4987] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:09 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:09.706807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:09.722346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:09.722346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:09.722346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:09.722346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:09.722346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:09.722346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:09.722346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:09.992577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:10.007778 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c565135-e9b6-47e5-afbb-23c3ce0a0dc3 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.463840 Nov 03 04:17:10.011188 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2553/4988] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:09 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:10.025290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:10.025290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:10.061115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.063098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.063563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.064327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.064887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.065364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.119430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:10.163911 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1791d0ba-912a-4f51-b0f8-5f7c0083766a tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.464063 Nov 03 04:17:10.164540 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2436/4989] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:09 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:10.187748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:10.188307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:10.230919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.248902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.249400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.250187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.250639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.251086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.342496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lazy-loading 'flavor' on Instance uuid 18905a6e-8634-481a-9183-7f5c5b15b546 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:17:10.485298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:10.513369 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db12069d-48ee-4f0d-853d-5ff4207e03b1 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1522 microversion: 2.1 time: 0.489672 Nov 03 04:17:10.513369 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2554/4990] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:10 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:10.513369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c07779c0-ed3f-46d4-8232-5a847d881335 req-22315d2f-49f5-45c1-84dc-ebaf3090596c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3459bc-8d10-4cb7-9f01-daa77c4a59b5", "name": "network-vif-plugged", "status": "completed", "tag": "2f966733-7844-4633-9607-9fb1d584e31f"}, {"server_uuid": "f2c01ebb-5afe-4dc4-8868-5e840ec89e87", "name": "network-vif-plugged", "status": "completed", "tag": "f7de82db-abba-46b0-915c-03c631032f57"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:10.520334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c07779c0-ed3f-46d4-8232-5a847d881335 req-22315d2f-49f5-45c1-84dc-ebaf3090596c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.521036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c07779c0-ed3f-46d4-8232-5a847d881335 req-22315d2f-49f5-45c1-84dc-ebaf3090596c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.521895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c07779c0-ed3f-46d4-8232-5a847d881335 req-22315d2f-49f5-45c1-84dc-ebaf3090596c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.539603 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c07779c0-ed3f-46d4-8232-5a847d881335 req-22315d2f-49f5-45c1-84dc-ebaf3090596c service nova] Creating event network-vif-plugged:2f966733-7844-4633-9607-9fb1d584e31f for instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 on n-h2-854653-7 Nov 03 04:17:10.540263 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c07779c0-ed3f-46d4-8232-5a847d881335 req-22315d2f-49f5-45c1-84dc-ebaf3090596c service nova] Creating event network-vif-plugged:f7de82db-abba-46b0-915c-03c631032f57 for instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 on n-h1-854653-7 Nov 03 04:17:10.581732 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c07779c0-ed3f-46d4-8232-5a847d881335 req-22315d2f-49f5-45c1-84dc-ebaf3090596c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076970 Nov 03 04:17:10.582554 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2555/4991] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:10.593292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:10.601346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:10.643853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.654714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.659684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.665436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.665436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.665436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.786231 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0eacdead-5111-4dc1-96e7-ef1f84003368 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.608405 Nov 03 04:17:10.788032 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2437/4992] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:17:10 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:17:10.805061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:10.806943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:10.817664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.818377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.819327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.821039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:10.821755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:10.823112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:10.831786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:11.709101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:11.722005 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d16af60d-f6de-4267-bc10-98959ada0799 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 200 len: 1488 microversion: 2.1 time: 1.135221 Nov 03 04:17:11.734684 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2556/4993] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:10 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 1488 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:11.742631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:11.743426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:11.751822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:11.755585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:11.756236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:11.757986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:11.760604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:11.761476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:12.082700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:12.094193 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-28b5bcdb-a7f4-4a44-8d00-dbd06cf47e95 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1677 microversion: 2.1 time: 1.299304 Nov 03 04:17:12.100786 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2438/4994] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:10 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1677 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:12.111009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:12.116852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:12.123560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:12.124376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:12.125092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:12.131947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:12.133156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:12.134051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:12.478524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:12.497478 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-adf44eb2-a526-4d88-ab51-282fcaba66d2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1370 microversion: 2.1 time: 0.770740 Nov 03 04:17:12.498069 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2557/4995] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:11 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1370 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:12.523618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-895788602"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:12.548136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:12.557468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:12.558825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:12.558825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:12.559392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:12.559855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:12.560290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:12.753826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:12.764453 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12eaf7af-91ba-4e89-b553-0732ba7e7276 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1522 microversion: 2.1 time: 0.662600 Nov 03 04:17:12.774595 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2439/4996] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:12 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1522 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:13.120398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:13.121220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:13.123197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:13.129357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:13.130091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:13.130792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:13.131852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:13.132650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:13.133125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:13.386921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:13.396056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0f86824d-6ba8-4bb9-8f75-7edef1ffa00b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1660 microversion: 2.1 time: 0.279917 Nov 03 04:17:13.406970 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2440/4997] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:13 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1660 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:13.434193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:13.439169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:13.447034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:13.449191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:13.449837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:13.451810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:13.452640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:13.453474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:13.468318 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5328d80-d7a2-4724-a802-cd6b6ee6c654 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b/action" status: 202 len: 0 microversion: 2.1 time: 0.951925 Nov 03 04:17:13.477107 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2558/4998] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:17:12 2022] POST /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b/action => generated 0 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:17:13.489301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c04ff44-f55a-4aaa-aeeb-e339faa41b1d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f845f430>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:13.572769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c04ff44-f55a-4aaa-aeeb-e339faa41b1d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.094133 Nov 03 04:17:13.574809 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2559/4999] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:13 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:13.606200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:13.607379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:13.632322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:13.637284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:13.638102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:13.640322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:13.641651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:13.646435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:13.987056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f714de35-e537-44f1-b427-3dcdfac3b06e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action" status: 202 len: 0 microversion: 2.1 time: 0.558282 Nov 03 04:17:13.990974 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2441/5000] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:17:13 2022] POST /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:17:13.996468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:13.997228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:14.020452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.037242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.037789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.038569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.039053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.039493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.245579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:14.263502 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50123bb7-fa5e-4ba1-a6f8-9103c30ff9d0 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1543 microversion: 2.1 time: 0.665967 Nov 03 04:17:14.277408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2560/5001] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:13 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1543 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:14.290810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:14.291446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:14.310014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.310523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.310977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.311713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.312181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.312620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.498064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:14.510101 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0704c3e9-5b8e-42eb-b1d5-8a191ac26dab tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1507 microversion: 2.1 time: 0.517820 Nov 03 04:17:14.511644 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2442/5002] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:13 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:14.535136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:14.539146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:14.557125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.558480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.559381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.561270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.563110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.564238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.574109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:14.582429 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c55953e0-1647-42d5-9654-e37af4ee80ba tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1666 microversion: 2.1 time: 0.303820 Nov 03 04:17:14.590380 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2561/5003] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:14 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1666 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:14.604747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:14.604747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:14.619727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.620346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.620854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.621670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:14.622361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:14.623129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:14.664366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:15.312859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:15.323369 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11e5e7ca-9baf-4b1e-9a5a-c04a757594f4 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1543 microversion: 2.1 time: 0.810382 Nov 03 04:17:15.324881 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2443/5004] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:14 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1543 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:15.330921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4700bee6-ff33-42db-b18d-3aa66c20fbb0 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f83a6160>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:15.421558 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4700bee6-ff33-42db-b18d-3aa66c20fbb0 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.095151 Nov 03 04:17:15.422834 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2444/5005] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:15 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:15.435880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:15.453507 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8bd42833-48de-469a-9b5d-04c5e2996fe0 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 200 len: 1507 microversion: 2.1 time: 0.857203 Nov 03 04:17:15.454765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2562/5006] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:14 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 1507 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:15.483119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:15.483904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:15.494780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:15.495618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:15.497258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:15.498239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:15.501493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:15.505637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:15.557008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:15.614831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:15.616092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:15.633058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:15.633058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:15.633058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:15.633058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:15.633058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:15.633058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:16.068224 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b6ad375-4884-4010-8e16-ad807b4232e2 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 204 len: 0 microversion: 2.1 time: 0.590754 Nov 03 04:17:16.069055 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2445/5007] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:15 2022] DELETE /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:17:16.110645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:16.121875 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21e3c6b2-9c7b-4d48-ae73-f4beaed3d00e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1666 microversion: 2.1 time: 0.512563 Nov 03 04:17:16.125343 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2563/5008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:15 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1666 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:16.293840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1330452122", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "7acae962-25a6-439e-baa0-a7ea8c1ce2c9"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:16.403483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] validate_networks() for [('7acae962-25a6-439e-baa0-a7ea8c1ce2c9', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:17:16.439304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e733370f-36d2-4073-912a-3f08c392142a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd492160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:16.550390 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e733370f-36d2-4073-912a-3f08c392142a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.106215 Nov 03 04:17:16.550390 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2564/5009] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:16 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:17.149977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:17.150625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:17.196000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:17.197170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:17.198671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:17.199488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:17.202380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:17.203544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:18.301344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:18.313981 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36d96222-4c1b-462d-8dcf-974297cee3be tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1666 microversion: 2.1 time: 1.167023 Nov 03 04:17:18.334113 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2565/5010] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:17 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1666 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:18.339553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-270a9a19-20f1-428e-baf0-5efffb3035ee tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84a08b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:18.417513 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-270a9a19-20f1-428e-baf0-5efffb3035ee tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.081836 Nov 03 04:17:18.420200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2566/5011] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:18 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:18.664028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:17:18.664565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:17:18.666114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:17:18.666594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:17:18.667035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:17:18.696051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:18.696578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:18.697005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:18.697773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:18.698236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:18.701969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:18.759708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Getting quotas for project b201c36deaa948b7a3f24424163a52d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:17:18.786750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Getting quotas for user 46a45724be7940dfb595b9db8e828e41 and project b201c36deaa948b7a3f24424163a52d2. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:17:18.818108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:17:18.820565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:17:19.003425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fb16cd0b-85a8-4654-8858-34c72d54393d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.714817 Nov 03 04:17:19.010548 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2446/5012] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:17:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:17:19.018196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e12e7b35-8daf-4e9f-8fb4-bf114a2a3659 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:19.018928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e12e7b35-8daf-4e9f-8fb4-bf114a2a3659 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:19.304874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e12e7b35-8daf-4e9f-8fb4-bf114a2a3659 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:19.322835 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e12e7b35-8daf-4e9f-8fb4-bf114a2a3659 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1218 microversion: 2.1 time: 0.310944 Nov 03 04:17:19.323915 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2567/5013] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:19 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1218 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:19.338541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:19.339167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:19.348773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:19.351688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:19.352315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:19.354911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:19.355576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:19.360923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:19.395966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3222e8a0-4b3e-437a-85ee-1cc59c570413 req-ff7e366c-c312-49df-8878-4741e155911e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3459bc-8d10-4cb7-9f01-daa77c4a59b5", "name": "network-vif-deleted", "tag": "2f966733-7844-4633-9607-9fb1d584e31f"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:19.423243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3222e8a0-4b3e-437a-85ee-1cc59c570413 req-ff7e366c-c312-49df-8878-4741e155911e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:19.423775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3222e8a0-4b3e-437a-85ee-1cc59c570413 req-ff7e366c-c312-49df-8878-4741e155911e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:19.424418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3222e8a0-4b3e-437a-85ee-1cc59c570413 req-ff7e366c-c312-49df-8878-4741e155911e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:19.489957 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3222e8a0-4b3e-437a-85ee-1cc59c570413 req-ff7e366c-c312-49df-8878-4741e155911e service nova] Creating event network-vif-deleted:2f966733-7844-4633-9607-9fb1d584e31f for instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 on n-h2-854653-7 Nov 03 04:17:19.506047 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3222e8a0-4b3e-437a-85ee-1cc59c570413 req-ff7e366c-c312-49df-8878-4741e155911e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114989 Nov 03 04:17:19.511862 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2568/5014] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:19.518001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cabcd9aa-f422-4291-a115-cc4e07e54021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f845f5e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:19.599075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cabcd9aa-f422-4291-a115-cc4e07e54021 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.083100 Nov 03 04:17:19.599075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2569/5015] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:19 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:19.790153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:19.806790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b90ec264-2f1a-411f-83e0-cd771001ae75 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.473093 Nov 03 04:17:19.822177 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2447/5016] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:19 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:19.838411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:19.839488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:19.849694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:19.851574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:19.853537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:19.854718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:19.855267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:19.855708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:20.351453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5a2cdd48-9f3a-471b-a6a9-a2991e0a7ee4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:20.352601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5a2cdd48-9f3a-471b-a6a9-a2991e0a7ee4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:20.618117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5a2cdd48-9f3a-471b-a6a9-a2991e0a7ee4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:20.627074 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5a2cdd48-9f3a-471b-a6a9-a2991e0a7ee4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1218 microversion: 2.1 time: 0.279528 Nov 03 04:17:20.628940 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2448/5017] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:20 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1218 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:20.637678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2541ba0b-0951-4ab5-a313-c314ca6974e5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f94b75e0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:20.682794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:20.718991 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82df1911-214c-4615-8cd7-2bdb3a471248 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1669 microversion: 2.1 time: 0.884422 Nov 03 04:17:20.722138 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2570/5018] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:19 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1669 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:20.724355 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2541ba0b-0951-4ab5-a313-c314ca6974e5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.092679 Nov 03 04:17:20.741459 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2449/5019] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:20 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:20.771570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:20.772742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:20.797199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:20.804512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:20.805074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:20.805767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:20.806243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:20.806685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:20.897271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:20.921583 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Working on deleting snapshot c5259a5e-b2bc-46b6-b012-f6514249b631 from shelved instance... Nov 03 04:17:21.666468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:21.667102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:21.678068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:21.678568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:21.697801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:21.698595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:21.699092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:21.699534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:22.042662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:22.072228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-180f87ec-d14f-4edf-8e6b-2ce00b709e43 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1270 microversion: 2.1 time: 0.407948 Nov 03 04:17:22.078325 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2450/5020] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:21 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1270 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:22.118249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca252f9c-e1e6-4401-a017-92c50314ae82 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f91e6c10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:23.797102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca252f9c-e1e6-4401-a017-92c50314ae82 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 1.717518 Nov 03 04:17:23.809812 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2451/5021] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:22 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:23.990090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Doing local delete in cell 464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) {{(pid=127594) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 03 04:17:23.992832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:24.009851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:24.010492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:24.011207 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 03 04:17:24.018138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] deallocate_for_instance() {{(pid=127594) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 03 04:17:24.055075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-77246224-64a3-4594-81a4-dd0d51b6714b req-0b0dfc35-48eb-43d2-80f1-d59ca1588400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c01ebb-5afe-4dc4-8868-5e840ec89e87", "tag": "f7de82db-abba-46b0-915c-03c631032f57"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:24.069877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-77246224-64a3-4594-81a4-dd0d51b6714b req-0b0dfc35-48eb-43d2-80f1-d59ca1588400 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:24.070868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-77246224-64a3-4594-81a4-dd0d51b6714b req-0b0dfc35-48eb-43d2-80f1-d59ca1588400 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:24.074036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-77246224-64a3-4594-81a4-dd0d51b6714b req-0b0dfc35-48eb-43d2-80f1-d59ca1588400 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:24.110957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-77246224-64a3-4594-81a4-dd0d51b6714b req-0b0dfc35-48eb-43d2-80f1-d59ca1588400 service nova] Creating event network-changed:f7de82db-abba-46b0-915c-03c631032f57 for instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 on n-h1-854653-7 Nov 03 04:17:24.133692 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-77246224-64a3-4594-81a4-dd0d51b6714b req-0b0dfc35-48eb-43d2-80f1-d59ca1588400 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318392 Nov 03 04:17:24.133692 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2452/5022] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:24.150229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:24.154975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:24.174110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:24.174688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:24.179849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:24.180645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:24.181184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:24.181631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:24.725572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:24.741241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e8916165-0496-4313-a760-96ab15301e00 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1276 microversion: 2.1 time: 0.602939 Nov 03 04:17:24.743510 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2453/5023] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:24 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1276 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:24.817155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40867968-1fe3-467a-959b-2494be1a535b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f95a9c10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:24.972052 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40867968-1fe3-467a-959b-2494be1a535b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.159882 Nov 03 04:17:24.974596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2454/5024] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:24 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:25.773461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:25.774441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:25.794444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:25.801711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:25.808992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:25.812597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:25.816506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:25.820702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:26.213337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:26.231188 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9cbf1fe4-8cdb-4b8d-9829-2e6304b2fc51 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1276 microversion: 2.1 time: 0.461535 Nov 03 04:17:26.240166 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2455/5025] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:25 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1276 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:26.263390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d9769ce-96eb-4051-a348-2f90263f6d0c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8b4dee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:26.391944 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d9769ce-96eb-4051-a348-2f90263f6d0c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.153406 Nov 03 04:17:26.393489 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2456/5026] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:26 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:27.284843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:27.284843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:27.295969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:27.296454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:27.297168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:27.300976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:27.302375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:27.302826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:28.721719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:29.323720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:29.588292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Updating instance_info_cache with network_info: [] {{(pid=127594) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 03 04:17:29.881435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:29.890961 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52a0f7d4-0799-4d9d-9db6-ea1f150b6de8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 2.632613 Nov 03 04:17:29.911016 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2457/5027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:27 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 2653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:29.935532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8d8fffb5-3685-4302-ac8a-6fc4ed6b783c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8943310>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:30.032046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8d8fffb5-3685-4302-ac8a-6fc4ed6b783c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.117868 Nov 03 04:17:30.033930 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2458/5028] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:29 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:30.177573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7df1791a-46cf-4705-9669-b95ba31d1838 req-f821954e-a74c-4b6a-9670-f77a163fe20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825bef4c-2420-47aa-94be-e2b287f1a09b", "name": "network-vif-plugged", "status": "completed", "tag": "6052fe58-754d-4e78-aa92-7a20c800504e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:30.207223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7df1791a-46cf-4705-9669-b95ba31d1838 req-f821954e-a74c-4b6a-9670-f77a163fe20a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.208008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7df1791a-46cf-4705-9669-b95ba31d1838 req-f821954e-a74c-4b6a-9670-f77a163fe20a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.209626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7df1791a-46cf-4705-9669-b95ba31d1838 req-f821954e-a74c-4b6a-9670-f77a163fe20a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.235994 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7df1791a-46cf-4705-9669-b95ba31d1838 req-f821954e-a74c-4b6a-9670-f77a163fe20a service nova] Creating event network-vif-plugged:6052fe58-754d-4e78-aa92-7a20c800504e for instance 825bef4c-2420-47aa-94be-e2b287f1a09b on n-h1-854653-7 Nov 03 04:17:30.246905 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7df1791a-46cf-4705-9669-b95ba31d1838 req-f821954e-a74c-4b6a-9670-f77a163fe20a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212962 Nov 03 04:17:30.249702 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2459/5029] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:30.282108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1d58ba50-11b0-4618-9341-ec4ec5c5a2a2 req-57f21d39-faac-4b07-93ad-892bebe94725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4556c668-4529-40a6-ade2-62ecba063d93", "name": "network-vif-deleted", "tag": "7961b8e6-ee70-4f70-905e-8b94bc479c43"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:30.318688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d58ba50-11b0-4618-9341-ec4ec5c5a2a2 req-57f21d39-faac-4b07-93ad-892bebe94725 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.320864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d58ba50-11b0-4618-9341-ec4ec5c5a2a2 req-57f21d39-faac-4b07-93ad-892bebe94725 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.322497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d58ba50-11b0-4618-9341-ec4ec5c5a2a2 req-57f21d39-faac-4b07-93ad-892bebe94725 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.382739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_external_events [req-1d58ba50-11b0-4618-9341-ec4ec5c5a2a2 req-57f21d39-faac-4b07-93ad-892bebe94725 service nova] Unable to find a host for instance 4556c668-4529-40a6-ade2-62ecba063d93. Dropping event network-vif-deleted {{(pid=127593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 03 04:17:30.386861 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1d58ba50-11b0-4618-9341-ec4ec5c5a2a2 req-57f21d39-faac-4b07-93ad-892bebe94725 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.135669 Nov 03 04:17:30.395311 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2460/5030] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 144 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 03 04:17:30.509068 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3e8c840a-90ac-4ceb-a7fe-9ee20768ac85 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 204 len: 0 microversion: 2.1 time: 9.758191 Nov 03 04:17:30.516855 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2571/5031] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:20 2022] DELETE /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 0 bytes in 9761 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:17:30.523390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:30.524114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 4556c668-4529-40a6-ade2-62ecba063d93] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:30.534992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.537688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.538590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.541398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.541909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.542356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.577735 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] HTTP exception thrown: Instance 4556c668-4529-40a6-ade2-62ecba063d93 could not be found. Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Request method failure captured: Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 HTTP/1.1 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz5obLGYsXMsCiJUNlEVMAwYzv3C-HCNO0Tt8826NWpMmXJyEoO8CMK1fOCClxvGv3qCGmJzQGpCnm7T73M6XrIm_QO6IU_3Lp6iRrGGHKX7HvdUDVmitEpnJxOZuoElZFmmtIKxyH9aC10ikmqZlCQf9r4d9WkFnSoOO4Z-YziLQWM Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5da4e6e327d94557872a462ca9fa96f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5da4e6e327d94557872a462ca9fa96f8"}]}] Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d374eee04fe4433d862b7bc04a16a563 Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 4556c668-4529-40a6-ade2-62ecba063d93 could not be found. Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '4556c668-4529-40a6-ade2-62ecba063d93'} Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4556c668-4529-40a6-ade2-62ecba063d93 could not be found. Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4556c668-4529-40a6-ade2-62ecba063d93 could not be found. Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:30.584049 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:30.590048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:30.590048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:30.590048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:30.590048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:30.590048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:30.590048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4556c668-4529-40a6-ade2-62ecba063d93 could not be found. Nov 03 04:17:30.590048 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:30.592359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Returning 404 to user: Instance 4556c668-4529-40a6-ade2-62ecba063d93 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:30.593525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1819c8ae-6560-47d3-8986-fdb7c13023b8 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93" status: 404 len: 111 microversion: 2.1 time: 0.074681 Nov 03 04:17:30.595503 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2461/5032] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:30 2022] GET /compute/v2.1/servers/4556c668-4529-40a6-ade2-62ecba063d93 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:17:30.625767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:30.626620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:30.641962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.642947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.644618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.647131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.647855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.650885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.724271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:30.917386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:30.921856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:30.929416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:30.934262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.935832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.936486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.938772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:30.942156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:30.942820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:30.966560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:31.251049 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7585a00-cb47-40da-b9f8-aef044e45fb6 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 204 len: 0 microversion: 2.1 time: 0.649979 Nov 03 04:17:31.256330 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2572/5033] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:30 2022] DELETE /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:17:31.270422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4c15f87-147d-4c20-a1b0-98f6b90bb7b2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f882ef70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:31.358321 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4c15f87-147d-4c20-a1b0-98f6b90bb7b2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.102261 Nov 03 04:17:31.360191 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2573/5034] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:31 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:31.380448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:31.382327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:31.403498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:31.403498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:31.405300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:31.406475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:31.408481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:31.413622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:31.673224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:31.682287 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d5b1fad-6e66-4991-9740-abc5fcbac388 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 0.769858 Nov 03 04:17:31.686922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2462/5035] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:30 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:31.729335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:31.746286 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-200a934d-56fc-4340-9279-37de00f15160 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1466 microversion: 2.1 time: 0.384964 Nov 03 04:17:31.749967 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2574/5036] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:31 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1466 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:32.377294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7e85557-2a54-4c99-9288-ed6c259edbb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f91e6820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:32.465176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7e85557-2a54-4c99-9288-ed6c259edbb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.093281 Nov 03 04:17:32.465755 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2463/5037] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:32 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:32.715925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:32.716587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:32.738516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:32.739990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:32.742636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:32.743404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:32.743875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:32.744310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:32.779145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:32.779767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:32.794175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:32.794680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:32.795123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:32.795839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:32.807050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:32.807773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:33.368561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:33.385316 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd7e7525-8193-4712-bc41-8c02b9606614 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1466 microversion: 2.1 time: 0.606823 Nov 03 04:17:33.389214 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2464/5038] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:32 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1466 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:33.419042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:33.430627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-582b2f09-51d5-466b-a920-939b160eaae5 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 0.718633 Nov 03 04:17:33.435177 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2575/5039] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:32 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:33.481947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d178f9c-ff87-422c-ac84-4f4e084a3b5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f97ae700>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:33.573811 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d178f9c-ff87-422c-ac84-4f4e084a3b5d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.087501 Nov 03 04:17:33.576689 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2465/5040] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:33 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:34.298536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-92656c5d-f397-4be3-85e6-784879e2bb15 req-28fd87ee-9110-460f-8a87-a10e1623b37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a", "name": "network-vif-deleted", "tag": "27d270b3-1634-4a21-b2e4-f2aa37a307f6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:34.331329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-92656c5d-f397-4be3-85e6-784879e2bb15 req-28fd87ee-9110-460f-8a87-a10e1623b37f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:34.332124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-92656c5d-f397-4be3-85e6-784879e2bb15 req-28fd87ee-9110-460f-8a87-a10e1623b37f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:34.332768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-92656c5d-f397-4be3-85e6-784879e2bb15 req-28fd87ee-9110-460f-8a87-a10e1623b37f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:34.357643 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-92656c5d-f397-4be3-85e6-784879e2bb15 req-28fd87ee-9110-460f-8a87-a10e1623b37f service nova] Creating event network-vif-deleted:27d270b3-1634-4a21-b2e4-f2aa37a307f6 for instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a on n-h2-854653-7 Nov 03 04:17:34.367881 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-92656c5d-f397-4be3-85e6-784879e2bb15 req-28fd87ee-9110-460f-8a87-a10e1623b37f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073272 Nov 03 04:17:34.368838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2576/5041] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:34.424201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:34.426090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:34.456656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:34.457212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:34.457751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:34.458504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:34.459033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:34.459480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:34.461394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:34.462366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:34.478183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:34.482470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:34.483189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:34.484508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:34.489904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:34.500623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:34.536183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:34.826657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:34.834056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9fe73e32-7971-48f2-80c3-0b0cb87d80ca tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1299 microversion: 2.1 time: 0.425552 Nov 03 04:17:34.834649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2466/5042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:34 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1299 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:34.839338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0cd45100-c360-4ebf-8545-6222ec5db80d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f83a6310>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:34.973175 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0cd45100-c360-4ebf-8545-6222ec5db80d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.137213 Nov 03 04:17:34.976866 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2467/5043] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:34 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:34.990777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d9e1baff-db82-4339-a2e8-177826a2b985 req-dafb85ef-6a5a-48ae-baec-f909b7d37fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3bf99a5-209d-4407-866a-53e1d48c4e0c", "tag": "4c17f42a-26ce-4f01-a48c-a21a4ce340e3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:35.024584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d9e1baff-db82-4339-a2e8-177826a2b985 req-dafb85ef-6a5a-48ae-baec-f909b7d37fb5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:35.024584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d9e1baff-db82-4339-a2e8-177826a2b985 req-dafb85ef-6a5a-48ae-baec-f909b7d37fb5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:35.024584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d9e1baff-db82-4339-a2e8-177826a2b985 req-dafb85ef-6a5a-48ae-baec-f909b7d37fb5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:35.038861 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d9e1baff-db82-4339-a2e8-177826a2b985 req-dafb85ef-6a5a-48ae-baec-f909b7d37fb5 service nova] Creating event network-changed:4c17f42a-26ce-4f01-a48c-a21a4ce340e3 for instance a3bf99a5-209d-4407-866a-53e1d48c4e0c on n-h2-854653-7 Nov 03 04:17:35.047033 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d9e1baff-db82-4339-a2e8-177826a2b985 req-dafb85ef-6a5a-48ae-baec-f909b7d37fb5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068442 Nov 03 04:17:35.049784 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2468/5044] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:35.212958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:35.244734 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-81da91a0-9ed7-4cd1-9e12-af37abcbd5b8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 0.788126 Nov 03 04:17:35.251102 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2577/5045] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:34 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:35.867195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:35.868763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:35.891937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:35.894189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:35.897600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:35.899017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:35.919211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:35.920865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:35.992350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3887e669-d2f4-4cff-b4b0-03a09206fa8f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84aac10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:36.043517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:36.047197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:36.055109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:36.055109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lazy-loading 'fault' on Instance uuid fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:17:36.087378 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3887e669-d2f4-4cff-b4b0-03a09206fa8f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.098665 Nov 03 04:17:36.088019 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2578/5046] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:35 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:36.291820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:36.292674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:36.294896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:36.309246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:36.317548 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68119e0e-c86c-480b-9fae-466345017075 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 200 len: 1304 microversion: 2.1 time: 0.460230 Nov 03 04:17:36.330593 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2469/5047] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:35 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 1304 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:36.338966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:36.351438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:36.352299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:36.358783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:36.359812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:36.360531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:36.921037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:36.933225 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-341dfbb6-b58f-4c43-9d6c-3b35949cbc08 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 0.658891 Nov 03 04:17:36.939785 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2579/5048] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:36 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:37.111388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bbaae845-9391-4f45-853a-08e101b61419 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f83a6940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:37.211398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bbaae845-9391-4f45-853a-08e101b61419 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.111266 Nov 03 04:17:37.213472 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2470/5049] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:37 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:37.358807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:37.359706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:37.375114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:37.381259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:37.381259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:37.381259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:37.381259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:37.381259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:37.408903 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] HTTP exception thrown: Instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a could not be found. Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Request method failure captured: Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a HTTP/1.1 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz5obLGYsXMsCiJUNlEVMAwYzv3C-HCNO0Tt8826NWpMmXJyEoO8CMK1fOCClxvGv3qCGmJzQGpCnm7T73M6XrIm_QO6IU_3Lp6iRrGGHKX7HvdUDVmitEpnJxOZuoElZFmmtIKxyH9aC10ikmqZlCQf9r4d9WkFnSoOO4Z-YziLQWM Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5da4e6e327d94557872a462ca9fa96f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5da4e6e327d94557872a462ca9fa96f8"}]}] Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d374eee04fe4433d862b7bc04a16a563 Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a could not be found. Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a'} Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a could not be found. Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a could not be found. Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:37.411993 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:37.416772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:37.416772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:37.416772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:37.416772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:37.416772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:37.416772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a could not be found. Nov 03 04:17:37.416772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:37.420979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Returning 404 to user: Instance fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:37.422231 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa118eaa-865a-47bc-88ce-a076b89e8b2d tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a" status: 404 len: 111 microversion: 2.1 time: 0.069144 Nov 03 04:17:37.427053 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2580/5050] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:37 2022] GET /compute/v2.1/servers/fe1f19e3-a2b5-4dd5-b9e9-83a2c303686a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:17:37.432069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:37.432658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:37.443136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:37.456552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:37.460050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:37.462159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:37.466081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:37.466975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:37.525998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:37.970458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:37.971276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:37.979162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:37.986604 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3224aa58-5a6b-43dd-935a-c99c71d24ec1 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "DELETE /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 204 len: 0 microversion: 2.1 time: 0.558413 Nov 03 04:17:37.990782 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2471/5051] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:37 2022] DELETE /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:17:37.998007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:38.002505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:38.003919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:38.005314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:38.006078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:38.007232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:38.008373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:38.037361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:38.041613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:38.042528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:38.043544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:38.044257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:38.045174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:38.960069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:38.977129 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c6d080c-fc4d-4a59-a6c5-ea256c9663c8 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 1.015203 Nov 03 04:17:38.978090 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2581/5052] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:37 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:38.982843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ca2b68bc-8e9a-4918-9c82-9078c71c13be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd4929d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:39.050521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:39.064698 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ce54d8a-59d2-4e33-98b5-0cdf68aaabfb tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1507 microversion: 2.1 time: 1.072077 Nov 03 04:17:39.069615 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2472/5053] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:37 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1507 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:39.087695 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ca2b68bc-8e9a-4918-9c82-9078c71c13be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.108459 Nov 03 04:17:39.102030 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2582/5054] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:38 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:39.999870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:40.000493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:40.017135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:40.019881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:40.021397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:40.025697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:40.026412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:40.027520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:40.109992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:40.113211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:40.171402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:40.172185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:40.173330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:40.185208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:40.185208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:40.185208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:40.946211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:40.961953 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3098779e-8268-4df9-810c-1408585dfb05 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 0.965841 Nov 03 04:17:40.966000 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2473/5055] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:39 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:40.978121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f43fb74-cb36-4e69-80d2-50e4c14bfe23 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f83a6430>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:41.099483 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f43fb74-cb36-4e69-80d2-50e4c14bfe23 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.131148 Nov 03 04:17:41.100231 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2474/5056] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:40 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:41.165933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6801c31d-16aa-4f3e-a9ad-7eafbf88cc52 req-1021da56-0085-40cb-9050-536b0e3a0644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ee051f-98cd-44b1-9f8f-0e2c1d907fa1", "name": "network-vif-deleted", "tag": "7f73f7ab-8181-44dc-b7fc-0de3e0f23a72"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:41.187059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6801c31d-16aa-4f3e-a9ad-7eafbf88cc52 req-1021da56-0085-40cb-9050-536b0e3a0644 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:41.187617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6801c31d-16aa-4f3e-a9ad-7eafbf88cc52 req-1021da56-0085-40cb-9050-536b0e3a0644 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:41.188064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6801c31d-16aa-4f3e-a9ad-7eafbf88cc52 req-1021da56-0085-40cb-9050-536b0e3a0644 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:41.215334 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6801c31d-16aa-4f3e-a9ad-7eafbf88cc52 req-1021da56-0085-40cb-9050-536b0e3a0644 service nova] Creating event network-vif-deleted:7f73f7ab-8181-44dc-b7fc-0de3e0f23a72 for instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 on n-h2-854653-7 Nov 03 04:17:41.228964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:41.238689 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9bea1f64-e653-4521-bfdc-e40b836317d9 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1507 microversion: 2.1 time: 1.139194 Nov 03 04:17:41.240235 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6801c31d-16aa-4f3e-a9ad-7eafbf88cc52 req-1021da56-0085-40cb-9050-536b0e3a0644 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071294 Nov 03 04:17:41.245568 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2475/5057] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:17:41.245854 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2583/5058] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:40 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1507 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:41.992181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:41.992896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:41.999816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:42.000314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:42.001323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:42.002043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:42.002506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:42.002938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:42.130633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e3a40cc-395b-43c3-ac7e-40c50ca257af tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd62c940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:42.214961 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e3a40cc-395b-43c3-ac7e-40c50ca257af tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.090604 Nov 03 04:17:42.218660 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2584/5059] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:42 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:42.265963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:42.267127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:42.285094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:42.303997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:42.304920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:42.305934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:42.306596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:42.307216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:42.418913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:42.422206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:42.425824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:42.426542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lazy-loading 'fault' on Instance uuid 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:17:43.051099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:43.059039 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13edfae5-7f2c-4cfc-92d7-fa789df5c190 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 200 len: 1304 microversion: 2.1 time: 0.796738 Nov 03 04:17:43.093534 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2585/5060] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:42 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 1304 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:43.235900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15d618b5-8ca4-4b33-a733-3a8b607f305f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f849d820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:43.294148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:43.303176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3c0fc183-0613-45bb-80e9-4be0ec291615 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 1.315237 Nov 03 04:17:43.321067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2476/5061] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:41 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:43.379491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15d618b5-8ca4-4b33-a733-3a8b607f305f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.148318 Nov 03 04:17:43.380080 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2586/5062] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:43 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:44.085939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:44.086559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:44.100482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.100988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.101465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.102194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.102657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.107988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.134809 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] HTTP exception thrown: Instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 could not be found. Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Request method failure captured: Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 HTTP/1.1 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz5obLGYsXMsCiJUNlEVMAwYzv3C-HCNO0Tt8826NWpMmXJyEoO8CMK1fOCClxvGv3qCGmJzQGpCnm7T73M6XrIm_QO6IU_3Lp6iRrGGHKX7HvdUDVmitEpnJxOZuoElZFmmtIKxyH9aC10ikmqZlCQf9r4d9WkFnSoOO4Z-YziLQWM Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5da4e6e327d94557872a462ca9fa96f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5da4e6e327d94557872a462ca9fa96f8"}]}] Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d374eee04fe4433d862b7bc04a16a563 Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 could not be found. Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '13ee051f-98cd-44b1-9f8f-0e2c1d907fa1'} Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 could not be found. Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 could not be found. Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:44.136521 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 could not be found. Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Returning 404 to user: Instance 13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:44.149401 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd2879b0-2134-482b-9b81-44348c0701cc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1" status: 404 len: 111 microversion: 2.1 time: 0.055956 Nov 03 04:17:44.150066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:44.150066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:44.159202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.159708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.160154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.160882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.161374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.161805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.162345 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2477/5063] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:44 2022] GET /compute/v2.1/servers/13ee051f-98cd-44b1-9f8f-0e2c1d907fa1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:17:44.224852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:44.346748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:44.347672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:44.363883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.364717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.365399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.366328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.367019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.367650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.622002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6fbb4fbb-c051-480f-b6bd-49db22e0a812 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 204 len: 0 microversion: 2.1 time: 0.479021 Nov 03 04:17:44.622723 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2587/5064] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:44 2022] DELETE /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:17:44.628970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d6086741-ae85-45a3-8be3-ee10b1c2af1f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f84c61f0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:44.739225 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d6086741-ae85-45a3-8be3-ee10b1c2af1f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.113967 Nov 03 04:17:44.739225 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2588/5065] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:44 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:44.759548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:44.761764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:44.789504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.790444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.791138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.796028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:44.797608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:44.800082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:44.962574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:44.982268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74599e07-6b1c-4db0-bbdc-99758a3d4dac tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 0.640634 Nov 03 04:17:44.983000 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2478/5066] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:44 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:45.288930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-eeb028d6-860c-4c6e-94b3-1a979802dc09 req-40da725f-8d80-4f06-a72d-6d9e4abdd6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bf99a5-209d-4407-866a-53e1d48c4e0c", "name": "network-vif-plugged", "status": "completed", "tag": "4c17f42a-26ce-4f01-a48c-a21a4ce340e3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:45.315542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:45.319661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-eeb028d6-860c-4c6e-94b3-1a979802dc09 req-40da725f-8d80-4f06-a72d-6d9e4abdd6a1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:45.320160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-eeb028d6-860c-4c6e-94b3-1a979802dc09 req-40da725f-8d80-4f06-a72d-6d9e4abdd6a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:45.320612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-eeb028d6-860c-4c6e-94b3-1a979802dc09 req-40da725f-8d80-4f06-a72d-6d9e4abdd6a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:45.342324 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-eeb028d6-860c-4c6e-94b3-1a979802dc09 req-40da725f-8d80-4f06-a72d-6d9e4abdd6a1 service nova] Creating event network-vif-plugged:4c17f42a-26ce-4f01-a48c-a21a4ce340e3 for instance a3bf99a5-209d-4407-866a-53e1d48c4e0c on n-h2-854653-7 Nov 03 04:17:45.351453 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-eeb028d6-860c-4c6e-94b3-1a979802dc09 req-40da725f-8d80-4f06-a72d-6d9e4abdd6a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078805 Nov 03 04:17:45.352380 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2479/5067] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Nov 03 04:17:45.508732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:45.518945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8572e51a-6a71-4c22-bc4e-336ccb7eadcc tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1495 microversion: 2.1 time: 0.768890 Nov 03 04:17:45.525137 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2589/5068] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:44 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1495 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:45.765300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-88712977-cedd-4c08-be11-de476aebf426 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f8b4de50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:45.876771 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-88712977-cedd-4c08-be11-de476aebf426 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.116903 Nov 03 04:17:45.877404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2480/5069] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:45 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:46.007973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:46.008602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:46.019910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:46.024866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:46.027004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:46.030905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:46.034336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:46.035064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:46.550172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:46.551578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:46.578254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:46.585694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:46.586400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:46.587360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:46.588025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:46.588641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:46.779352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:46.825938 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-faecf800-3b50-4b72-9e62-bf2c00f76710 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1453 microversion: 2.1 time: 0.274284 Nov 03 04:17:46.848327 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2481/5070] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:46 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1453 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:46.865286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5a77adf3-24df-4eab-89d1-f929e1c26203 req-5e4dfe6b-5c7d-4f22-a90c-045b881e58d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a89c8874-6e5c-4d54-b5b3-04d416801153", "name": "network-vif-deleted", "tag": "4d314987-2e70-453e-8561-399be3e4c819"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:46.925284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a77adf3-24df-4eab-89d1-f929e1c26203 req-5e4dfe6b-5c7d-4f22-a90c-045b881e58d9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:46.925980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a77adf3-24df-4eab-89d1-f929e1c26203 req-5e4dfe6b-5c7d-4f22-a90c-045b881e58d9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:46.926448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5a77adf3-24df-4eab-89d1-f929e1c26203 req-5e4dfe6b-5c7d-4f22-a90c-045b881e58d9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:46.927588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:46.935850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ccf89fbb-8ae2-4f63-96fc-53d5cba3aa3d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1318 microversion: 2.1 time: 0.931777 Nov 03 04:17:46.941852 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2590/5071] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:46 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:46.949298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27ba38d6-1b15-4d62-a40c-57898b72ec5c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f844a430>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:47.039062 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5a77adf3-24df-4eab-89d1-f929e1c26203 req-5e4dfe6b-5c7d-4f22-a90c-045b881e58d9 service nova] Creating event network-vif-deleted:4d314987-2e70-453e-8561-399be3e4c819 for instance a89c8874-6e5c-4d54-b5b3-04d416801153 on n-h2-854653-7 Nov 03 04:17:47.066629 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5a77adf3-24df-4eab-89d1-f929e1c26203 req-5e4dfe6b-5c7d-4f22-a90c-045b881e58d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213423 Nov 03 04:17:47.079961 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27ba38d6-1b15-4d62-a40c-57898b72ec5c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.136730 Nov 03 04:17:47.080553 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2591/5072] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:46 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:47.093111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2482/5073] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:47.845258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:47.849169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:47.871421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:47.877816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:47.877816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:47.877816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:47.877816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:47.877816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:47.963272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:47.963989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:47.978223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:47.985770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:47.994221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:47.997879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:48.002090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:48.004970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:48.018895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:48.024471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:48.026141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:48.030834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lazy-loading 'fault' on Instance uuid a89c8874-6e5c-4d54-b5b3-04d416801153 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:17:48.263383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:48.272338 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-09250568-5bf5-4efd-bad3-83dce4125e33 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 200 len: 1305 microversion: 2.1 time: 0.432478 Nov 03 04:17:48.275046 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2592/5074] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:47 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 1305 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:48.290822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd66d069-574c-400c-817e-3b01c06b6710 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f849ddc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:48.435477 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd66d069-574c-400c-817e-3b01c06b6710 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.157614 Nov 03 04:17:48.436513 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2593/5075] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:48 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:48.566471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:48.574970 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9953dd6-d5ce-4e4a-9844-485f87d4ef75 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1507 microversion: 2.1 time: 0.615819 Nov 03 04:17:48.585881 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2483/5076] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:47 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1507 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:48.613709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:48.614340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:48.628176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:48.628684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:48.629159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:48.629891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:48.638987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:48.643283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.053963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:49.073443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1725705-0b29-477e-9ea1-ba71e0c276fd tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1507 microversion: 2.1 time: 0.465223 Nov 03 04:17:49.075409 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2594/5077] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:48 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:49.112524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:49.119803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:49.139443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.139943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.140397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.141174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.141634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.142066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.304225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:49.305720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: a89c8874-6e5c-4d54-b5b3-04d416801153] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:49.329534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.336779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.337943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.339254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.339967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.340493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.358206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] HTTP exception thrown: Instance a89c8874-6e5c-4d54-b5b3-04d416801153 could not be found. Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Request method failure captured: Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 HTTP/1.1 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz5obLGYsXMsCiJUNlEVMAwYzv3C-HCNO0Tt8826NWpMmXJyEoO8CMK1fOCClxvGv3qCGmJzQGpCnm7T73M6XrIm_QO6IU_3Lp6iRrGGHKX7HvdUDVmitEpnJxOZuoElZFmmtIKxyH9aC10ikmqZlCQf9r4d9WkFnSoOO4Z-YziLQWM Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5da4e6e327d94557872a462ca9fa96f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5da4e6e327d94557872a462ca9fa96f8"}]}] Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d374eee04fe4433d862b7bc04a16a563 Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a89c8874-6e5c-4d54-b5b3-04d416801153 could not be found. Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a89c8874-6e5c-4d54-b5b3-04d416801153'} Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89c8874-6e5c-4d54-b5b3-04d416801153 could not be found. Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89c8874-6e5c-4d54-b5b3-04d416801153 could not be found. Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:49.360533 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89c8874-6e5c-4d54-b5b3-04d416801153 could not be found. Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:49.365965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Returning 404 to user: Instance a89c8874-6e5c-4d54-b5b3-04d416801153 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:49.366968 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a2f0630-498a-4579-96da-f91b57b36235 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153" status: 404 len: 111 microversion: 2.1 time: 0.066622 Nov 03 04:17:49.371288 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2595/5078] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:49 2022] GET /compute/v2.1/servers/a89c8874-6e5c-4d54-b5b3-04d416801153 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:17:49.378687 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bbf11023-aedd-4848-96b6-ae506f1f795d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "PUT /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1079 microversion: 2.1 time: 0.276750 Nov 03 04:17:49.378847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:49.378847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:49.386211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.387114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.387881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.388845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.389617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.390372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.394999 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2484/5079] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:17:49 2022] PUT /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1079 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:49.407890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:49.409737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:49.424372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.426806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.427302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.428068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:49.428552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:49.428980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:49.444151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:49.881901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e1efd4d-8e3b-4779-9bc8-beb8275b5334 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "DELETE /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 204 len: 0 microversion: 2.1 time: 0.508753 Nov 03 04:17:49.882537 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2596/5080] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:49 2022] DELETE /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:17:49.889696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d9ab863-63a0-437b-b78a-b692b19fc994 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f845f5e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:50.059706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d9ab863-63a0-437b-b78a-b692b19fc994 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.175666 Nov 03 04:17:50.060597 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2597/5081] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:49 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:50.075842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:50.076696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:50.084494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.085050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.085571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.086726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.087195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.087656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.122060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:50.126675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:50.131930 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-875f2ce1-590c-467d-934b-ab2d09cf8986 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1505 microversion: 2.1 time: 0.735620 Nov 03 04:17:50.132529 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2485/5082] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:49 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:50.155754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:50.156403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:50.163798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.164297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.165008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.165828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.166445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.166930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.325631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:50.325631 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13cb1650-a54b-4171-8a3b-2e2f8536b65b tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1675 microversion: 2.1 time: 0.225911 Nov 03 04:17:50.325631 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2598/5083] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:50 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:50.331381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:50.340152 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-815e9ecb-54e1-4114-91a3-e5a595d4d6d4 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1505 microversion: 2.1 time: 0.188684 Nov 03 04:17:50.341117 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2486/5084] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:50 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:50.367303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:50.374696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:50.376526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.377110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.377475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.378185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.378639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.379058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.403456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:17:50.507043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-541c53ed-5d39-48c7-b9a6-8d72e761f891 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "PUT /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1081 microversion: 2.1 time: 0.143744 Nov 03 04:17:50.507686 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2599/5085] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:17:50 2022] PUT /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1081 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:50.528817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:50.529758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:50.550862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.551466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.551996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.552793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:50.556109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:50.556109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:50.983504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:50.996962 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-21dc620a-7107-4e85-8249-308875652e24 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1507 microversion: 2.1 time: 0.470626 Nov 03 04:17:50.998143 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2487/5086] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:50 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:51.021312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:51.021938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:51.034750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:51.037322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:51.038558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:51.039322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:51.041603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:51.042872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:51.079854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2bcb9477-eae9-4480-965d-ec576568b83f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f994a940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:51.151117 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2bcb9477-eae9-4480-965d-ec576568b83f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1413 microversion: 2.1 time: 0.075049 Nov 03 04:17:51.161056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2488/5087] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:51 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:51.335731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:51.336587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:51.382857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:51.383753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:51.384418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:51.387544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:51.388199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:51.388806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:52.102439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:52.112608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ca37387f-f66f-411a-93e3-46092545a6ae tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1675 microversion: 2.1 time: 0.780930 Nov 03 04:17:52.121982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:52.134953 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2489/5088] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:51 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1675 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:52.139543 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a0c2841-b5a9-4b1b-81b1-ccf57a908167 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1507 microversion: 2.1 time: 1.124136 Nov 03 04:17:52.140301 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2600/5089] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:51 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1507 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:52.171552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:52.173788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-767f4343-6388-451f-bd1d-6be18aa543f1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f971ddc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:52.176543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:52.211200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:52.211790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:52.212263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:52.213787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:52.214416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:52.214699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:52.290720 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-767f4343-6388-451f-bd1d-6be18aa543f1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1422 microversion: 2.1 time: 0.121859 Nov 03 04:17:52.301103 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2601/5090] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:52 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1422 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:52.313168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-feec5f8f-4d3c-4828-a223-b6240760db58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f87feb80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:52.324034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:52.388895 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-feec5f8f-4d3c-4828-a223-b6240760db58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 200 len: 1422 microversion: 2.1 time: 0.086346 Nov 03 04:17:52.389692 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2602/5091] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:17:52 2022] GET /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 1422 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:52.520083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1910754369", "imageRef": "cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00", "flavorRef": "452", "networks": [{"uuid": "67e5b85f-4010-4f46-ba0a-653e66da87d8"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:52.670986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] validate_networks() for [('67e5b85f-4010-4f46-ba0a-653e66da87d8', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:17:52.738817 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2f48794-4068-4b0e-a875-d724fbfb72bf tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 204 len: 0 microversion: 2.1 time: 0.575916 Nov 03 04:17:52.742651 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2490/5092] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:52 2022] DELETE /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:17:52.753554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:52.755042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:52.764436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:52.767103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:52.769344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:52.771583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:52.771583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:52.771583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:52.847485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:17:53.104598 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.compute.api [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Instance is already in deleting state, ignoring this request Nov 03 04:17:53.105496 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-95704365-a15c-48b3-adc4-25d46822bf02 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 204 len: 0 microversion: 2.1 time: 0.356933 Nov 03 04:17:53.106098 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2491/5093] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:52 2022] DELETE /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:17:53.115479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:53.121226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:53.135647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:53.136692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:53.137358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:53.138388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:53.139136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:53.139734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:53.666547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:53.677850 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c570687-2619-49f0-ac72-ec821e5f4c96 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1513 microversion: 2.1 time: 0.564941 Nov 03 04:17:53.678998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2492/5094] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:53 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1513 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:53.684636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:53.685586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:53.692247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:53.693428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:53.694109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:53.695194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:53.695665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:53.696091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:53.963917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:17:53.965339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:17:53.966387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:17:53.967033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:17:53.967945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:17:53.996581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:54.003223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:54.004505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:54.007966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:54.008647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:54.015474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:54.016756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:54.025410 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20bb3fe0-590b-4b50-9cb7-2db9f8023f80 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1675 microversion: 2.1 time: 0.345048 Nov 03 04:17:54.038201 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2493/5095] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:53 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1675 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:54.072480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:17:54.080447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for user 324a1dfe0c4843bd917eb6ecd6cc2c4c and project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:17:54.103226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:17:54.106157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:17:54.290102 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-faa79d43-b74d-4da9-aa94-0fcd33e0892a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774534 Nov 03 04:17:54.291082 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2603/5096] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:17:54.302016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02b339b6-de9f-4993-95af-24ce8b9db212 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:54.302643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-02b339b6-de9f-4993-95af-24ce8b9db212 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:54.451883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-02b339b6-de9f-4993-95af-24ce8b9db212 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:54.477249 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-02b339b6-de9f-4993-95af-24ce8b9db212 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1208 microversion: 2.1 time: 0.173714 Nov 03 04:17:54.494009 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2494/5097] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:54 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1208 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:54.703068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:54.703798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:54.717535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:54.718177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:54.726575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:54.727342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:54.727826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:54.728258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:55.064945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:55.066244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:55.080907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:55.081442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:55.082103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:55.084662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:55.085872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:55.088598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:55.307296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:55.316457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90668fa5-1b82-44bc-abfd-1272ed940a5e tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1607 microversion: 2.1 time: 0.256558 Nov 03 04:17:55.320158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2495/5098] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:55 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1607 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:55.582199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:55.587331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:55.589713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:55.590218 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-796e2d58-d72c-490e-b706-1b7eb2883709 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1513 microversion: 2.1 time: 0.892344 Nov 03 04:17:55.603926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:55.604435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:55.604892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:55.607521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:55.620972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:55.621412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2604/5099] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:54 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1513 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:55.621772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:55.626799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85895419-3633-4961-90dc-6def2e88d2e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:55.627680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85895419-3633-4961-90dc-6def2e88d2e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:55.782493 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ee8dcec-a8a9-4569-8bec-b4726698b418 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87/action" status: 200 len: 24558 microversion: 2.1 time: 0.459409 Nov 03 04:17:55.785356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85895419-3633-4961-90dc-6def2e88d2e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:55.786635 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2496/5100] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:17:55 2022] POST /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87/action => generated 24558 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:17:55.795408 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85895419-3633-4961-90dc-6def2e88d2e8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1208 microversion: 2.1 time: 0.171957 Nov 03 04:17:55.801727 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2605/5101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:55 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1208 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:55.803561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-572eb065-7fff-4b8c-85f7-49741fd47801 req-9706b26f-6a29-4f91-9280-a452134ed343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18905a6e-8634-481a-9183-7f5c5b15b546", "name": "network-vif-deleted", "tag": "dbbe4757-f83d-49a4-93b9-fbd5421a6f90"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:55.824103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-572eb065-7fff-4b8c-85f7-49741fd47801 req-9706b26f-6a29-4f91-9280-a452134ed343 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:55.826078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-572eb065-7fff-4b8c-85f7-49741fd47801 req-9706b26f-6a29-4f91-9280-a452134ed343 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:55.826921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-572eb065-7fff-4b8c-85f7-49741fd47801 req-9706b26f-6a29-4f91-9280-a452134ed343 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:55.858211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-572eb065-7fff-4b8c-85f7-49741fd47801 req-9706b26f-6a29-4f91-9280-a452134ed343 service nova] Creating event network-vif-deleted:dbbe4757-f83d-49a4-93b9-fbd5421a6f90 for instance 18905a6e-8634-481a-9183-7f5c5b15b546 on n-h1-854653-7 Nov 03 04:17:55.885087 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-572eb065-7fff-4b8c-85f7-49741fd47801 req-9706b26f-6a29-4f91-9280-a452134ed343 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084399 Nov 03 04:17:55.886395 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2497/5102] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:56.342720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:56.346572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:56.372000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:56.375413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:56.375905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:56.376667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:56.377172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:56.377621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:56.501536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:56.502048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:56.502502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:56.502967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lazy-loading 'fault' on Instance uuid 18905a6e-8634-481a-9183-7f5c5b15b546 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:17:56.617934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:56.620290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:56.622265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd374eee04fe4433d862b7bc04a16a563', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5da4e6e327d94557872a462ca9fa96f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:56.637751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:56.638638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:56.639276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:56.640178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:56.641761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:56.642381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:56.655684 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5bd445ee-d5d3-468f-92b2-29727ba78b4c tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 200 len: 1329 microversion: 2.1 time: 0.315302 Nov 03 04:17:56.656346 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2606/5103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:56 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 1329 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:56.840960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:56.844409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:56.863526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:56.874598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:56.876392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:56.878340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:56.879511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:56.881993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:57.027467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:57.053876 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b4fab9d-5542-4843-b24a-592d6e842904 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1471 microversion: 2.1 time: 0.440693 Nov 03 04:17:57.057233 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2498/5104] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:56 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:57.083913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:57.092908 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b38de2e-9ec7-48cd-aaec-5068cb73914b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1260 microversion: 2.1 time: 0.266241 Nov 03 04:17:57.094919 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2607/5105] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:56 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:57.127453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2ecd5d55-dec6-49ba-9d1c-86251f391662 req-dff08f3a-11bf-4a4b-b2db-bbe82a242fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825bef4c-2420-47aa-94be-e2b287f1a09b", "name": "network-vif-unplugged", "status": "completed", "tag": "6052fe58-754d-4e78-aa92-7a20c800504e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:57.152830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ecd5d55-dec6-49ba-9d1c-86251f391662 req-dff08f3a-11bf-4a4b-b2db-bbe82a242fdd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:57.169001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ecd5d55-dec6-49ba-9d1c-86251f391662 req-dff08f3a-11bf-4a4b-b2db-bbe82a242fdd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:57.169870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ecd5d55-dec6-49ba-9d1c-86251f391662 req-dff08f3a-11bf-4a4b-b2db-bbe82a242fdd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:57.196941 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2ecd5d55-dec6-49ba-9d1c-86251f391662 req-dff08f3a-11bf-4a4b-b2db-bbe82a242fdd service nova] Creating event network-vif-unplugged:6052fe58-754d-4e78-aa92-7a20c800504e for instance 825bef4c-2420-47aa-94be-e2b287f1a09b on n-h1-854653-7 Nov 03 04:17:57.208649 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2ecd5d55-dec6-49ba-9d1c-86251f391662 req-dff08f3a-11bf-4a4b-b2db-bbe82a242fdd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084964 Nov 03 04:17:57.212200 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2499/5106] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:57.687132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:57.688493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] [instance: 18905a6e-8634-481a-9183-7f5c5b15b546] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:57.699770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:57.707249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:57.707249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:57.707249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:57.707249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:57.707249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:57.737484 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] HTTP exception thrown: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 could not be found. Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Request method failure captured: Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 HTTP/1.1 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz5obLGYsXMsCiJUNlEVMAwYzv3C-HCNO0Tt8826NWpMmXJyEoO8CMK1fOCClxvGv3qCGmJzQGpCnm7T73M6XrIm_QO6IU_3Lp6iRrGGHKX7HvdUDVmitEpnJxOZuoElZFmmtIKxyH9aC10ikmqZlCQf9r4d9WkFnSoOO4Z-YziLQWM Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5da4e6e327d94557872a462ca9fa96f8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5da4e6e327d94557872a462ca9fa96f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5da4e6e327d94557872a462ca9fa96f8"}]}] Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 5da4e6e327d94557872a462ca9fa96f8 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-1866732329 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d374eee04fe4433d862b7bc04a16a563 Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-1866732329-project Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 could not be found. Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '18905a6e-8634-481a-9183-7f5c5b15b546'} Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 could not be found. Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 could not be found. Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:57.739492 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:57.746883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:57.746883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:57.746883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:57.746883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:57.746883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:57.746883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 could not be found. Nov 03 04:17:57.746883 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:57.750482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Returning 404 to user: Instance 18905a6e-8634-481a-9183-7f5c5b15b546 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:57.767814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1a664459-275c-43c9-8b90-07c8e8db01c3 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546" status: 404 len: 111 microversion: 2.1 time: 0.076462 Nov 03 04:17:57.770095 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2608/5107] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:57 2022] GET /compute/v2.1/servers/18905a6e-8634-481a-9183-7f5c5b15b546 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:17:57.781192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50a9beec-76cf-47e9-a693-ceaad3183391 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] Calling method '.version_select at 0x7ff7f83e2280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:57.883706 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50a9beec-76cf-47e9-a693-ceaad3183391 tempest-ServerActionsTestJSON-1866732329 tempest-ServerActionsTestJSON-1866732329-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570627810" status: 202 len: 0 microversion: 2.1 time: 0.109307 Nov 03 04:17:57.884697 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2500/5108] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:17:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570627810 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:17:57.927598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-79c279e2-4221-4df1-a034-6e9f6ec94c81 req-28a1c65a-ddd0-4f53-84c0-3675127c1cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3bf99a5-209d-4407-866a-53e1d48c4e0c", "name": "network-vif-deleted", "tag": "4c17f42a-26ce-4f01-a48c-a21a4ce340e3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:17:57.962759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-79c279e2-4221-4df1-a034-6e9f6ec94c81 req-28a1c65a-ddd0-4f53-84c0-3675127c1cca service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:57.964456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-79c279e2-4221-4df1-a034-6e9f6ec94c81 req-28a1c65a-ddd0-4f53-84c0-3675127c1cca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:57.965197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-79c279e2-4221-4df1-a034-6e9f6ec94c81 req-28a1c65a-ddd0-4f53-84c0-3675127c1cca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:57.993358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-79c279e2-4221-4df1-a034-6e9f6ec94c81 req-28a1c65a-ddd0-4f53-84c0-3675127c1cca service nova] Creating event network-vif-deleted:4c17f42a-26ce-4f01-a48c-a21a4ce340e3 for instance a3bf99a5-209d-4407-866a-53e1d48c4e0c on n-h2-854653-7 Nov 03 04:17:58.011645 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-79c279e2-4221-4df1-a034-6e9f6ec94c81 req-28a1c65a-ddd0-4f53-84c0-3675127c1cca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088171 Nov 03 04:17:58.012916 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2609/5109] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:17:58.085174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:58.085937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:58.149326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:58.153602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:58.156431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:58.158139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:58.161999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:58.163355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:58.261141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:58.261732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:58.266345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:58.266843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lazy-loading 'fault' on Instance uuid a3bf99a5-209d-4407-866a-53e1d48c4e0c {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:17:58.287957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:58.288671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:58.347374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:58.347950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:58.348407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:58.349187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:58.349658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:58.364837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:58.521802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46a45724be7940dfb595b9db8e828e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b201c36deaa948b7a3f24424163a52d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:58.535631 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ac4971e-2168-4751-bab2-db3a1b493253 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 200 len: 1308 microversion: 2.1 time: 0.459409 Nov 03 04:17:58.538900 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2501/5110] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:58 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 1308 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:17:58.692069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:17:58.743315 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d61aa5db-402d-4a26-a435-b6ccf37bd2f6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1266 microversion: 2.1 time: 0.606152 Nov 03 04:17:58.757234 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2610/5111] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:58 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1266 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:17:59.571238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:59.571888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: a3bf99a5-209d-4407-866a-53e1d48c4e0c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:59.591757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.594951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.595594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.596329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.596787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.598059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.632894 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] HTTP exception thrown: Instance a3bf99a5-209d-4407-866a-53e1d48c4e0c could not be found. Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Request method failure captured: Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c HTTP/1.1 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Att6sKGa0MLQRT5jpYr7bucDRJ9DRwXG6f5imxAzq5RIuM66PxlApTtbFYJO8ENJCvzuYu5gtaeTOXEqHixhoDrxPyX6FkoAOuylRlSVDeEvdms_ht5uoAr0Q-HQ1Pn60KnIEg3akLkPro6tcyzqtSEP9W0tHVlY3vv4uTdcCc1LQ Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b201c36deaa948b7a3f24424163a52d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b201c36deaa948b7a3f24424163a52d2"}]}] Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 46a45724be7940dfb595b9db8e828e41 Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a3bf99a5-209d-4407-866a-53e1d48c4e0c could not be found. Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a3bf99a5-209d-4407-866a-53e1d48c4e0c'} Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3bf99a5-209d-4407-866a-53e1d48c4e0c could not be found. Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3bf99a5-209d-4407-866a-53e1d48c4e0c could not be found. Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.634571 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.640144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.640144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.640144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.640144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:59.640144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:59.640144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3bf99a5-209d-4407-866a-53e1d48c4e0c could not be found. Nov 03 04:17:59.640144 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.643618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Returning 404 to user: Instance a3bf99a5-209d-4407-866a-53e1d48c4e0c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:59.650680 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00232bae-5375-4564-af1a-116318f66252 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c" status: 404 len: 111 microversion: 2.1 time: 0.078569 Nov 03 04:17:59.650680 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2502/5112] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:59 2022] GET /compute/v2.1/servers/a3bf99a5-209d-4407-866a-53e1d48c4e0c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:17:59.653898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:59.654408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:59.660962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.661520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.662225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.662952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.663472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.663937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.681802 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] HTTP exception thrown: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Request method failure captured: Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 HTTP/1.1 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Att6sKGa0MLQRT5jpYr7bucDRJ9DRwXG6f5imxAzq5RIuM66PxlApTtbFYJO8ENJCvzuYu5gtaeTOXEqHixhoDrxPyX6FkoAOuylRlSVDeEvdms_ht5uoAr0Q-HQ1Pn60KnIEg3akLkPro6tcyzqtSEP9W0tHVlY3vv4uTdcCc1LQ Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b201c36deaa948b7a3f24424163a52d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b201c36deaa948b7a3f24424163a52d2"}]}] Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 46a45724be7940dfb595b9db8e828e41 Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '9c3459bc-8d10-4cb7-9f01-daa77c4a59b5'} Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:59.684733 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.691380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.698048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Returning 404 to user: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:59.698048 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce465796-3821-4c27-8d1e-16eacac7eb76 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 404 len: 111 microversion: 2.1 time: 0.047571 Nov 03 04:17:59.698048 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2611/5113] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:59 2022] DELETE /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:17:59.708325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:59.709430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:59.719127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.721032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.721032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.721696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.722389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.723028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.748523 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] HTTP exception thrown: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Request method failure captured: Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 HTTP/1.1 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Att6sKGa0MLQRT5jpYr7bucDRJ9DRwXG6f5imxAzq5RIuM66PxlApTtbFYJO8ENJCvzuYu5gtaeTOXEqHixhoDrxPyX6FkoAOuylRlSVDeEvdms_ht5uoAr0Q-HQ1Pn60KnIEg3akLkPro6tcyzqtSEP9W0tHVlY3vv4uTdcCc1LQ Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b201c36deaa948b7a3f24424163a52d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b201c36deaa948b7a3f24424163a52d2"}]}] Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 46a45724be7940dfb595b9db8e828e41 Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '9c3459bc-8d10-4cb7-9f01-daa77c4a59b5'} Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.752321 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.757570 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.757570 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.757570 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.757570 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:59.757570 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:59.757570 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. Nov 03 04:17:59.757570 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.759787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Returning 404 to user: Instance 9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:59.760843 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-676cee6e-b189-4d28-a493-0d16d103eb9d tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5" status: 404 len: 111 microversion: 2.1 time: 0.059202 Nov 03 04:17:59.762198 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2503/5114] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:59 2022] GET /compute/v2.1/servers/9c3459bc-8d10-4cb7-9f01-daa77c4a59b5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:17:59.772357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:59.773204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:59.789346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:59.790681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:59.809200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.809750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.810199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.810920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.811382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.811812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.814793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.822357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.824690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.825588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.827757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.831492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] HTTP exception thrown: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Request method failure captured: Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 HTTP/1.1 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Att6sKGa0MLQRT5jpYr7bucDRJ9DRwXG6f5imxAzq5RIuM66PxlApTtbFYJO8ENJCvzuYu5gtaeTOXEqHixhoDrxPyX6FkoAOuylRlSVDeEvdms_ht5uoAr0Q-HQ1Pn60KnIEg3akLkPro6tcyzqtSEP9W0tHVlY3vv4uTdcCc1LQ Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b201c36deaa948b7a3f24424163a52d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b201c36deaa948b7a3f24424163a52d2"}]}] Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 46a45724be7940dfb595b9db8e828e41 Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e6870a06-4391-4f7f-9730-ad8fe574d8d8'} Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:17:59.877824 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Returning 404 to user: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b7699bc0-77cd-471c-99df-cbe6c877c4ec tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 404 len: 111 microversion: 2.1 time: 0.111993 Nov 03 04:17:59.884416 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2612/5115] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:17:59 2022] DELETE /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:17:59.893483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:17:59.894133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] [instance: e6870a06-4391-4f7f-9730-ad8fe574d8d8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:17:59.908461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.909418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.910097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.911098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:17:59.912918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:17:59.914802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:17:59.954521 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] HTTP exception thrown: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Request method failure captured: Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 HTTP/1.1 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Att6sKGa0MLQRT5jpYr7bucDRJ9DRwXG6f5imxAzq5RIuM66PxlApTtbFYJO8ENJCvzuYu5gtaeTOXEqHixhoDrxPyX6FkoAOuylRlSVDeEvdms_ht5uoAr0Q-HQ1Pn60KnIEg3akLkPro6tcyzqtSEP9W0tHVlY3vv4uTdcCc1LQ Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b201c36deaa948b7a3f24424163a52d2", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b201c36deaa948b7a3f24424163a52d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b201c36deaa948b7a3f24424163a52d2"}]}] Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: b201c36deaa948b7a3f24424163a52d2 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1779112012 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 46a45724be7940dfb595b9db8e828e41 Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerDiskConfigTestJSON-1779112012-project Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e6870a06-4391-4f7f-9730-ad8fe574d8d8'} Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:17:59.960930 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.965908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:17:59.965908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:17:59.965908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:17:59.965908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:17:59.965908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:17:59.965908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. Nov 03 04:17:59.965908 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:17:59.968052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] Returning 404 to user: Instance e6870a06-4391-4f7f-9730-ad8fe574d8d8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:17:59.973199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5551124-4819-456b-a30e-edafd475e496 tempest-ServerDiskConfigTestJSON-1779112012 tempest-ServerDiskConfigTestJSON-1779112012-project] 10.222.0.30 "GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8" status: 404 len: 111 microversion: 2.1 time: 0.086051 Nov 03 04:17:59.974468 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2613/5116] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:59 2022] GET /compute/v2.1/servers/e6870a06-4391-4f7f-9730-ad8fe574d8d8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:18:00.606528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:00.621835 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee17e808-98c7-4876-a8ce-51b7196c68d1 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1266 microversion: 2.1 time: 0.838961 Nov 03 04:18:00.629867 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2504/5117] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:17:59 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1266 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:01.658559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:01.660115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:01.688029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:01.689881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:01.691898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:01.696854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:01.697912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:01.726257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:01.853912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:01.871469 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-47baa10e-0089-417b-91f3-5e449fbddccd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1266 microversion: 2.1 time: 0.221576 Nov 03 04:18:01.878707 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2614/5118] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:01 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:02.898959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:02.921302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:02.941134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:02.942064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:02.942813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:02.943847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:02.944528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:02.945266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:02.948949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:03.573770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:03.646764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-92ff8156-18ae-4795-b7d1-e23386bca182 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.748418 Nov 03 04:18:03.653365 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2505/5119] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:02 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:04.686890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:04.689584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:04.714444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:04.718759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:04.724834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:04.725560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:04.729752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:04.729752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:04.729752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:05.793302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:05.956533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:05.971624 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78d61dba-7803-4876-93eb-bcbecc2035be tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 1.303261 Nov 03 04:18:05.977953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2615/5120] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:04 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:06.522294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5622fdb4-8aef-44c7-b340-7df02d4e0c1a req-ade0b046-4cdc-4c1b-90e1-a9937e17cf28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16246bfb-f0a5-4605-853d-ddb0a6d26cac", "tag": "67476a9c-e69d-4a18-8305-5a15d9d5ad0a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:06.545441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:06.548768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5622fdb4-8aef-44c7-b340-7df02d4e0c1a req-ade0b046-4cdc-4c1b-90e1-a9937e17cf28 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:06.549554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5622fdb4-8aef-44c7-b340-7df02d4e0c1a req-ade0b046-4cdc-4c1b-90e1-a9937e17cf28 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:06.550183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5622fdb4-8aef-44c7-b340-7df02d4e0c1a req-ade0b046-4cdc-4c1b-90e1-a9937e17cf28 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:06.575857 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5622fdb4-8aef-44c7-b340-7df02d4e0c1a req-ade0b046-4cdc-4c1b-90e1-a9937e17cf28 service nova] Creating event network-changed:67476a9c-e69d-4a18-8305-5a15d9d5ad0a for instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac on n-h2-854653-7 Nov 03 04:18:06.587898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5622fdb4-8aef-44c7-b340-7df02d4e0c1a req-ade0b046-4cdc-4c1b-90e1-a9937e17cf28 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068106 Nov 03 04:18:06.590163 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2506/5121] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:07.006836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:07.008178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:07.011221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:07.036555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:07.037083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:07.037611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:07.038349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:07.038821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:07.039258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:08.015976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:08.041432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c65f1bc-cff2-4a97-acf5-ace9d5c55293 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 1.038357 Nov 03 04:18:08.042040 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2616/5122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:07 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:09.069112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:09.069822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:09.113722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:09.114775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:09.117267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:09.119655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:09.127871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:09.133927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:10.306791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:10.326936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b5090be-81d7-4703-aeb0-bbed099d8717 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 1.261928 Nov 03 04:18:10.349630 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2507/5123] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:09 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:11.365735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:11.367055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:11.384858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:11.395594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:11.397936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:11.399831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:11.405686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:11.406418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:11.872791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:11.888205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee2aeb00-ba92-4150-8d84-ee574a32190d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.524147 Nov 03 04:18:11.890400 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2617/5124] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:11 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:12.925720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:12.926352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:12.961543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:12.964798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:12.969793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:12.970582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:12.989938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:12.990679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:13.498321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:13.519677 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ce2fc3c-651e-4b30-9a7e-f01e2be4f475 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.611244 Nov 03 04:18:13.522568 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2508/5125] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:12 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:14.552707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:14.554008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:14.562216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:14.562909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:14.563557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:14.564609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:14.565366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:14.565987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:14.799995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:14.811605 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cb9019d-d579-45e6-bb28-a6cbdede0a43 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.264069 Nov 03 04:18:14.813725 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2618/5126] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:14 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:15.837034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:15.837636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:15.847706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:15.848212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:15.848650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:15.862230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:15.862999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:15.863672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:16.732035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:16.746707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0286499c-ec93-4764-ae08-1dca82d1373d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.912789 Nov 03 04:18:16.748165 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2509/5127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:15 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:17.772771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:17.773423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:17.780440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:17.780930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:17.781412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:17.782113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:17.782576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:17.783013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:18.246394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:18.260579 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c94040c-2558-474f-8ca7-c30bb5c82c58 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.486379 Nov 03 04:18:18.261386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2619/5128] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:17 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:19.292777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:19.293439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:19.312089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:19.323129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:19.323129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:19.323129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:19.324142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:19.324729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:19.325236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:19.955235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:19.970379 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84a4de7d-befb-497f-b8a4-48f59cb45b33 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.687598 Nov 03 04:18:19.971834 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2510/5129] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:19 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:20.818891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3de30d3c-7911-45c1-bc80-0f31ebed7385 req-5fc413d5-ef35-4bbf-8c69-6a51777bc61c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16246bfb-f0a5-4605-853d-ddb0a6d26cac", "name": "network-vif-plugged", "status": "completed", "tag": "67476a9c-e69d-4a18-8305-5a15d9d5ad0a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:20.837595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3de30d3c-7911-45c1-bc80-0f31ebed7385 req-5fc413d5-ef35-4bbf-8c69-6a51777bc61c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:20.837595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3de30d3c-7911-45c1-bc80-0f31ebed7385 req-5fc413d5-ef35-4bbf-8c69-6a51777bc61c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:20.837595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3de30d3c-7911-45c1-bc80-0f31ebed7385 req-5fc413d5-ef35-4bbf-8c69-6a51777bc61c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:20.866283 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3de30d3c-7911-45c1-bc80-0f31ebed7385 req-5fc413d5-ef35-4bbf-8c69-6a51777bc61c service nova] Creating event network-vif-plugged:67476a9c-e69d-4a18-8305-5a15d9d5ad0a for instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac on n-h2-854653-7 Nov 03 04:18:20.869975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3de30d3c-7911-45c1-bc80-0f31ebed7385 req-5fc413d5-ef35-4bbf-8c69-6a51777bc61c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055205 Nov 03 04:18:20.874014 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2620/5130] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:20.996330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:20.997879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:21.011590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:21.012983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:21.016212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:21.019729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:21.021883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:21.022617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:21.400870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:21.414473 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1470aec0-f59c-4d0d-94d9-861be5bd9f2d tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.420326 Nov 03 04:18:21.429038 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2511/5131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:20 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:22.439525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:22.440235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:22.456655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:22.457456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:22.457890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:22.462023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:22.462686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:22.463177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:22.481706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:22.789381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:22.803592 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e67063fd-5f07-4ad0-8a8b-26851288d4e9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1308 microversion: 2.1 time: 0.369672 Nov 03 04:18:22.820947 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2621/5132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:22 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1308 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:23.241392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9270869-db1a-41e6-a1dc-2cd96191777f tempest-ComputeTenantNetworksTest-1585659750 tempest-ComputeTenantNetworksTest-1585659750-project] Calling method '.version_select at 0x7ff7f89400d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:23.640880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9270869-db1a-41e6-a1dc-2cd96191777f tempest-ComputeTenantNetworksTest-1585659750 tempest-ComputeTenantNetworksTest-1585659750-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.603308 Nov 03 04:18:23.641206 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2512/5133] 10.222.0.30 () {58 vars in 1158 bytes} [Thu Nov 3 04:18:23 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:23.651815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1b8ff80-f54a-4f7b-b152-5124f176205f tempest-ComputeTenantNetworksTest-1585659750 tempest-ComputeTenantNetworksTest-1585659750-project] Calling method '.version_select at 0x7ff7f88edee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:23.828725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:23.829903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:23.841440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:23.842119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:23.845672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:23.849819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:23.850461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:23.851727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:23.871087 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1b8ff80-f54a-4f7b-b152-5124f176205f tempest-ComputeTenantNetworksTest-1585659750 tempest-ComputeTenantNetworksTest-1585659750-project] 10.222.0.30 "GET /compute/v2.1/os-tenant-networks/d9b79ccb-7739-4ee3-a86c-1d20fd6e35b5" status: 200 len: 140 microversion: 2.1 time: 0.223157 Nov 03 04:18:23.872139 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2622/5134] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:18:23 2022] GET /compute/v2.1/os-tenant-networks/d9b79ccb-7739-4ee3-a86c-1d20fd6e35b5 => generated 140 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:24.063866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:24.071698 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b79f5f77-cf70-442a-84f4-68454255d816 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1489 microversion: 2.1 time: 0.247696 Nov 03 04:18:24.072356 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2513/5135] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:23 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1489 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:24.099071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:24.099863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:24.113871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:24.113871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:24.113871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:24.113871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:24.113871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:24.113871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:24.148533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:18:24.511397 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4a59c74c-a747-4904-9703-532d7f6378d6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 204 len: 0 microversion: 2.1 time: 0.413915 Nov 03 04:18:24.512671 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2623/5136] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:18:24 2022] DELETE /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:18:24.522089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:24.524128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:24.533554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:24.534369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:24.535147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:24.543947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:24.543947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:24.543947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:24.874821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:24.898678 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b9d8814-1b4e-4e48-8aed-6499651a2880 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1495 microversion: 2.1 time: 0.381187 Nov 03 04:18:24.900638 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2514/5137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:24 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1495 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:25.862693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1235057179", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "5d50edac-cb5f-4e87-84d0-ccf478566c5a"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:25.924633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:25.926480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:25.959412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:25.966158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:25.966615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:25.969465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:25.970062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:25.970674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:26.051231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] validate_networks() for [('5d50edac-cb5f-4e87-84d0-ccf478566c5a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:18:26.693684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:26.710011 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d157d685-c294-486e-b509-70f9fabc5560 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1495 microversion: 2.1 time: 0.790008 Nov 03 04:18:26.711162 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2515/5138] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:25 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1495 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:27.262474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:18:27.268289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:18:27.268289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:18:27.268289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:18:27.268289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:18:27.289075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:27.291825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:27.292562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:27.296474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:27.298572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:27.303473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:27.341404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Getting quotas for project 32d3a04c36254e558e1df54a3d85d94c. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:18:27.361001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Getting quotas for user 423a17f2f7184a1f99252bb7242393e9 and project 32d3a04c36254e558e1df54a3d85d94c. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:18:27.411134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:18:27.428366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:18:27.610090 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0abed883-2d8a-400e-94ef-b45b5c282937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.344791 Nov 03 04:18:27.628194 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2624/5139] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:18:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:18:27.736875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:27.737754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:27.755440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:27.755972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:27.756433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:27.757193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:27.757666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:27.758085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:27.972530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:27.984948 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b722c7c1-b0de-4eda-a59d-be8a5a0ca38b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1453 microversion: 2.1 time: 0.253829 Nov 03 04:18:27.992706 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2516/5140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:27 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:28.060263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-fae31765-03c8-44cc-beb8-ee946e092dd4 req-a0317735-967a-42ad-9114-7bd44bdb3a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16246bfb-f0a5-4605-853d-ddb0a6d26cac", "name": "network-vif-deleted", "tag": "67476a9c-e69d-4a18-8305-5a15d9d5ad0a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:28.078665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fae31765-03c8-44cc-beb8-ee946e092dd4 req-a0317735-967a-42ad-9114-7bd44bdb3a7f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:28.087599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fae31765-03c8-44cc-beb8-ee946e092dd4 req-a0317735-967a-42ad-9114-7bd44bdb3a7f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:28.088209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-fae31765-03c8-44cc-beb8-ee946e092dd4 req-a0317735-967a-42ad-9114-7bd44bdb3a7f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:28.118230 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-fae31765-03c8-44cc-beb8-ee946e092dd4 req-a0317735-967a-42ad-9114-7bd44bdb3a7f service nova] Creating event network-vif-deleted:67476a9c-e69d-4a18-8305-5a15d9d5ad0a for instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac on n-h2-854653-7 Nov 03 04:18:28.161939 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-fae31765-03c8-44cc-beb8-ee946e092dd4 req-a0317735-967a-42ad-9114-7bd44bdb3a7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105046 Nov 03 04:18:28.168633 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2625/5141] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:28.194343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1744868110", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "5d50edac-cb5f-4e87-84d0-ccf478566c5a"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:28.296255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] validate_networks() for [('5d50edac-cb5f-4e87-84d0-ccf478566c5a', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:18:29.017621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:29.019070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:29.042983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:29.043548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:29.045915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:29.045915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:29.045915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:29.045915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:29.151469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:29.153571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:29.154634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:29.156563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lazy-loading 'fault' on Instance uuid 16246bfb-f0a5-4605-853d-ddb0a6d26cac {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:18:29.326592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:29.338720 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f311fa3a-30d3-47c2-acb4-52df5adf3128 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 200 len: 1298 microversion: 2.1 time: 0.325725 Nov 03 04:18:29.354298 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2626/5142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:29 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 1298 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:29.530026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:18:29.530684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:18:29.531171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:18:29.531690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:18:29.532003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:18:29.543216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:29.543721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:29.544295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:29.545073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:29.546201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:29.546706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:29.580357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Getting quotas for project 32d3a04c36254e558e1df54a3d85d94c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:18:29.586748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Getting quotas for user 423a17f2f7184a1f99252bb7242393e9 and project 32d3a04c36254e558e1df54a3d85d94c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:18:29.602296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:18:29.604969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:18:29.775313 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de7addc0-c0e7-4d12-a632-16ef486c8cd7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.585680 Nov 03 04:18:29.776004 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2517/5143] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:18:29.986046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-546154525", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "451", "networks": [{"uuid": "5d50edac-cb5f-4e87-84d0-ccf478566c5a"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:30.115376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] validate_networks() for [('5d50edac-cb5f-4e87-84d0-ccf478566c5a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:18:30.370232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:30.372817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:30.387317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:30.390705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:30.391600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:30.392544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:30.392954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:30.393423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:30.478484 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac HTTP/1.1 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '16246bfb-f0a5-4605-853d-ddb0a6d26cac'} Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:30.480906 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:18:30.485237 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:18:30.485237 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:18:30.485237 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:18:30.485237 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:18:30.485237 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:18:30.485237 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:30.485237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:18:30.487698 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b402592-b797-4633-a9ed-0d4cb6ed9633 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 404 len: 111 microversion: 2.1 time: 0.124201 Nov 03 04:18:30.493514 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2518/5144] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:30 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:18:30.507169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2579a44a-0605-4d4d-9a0e-665fb302ac4a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd67a940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:31.573477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:18:31.574018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:18:31.574506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:18:31.575039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:18:31.575359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:18:31.589885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:31.594402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:31.597317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:31.598322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:31.598947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:31.599529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:31.620363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Getting quotas for project 32d3a04c36254e558e1df54a3d85d94c. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:18:31.627206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Getting quotas for user 423a17f2f7184a1f99252bb7242393e9 and project 32d3a04c36254e558e1df54a3d85d94c. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:18:31.643047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:18:31.646125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:18:31.877916 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-11824bb7-041f-476d-ae8f-8a7ad176fd32 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.896475 Nov 03 04:18:31.887013 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2627/5145] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:18:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:18:31.895246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18c03d31-056e-4060-bd8d-b49a728e3755 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:31.895878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18c03d31-056e-4060-bd8d-b49a728e3755 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:32.221631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18c03d31-056e-4060-bd8d-b49a728e3755 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:32.232029 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18c03d31-056e-4060-bd8d-b49a728e3755 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1220 microversion: 2.1 time: 0.341740 Nov 03 04:18:32.253173 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2628/5146] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:31 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1220 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:33.116545 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2579a44a-0605-4d4d-9a0e-665fb302ac4a tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 204 len: 0 microversion: 2.1 time: 2.621001 Nov 03 04:18:33.117164 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2519/5147] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:30 2022] DELETE /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 0 bytes in 2623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:18:33.126580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:33.127848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:33.152870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:33.152870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:33.152870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:33.152870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:33.152870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:33.153522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:33.207829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:18:33.271071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-153d4c5f-610d-4970-862a-cc612c9fabc0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:33.271849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-153d4c5f-610d-4970-862a-cc612c9fabc0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:33.410970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-153d4c5f-610d-4970-862a-cc612c9fabc0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:33.418514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-153d4c5f-610d-4970-862a-cc612c9fabc0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1220 microversion: 2.1 time: 0.151478 Nov 03 04:18:33.425349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2520/5148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:33 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:33.736906 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-818c7b14-495b-4b16-ac4c-7e1ae4639095 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 204 len: 0 microversion: 2.1 time: 0.614935 Nov 03 04:18:33.738218 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2629/5149] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:18:33 2022] DELETE /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:18:34.071858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-754860321", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "67e5b85f-4010-4f46-ba0a-653e66da87d8"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:34.239464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] validate_networks() for [('67e5b85f-4010-4f46-ba0a-653e66da87d8', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:18:34.451815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:34.458248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:34.465886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:34.466948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:34.467615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:34.468600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:34.469413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:34.470091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:34.895393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:34.909587 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35061954-980d-48e5-aedd-845ccbece3b6 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1272 microversion: 2.1 time: 0.468837 Nov 03 04:18:34.914062 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2630/5150] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:34 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1272 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:35.117323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:35.123053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:35.143325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:35.144219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:35.144820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:35.147857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:35.150771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:35.151697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:35.231175 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4701eca2-c032-4b6b-a0f7-1d81c0168e48 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "POST /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87/action" status: 200 len: 32631 microversion: 2.1 time: 0.118678 Nov 03 04:18:35.235264 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2631/5151] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:18:35 2022] POST /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87/action => generated 32631 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:18:35.944641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:35.945572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:35.963401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:35.964977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:35.966462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:35.968820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:35.970242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:35.972777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:36.521474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:36.536280 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ca4717c3-d632-403b-82c4-c81e2fe8adaf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1278 microversion: 2.1 time: 0.596426 Nov 03 04:18:36.554569 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2632/5152] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:35 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1278 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:18:36.709675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:18:36.711283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:18:36.711955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:18:36.712726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:18:36.713532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:18:36.730696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:36.733081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:36.734143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:36.735184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:36.735800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:36.736994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:36.750424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=66 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:36.785260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:18:36.803159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Getting quotas for user 324a1dfe0c4843bd917eb6ecd6cc2c4c and project 3f70bc24fd3747e7b5bb787ac956de69. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:18:36.837212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:18:36.839416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:18:37.133971 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c50a0c4c-aa39-468f-b7fc-e7b3b235cbd2 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.066135 Nov 03 04:18:37.141228 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2521/5153] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:18:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:18:37.152563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6bc796c5-2234-4f32-9c2e-7522d6221cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:37.153907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6bc796c5-2234-4f32-9c2e-7522d6221cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:37.565753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:37.570560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:37.604558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:37.608294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:37.616938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:37.625056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:37.630565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:37.631671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:38.792890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6bc796c5-2234-4f32-9c2e-7522d6221cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:38.802332 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6bc796c5-2234-4f32-9c2e-7522d6221cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1207 microversion: 2.1 time: 1.652870 Nov 03 04:18:38.807779 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2633/5154] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:37 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1207 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:39.006387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:39.016816 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-78f7117f-95ac-4981-a65c-0494314c4882 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1320 microversion: 2.1 time: 1.455510 Nov 03 04:18:39.018067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2522/5155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:37 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1320 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:39.166674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5c99f2ca-360e-4e4c-9454-df740c947e5c req-5598811f-f982-48e2-b504-4ae80a1d8f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825bef4c-2420-47aa-94be-e2b287f1a09b", "name": "network-vif-deleted", "tag": "6052fe58-754d-4e78-aa92-7a20c800504e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:39.203340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:39.209797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5c99f2ca-360e-4e4c-9454-df740c947e5c req-5598811f-f982-48e2-b504-4ae80a1d8f6f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:39.210334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5c99f2ca-360e-4e4c-9454-df740c947e5c req-5598811f-f982-48e2-b504-4ae80a1d8f6f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:39.210916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5c99f2ca-360e-4e4c-9454-df740c947e5c req-5598811f-f982-48e2-b504-4ae80a1d8f6f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:39.244822 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5c99f2ca-360e-4e4c-9454-df740c947e5c req-5598811f-f982-48e2-b504-4ae80a1d8f6f service nova] Creating event network-vif-deleted:6052fe58-754d-4e78-aa92-7a20c800504e for instance 825bef4c-2420-47aa-94be-e2b287f1a09b on n-h1-854653-7 Nov 03 04:18:39.278436 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5c99f2ca-360e-4e4c-9454-df740c947e5c req-5598811f-f982-48e2-b504-4ae80a1d8f6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108800 Nov 03 04:18:39.287909 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2634/5156] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:39.833416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:39.834060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:39.845260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:39.849061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:39.854291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:39.854291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:39.854935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:39.855686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:40.049340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:40.051731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:40.059386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:40.060904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:40.061765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:40.062740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:40.063360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:40.063949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:40.199832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:40.213287 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c58c52fc-dfec-4e67-a329-2d113caca5cd tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1259 microversion: 2.1 time: 0.380114 Nov 03 04:18:40.213956 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2523/5157] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:39 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1259 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:40.921608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:40.939776 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e75099d-feae-454e-b756-141c82d3375a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1320 microversion: 2.1 time: 0.895387 Nov 03 04:18:40.942160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2635/5158] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:40 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1320 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:41.238131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:41.238819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:41.260745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:41.261355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:41.261824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:41.266233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:41.266739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:41.267189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:41.535067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:41.546304 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b1a29c5-decd-4d00-a7d9-b3056e67cf12 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1277 microversion: 2.1 time: 0.312655 Nov 03 04:18:41.556031 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2524/5159] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:41 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:41.963068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:41.968900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:41.969783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:42.004995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:42.009940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:42.012141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:42.013868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:42.016493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:42.032985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:42.431551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-82d19386-5952-4477-b9c2-4895eb1d98db req-54a4ee71-0396-4281-adb8-66a519615249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd", "tag": "2d68eb90-a44d-465e-8c08-14857c6e1db1"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:42.463930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-82d19386-5952-4477-b9c2-4895eb1d98db req-54a4ee71-0396-4281-adb8-66a519615249 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:42.464446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-82d19386-5952-4477-b9c2-4895eb1d98db req-54a4ee71-0396-4281-adb8-66a519615249 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:42.464881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-82d19386-5952-4477-b9c2-4895eb1d98db req-54a4ee71-0396-4281-adb8-66a519615249 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:42.494137 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-82d19386-5952-4477-b9c2-4895eb1d98db req-54a4ee71-0396-4281-adb8-66a519615249 service nova] Creating event network-changed:2d68eb90-a44d-465e-8c08-14857c6e1db1 for instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd on n-h2-854653-7 Nov 03 04:18:42.518090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-82d19386-5952-4477-b9c2-4895eb1d98db req-54a4ee71-0396-4281-adb8-66a519615249 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090386 Nov 03 04:18:42.520989 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2525/5160] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:18:42.580342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:42.581084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:42.598984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:42.599504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:42.599960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:42.600692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:42.601354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:42.601799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:42.942949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:42.954730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f4da88a-2074-43ca-9313-f76483f2ff97 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1265 microversion: 2.1 time: 0.376567 Nov 03 04:18:42.955512 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2526/5161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:42 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:18:42.999772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:43.010214 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15dd3bce-5018-4c95-aa1f-9cf85276bd88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1320 microversion: 2.1 time: 1.049453 Nov 03 04:18:43.020237 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2636/5162] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:41 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1320 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:43.983386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:43.984443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:43.999479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:43.999994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:44.000443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:44.003942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:44.006563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:44.009416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:44.035355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:44.035975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:44.050633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:44.051175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:44.051630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:44.052383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:44.052843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:44.053300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:44.408392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:44.423764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f90d153-f297-42de-8941-98a65277c662 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1265 microversion: 2.1 time: 0.444734 Nov 03 04:18:44.424821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2527/5163] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:43 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1265 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:44.434176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:44.435518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:44.455280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:44.460489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:44.461246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:44.462456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:44.463134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:44.464519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:44.545282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:18:44.980239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0f4928bb-54b8-4efa-ba0e-d6c586cfdbd2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 204 len: 0 microversion: 2.1 time: 0.553864 Nov 03 04:18:44.983334 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2528/5164] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:18:44 2022] DELETE /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:18:44.989483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-aac62d25-9795-42db-849c-74558773e03e req-d7cb9c46-2f7b-4b9d-85c2-d942ca04772f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c01ebb-5afe-4dc4-8868-5e840ec89e87", "tag": "f7de82db-abba-46b0-915c-03c631032f57"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:45.002575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aac62d25-9795-42db-849c-74558773e03e req-d7cb9c46-2f7b-4b9d-85c2-d942ca04772f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:45.003403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aac62d25-9795-42db-849c-74558773e03e req-d7cb9c46-2f7b-4b9d-85c2-d942ca04772f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:45.004236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-aac62d25-9795-42db-849c-74558773e03e req-d7cb9c46-2f7b-4b9d-85c2-d942ca04772f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:45.020898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-aac62d25-9795-42db-849c-74558773e03e req-d7cb9c46-2f7b-4b9d-85c2-d942ca04772f service nova] Creating event network-changed:f7de82db-abba-46b0-915c-03c631032f57 for instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 on n-h1-854653-7 Nov 03 04:18:45.029135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-aac62d25-9795-42db-849c-74558773e03e req-d7cb9c46-2f7b-4b9d-85c2-d942ca04772f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043010 Nov 03 04:18:45.031327 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2529/5165] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:45.043766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:45.048922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:45.061390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:45.063707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:45.065574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:45.069582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:45.070915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:45.072366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:45.100598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:45.115242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-497e9a37-6a83-44dd-bcc0-20a518d0418a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1320 microversion: 2.1 time: 1.084924 Nov 03 04:18:45.182279 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2637/5166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:44 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1320 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:18:45.984720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b36519bf-5500-4d8d-a400-a63e73b7923e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'create', calling method: .version_select at 0x7ff7f90fb550>, body: {"keypair": {"name": "tempest-keypair-1869445121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdzsValTO4wZ4AvoRNPEJO7swlTsXqsZ4LYXTGodjShjs1iaxNneOe3FeFvcnqikoHm1mWhZEduTn5F2xuOHca6l2ZjHrtbePwqPWlRuqHNm5bx5B6M373Wwcmd2bCU/g=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:46.040817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b36519bf-5500-4d8d-a400-a63e73b7923e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:18:46.076896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b36519bf-5500-4d8d-a400-a63e73b7923e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for user 0e6a65ca09f54e1eb3e3ee5cc9c7e64f and project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:18:46.210792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:46.224235 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d69e8874-7767-45a9-9b2c-11bdde69ea85 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1667 microversion: 2.1 time: 1.191168 Nov 03 04:18:46.241064 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2530/5167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:45 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1667 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:46.242384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:46.250438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:46.251791 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b36519bf-5500-4d8d-a400-a63e73b7923e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.022995 Nov 03 04:18:46.258630 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2638/5168] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 04:18:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1026 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 04:18:46.281041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:46.282623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:46.286283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:46.286683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:46.287695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:46.288367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:46.289359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:46.291637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:46.315958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:46.316732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:46.317405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:46.328462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:46.334001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:46.334315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:46.750288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:46.829142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:48.022806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:48.035489 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72044032-546f-4eca-8df4-99b6949c33e7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1320 microversion: 2.1 time: 1.781978 Nov 03 04:18:48.037060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2639/5169] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:46 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1320 bytes in 1784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:48.042433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-abf841b6-d5c9-4334-83fd-1737de203b58 req-d0ee9558-2256-45c2-b22b-3761d05d9f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b5cf5c-4513-4774-9e62-4e3b325f943f", "tag": "2f991e9f-8437-42f3-ae00-76e68d352cb5"}, {"name": "network-changed", "server_uuid": "6cce72e8-a2c8-4be3-80d6-a91c3801eb88", "tag": "cb738359-24c1-4c1d-b81b-74f0ad39a0e9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:48.057546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:48.076832 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1724893-ffe3-41e3-9169-b1e3492f2855 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 1.847895 Nov 03 04:18:48.078153 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2531/5170] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:46 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:48.088664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:48.092012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:48.109295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:48.110040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:48.110623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:48.111983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-abf841b6-d5c9-4334-83fd-1737de203b58 req-d0ee9558-2256-45c2-b22b-3761d05d9f6a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:48.112913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:48.113456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-abf841b6-d5c9-4334-83fd-1737de203b58 req-d0ee9558-2256-45c2-b22b-3761d05d9f6a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:48.114888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:48.115427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-abf841b6-d5c9-4334-83fd-1737de203b58 req-d0ee9558-2256-45c2-b22b-3761d05d9f6a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:48.117878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:48.173146 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-abf841b6-d5c9-4334-83fd-1737de203b58 req-d0ee9558-2256-45c2-b22b-3761d05d9f6a service nova] Creating event network-changed:2f991e9f-8437-42f3-ae00-76e68d352cb5 for instance 48b5cf5c-4513-4774-9e62-4e3b325f943f on n-h1-854653-7 Nov 03 04:18:48.173146 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-abf841b6-d5c9-4334-83fd-1737de203b58 req-d0ee9558-2256-45c2-b22b-3761d05d9f6a service nova] Creating event network-changed:cb738359-24c1-4c1d-b81b-74f0ad39a0e9 for instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 on n-h2-854653-7 Nov 03 04:18:48.191223 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-abf841b6-d5c9-4334-83fd-1737de203b58 req-d0ee9558-2256-45c2-b22b-3761d05d9f6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.149059 Nov 03 04:18:48.196213 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2640/5171] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:48.987908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0f8083cd-8fb4-4512-8728-9e1058f2e001 req-2334412a-a9f4-4ef1-9bbe-e4a8d35947ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd", "name": "network-vif-plugged", "status": "completed", "tag": "2d68eb90-a44d-465e-8c08-14857c6e1db1"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:49.027553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f8083cd-8fb4-4512-8728-9e1058f2e001 req-2334412a-a9f4-4ef1-9bbe-e4a8d35947ca service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:49.029644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f8083cd-8fb4-4512-8728-9e1058f2e001 req-2334412a-a9f4-4ef1-9bbe-e4a8d35947ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:49.030520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f8083cd-8fb4-4512-8728-9e1058f2e001 req-2334412a-a9f4-4ef1-9bbe-e4a8d35947ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:49.066129 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0f8083cd-8fb4-4512-8728-9e1058f2e001 req-2334412a-a9f4-4ef1-9bbe-e4a8d35947ca service nova] Creating event network-vif-plugged:2d68eb90-a44d-465e-8c08-14857c6e1db1 for instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd on n-h2-854653-7 Nov 03 04:18:49.078105 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0f8083cd-8fb4-4512-8728-9e1058f2e001 req-2334412a-a9f4-4ef1-9bbe-e4a8d35947ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096598 Nov 03 04:18:49.095506 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2641/5172] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:18:49.114662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:49.116803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:49.164407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:49.167846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:49.168312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:49.169128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:49.177775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:49.178529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:49.220001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:50.996015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:51.008236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ed4cf9a-d327-4306-b202-f82a52a9b4a2 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1667 microversion: 2.1 time: 2.928685 Nov 03 04:18:51.012361 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2532/5173] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:48 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1667 bytes in 2933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:51.021493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:51.025798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:51.030065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:51.031907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:51.033164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:51.034108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:51.035077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:51.035752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:51.036628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:51.224700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:51.239317 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f10f360-f2f5-43f8-baa5-07064d1a680f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1320 microversion: 2.1 time: 2.142109 Nov 03 04:18:51.245765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2642/5174] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:49 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1320 bytes in 2149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:51.260870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-859f8c13-23fc-4c5a-82af-099ea0f32a86 req-b9826694-185b-48cc-b31f-9a100fe189a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c01ebb-5afe-4dc4-8868-5e840ec89e87", "name": "network-vif-unplugged", "status": "completed", "tag": "f7de82db-abba-46b0-915c-03c631032f57"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:51.299216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-859f8c13-23fc-4c5a-82af-099ea0f32a86 req-b9826694-185b-48cc-b31f-9a100fe189a8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:51.300021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-859f8c13-23fc-4c5a-82af-099ea0f32a86 req-b9826694-185b-48cc-b31f-9a100fe189a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:51.302818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-859f8c13-23fc-4c5a-82af-099ea0f32a86 req-b9826694-185b-48cc-b31f-9a100fe189a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:51.346863 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-859f8c13-23fc-4c5a-82af-099ea0f32a86 req-b9826694-185b-48cc-b31f-9a100fe189a8 service nova] Creating event network-vif-unplugged:f7de82db-abba-46b0-915c-03c631032f57 for instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 on n-h1-854653-7 Nov 03 04:18:51.359955 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-859f8c13-23fc-4c5a-82af-099ea0f32a86 req-b9826694-185b-48cc-b31f-9a100fe189a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112636 Nov 03 04:18:51.363934 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2643/5175] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:51.935678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:51.951938 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43fd0658-4833-4f87-a0a9-037101a36df9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.937639 Nov 03 04:18:51.952544 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2533/5176] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:51 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:51.987508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1705431368", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "311009ff-5554-431b-969f-71038bba448a"}], "security_groups": [{"name": "tempest-securitygroup--1691675760"}], "key_name": "tempest-keypair-1869445121", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:52.041669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:52.042311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:52.059394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:52.059930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:52.060381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:52.064088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:52.065155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:52.068716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:52.411799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3c6e4b088224f33aa607e2a27ed798b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85363c2a53b549da92c7e3f9b09294bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:52.424459 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83f48315-ed41-4205-b05f-32e22f4aaa1d tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 200 len: 1602 microversion: 2.1 time: 0.387676 Nov 03 04:18:52.427101 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2534/5177] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:52 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 1602 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:18:52.431752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:52.432867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:52.441851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:52.442518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:52.443188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:52.444225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:52.445206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:52.445789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:52.707288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] validate_networks() for [('311009ff-5554-431b-969f-71038bba448a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:18:53.365971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:53.398196 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d084c40b-d3fc-4d06-8ad8-05526d1713a9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1512 microversion: 2.1 time: 0.968537 Nov 03 04:18:53.402043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2535/5178] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:52 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1512 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:53.411117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-97c8b53b-a966-43ec-a641-54232ed17037 req-1e637de0-628b-4a8d-87d2-1cbcf3a4b81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c01ebb-5afe-4dc4-8868-5e840ec89e87", "name": "network-vif-deleted", "tag": "f7de82db-abba-46b0-915c-03c631032f57"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:53.437448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97c8b53b-a966-43ec-a641-54232ed17037 req-1e637de0-628b-4a8d-87d2-1cbcf3a4b81c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:53.440344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97c8b53b-a966-43ec-a641-54232ed17037 req-1e637de0-628b-4a8d-87d2-1cbcf3a4b81c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:53.440922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-97c8b53b-a966-43ec-a641-54232ed17037 req-1e637de0-628b-4a8d-87d2-1cbcf3a4b81c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:53.475083 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-97c8b53b-a966-43ec-a641-54232ed17037 req-1e637de0-628b-4a8d-87d2-1cbcf3a4b81c service nova] Creating event network-vif-deleted:f7de82db-abba-46b0-915c-03c631032f57 for instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 on n-h1-854653-7 Nov 03 04:18:53.488821 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-97c8b53b-a966-43ec-a641-54232ed17037 req-1e637de0-628b-4a8d-87d2-1cbcf3a4b81c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088523 Nov 03 04:18:53.490571 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2536/5179] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:53.498744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:53.499825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:53.511394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:53.512205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:53.513419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:53.514474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:53.515438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:53.516926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:54.245065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:54.254536 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-77a686a9-a89a-4f7d-98f9-44fd0bd4212f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.762225 Nov 03 04:18:54.255123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2537/5180] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:53 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:54.275402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-03431158-24dd-44cf-9ae2-98d3aae94789 req-380a1dd6-6a34-4ec5-b3ad-a321926c245c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cce72e8-a2c8-4be3-80d6-a91c3801eb88", "name": "network-vif-plugged", "status": "completed", "tag": "cb738359-24c1-4c1d-b81b-74f0ad39a0e9"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:54.295665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-03431158-24dd-44cf-9ae2-98d3aae94789 req-380a1dd6-6a34-4ec5-b3ad-a321926c245c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:54.296147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-03431158-24dd-44cf-9ae2-98d3aae94789 req-380a1dd6-6a34-4ec5-b3ad-a321926c245c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:54.296580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-03431158-24dd-44cf-9ae2-98d3aae94789 req-380a1dd6-6a34-4ec5-b3ad-a321926c245c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:54.310085 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-03431158-24dd-44cf-9ae2-98d3aae94789 req-380a1dd6-6a34-4ec5-b3ad-a321926c245c service nova] Creating event network-vif-plugged:cb738359-24c1-4c1d-b81b-74f0ad39a0e9 for instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 on n-h2-854653-7 Nov 03 04:18:54.316949 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-03431158-24dd-44cf-9ae2-98d3aae94789 req-380a1dd6-6a34-4ec5-b3ad-a321926c245c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045184 Nov 03 04:18:54.317597 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2538/5181] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:54.331754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:54.334471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:54.349408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:54.351995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:54.352703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:54.353425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:54.358130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:54.358666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:54.432572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:55.318807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:18:55.319249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:18:55.319715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:18:55.320693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:18:55.321186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:18:55.342906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=21 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:18:55.344520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:55.345044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:55.345493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:55.346238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:55.346697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:55.356274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:55.412136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:18:55.418614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for user 0e6a65ca09f54e1eb3e3ee5cc9c7e64f and project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:18:55.439683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:55.447851 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f79da0a-f967-4c16-bc07-28ff7912f7a5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1321 microversion: 2.1 time: 1.125639 Nov 03 04:18:55.457768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2539/5182] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:54 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1321 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:55.467308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:55.467951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] [instance: f2c01ebb-5afe-4dc4-8868-5e840ec89e87] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:55.471608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:18:55.499923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:18:55.502128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:55.510057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:55.510695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:55.511454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:55.511922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:55.512354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:55.559532 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] HTTP exception thrown: Instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 could not be found. Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Request method failure captured: Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 HTTP/1.1 Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz-4IAnl34rYSGAvJa3J4yoQ-n2hDnCMkkjhXn9Ras4udVoEU5J6m7fIgorWFF9gYuH9ADZRItivaL2F5b7w6sj_0mhSRrCf-wu3WsGwuPM-BoDOcEf8p5Yqz2kDxhsSBUgYS89GPYNnmpbhDb08w1fGA4dlcS5AXUtRTursOXrOAuA Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 85363c2a53b549da92c7e3f9b09294bc Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkBasicOps-394395558 Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85363c2a53b549da92c7e3f9b09294bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_85363c2a53b549da92c7e3f9b09294bc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/85363c2a53b549da92c7e3f9b09294bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/85363c2a53b549da92c7e3f9b09294bc"}]}] Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkBasicOps-394395558 Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 85363c2a53b549da92c7e3f9b09294bc Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkBasicOps-394395558 Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkBasicOps-394395558-project Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a3c6e4b088224f33aa607e2a27ed798b Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkBasicOps-394395558-project Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 could not be found. Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f2c01ebb-5afe-4dc4-8868-5e840ec89e87'} Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 could not be found. Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 could not be found. Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:18:55.567572 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 could not be found. Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Returning 404 to user: Instance f2c01ebb-5afe-4dc4-8868-5e840ec89e87 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e0180190-6c32-4eaa-b694-ce2f541e2ef6 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87" status: 404 len: 111 microversion: 2.1 time: 0.119769 Nov 03 04:18:55.576422 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2540/5183] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:55 2022] GET /compute/v2.1/servers/f2c01ebb-5afe-4dc4-8868-5e840ec89e87 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:18:55.594390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:55.595021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:55.621246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:55.623289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:55.623289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:55.640091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:55.640834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:55.645004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:55.724371 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0857bb37-83ab-41f6-ad98-46d43e803c51 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.743682 Nov 03 04:18:55.725055 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2644/5184] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:18:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 3745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 03 04:18:55.755251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d88fd4dc-7df1-4131-a642-b6e3165a1546 req-cf5358dc-6bf7-44b7-981f-5c6ba70a16ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe14a3e-a087-4587-b686-e2922e6db816", "tag": "3a553d57-c99c-4b91-b427-590612c49d1a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:18:55.788969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d88fd4dc-7df1-4131-a642-b6e3165a1546 req-cf5358dc-6bf7-44b7-981f-5c6ba70a16ae service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:55.789833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d88fd4dc-7df1-4131-a642-b6e3165a1546 req-cf5358dc-6bf7-44b7-981f-5c6ba70a16ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:55.790477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d88fd4dc-7df1-4131-a642-b6e3165a1546 req-cf5358dc-6bf7-44b7-981f-5c6ba70a16ae service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:55.808774 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d88fd4dc-7df1-4131-a642-b6e3165a1546 req-cf5358dc-6bf7-44b7-981f-5c6ba70a16ae service nova] Creating event network-changed:3a553d57-c99c-4b91-b427-590612c49d1a for instance 9fe14a3e-a087-4587-b686-e2922e6db816 on n-h1-854653-7 Nov 03 04:18:55.827607 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d88fd4dc-7df1-4131-a642-b6e3165a1546 req-cf5358dc-6bf7-44b7-981f-5c6ba70a16ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090553 Nov 03 04:18:55.828871 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2645/5185] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:18:55.839041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-501f8163-6962-481f-9849-a0f97ad3fc0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:55.840104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-501f8163-6962-481f-9849-a0f97ad3fc0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:56.232682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-501f8163-6962-481f-9849-a0f97ad3fc0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:56.262055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-501f8163-6962-481f-9849-a0f97ad3fc0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:56.263586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-501f8163-6962-481f-9849-a0f97ad3fc0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:56.264729 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-501f8163-6962-481f-9849-a0f97ad3fc0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1282 microversion: 2.20 time: 0.434552 Nov 03 04:18:56.285612 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2646/5186] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:18:55 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1282 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:18:56.420989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:56.429176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5e920742-c325-41d8-a9b6-63b5dfe52c7b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.858371 Nov 03 04:18:56.435036 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2541/5187] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:55 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:56.475140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:56.480795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:56.525635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:56.529681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:56.532025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:56.533905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:56.534752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:56.539316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:56.628063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59d087df-69b6-4a0f-b875-456a65b5bdc7 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] Calling method '.version_select at 0x7ff7f92f5280>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:56.897328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-59d087df-69b6-4a0f-b875-456a65b5bdc7 tempest-TestNetworkBasicOps-394395558 tempest-TestNetworkBasicOps-394395558-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-344547053" status: 202 len: 0 microversion: 2.1 time: 0.273493 Nov 03 04:18:56.897980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2542/5188] 10.222.0.30 () {58 vars in 1254 bytes} [Thu Nov 3 04:18:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-344547053 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:18:56.938763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:56.974498 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-586898f5-2cc2-4cf7-b952-7f0c74181c5e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1321 microversion: 2.1 time: 0.505023 Nov 03 04:18:56.977425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2647/5189] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:56 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:57.319877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8adc4a5-b20b-4503-988a-8d65c341fc73 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:57.321914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a8adc4a5-b20b-4503-988a-8d65c341fc73 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:57.465466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:57.467030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:57.478849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8adc4a5-b20b-4503-988a-8d65c341fc73 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:57.513220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8adc4a5-b20b-4503-988a-8d65c341fc73 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:57.513437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:57.514418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:57.514959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:57.517458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:57.518166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8adc4a5-b20b-4503-988a-8d65c341fc73 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:57.520345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:57.520910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:57.522427 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a8adc4a5-b20b-4503-988a-8d65c341fc73 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1282 microversion: 2.20 time: 0.210860 Nov 03 04:18:57.524602 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2543/5190] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:18:57 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1282 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:18:57.836270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:57.844892 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-015a65fb-55a6-4331-b0cd-4fa6cbea10f9 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.386595 Nov 03 04:18:57.867022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2648/5191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:57 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:58.012202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:58.013427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:58.023505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:58.026851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:58.028605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:58.038818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:58.048328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:58.048728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:58.549671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:58.551786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:58.569841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:58.572221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:58.573490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:58.575976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:58.579948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:58.581102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:58.600952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:58.610240 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e3f0f7d-64e1-4b40-9196-9bbe0533f189 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1321 microversion: 2.1 time: 0.602932 Nov 03 04:18:58.610826 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2544/5192] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:58 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:18:58.874330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:58.875215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:58.889447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:58.890728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:58.892764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:58.893736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:58.906638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:58.915601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:58.926901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:58.943498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:58.945962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:58.948047 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b7c103dd-16b1-4f68-98eb-293beed9c951 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1286 microversion: 2.20 time: 0.404177 Nov 03 04:18:58.949500 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2649/5193] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:18:58 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1286 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:18:59.639019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:59.640741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:18:59.657865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:59.672823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:59.677614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:59.678552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:18:59.681452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:18:59.681964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:18:59.726329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:18:59.767429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a6a53e4-ee11-4815-ab33-6d784bece60b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.885487 Nov 03 04:18:59.770313 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2545/5194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:58 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:18:59.979110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:18:59.979744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:00.000941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:00.005542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:00.006063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:00.006836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:00.012084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:00.015410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:00.317183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:00.329614 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f51e2342-9034-40ae-bfcc-f91071306eb7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1321 microversion: 2.1 time: 0.693349 Nov 03 04:19:00.343764 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2650/5195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:18:59 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:00.396761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:00.423086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:00.425848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:00.427392 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-baf73aa0-c320-4bcf-aca5-231e258f3ed1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1334 microversion: 2.20 time: 0.453155 Nov 03 04:19:00.441379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2546/5196] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:18:59 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1334 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:00.792883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:00.798314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:00.814452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:00.815759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:00.816804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:00.819443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:00.821704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:00.823769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:01.313992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:01.328355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d130eae-2f92-4b16-8546-9daf450db7a6 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.539608 Nov 03 04:19:01.330288 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2651/5197] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:00 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:01.359770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:01.369435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:01.379853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:01.380961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:01.381626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:01.382740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:01.383387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:01.390725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:01.477124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:01.478016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:01.486795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:01.487584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:01.488178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:01.490635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:01.491583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:01.493917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:01.945388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:01.955334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:01.962469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:01.964095 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-817a3541-4221-4b3a-8c7c-e611c6d8d4b4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1340 microversion: 2.20 time: 0.495162 Nov 03 04:19:01.982686 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2652/5198] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:01 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1340 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:01.993902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f739115b-a5e4-484d-b4ce-3dce69f7b4f8 req-4cc7d7f5-ff59-469b-9eb4-2485493a27c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b5cf5c-4513-4774-9e62-4e3b325f943f", "name": "network-vif-plugged", "status": "completed", "tag": "2f991e9f-8437-42f3-ae00-76e68d352cb5"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:02.017288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f739115b-a5e4-484d-b4ce-3dce69f7b4f8 req-4cc7d7f5-ff59-469b-9eb4-2485493a27c9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:02.019040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f739115b-a5e4-484d-b4ce-3dce69f7b4f8 req-4cc7d7f5-ff59-469b-9eb4-2485493a27c9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:02.022378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f739115b-a5e4-484d-b4ce-3dce69f7b4f8 req-4cc7d7f5-ff59-469b-9eb4-2485493a27c9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:02.048396 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f739115b-a5e4-484d-b4ce-3dce69f7b4f8 req-4cc7d7f5-ff59-469b-9eb4-2485493a27c9 service nova] Creating event network-vif-plugged:2f991e9f-8437-42f3-ae00-76e68d352cb5 for instance 48b5cf5c-4513-4774-9e62-4e3b325f943f on n-h1-854653-7 Nov 03 04:19:02.060539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f739115b-a5e4-484d-b4ce-3dce69f7b4f8 req-4cc7d7f5-ff59-469b-9eb4-2485493a27c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075830 Nov 03 04:19:02.064130 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2653/5199] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:02.252064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:02.262622 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0283d54d-5a0c-4836-94e3-dc98e1595622 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1321 microversion: 2.1 time: 0.907880 Nov 03 04:19:02.264553 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2547/5200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:01 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1321 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:02.359832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:02.360916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:02.380288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:02.380879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:02.382416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:02.384299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:02.384785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:02.390149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:02.998104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:02.999810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:03.014255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:03.015088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:03.017996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:03.018944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:03.020361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:03.021967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:03.590988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:03.614305 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-917ff0c3-f04f-4368-875b-44b15d34e62e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 1.261237 Nov 03 04:19:03.635224 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2654/5201] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:02 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:03.641051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:03.641929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:03.653414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:03.654239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:03.654892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:03.655931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:03.656545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:03.657162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:03.689669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:03.703172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:03.708436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:03.712246 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9106c38-f125-498d-a463-d7120ff46da8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1340 microversion: 2.20 time: 0.718816 Nov 03 04:19:03.713493 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2548/5202] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:02 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1340 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:04.430393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:04.460601 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91fb4165-1923-42f0-9dc3-bed428c09024 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1321 microversion: 2.1 time: 0.823579 Nov 03 04:19:04.481528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2655/5203] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:03 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1321 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:04.649620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:04.650749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:04.690691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:04.691655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:04.694579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:04.700487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:04.703250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:04.703627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:04.740200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:04.740883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:04.748512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:04.749050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:04.749674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:04.750554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:04.751175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:04.751764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:05.073563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:05.088643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:05.090166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:05.091898 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23f72d7b-8712-4531-a7c5-b398b914f125 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1340 microversion: 2.20 time: 0.356536 Nov 03 04:19:05.114826 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2656/5204] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:04 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1340 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:05.261872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:05.272323 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-671aa70b-14f7-4e99-9f0a-ebaaf5d1d4df tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.633347 Nov 03 04:19:05.273432 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2549/5205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:04 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:05.327761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-80d82079-b241-4209-b6d1-d89c16a804cc req-e3b04c50-aebf-4975-95f6-9151b8fb947a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe14a3e-a087-4587-b686-e2922e6db816", "name": "network-vif-plugged", "status": "completed", "tag": "3a553d57-c99c-4b91-b427-590612c49d1a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:05.342979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-80d82079-b241-4209-b6d1-d89c16a804cc req-e3b04c50-aebf-4975-95f6-9151b8fb947a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:05.343457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-80d82079-b241-4209-b6d1-d89c16a804cc req-e3b04c50-aebf-4975-95f6-9151b8fb947a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:05.343897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-80d82079-b241-4209-b6d1-d89c16a804cc req-e3b04c50-aebf-4975-95f6-9151b8fb947a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:05.370530 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-80d82079-b241-4209-b6d1-d89c16a804cc req-e3b04c50-aebf-4975-95f6-9151b8fb947a service nova] Creating event network-vif-plugged:3a553d57-c99c-4b91-b427-590612c49d1a for instance 9fe14a3e-a087-4587-b686-e2922e6db816 on n-h1-854653-7 Nov 03 04:19:05.377985 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-80d82079-b241-4209-b6d1-d89c16a804cc req-e3b04c50-aebf-4975-95f6-9151b8fb947a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054286 Nov 03 04:19:05.378780 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2657/5206] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:05.499936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:05.500598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:05.531699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:05.532564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:05.535191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:05.539970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:05.542312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:05.542833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:05.998415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:06.008490 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-746325ac-930c-474b-a2b7-3d479ae0020e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1512 microversion: 2.1 time: 0.511364 Nov 03 04:19:06.020835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2550/5207] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:05 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:06.040161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:06.040931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:06.043788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:06.064728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:06.065291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:06.065753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:06.066482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:06.067430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:06.067876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:06.125172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:06.125801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:06.147779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:06.148284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:06.153776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:06.154558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:06.154997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:06.155428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:06.260328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=7 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:07.074723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:07.097306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:07.100006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:07.102345 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9ddfb86-f296-41d2-82d8-b90bb93d8ebb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1408 microversion: 2.20 time: 0.983038 Nov 03 04:19:07.103545 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2551/5208] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:06 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1408 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:07.115122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:07.115122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:07.119718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:07.120477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:07.121178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:07.123719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:07.124583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:07.125287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:07.138766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:07.151935 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9687d5ae-675b-4017-a5cb-bc85d32948ae tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 200 len: 1512 microversion: 2.1 time: 1.116815 Nov 03 04:19:07.167144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2658/5209] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:06 2022] GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 1512 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:07.184111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:07.190738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:07.192145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:07.247051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:07.247463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:07.247911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:07.278878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:07.280904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:07.281694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:07.489836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:07.492656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:07.501400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:07.513397 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d24a52e-70a0-4912-b51f-44cc54663886 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1307 microversion: 2.1 time: 0.408212 Nov 03 04:19:07.538526 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2552/5210] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:07 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1307 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:07.650717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:07.659290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:07.659894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:07.660416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:08.170354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:08.171782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:08.193774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:08.200851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:08.201339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:08.206699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:08.207206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:08.207654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:08.287695 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4182f7b-cd24-4a63-b7b6-0a5999cc69b2 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.108736 Nov 03 04:19:08.303614 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2659/5211] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Nov 3 04:19:07 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:08.346593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:08.391143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:08.395212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1235057179', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:08.424077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:08.424959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:08.425586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:08.427738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:08.429429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:08.430062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:08.654161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:08.740430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:08.754204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:08.755765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:08.756885 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccb3dc11-4d7a-4ca0-b33e-0821b1fad6db tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1408 microversion: 2.20 time: 0.624939 Nov 03 04:19:08.768042 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2553/5212] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:08 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1408 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:08.804991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:08.807780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:08.825464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:08.826718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:08.827405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:08.828405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:08.829107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:08.829772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:08.865851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:08.876976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:08.877525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:08.877965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:09.252888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:09.265944 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55ba1727-4a43-4491-a231-dcbdf10f613c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1488 microversion: 2.1 time: 0.474817 Nov 03 04:19:09.266571 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2554/5213] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:08 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1488 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:09.288057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-316e26a8-64bb-4104-a36d-d151f0aa2816 req-7485e3df-0baa-409a-b5ae-e2c3ab3558c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:09.320533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-316e26a8-64bb-4104-a36d-d151f0aa2816 req-7485e3df-0baa-409a-b5ae-e2c3ab3558c5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:09.322701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-316e26a8-64bb-4104-a36d-d151f0aa2816 req-7485e3df-0baa-409a-b5ae-e2c3ab3558c5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:09.323329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-316e26a8-64bb-4104-a36d-d151f0aa2816 req-7485e3df-0baa-409a-b5ae-e2c3ab3558c5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:09.354547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-316e26a8-64bb-4104-a36d-d151f0aa2816 req-7485e3df-0baa-409a-b5ae-e2c3ab3558c5 service nova] Creating event network-changed:6b519c86-8b5c-406f-9ed8-fed59ea01091 for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 on n-h2-854653-7 Nov 03 04:19:09.361328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-316e26a8-64bb-4104-a36d-d151f0aa2816 req-7485e3df-0baa-409a-b5ae-e2c3ab3558c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093048 Nov 03 04:19:09.362868 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2555/5214] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:09.369422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-40171766"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:09.372943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:09.379877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:09.380286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:09.380784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:09.381668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:09.382288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:09.382867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:09.758380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5ef02bf-5993-4050-a569-07ad7a346257 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1235057179" status: 200 len: 1515 microversion: 2.1 time: 1.429532 Nov 03 04:19:09.786500 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2660/5215] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:19:08 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1235057179 => generated 1515 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:09.795128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:09.813969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:09.817929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:09.844954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:09.845475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:09.845919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:09.857255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:09.858631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:09.859357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:10.150867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:10.202489 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae98f909-deac-4d3c-905a-587f46e93d21 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "POST /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816/action" status: 202 len: 0 microversion: 2.1 time: 0.836728 Nov 03 04:19:10.211182 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2556/5216] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:19:09 2022] POST /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816/action => generated 0 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:19:10.220773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:10.221688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:10.241947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:10.243115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:10.244161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:10.247162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:10.247659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:10.251632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:10.352753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:10.411674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:10.422530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:10.426053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:10.427152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:10.427790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.078507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.098150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.105423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.107927 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fd44f469-145b-4b0e-9bb5-b5d3c787e74a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 1.318969 Nov 03 04:19:11.108374 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cac124f0-25af-4bce-b95f-5c35a6d76526 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1408 microversion: 2.20 time: 0.899484 Nov 03 04:19:11.109396 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2661/5217] 10.222.0.30 () {58 vars in 1173 bytes} [Thu Nov 3 04:19:09 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:11.114371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9af8266a-6705-4780-945a-f93c00dc18bb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f921cee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.132610 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2557/5218] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:10 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1408 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:11.160916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.166506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.167243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.servers [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Removing options 'limit' from query {{(pid=127593) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 03 04:19:11.168917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:11.175598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.176343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.176783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.178016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.178634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.179276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.201990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:11.242382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.249329 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9af8266a-6705-4780-945a-f93c00dc18bb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0" status: 200 len: 1412 microversion: 2.1 time: 0.138441 Nov 03 04:19:11.250293 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2662/5219] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 => generated 1412 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:11.251852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.252342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.252783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.266864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f43a2a84-adea-4ba7-aecb-58e80971a716 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f844a430>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.368815 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f43a2a84-adea-4ba7-aecb-58e80971a716 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0" status: 200 len: 1412 microversion: 2.1 time: 0.105907 Nov 03 04:19:11.375950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2663/5220] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:11.395145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d745971-d56a-44d1-8416-e2227074c12e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd564af0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.519548 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3469199f-8748-4623-a2fe-352d3937feca tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.369008 Nov 03 04:19:11.531002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2558/5221] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:11.553400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.560515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.561925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:11.568428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.569704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.570388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.571359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.572220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.573027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.607625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:11.640588 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47bf79d2-9601-4556-83d0-d4ad1e4cf989 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.092807 Nov 03 04:19:11.651591 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2559/5222] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:11.666342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.672450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.672902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.servers [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Removing options 'limit' from query {{(pid=127593) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 03 04:19:11.673635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:11.698106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.704565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.705271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.708418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.711065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.711560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.759909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:11.810878 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b270c0b4-d667-4f09-aa51-85bd07a202c9 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.158183 Nov 03 04:19:11.821703 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2560/5223] 10.222.0.30 () {58 vars in 1150 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:11.824889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.847682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.849320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:11.857377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.858007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.858704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.859833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.860450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.861070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.862861 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d745971-d56a-44d1-8416-e2227074c12e tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0" status: 204 len: 0 microversion: 2.1 time: 0.471741 Nov 03 04:19:11.864109 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2664/5224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:11 2022] DELETE /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:19:11.874655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa4d8ea4-82b3-46b3-a87f-1998e4be456f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fd5daa60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.905737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:11.923761 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fa4d8ea4-82b3-46b3-a87f-1998e4be456f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Image not found. Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa4d8ea4-82b3-46b3-a87f-1998e4be456f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 HTTP/1.1 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0'} Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 03 04:19:11.926701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 could not be found. Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa4d8ea4-82b3-46b3-a87f-1998e4be456f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fa4d8ea4-82b3-46b3-a87f-1998e4be456f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0" status: 404 len: 62 microversion: 2.1 time: 0.060712 Nov 03 04:19:11.936701 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2665/5225] 10.222.0.30 () {58 vars in 1233 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:19:11.957359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.958287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:11.962141 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abcaada1-90d0-46ce-92b6-2f9d7a425c50 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.142039 Nov 03 04:19:11.963081 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2561/5226] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/servers => generated 1011 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:11.978915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.981744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:11.986602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.987156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.987934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:11.988426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:11.993080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:11.997119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:11.999248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:12.020012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:12.020793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:12.021526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:12.022444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:12.023107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:12.023733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:12.178363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:12.279677 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b2c8ee3-9418-4e04-9c9e-e30b89ebdfe5 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.305819 Nov 03 04:19:12.280954 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2562/5227] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:19:12.285973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:12.286753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:12.294698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:12.295483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:12.296100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:12.296994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:12.298548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:12.299133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:13.066474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:13.077525 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-87050eb4-f62c-41df-b387-fd7793b6109b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1500 microversion: 2.1 time: 1.135181 Nov 03 04:19:13.097985 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2666/5228] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:11 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1500 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:13.109166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:13.115899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:13.116363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.compute.servers [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Removing options 'limit' from query {{(pid=127594) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 03 04:19:13.117066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:13.123557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:13.124328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:13.124954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:13.126702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:13.127378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:13.128439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:13.189234 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c77a9ca6-c4fa-4a68-86a1-fe7ae874b1be tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.089035 Nov 03 04:19:13.190344 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2667/5229] 10.222.0.30 () {58 vars in 1140 bytes} [Thu Nov 3 04:19:13 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:13.197237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:13.210999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:13.216430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:13.217439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:13.220284 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3bcdf4a8-bf55-419f-a88b-cec6d7e5e187 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1408 microversion: 2.20 time: 0.938117 Nov 03 04:19:13.223011 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2563/5230] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:12 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1408 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:13.245137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:13.245988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1235057179', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:13.252818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:13.253558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:13.254166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:13.254909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:13.255365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:13.255796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:13.377237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:13.485664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-500fe5d3-52fa-4211-af00-581654c9dad7 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1235057179" status: 200 len: 346 microversion: 2.1 time: 0.282183 Nov 03 04:19:13.488262 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2668/5231] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 04:19:13 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1235057179 => generated 346 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:13.502810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f60b030-15db-4507-ab31-70c9c462b1b3 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:13.512816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f60b030-15db-4507-ab31-70c9c462b1b3 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:13.522396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f60b030-15db-4507-ab31-70c9c462b1b3 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:13.522974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f60b030-15db-4507-ab31-70c9c462b1b3 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:13.596104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f60b030-15db-4507-ab31-70c9c462b1b3 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Going to try to stop instance {{(pid=127593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:19:14.113387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:14.115208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:14.126362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:14.127547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:14.128466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:14.129311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:14.130013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:14.130708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:14.258658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f60b030-15db-4507-ab31-70c9c462b1b3 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "POST /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f/action" status: 202 len: 0 microversion: 2.1 time: 0.759548 Nov 03 04:19:14.259893 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2564/5232] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:19:13 2022] POST /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:19:14.266179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:14.266948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:14.286476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:14.286973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:14.287623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:14.288491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:14.289130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:14.289726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:14.354984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:14.368444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c1cf0676-d13d-429e-baab-ad8a0cddce6b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1506 microversion: 2.1 time: 0.261687 Nov 03 04:19:14.369888 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2669/5233] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:14 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:14.402584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:14.403534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:14.416525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:14.419229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:14.422861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:14.423968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:14.424729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:14.425462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:15.515058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:15.528647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:15.534769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:15.536409 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9835e9c-a6e8-436d-864a-c242c1404531 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1408 microversion: 2.20 time: 1.275182 Nov 03 04:19:15.541196 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2565/5234] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:14 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1408 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:15.550189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0453c9ea-6754-4992-95a5-bfd6623e7e86 req-569963a6-4360-47dd-83bb-26645e04545e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "name": "network-vif-plugged", "status": "completed", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:15.578149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0453c9ea-6754-4992-95a5-bfd6623e7e86 req-569963a6-4360-47dd-83bb-26645e04545e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:15.590831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0453c9ea-6754-4992-95a5-bfd6623e7e86 req-569963a6-4360-47dd-83bb-26645e04545e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:15.590831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0453c9ea-6754-4992-95a5-bfd6623e7e86 req-569963a6-4360-47dd-83bb-26645e04545e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:15.601270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:15.612578 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d894b3cd-a126-4b7b-9c4e-2e059f70a198 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 1.222893 Nov 03 04:19:15.616529 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2670/5235] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:14 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:15.622285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:15.625378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:15.631497 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0453c9ea-6754-4992-95a5-bfd6623e7e86 req-569963a6-4360-47dd-83bb-26645e04545e service nova] Creating event network-vif-plugged:6b519c86-8b5c-406f-9ed8-fed59ea01091 for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 on n-h2-854653-7 Nov 03 04:19:15.638053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0453c9ea-6754-4992-95a5-bfd6623e7e86 req-569963a6-4360-47dd-83bb-26645e04545e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095124 Nov 03 04:19:15.638949 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2566/5236] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:15.640926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:15.641612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:15.645932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:15.645932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:15.645932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:15.645932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:16.032410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:16.044773 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4212ecb-0661-447e-8279-231f248aed4c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1506 microversion: 2.1 time: 0.426867 Nov 03 04:19:16.057765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2671/5237] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:15 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1506 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:16.578114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:16.579564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:16.617056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:16.644552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:16.651482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:16.651733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:16.651839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:16.651839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:16.651839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:16.651839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:16.667496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:16.670990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:16.673814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:16.674874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:16.676323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:16.680333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:17.127921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:17.130765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:17.139349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a36a6eb-ed66-43f6-b631-ff32028fd84a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.503336 Nov 03 04:19:17.141200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2672/5238] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:16 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:17.154571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:17.155740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:17.163310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:17.164170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:17.164907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:17.165740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:17.166595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:17.167234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:17.168071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:17.168415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:17.169838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d47f5b9b-0fd3-4f5e-ba14-ae12c4ce4a48 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1408 microversion: 2.20 time: 0.603859 Nov 03 04:19:17.170566 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2567/5239] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:16 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1408 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:17.601649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:17.622102 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80eb4ec5-dba9-4e53-bbc0-4779a79498d3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1488 microversion: 2.1 time: 0.473545 Nov 03 04:19:17.634311 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2673/5240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:17 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1488 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:17.650441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:17.650952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:17.668742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:17.669212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:17.669716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:17.671694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:17.672574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:17.674120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:17.749213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:19:18.166919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:18.167705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:18.176558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.177904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.178599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.179560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.180246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.181157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.253407 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-63de4a0c-0d09-48cb-bffe-06bd3410d187 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 204 len: 0 microversion: 2.1 time: 0.602338 Nov 03 04:19:18.255520 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2568/5241] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:17 2022] DELETE /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.364150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.660084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:18.705062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:18.706768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:18.708446 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c1a4b43-60f2-46fa-ab88-5b5d58408491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1600 microversion: 2.20 time: 0.442719 Nov 03 04:19:18.725512 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2569/5242] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:19:18 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1600 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:19:18.735893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-621c23b0-e535-4a0b-8c86-80629b1a357c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f86cc4c0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:18.771193 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-621c23b0-e535-4a0b-8c86-80629b1a357c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Image not found. Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-621c23b0-e535-4a0b-8c86-80629b1a357c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 HTTP/1.1 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0'} Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 to delete Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 could not be found. Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:18.773739 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-621c23b0-e535-4a0b-8c86-80629b1a357c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:18.777680 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-621c23b0-e535-4a0b-8c86-80629b1a357c tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0" status: 404 len: 62 microversion: 2.1 time: 0.048585 Nov 03 04:19:18.778946 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2570/5243] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:18 2022] DELETE /compute/v2.1/images/2e2c03f2-84fa-4fce-845e-1dbf8a2b13f0 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:19:18.780817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:18.790462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-68f8ccbf-6646-42cb-a2aa-23b3472c1ea6 req-3adfbbe2-c63d-459d-83af-e5fb556dbf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe14a3e-a087-4587-b686-e2922e6db816", "name": "network-vif-plugged", "status": "completed", "tag": "3a553d57-c99c-4b91-b427-590612c49d1a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:18.792219 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c66c376-39a4-4019-97c2-92dfe4ae3311 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.629365 Nov 03 04:19:18.798765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2674/5244] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:18 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:18.807492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:18.813861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:18.815424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-68f8ccbf-6646-42cb-a2aa-23b3472c1ea6 req-3adfbbe2-c63d-459d-83af-e5fb556dbf10 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.815908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-68f8ccbf-6646-42cb-a2aa-23b3472c1ea6 req-3adfbbe2-c63d-459d-83af-e5fb556dbf10 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.819721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-68f8ccbf-6646-42cb-a2aa-23b3472c1ea6 req-3adfbbe2-c63d-459d-83af-e5fb556dbf10 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.826728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.827505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.828233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.829231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.829907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.830563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.848508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-68f8ccbf-6646-42cb-a2aa-23b3472c1ea6 req-3adfbbe2-c63d-459d-83af-e5fb556dbf10 service nova] Creating event network-vif-plugged:3a553d57-c99c-4b91-b427-590612c49d1a for instance 9fe14a3e-a087-4587-b686-e2922e6db816 on n-h1-854653-7 Nov 03 04:19:18.867155 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-68f8ccbf-6646-42cb-a2aa-23b3472c1ea6 req-3adfbbe2-c63d-459d-83af-e5fb556dbf10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084071 Nov 03 04:19:18.869434 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2571/5245] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:18.884535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:18.887334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:18.903808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.905584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.909638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.910635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:18.911759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:18.912540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:18.977298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:19:19.000732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:19.002137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5fb0184-9b71-4659-977d-b8b78f9011b3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.201981 Nov 03 04:19:19.003299 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2675/5246] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 04:19:18 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-interface => generated 285 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:19:19.156463 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.compute.api [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Instance is already in deleting state, ignoring this request Nov 03 04:19:19.157476 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47774049-7dd3-439e-b29c-d9b590fdc670 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 204 len: 0 microversion: 2.1 time: 0.286576 Nov 03 04:19:19.158377 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2572/5247] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:18 2022] DELETE /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:19:19.168916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:19.169631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:19.189570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:19.190346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:19.190974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:19.192055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:19.192700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:19.193685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:19.556655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:19.569653 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f770bfa-c8cb-4285-b1b0-1f9fabd05fb8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1494 microversion: 2.1 time: 0.406721 Nov 03 04:19:19.574018 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2676/5248] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:19 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1494 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:19.832869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:19.832869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:19.848317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:19.848894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:19.849379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:19.850128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:19.850598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:19.853863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:20.469788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:20.485597 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9132b57-877d-4d8e-90a9-e697c4f14dbf tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.661345 Nov 03 04:19:20.486735 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2573/5249] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:19 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:20.593131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:20.603064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:20.604421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:20.658069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:20.665871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:20.667639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:20.685806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:20.688419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:20.689137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:20.944797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-af41a6a9-47a0-49b8-b659-3d4da3451c5d req-c66b66fb-a633-4378-affe-398828932e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe14a3e-a087-4587-b686-e2922e6db816", "name": "network-vif-unplugged", "status": "completed", "tag": "3a553d57-c99c-4b91-b427-590612c49d1a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:20.996646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-af41a6a9-47a0-49b8-b659-3d4da3451c5d req-c66b66fb-a633-4378-affe-398828932e56 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:20.996646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-af41a6a9-47a0-49b8-b659-3d4da3451c5d req-c66b66fb-a633-4378-affe-398828932e56 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:20.996646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-af41a6a9-47a0-49b8-b659-3d4da3451c5d req-c66b66fb-a633-4378-affe-398828932e56 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:21.024283 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-af41a6a9-47a0-49b8-b659-3d4da3451c5d req-c66b66fb-a633-4378-affe-398828932e56 service nova] Creating event network-vif-unplugged:3a553d57-c99c-4b91-b427-590612c49d1a for instance 9fe14a3e-a087-4587-b686-e2922e6db816 on n-h1-854653-7 Nov 03 04:19:21.038085 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-af41a6a9-47a0-49b8-b659-3d4da3451c5d req-c66b66fb-a633-4378-affe-398828932e56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095429 Nov 03 04:19:21.040027 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2574/5250] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:19:21.267247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:21.276310 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d11c286e-b839-442f-8272-9aaaea3292ce tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1494 microversion: 2.1 time: 0.684732 Nov 03 04:19:21.279690 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2677/5251] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:20 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1494 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:21.513405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:21.514203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:21.527513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:21.531801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:21.550205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:21.550673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:21.551420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:21.552743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:21.562590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:22.117309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:22.302445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:22.303768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:22.316336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:22.318731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:22.318731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:22.323441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:22.324153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:22.324799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:22.487916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:22.491121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:22.513685 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08baeeb2-b38f-4c47-9fec-74c9dd8a6cb5 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1452 microversion: 2.1 time: 0.208594 Nov 03 04:19:22.513685 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2678/5252] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:22 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:22.513863 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-119e5ed1-83e0-4e85-b3f7-efdcd37fab88 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.989455 Nov 03 04:19:22.531354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-53f4c4b3-fd44-4aa3-914d-09caff3be257 req-12552572-6d19-415d-bfc6-5e552946be72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}, {"server_uuid": "9fe14a3e-a087-4587-b686-e2922e6db816", "name": "network-vif-deleted", "tag": "3a553d57-c99c-4b91-b427-590612c49d1a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:22.545384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-53f4c4b3-fd44-4aa3-914d-09caff3be257 req-12552572-6d19-415d-bfc6-5e552946be72 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:22.545948 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2575/5253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:21 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:22.546378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-53f4c4b3-fd44-4aa3-914d-09caff3be257 req-12552572-6d19-415d-bfc6-5e552946be72 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:22.547024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-53f4c4b3-fd44-4aa3-914d-09caff3be257 req-12552572-6d19-415d-bfc6-5e552946be72 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:22.571790 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-53f4c4b3-fd44-4aa3-914d-09caff3be257 req-12552572-6d19-415d-bfc6-5e552946be72 service nova] Creating event network-changed:6b519c86-8b5c-406f-9ed8-fed59ea01091 for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 on n-h2-854653-7 Nov 03 04:19:22.572414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-53f4c4b3-fd44-4aa3-914d-09caff3be257 req-12552572-6d19-415d-bfc6-5e552946be72 service nova] Creating event network-vif-deleted:3a553d57-c99c-4b91-b427-590612c49d1a for instance 9fe14a3e-a087-4587-b686-e2922e6db816 on n-h1-854653-7 Nov 03 04:19:22.594029 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-53f4c4b3-fd44-4aa3-914d-09caff3be257 req-12552572-6d19-415d-bfc6-5e552946be72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.067775 Nov 03 04:19:22.607764 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2679/5254] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:19:23.538631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:23.544554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:23.547169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:23.549289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:23.550052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:23.550723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:23.551663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:23.552334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:23.552986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:23.560375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:23.568224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:23.568879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:23.583454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:23.585404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:23.588981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:23.596147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:23.596147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:23.596147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:23.622884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:23.623815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:23.624657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:23.625279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lazy-loading 'fault' on Instance uuid 9fe14a3e-a087-4587-b686-e2922e6db816 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:19:23.704081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324a1dfe0c4843bd917eb6ecd6cc2c4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f70bc24fd3747e7b5bb787ac956de69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:23.712425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-adbe04b7-73f6-42ef-b57b-99c53f21e6b8 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 200 len: 1297 microversion: 2.1 time: 0.177795 Nov 03 04:19:23.726393 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2576/5255] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:23 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 1297 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:23.810984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:23.864144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-367fc03f-e477-418e-8124-a057c3a13c94 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.280394 Nov 03 04:19:23.864144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2680/5256] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:23 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:24.744472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:24.746279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 9fe14a3e-a087-4587-b686-e2922e6db816] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:24.763162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.763651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.764086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.765316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.765816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.766249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.786616 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 9fe14a3e-a087-4587-b686-e2922e6db816 could not be found. Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 HTTP/1.1 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 9fe14a3e-a087-4587-b686-e2922e6db816 could not be found. Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '9fe14a3e-a087-4587-b686-e2922e6db816'} Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe14a3e-a087-4587-b686-e2922e6db816 could not be found. Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe14a3e-a087-4587-b686-e2922e6db816 could not be found. Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.794140 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.798663 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:24.798663 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:24.798663 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:24.798663 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:24.798663 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe14a3e-a087-4587-b686-e2922e6db816 could not be found. Nov 03 04:19:24.798663 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.800267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 9fe14a3e-a087-4587-b686-e2922e6db816 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:24.801273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5368e6e0-484d-42be-bd6b-879f67a02a3f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816" status: 404 len: 111 microversion: 2.1 time: 0.064176 Nov 03 04:19:24.805037 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2577/5257] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:24 2022] GET /compute/v2.1/servers/9fe14a3e-a087-4587-b686-e2922e6db816 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:24.812101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:24.813558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:24.822222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.823040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.823478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.824269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.824718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.825321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.850480 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac HTTP/1.1 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '16246bfb-f0a5-4605-853d-ddb0a6d26cac'} Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:24.852745 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.857342 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.859160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:24.860380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cfe2b2f9-adfd-41d2-b73f-b04e95aff3aa tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 404 len: 111 microversion: 2.1 time: 0.053526 Nov 03 04:19:24.866942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:24.867783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:24.886060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2681/5258] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:24 2022] DELETE /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:24.886252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.886252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.886252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.888420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.889225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.890070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:24.890826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.898841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 16246bfb-f0a5-4605-853d-ddb0a6d26cac] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:24.907152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.909086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.909560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.910285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:24.910749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:24.911341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:24.937597 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac HTTP/1.1 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '16246bfb-f0a5-4605-853d-ddb0a6d26cac'} Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.939949 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:24.944229 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:24.944229 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:24.944229 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:24.944229 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:24.944229 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. Nov 03 04:19:24.944229 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:24.946396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 16246bfb-f0a5-4605-853d-ddb0a6d26cac could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:24.954312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d289519c-141d-4906-9cb3-8cb3900cbae3 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac" status: 404 len: 111 microversion: 2.1 time: 0.074135 Nov 03 04:19:24.959348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2682/5259] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:24 2022] GET /compute/v2.1/servers/16246bfb-f0a5-4605-853d-ddb0a6d26cac => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:24.965353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a945b3c-1c99-43d7-a844-68c196f585da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f87fe1f0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.018958 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-8a945b3c-1c99-43d7-a844-68c196f585da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Image not found. Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a945b3c-1c99-43d7-a844-68c196f585da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 HTTP/1.1 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00'} Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 to delete Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 could not be found. Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.020928 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:19:25.024635 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.028009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a945b3c-1c99-43d7-a844-68c196f585da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.028680 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8a945b3c-1c99-43d7-a844-68c196f585da tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00" status: 404 len: 62 microversion: 2.1 time: 0.068206 Nov 03 04:19:25.029506 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2683/5260] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:24 2022] DELETE /compute/v2.1/images/cb19cd7f-9ae1-4e4b-bcc5-1b1339715e00 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:19:25.039466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.040294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.048524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.049417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.050153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.051080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.051751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.052429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.069561 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b HTTP/1.1 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '825bef4c-2420-47aa-94be-e2b287f1a09b'} Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.071712 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.076090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.078295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.079427 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8994721-60d1-406b-b19e-c7b9c8897aa4 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 404 len: 111 microversion: 2.1 time: 0.044335 Nov 03 04:19:25.083917 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2684/5261] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:25 2022] DELETE /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:25.097287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.097287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 825bef4c-2420-47aa-94be-e2b287f1a09b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.113714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.113714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.113714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.113714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.113714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.113714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b HTTP/1.1 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '825bef4c-2420-47aa-94be-e2b287f1a09b'} Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.141797 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 825bef4c-2420-47aa-94be-e2b287f1a09b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-67489729-78f9-4f2a-b8f8-fc37bd999278 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b" status: 404 len: 111 microversion: 2.1 time: 0.050516 Nov 03 04:19:25.145747 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2685/5262] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:25 2022] GET /compute/v2.1/servers/825bef4c-2420-47aa-94be-e2b287f1a09b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:25.152997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b8fd3ff-6f3d-45f2-bd25-9c16caa74418 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f9206790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.201069 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9b8fd3ff-6f3d-45f2-bd25-9c16caa74418 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Image not found. Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b8fd3ff-6f3d-45f2-bd25-9c16caa74418 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 HTTP/1.1 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '73b8ea12-49f1-429f-b485-49834ea3ae14'} Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 73b8ea12-49f1-429f-b485-49834ea3ae14 to delete Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 73b8ea12-49f1-429f-b485-49834ea3ae14 could not be found. Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.206200 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b8fd3ff-6f3d-45f2-bd25-9c16caa74418 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.209907 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b8fd3ff-6f3d-45f2-bd25-9c16caa74418 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14" status: 404 len: 62 microversion: 2.1 time: 0.066457 Nov 03 04:19:25.217045 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2686/5263] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:25 2022] DELETE /compute/v2.1/images/73b8ea12-49f1-429f-b485-49834ea3ae14 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:19:25.231846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.232235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.240731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.241350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.241919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.242747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.243439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.243962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.264617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:25.273184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 HTTP/1.1 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5031d1f0-da10-45db-a3a0-a7b979e21098'} Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.276535 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a462157a-7eff-4043-a46d-6909b9c85a8b tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 404 len: 111 microversion: 2.1 time: 0.058537 Nov 03 04:19:25.280488 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2687/5264] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:25 2022] DELETE /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:25.282567 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2548f3b8-c2f2-4f2b-b0ae-9896a795e289 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.420139 Nov 03 04:19:25.300413 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2578/5265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:24 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:25.305049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.305834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 5031d1f0-da10-45db-a3a0-a7b979e21098] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.316656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.320035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.320668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.321827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.323022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.324197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.354454 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 HTTP/1.1 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5031d1f0-da10-45db-a3a0-a7b979e21098'} Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.357523 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.362112 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.362112 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.362112 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.362112 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.362112 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. Nov 03 04:19:25.362112 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.362626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 5031d1f0-da10-45db-a3a0-a7b979e21098 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.363759 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-028bda1d-40e4-40e4-a7ca-64d1996a0f20 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098" status: 404 len: 111 microversion: 2.1 time: 0.063572 Nov 03 04:19:25.367449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2688/5266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:25 2022] GET /compute/v2.1/servers/5031d1f0-da10-45db-a3a0-a7b979e21098 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:25.373754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-219271bd-4c2f-4142-a672-e663f9dee88f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7fa066ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.405685 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-219271bd-4c2f-4142-a672-e663f9dee88f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Image not found. Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-219271bd-4c2f-4142-a672-e663f9dee88f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 HTTP/1.1 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: exception: Image not found. Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ee262f0c-bc80-4aaf-ab1f-053178eb26e8'} Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ee262f0c-bc80-4aaf-ab1f-053178eb26e8 to delete Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ee262f0c-bc80-4aaf-ab1f-053178eb26e8 could not be found. Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.425462 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-219271bd-4c2f-4142-a672-e663f9dee88f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Image not found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.429707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-219271bd-4c2f-4142-a672-e663f9dee88f tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8" status: 404 len: 62 microversion: 2.1 time: 0.060368 Nov 03 04:19:25.432042 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2579/5267] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:25 2022] DELETE /compute/v2.1/images/ee262f0c-bc80-4aaf-ab1f-053178eb26e8 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:19:25.439893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.439893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.451250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.451745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.452199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.452987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.453552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.453996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.461957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:25.472437 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 HTTP/1.1 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f77f4b73-22b8-46b1-bd3d-a3d3f37d6358'} Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.474525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.478738 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.481462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.482812 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-148c144e-ff43-4473-9434-20fdc49bf979 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 404 len: 111 microversion: 2.1 time: 0.047409 Nov 03 04:19:25.482907 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2689/5268] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:25 2022] DELETE /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:25.497611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.497611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: f77f4b73-22b8-46b1-bd3d-a3d3f37d6358] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.521605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.522142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.522864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.523607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.524476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.525199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.553924 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 HTTP/1.1 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f77f4b73-22b8-46b1-bd3d-a3d3f37d6358'} Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.555755 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-484dcfbc-866f-4a9a-b9a0-7dad4cd90cfb tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358" status: 404 len: 111 microversion: 2.1 time: 0.069460 Nov 03 04:19:25.572834 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2580/5269] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:25 2022] GET /compute/v2.1/servers/f77f4b73-22b8-46b1-bd3d-a3d3f37d6358 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:25.581050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea59cbdc-303a-4810-8b17-e0ac8841e318 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '.version_select at 0x7ff7f9156550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.621309 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ea59cbdc-303a-4810-8b17-e0ac8841e318 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Image not found. Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea59cbdc-303a-4810-8b17-e0ac8841e318 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 HTTP/1.1 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: exception: Image not found. Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'd7ebc2ae-40ba-4a07-abbe-73090ff58e20'} Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d7ebc2ae-40ba-4a07-abbe-73090ff58e20 to delete Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d7ebc2ae-40ba-4a07-abbe-73090ff58e20 could not be found. Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.623482 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 03 04:19:25.627847 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.630591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ea59cbdc-303a-4810-8b17-e0ac8841e318 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Image not found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.632430 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ea59cbdc-303a-4810-8b17-e0ac8841e318 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20" status: 404 len: 62 microversion: 2.1 time: 0.059636 Nov 03 04:19:25.634296 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2690/5270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:25 2022] DELETE /compute/v2.1/images/d7ebc2ae-40ba-4a07-abbe-73090ff58e20 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 03 04:19:25.643079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.643690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.649852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.662941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.663487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.670771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.672522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.673225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.708790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 HTTP/1.1 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '0f664e16-567c-49fd-a90f-dc44a6bbb6f0'} Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.716284 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.720340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.721453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.723675 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ecec2a9-5a79-48a5-a23a-4efbbb419385 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 404 len: 111 microversion: 2.1 time: 0.084853 Nov 03 04:19:25.763977 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2581/5271] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:25 2022] DELETE /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:25.774260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:25.774889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] [instance: 0f664e16-567c-49fd-a90f-dc44a6bbb6f0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:25.782606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.783783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.784241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.784947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:25.785493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:25.786279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:25.804529 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] HTTP exception thrown: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Request method failure captured: Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 HTTP/1.1 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjYz_JnvzVCKB3qYb3EPZToKBGy21FXj-SRXebFqzHz6eHLqWN3-A_2NgX1TPO55KFjOZX9_IAWGzQGh477Z_vG2MqE71ljZBqN2MXPjqTU_Juv2gTIebv0Y3qva1r4e-9lkgitwgQKGzb3SWNkk-_vd5I-uZnlE3DwzkCbTBd7ZM8wnw Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3f70bc24fd3747e7b5bb787ac956de69", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3f70bc24fd3747e7b5bb787ac956de69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3f70bc24fd3747e7b5bb787ac956de69"}]}] Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 3f70bc24fd3747e7b5bb787ac956de69 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesTestJSON-2024570288 Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 324a1dfe0c4843bd917eb6ecd6cc2c4c Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesTestJSON-2024570288-project Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0f664e16-567c-49fd-a90f-dc44a6bbb6f0'} Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.807445 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:25.812105 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:25.812105 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:25.812105 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:25.812105 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:25.812105 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. Nov 03 04:19:25.812105 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:25.814417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] Returning 404 to user: Instance 0f664e16-567c-49fd-a90f-dc44a6bbb6f0 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:25.815481 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c9717f3e-ca02-4a0f-a20b-45ed48832235 tempest-ImagesTestJSON-2024570288 tempest-ImagesTestJSON-2024570288-project] 10.222.0.30 "GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0" status: 404 len: 111 microversion: 2.1 time: 0.046271 Nov 03 04:19:25.816221 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2691/5272] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:25 2022] GET /compute/v2.1/servers/0f664e16-567c-49fd-a90f-dc44a6bbb6f0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:19:26.307396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:26.307999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:26.327175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:26.330961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:26.330961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:26.334301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:26.334857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:26.335305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:26.719759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:26.738380 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1657851c-44b2-420f-9681-e6983628dfe0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.435818 Nov 03 04:19:26.758319 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2582/5273] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:26 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:27.766379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:27.767635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:27.804667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:27.805610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:27.806216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:27.813335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:27.814030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:27.814629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:28.685440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:28.694791 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dda1a27c-f26a-49b4-a417-2099843fd25e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.932486 Nov 03 04:19:28.699209 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2692/5274] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:27 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:29.722730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:29.723351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:29.754820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:29.760511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:29.760511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:29.760511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:29.760511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:29.760511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:30.121831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:30.131676 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07863356-203d-4aaa-802e-a1d3045b6390 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.413435 Nov 03 04:19:30.137687 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2583/5275] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:29 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:31.159979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:31.160609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:31.168141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:31.168636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:31.177280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:31.181392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:31.181392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:31.181392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:31.717300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:31.728861 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc2cfc0c-95b1-4727-b333-93eb4b4fa07d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.572605 Nov 03 04:19:31.732852 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2693/5276] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:31 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:32.763907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:32.765690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:32.774595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:32.775635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:32.776268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:32.777452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:32.778076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:32.778710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:33.305183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:33.314210 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e0e83fe-1f63-4486-8ba6-8f5298eda20b tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.558757 Nov 03 04:19:33.314807 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2584/5277] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:32 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:34.347771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:34.350435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:34.378560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:34.378993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:34.379551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:34.383526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:34.384878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:34.388722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:35.103174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:35.122030 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc166d4a-d69f-4ddd-9704-1616f0838638 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1522 microversion: 2.1 time: 0.784297 Nov 03 04:19:35.124100 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2694/5278] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:34 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1522 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:36.150244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:36.151044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:36.181043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:36.181662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:36.182185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:36.183112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:36.187213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:36.187827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:36.495766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:36.506045 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04a989c3-198a-4ae2-bb45-e55be5219b47 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1499 microversion: 2.1 time: 0.360431 Nov 03 04:19:36.506639 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2585/5279] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:36 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1499 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:36.540678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:36.551608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:36.559144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:36.581967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:36.581967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:36.581967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:36.581967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:36.583263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:36.585915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:36.780738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:36.881092 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a2814d57-04dd-4691-8091-c859b8ae3934 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.350194 Nov 03 04:19:36.881724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2695/5280] 10.222.0.30 () {58 vars in 1154 bytes} [Thu Nov 3 04:19:36 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:36.900052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abeeed38-bbab-4f6c-a25d-59287c058d2c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:36.916637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abeeed38-bbab-4f6c-a25d-59287c058d2c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:36.919001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abeeed38-bbab-4f6c-a25d-59287c058d2c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:36.919451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abeeed38-bbab-4f6c-a25d-59287c058d2c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:37.022790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abeeed38-bbab-4f6c-a25d-59287c058d2c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Going to try to start instance {{(pid=127593) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 03 04:19:37.328222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abeeed38-bbab-4f6c-a25d-59287c058d2c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "POST /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f/action" status: 202 len: 0 microversion: 2.1 time: 0.431902 Nov 03 04:19:37.339729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:37.349376 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2586/5281] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:19:36 2022] POST /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:19:37.369124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:37.369124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:37.369124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:37.369124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:37.369124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:37.369124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:37.369124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:37.688320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:37.721463 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ed3f89db-68e3-4440-8cf1-adce910549c4 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1508 microversion: 2.1 time: 0.387239 Nov 03 04:19:37.749849 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2696/5282] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:37 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:38.758633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:38.762082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:38.789238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:38.789238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:38.789238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:38.789238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:38.789238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:38.789238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:39.168591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:39.210384 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-701c916b-f44a-4eda-9b0a-bcc83ad97db0 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1508 microversion: 2.1 time: 0.432662 Nov 03 04:19:39.213002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2587/5283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:38 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:40.242360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:40.243756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:40.281613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.295086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.295609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:40.301534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.301534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.301534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:40.529741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:40.537664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9682d195-71e8-4740-98d5-caa03eb9e177 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1512 microversion: 2.1 time: 0.302451 Nov 03 04:19:40.540952 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2697/5284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:40 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1512 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:40.574277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:40.584026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:40.584505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.servers [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Removing options 'limit' from query {{(pid=127593) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Nov 03 04:19:40.586057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:40.588488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.589212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.589844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:40.591088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.591741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.592358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:40.597385 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f553bdf5-aa21-49cb-9265-e21547219e9f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.030167 Nov 03 04:19:40.614987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:40.615735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:40.617979 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2588/5285] 10.222.0.30 () {58 vars in 1140 bytes} [Thu Nov 3 04:19:40 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:19:40.625420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.626169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.626761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:40.627823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.628501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.629156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:40.914010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:40.933928 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-79a5d4a2-dfae-45e8-9d2b-6a6bd78db818 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1512 microversion: 2.1 time: 0.325618 Nov 03 04:19:40.935168 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2698/5286] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:40 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:40.960594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:40.961265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:40.974218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.974798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.975555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:40.976726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:40.977265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:40.977704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:41.221221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:41.230891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60b977cc-7af7-476e-847d-0181aabbd6da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 200 len: 1512 microversion: 2.1 time: 0.275309 Nov 03 04:19:41.245589 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2589/5287] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:40 2022] GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:41.264314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:41.264987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:41.285813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=62 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:41.294101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:41.295314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:41.295954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:41.299742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:41.299742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:41.299742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:41.660922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:41.702887 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4880e56b-a6f7-4e05-ba4e-3115a45e935f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1512 microversion: 2.1 time: 0.444951 Nov 03 04:19:41.704422 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2699/5288] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:41 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1512 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:41.724678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:41.736366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:41.736366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:41.924986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:41.925502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:41.926141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:41.927029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:41.927648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:41.928229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:42.079935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:42.184300 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e02360d3-3796-4579-8af1-e4d4515d185a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.463126 Nov 03 04:19:42.185601 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2590/5289] 10.222.0.30 () {58 vars in 1154 bytes} [Thu Nov 3 04:19:41 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:42.203532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:42.204725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:42.212389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:42.213099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:42.213805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:42.214731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:42.215394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:42.216088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:42.878312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:42.887591 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c6e3f259-b6d6-4fcb-8cca-abc91e3c4395 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1512 microversion: 2.1 time: 0.690516 Nov 03 04:19:42.888230 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2700/5290] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:42 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1512 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:42.917956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:42.918628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:42.939439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:42.940244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:42.953595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:42.961685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:42.965454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:42.970437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:43.002131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:43.251063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1778992945", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "8a875d70-f302-4961-9b3a-2146d99808aa"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:43.378633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] validate_networks() for [('8a875d70-f302-4961-9b3a-2146d99808aa', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:19:43.444702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:43.472373 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87bbe4bd-2038-48f4-967f-3684bba54937 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 200 len: 1512 microversion: 2.1 time: 0.558917 Nov 03 04:19:43.506005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2591/5291] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:42 2022] GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:43.519764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:43.520611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:43.538990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:43.539999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:43.542375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:43.547805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:43.548474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:43.555639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:43.856242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:43.868192 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a6aecad-55a4-4890-a29f-1a022a9e43da tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1512 microversion: 2.1 time: 0.352173 Nov 03 04:19:43.889660 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2592/5292] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:43 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:43.899755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:43.918338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:43.919878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:43.937135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:43.937888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:43.938615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:43.939582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:43.940207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:43.940831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:44.016319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:44.067503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:44.080514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:44.081303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:44.081900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:44.768414 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2beaa1f2-9574-4a87-a4d2-48fa4505027d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.875312 Nov 03 04:19:44.769508 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2593/5293] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:19:43 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:44.798354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:44.805329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:44.806472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:45.003845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.004506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.007221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:45.011135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.012450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.013931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:45.095595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:19:45.095595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:19:45.096326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:19:45.096710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:19:45.097223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:19:45.112216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:45.122211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.124641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.125896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:45.127633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.128293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.130933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:45.210052 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-059fe1df-9b74-4e36-8936-951e8dba7273 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.415854 Nov 03 04:19:45.211800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Getting quotas for project 09a3843a61274e25a32a4b4831e2e720. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:19:45.223513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Getting quotas for user fb267ab994fa4bf787afd128fb084e35 and project 09a3843a61274e25a32a4b4831e2e720. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:19:45.235082 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2594/5294] 10.222.0.30 () {58 vars in 1150 bytes} [Thu Nov 3 04:19:44 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:45.240874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:45.247365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:45.248041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:45.253599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:19:45.257272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:19:45.262251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.262748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.267793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:45.268756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.269272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.271798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:45.405405 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-adf64be6-55cc-409b-9add-d782e778c60d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.159439 Nov 03 04:19:45.407807 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2701/5295] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:19:45.418938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b7e1d40-85a1-4d51-894a-905f7e16ca71 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:45.422890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b7e1d40-85a1-4d51-894a-905f7e16ca71 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:45.589837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:45.761904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ad14b6c-37b2-429d-ae71-e8145cfd2e91 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.525003 Nov 03 04:19:45.765172 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2595/5296] 10.222.0.30 () {58 vars in 1212 bytes} [Thu Nov 3 04:19:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:45.773313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4b7e1d40-85a1-4d51-894a-905f7e16ca71 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:45.782399 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b7e1d40-85a1-4d51-894a-905f7e16ca71 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1214 microversion: 2.1 time: 0.367928 Nov 03 04:19:45.785144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2702/5297] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:45 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1214 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:45.798442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:45.812158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:45.812841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:45.852100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.855511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.857358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:45.857358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:45.859088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:45.859602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:46.103330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:46.263271 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc28797c-1564-477b-b015-8919bfd1f485 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.490569 Nov 03 04:19:46.264725 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2596/5298] 10.222.0.30 () {58 vars in 1196 bytes} [Thu Nov 3 04:19:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:46.283943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:46.305346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:46.306099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'name': '1235057179', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:46.338120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:46.339228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:46.339671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:46.340406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:46.349300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:46.350706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:46.572281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:46.741385 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2b17cbb5-ca08-4f21-9f3a-f8565379188c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?name=1235057179" status: 200 len: 346 microversion: 2.1 time: 0.461594 Nov 03 04:19:46.755575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:46.760724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2703/5299] 10.222.0.30 () {58 vars in 1156 bytes} [Thu Nov 3 04:19:46 2022] GET /compute/v2.1/servers?name=1235057179 => generated 346 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:46.761420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:46.762259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:46.768600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:46.772933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:46.773609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:46.774588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:46.777114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:46.781085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:46.810611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9aeccc0c-74df-483a-a4ea-f41872ee278a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:46.811649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9aeccc0c-74df-483a-a4ea-f41872ee278a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:46.989729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:47.095774 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12fc0766-e17f-45a3-85d1-3b3071bffb97 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.344047 Nov 03 04:19:47.104880 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2597/5300] 10.222.0.30 () {58 vars in 1154 bytes} [Thu Nov 3 04:19:46 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:47.111667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:47.118308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:47.120334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-123505717', 'deleted': False, 'project_id': '32d3a04c36254e558e1df54a3d85d94c'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 04:19:47.127270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:47.127996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:47.131405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:47.131405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:47.131405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:47.131874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:47.376792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9aeccc0c-74df-483a-a4ea-f41872ee278a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:47.392324 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9aeccc0c-74df-483a-a4ea-f41872ee278a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1214 microversion: 2.1 time: 0.585827 Nov 03 04:19:47.392929 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2704/5301] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:46 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1214 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:47.400481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 04:19:47.620440 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2bce42d-5ec2-466f-9252-c2464414cc3a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-123505717" status: 200 len: 346 microversion: 2.1 time: 0.513556 Nov 03 04:19:47.629220 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2598/5302] 10.222.0.30 () {58 vars in 1228 bytes} [Thu Nov 3 04:19:47 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-123505717 => generated 346 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:47.634433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:47.635234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:47.642355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:47.647497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:47.651383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:47.652692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:47.655782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:47.656825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:47.695258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:19:48.162786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-79643f94-f002-470b-a732-53f97e6e84d1 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 204 len: 0 microversion: 2.1 time: 0.531877 Nov 03 04:19:48.163641 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2705/5303] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:47 2022] DELETE /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:19:48.172990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:48.173694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:48.202155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:48.202679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:48.203132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:48.213758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:48.213758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:48.213758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:48.420197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:48.421604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:48.438149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:48.439311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:48.439979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:48.440906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:48.443510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:48.455640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:48.657269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:48.676634 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f5a0469-430c-40fd-9b66-83b26af7348d tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1518 microversion: 2.1 time: 0.505599 Nov 03 04:19:48.680485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2599/5304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:48 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1518 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:48.766630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:48.779151 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bab6fc38-e0fb-4dcc-a68c-6f8926c0d2ef tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1266 microversion: 2.1 time: 0.363203 Nov 03 04:19:48.783657 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2706/5305] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:48 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:49.707984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:49.709372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:49.719839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:49.723425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:49.727028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:49.745822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:49.755633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:49.756111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:49.804405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:49.805106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:49.815157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:49.816344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:49.817109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:49.818191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:49.818814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:49.819399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:50.122342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:50.133649 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a649b95e-8446-4518-9593-08be0efaccb3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1272 microversion: 2.1 time: 0.333000 Nov 03 04:19:50.137687 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2707/5306] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:49 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1272 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:50.438007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1535470722", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "30a3152b-8f6b-43e3-a910-68db2e639cbf"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:50.554671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] validate_networks() for [('30a3152b-8f6b-43e3-a910-68db2e639cbf', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:19:50.858229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:50.870927 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-543dd667-e5dd-46d4-9529-7be10a0d677f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1518 microversion: 2.1 time: 1.166995 Nov 03 04:19:50.873330 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2600/5307] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:49 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1518 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:51.168760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:51.172697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:51.187253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:51.195255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:51.195959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:51.197112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:51.197758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:51.198344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:51.425920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:51.440889 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bf49ccc5-f851-47cc-b1de-4498be75c2f9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1272 microversion: 2.1 time: 0.277937 Nov 03 04:19:51.456070 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2601/5308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:51 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:51.896395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:51.898052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:51.911244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:51.912097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:51.912955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:51.923193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:51.924577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:51.925357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:52.337721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:19:52.338968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:19:52.339623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:19:52.340186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:19:52.340759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:19:52.350948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:52.351497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:52.351858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:52.352576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:52.353073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:52.354103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:52.428773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Getting quotas for project 0c389e0ed09f4ef5929cbedb58ea3b18. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:19:52.441728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Getting quotas for user ac422093d6da4d13ab7bb8b14940d371 and project 0c389e0ed09f4ef5929cbedb58ea3b18. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:19:52.456707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:19:52.460230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:19:52.562038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:52.571896 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8d154e1e-cc70-4262-a322-8876bfc2f816 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1518 microversion: 2.1 time: 0.681284 Nov 03 04:19:52.575678 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2602/5309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:51 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1518 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:52.580285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:52.580901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:52.599455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:52.600040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:52.600483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:52.601412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:52.601873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:52.602473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:52.669647 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ff550f0-cb81-471a-a1e5-689c33942671 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.526693 Nov 03 04:19:52.676482 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2708/5310] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:19:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:19:52.680791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c23dea2a-4388-4c48-a504-56b15cdac7b4 req-2190b425-08d4-407a-a42a-257ffe341a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd", "name": "network-vif-deleted", "tag": "2d68eb90-a44d-465e-8c08-14857c6e1db1"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:52.700980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c23dea2a-4388-4c48-a504-56b15cdac7b4 req-2190b425-08d4-407a-a42a-257ffe341a85 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:52.705761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c23dea2a-4388-4c48-a504-56b15cdac7b4 req-2190b425-08d4-407a-a42a-257ffe341a85 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:52.709888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c23dea2a-4388-4c48-a504-56b15cdac7b4 req-2190b425-08d4-407a-a42a-257ffe341a85 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:52.717436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:52.728018 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c23dea2a-4388-4c48-a504-56b15cdac7b4 req-2190b425-08d4-407a-a42a-257ffe341a85 service nova] Creating event network-vif-deleted:2d68eb90-a44d-465e-8c08-14857c6e1db1 for instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd on n-h2-854653-7 Nov 03 04:19:52.734539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c23dea2a-4388-4c48-a504-56b15cdac7b4 req-2190b425-08d4-407a-a42a-257ffe341a85 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062033 Nov 03 04:19:52.735045 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2709/5311] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:52.740054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-924a8fcd-d864-4db5-b796-6ce48bfe420d tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:52.740771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-924a8fcd-d864-4db5-b796-6ce48bfe420d tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:52.974855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:52.979568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-924a8fcd-d864-4db5-b796-6ce48bfe420d tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:52.987307 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-924a8fcd-d864-4db5-b796-6ce48bfe420d tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1216 microversion: 2.1 time: 0.251089 Nov 03 04:19:52.989289 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6e6006c-74a6-4d00-99c7-649646790a6e tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1272 microversion: 2.1 time: 0.412230 Nov 03 04:19:52.990705 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2710/5312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:52 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1216 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:52.998068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2603/5313] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:52 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1272 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:53.601906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:53.604244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:53.630282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:53.635874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:53.639135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:53.645669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:53.646698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:53.647348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:53.760373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:53.760882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:53.761375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:53.761841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lazy-loading 'fault' on Instance uuid 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:19:53.926336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:53.941928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f0d2845c-dd14-452e-99b9-5e98fc961b6e tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 200 len: 1310 microversion: 2.1 time: 0.344089 Nov 03 04:19:53.943818 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2604/5314] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:53 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 1310 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:54.017485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b65cca8-c8fc-4231-bf62-0d1949c30b15 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:54.018606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0b65cca8-c8fc-4231-bf62-0d1949c30b15 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:54.024610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:54.024610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:54.033034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:54.033758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:54.035122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:54.037442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:54.038086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:54.040154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:54.071927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:54.079680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:54.209241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0b65cca8-c8fc-4231-bf62-0d1949c30b15 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:54.218374 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b65cca8-c8fc-4231-bf62-0d1949c30b15 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1216 microversion: 2.1 time: 0.205191 Nov 03 04:19:54.219242 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2711/5315] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:54 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1216 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:54.359126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:54.369792 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd2dd9d1-280c-4d5f-b77f-abccbd90c534 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 0.353173 Nov 03 04:19:54.370435 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2605/5316] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:54 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:54.972544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:54.973267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:54.985862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:54.986506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:54.987275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:54.988219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:54.988880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:54.989549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.005439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] HTTP exception thrown: Instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd could not be found. Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Request method failure captured: Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd HTTP/1.1 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0EQi6BfL8KNa0jejljTYq5ZLYy3XoGI_Iwkp0tNCMgsGUh95n0ILYI3s_5q1Q7tQ_A6WmfOB1frf8X5aQK2T2A5w_xI9KXZ-zLrxwkIvu87L3slygNFs1rNH6DLN20fHCvR7wrBvLElitWdX-14D4FVqXoJRMjecmqbAb-C9pRUUBE Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 32d3a04c36254e558e1df54a3d85d94c Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/32d3a04c36254e558e1df54a3d85d94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_32d3a04c36254e558e1df54a3d85d94c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/32d3a04c36254e558e1df54a3d85d94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/32d3a04c36254e558e1df54a3d85d94c"}]}] Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 32d3a04c36254e558e1df54a3d85d94c Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ListServerFiltersTestJSON-81842574-project Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 423a17f2f7184a1f99252bb7242393e9 Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ListServerFiltersTestJSON-81842574-project Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd could not be found. Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd'} Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd could not be found. Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd could not be found. Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:19:55.009772 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd could not be found. Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:19:55.014329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Returning 404 to user: Instance 243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:19:55.015444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dbbdb3d8-59aa-4156-87df-4d7b4f4a8041 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd" status: 404 len: 111 microversion: 2.1 time: 0.045650 Nov 03 04:19:55.021690 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2712/5317] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:54 2022] GET /compute/v2.1/servers/243f4ed1-495d-4d29-bc10-4d6bd3cbe8cd => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:19:55.031141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:55.031671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:55.057716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.058494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.058956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.061703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.063932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.064478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.201883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:19:55.245900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:55.246632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:55.256169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.266759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.267534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.268500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.269062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.270522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.510013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:55.529443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d6895cf-7bb6-483e-9b05-db2aa3413391 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1212 microversion: 2.1 time: 0.288098 Nov 03 04:19:55.550514 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2713/5318] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:55 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1212 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:55.567117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:55.574172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:55.596236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.600817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.604749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.604749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.604749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.604749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.686066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7a90082d-5a2c-4aee-81db-4ad7945db680 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 204 len: 0 microversion: 2.1 time: 0.662331 Nov 03 04:19:55.686919 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2606/5319] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:19:55 2022] DELETE /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:19:55.699224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:55.701151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:55.721619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.737741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.738228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.738986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:55.751775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:55.752499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:55.860999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:55.878494 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e56a6ac7-b06e-43c0-889a-f776956e6ba1 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 0.326627 Nov 03 04:19:55.889535 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2714/5320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:55 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:56.164235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7fb926b6-66ed-47d1-8f8e-81ad6275248c req-9fecce3e-b0aa-444e-a137-9a18ae8e7bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b02fbac-d03a-4a30-81ce-7a36a84f4d88", "tag": "481d5a72-3424-478c-a834-ce8e85243b1c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:56.184991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7fb926b6-66ed-47d1-8f8e-81ad6275248c req-9fecce3e-b0aa-444e-a137-9a18ae8e7bed service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:56.186943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7fb926b6-66ed-47d1-8f8e-81ad6275248c req-9fecce3e-b0aa-444e-a137-9a18ae8e7bed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:56.190302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7fb926b6-66ed-47d1-8f8e-81ad6275248c req-9fecce3e-b0aa-444e-a137-9a18ae8e7bed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:56.217504 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7fb926b6-66ed-47d1-8f8e-81ad6275248c req-9fecce3e-b0aa-444e-a137-9a18ae8e7bed service nova] Creating event network-changed:481d5a72-3424-478c-a834-ce8e85243b1c for instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 on n-h1-854653-7 Nov 03 04:19:56.260888 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7fb926b6-66ed-47d1-8f8e-81ad6275248c req-9fecce3e-b0aa-444e-a137-9a18ae8e7bed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100526 Nov 03 04:19:56.263412 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2715/5321] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:19:56.527091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:56.544377 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1e4b4288-e410-4e91-b3bc-2b847672e348 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 200 len: 1518 microversion: 2.1 time: 0.853142 Nov 03 04:19:56.545811 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2607/5322] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:55 2022] GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 1518 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:19:56.564845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:56.583017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:56.610844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:56.612303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:56.613051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:56.615243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:56.615653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:56.616100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:56.661657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:56.662300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:56.676723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:56.680282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:56.680282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:56.680282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:56.685653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:56.686945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:56.687873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:56.795150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a43c9fe-8fa1-410e-9004-5abb70d0a7a5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/ips" status: 200 len: 151 microversion: 2.20 time: 0.137566 Nov 03 04:19:56.795829 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2608/5323] 10.222.0.30 () {60 vars in 1289 bytes} [Thu Nov 3 04:19:56 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/ips => generated 151 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:19:56.932858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:56.934085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:57.013003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:57.013533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:57.013985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:57.019217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:57.019708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:57.038488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:57.041408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:57.063975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75c24144-8a08-4c5a-b38b-bbc20bca9294 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1268 microversion: 2.1 time: 0.503655 Nov 03 04:19:57.073251 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2716/5324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:56 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1268 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:57.194705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:19:57.574726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:57.576164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:57.591821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:57.594526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:57.595012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:57.595707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:57.596176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:57.596609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:58.423297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:58.433125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-999b33a2-996e-48be-960a-f597099a5c48 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 1.515263 Nov 03 04:19:58.434298 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2609/5325] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:56 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:58.439408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:58.440283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:58.485693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:58.486740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:58.487382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:58.504176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:58.505944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:58.511397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:58.763064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:58.783846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2b6d7ab3-ae41-4022-9674-1130fb50d515 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 200 len: 1518 microversion: 2.1 time: 1.212976 Nov 03 04:19:58.784807 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2717/5326] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:57 2022] GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 1518 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:58.803703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:58.816329 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a38e6afd-d8da-4ee3-99dd-a6c5e4513752 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1286 microversion: 2.1 time: 0.380543 Nov 03 04:19:58.816994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2610/5327] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:58 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1286 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:59.037881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cf7a30f6-5f2e-4cc9-a36d-6d18dd35c2c8 req-217a175b-a7bc-4658-9807-a5e6a2a52db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cce72e8-a2c8-4be3-80d6-a91c3801eb88", "name": "network-vif-deleted", "tag": "cb738359-24c1-4c1d-b81b-74f0ad39a0e9"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:19:59.063846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cf7a30f6-5f2e-4cc9-a36d-6d18dd35c2c8 req-217a175b-a7bc-4658-9807-a5e6a2a52db5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:59.064540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cf7a30f6-5f2e-4cc9-a36d-6d18dd35c2c8 req-217a175b-a7bc-4658-9807-a5e6a2a52db5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:59.065112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cf7a30f6-5f2e-4cc9-a36d-6d18dd35c2c8 req-217a175b-a7bc-4658-9807-a5e6a2a52db5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:59.091179 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cf7a30f6-5f2e-4cc9-a36d-6d18dd35c2c8 req-217a175b-a7bc-4658-9807-a5e6a2a52db5 service nova] Creating event network-vif-deleted:cb738359-24c1-4c1d-b81b-74f0ad39a0e9 for instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 on n-h2-854653-7 Nov 03 04:19:59.106089 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cf7a30f6-5f2e-4cc9-a36d-6d18dd35c2c8 req-217a175b-a7bc-4658-9807-a5e6a2a52db5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071812 Nov 03 04:19:59.107380 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2718/5328] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:19:59.458800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:59.460234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:59.471798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:59.479737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:59.480670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:59.481690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:59.482379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:59.483053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:59.819952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:59.823258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:19:59.832535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:59.833655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:59.834328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:59.835436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:59.836164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:59.836819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:59.924739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:19:59.927887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:19:59.928682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:19:59.934727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:19:59.944377 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa392252-2f08-4f91-9861-be2fb5e4f628 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 0.490286 Nov 03 04:19:59.947981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lazy-loading 'fault' on Instance uuid 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:19:59.982325 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2611/5329] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:59 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:19:59.995943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:19:59.997125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:00.011362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:00.011906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:00.013388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:00.014194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:00.017040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:00.017797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:00.468554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:00.489840 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-053fea07-db0e-48ed-83d0-2df27295432a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 200 len: 1311 microversion: 2.1 time: 0.674715 Nov 03 04:20:00.490491 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2719/5330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:59 2022] GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 1311 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:00.534711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:00.557735 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20741272-9ee6-491f-bf2e-4f8a9b07a45b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1274 microversion: 2.1 time: 0.572511 Nov 03 04:20:00.560257 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2612/5331] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:19:59 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1274 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:00.979682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:00.982044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:01.036478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.042166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.045696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.046691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.049416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.057708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.074024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:01.074760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:01.088828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.097438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.098405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.101286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.101897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.113793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.183949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lazy-loading 'flavor' on Instance uuid ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:20:01.737106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:01.748799 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ec4126b-82b3-415e-a1a6-0e8d14bce006 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 0.773949 Nov 03 04:20:01.749779 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2720/5332] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:00 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:01.780331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:01.783981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 6cce72e8-a2c8-4be3-80d6-a91c3801eb88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:01.818639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.820211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.820847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.824235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.825612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.827962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.857512 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] HTTP exception thrown: Instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 could not be found. Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Request method failure captured: Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 HTTP/1.1 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0EQi6BfL8KNa0jejljTYq5ZLYy3XoGI_Iwkp0tNCMgsGUh95n0ILYI3s_5q1Q7tQ_A6WmfOB1frf8X5aQK2T2A5w_xI9KXZ-zLrxwkIvu87L3slygNFs1rNH6DLN20fHCvR7wrBvLElitWdX-14D4FVqXoJRMjecmqbAb-C9pRUUBE Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 32d3a04c36254e558e1df54a3d85d94c Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/32d3a04c36254e558e1df54a3d85d94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_32d3a04c36254e558e1df54a3d85d94c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/32d3a04c36254e558e1df54a3d85d94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/32d3a04c36254e558e1df54a3d85d94c"}]}] Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 32d3a04c36254e558e1df54a3d85d94c Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ListServerFiltersTestJSON-81842574-project Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 423a17f2f7184a1f99252bb7242393e9 Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ListServerFiltersTestJSON-81842574-project Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 could not be found. Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '6cce72e8-a2c8-4be3-80d6-a91c3801eb88'} Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 could not be found. Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 could not be found. Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:01.859512 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 could not be found. Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Returning 404 to user: Instance 6cce72e8-a2c8-4be3-80d6-a91c3801eb88 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60862946-8341-423f-afc8-8ce59f77d398 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88" status: 404 len: 111 microversion: 2.1 time: 0.108715 Nov 03 04:20:01.863792 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2721/5333] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:01 2022] GET /compute/v2.1/servers/6cce72e8-a2c8-4be3-80d6-a91c3801eb88 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:01.868043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:01.873250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:01.883739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.887545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.889730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.892381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:01.892381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:01.892381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:01.956023 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40539628-0e20-48e1-a580-b67998cacbe5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/action" status: 202 len: 0 microversion: 2.20 time: 0.886356 Nov 03 04:20:01.961873 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2613/5334] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:20:01 2022] POST /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/action => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:20:01.987584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:01.988910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:02.016427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:02.028694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:02.029202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:02.029953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:02.030417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:02.030844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:02.111550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:20:02.262425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:02.288426 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bb713c8-c09d-450a-8acd-c3fa0c8fb764 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1316 microversion: 2.1 time: 0.425182 Nov 03 04:20:02.289821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2722/5335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:01 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:02.295780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:02.296632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:02.303600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:02.304390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:02.305150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:02.306177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:02.307575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:02.308232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:02.364536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:02.500503 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ca71d12-147d-4d41-9c12-ecd117fe4c7a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "DELETE /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 204 len: 0 microversion: 2.1 time: 0.526782 Nov 03 04:20:02.501390 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2614/5336] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:20:01 2022] DELETE /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:20:02.524162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:02.525735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:02.538638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:02.539546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:02.542656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:02.543583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:02.549347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:02.551103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:03.239966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:03.248644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:03.250145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:03.251339 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23f6afd3-6631-4128-9aad-4e4938431f27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.959839 Nov 03 04:20:03.263376 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2723/5337] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:02 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:03.263376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:03.273354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:03.284244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:03.284812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:03.285304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:03.297674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:03.298187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:03.298648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:03.565567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:03.576775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5814f141-3828-4dad-991c-d185b0c2b08a tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1518 microversion: 2.1 time: 1.058854 Nov 03 04:20:03.578563 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2615/5338] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:02 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1518 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:03.590024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e68fb27a-cbb3-4760-ae9c-8a0799841e28 req-8f31e1e8-6d13-43a3-a098-54414f863e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f7e7936-d980-42d1-a3e2-37a930ee5a56", "tag": "2e1d1b97-f6cd-4283-91c8-a337867bb0d1"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:03.611423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e68fb27a-cbb3-4760-ae9c-8a0799841e28 req-8f31e1e8-6d13-43a3-a098-54414f863e65 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:03.611919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e68fb27a-cbb3-4760-ae9c-8a0799841e28 req-8f31e1e8-6d13-43a3-a098-54414f863e65 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:03.612361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e68fb27a-cbb3-4760-ae9c-8a0799841e28 req-8f31e1e8-6d13-43a3-a098-54414f863e65 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:03.642303 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e68fb27a-cbb3-4760-ae9c-8a0799841e28 req-8f31e1e8-6d13-43a3-a098-54414f863e65 service nova] Creating event network-changed:2e1d1b97-f6cd-4283-91c8-a337867bb0d1 for instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 on n-h2-854653-7 Nov 03 04:20:03.651893 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e68fb27a-cbb3-4760-ae9c-8a0799841e28 req-8f31e1e8-6d13-43a3-a098-54414f863e65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069633 Nov 03 04:20:03.653157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2616/5339] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:03.662852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:03.666790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:03.677889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:03.685895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:03.685895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:03.685895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:03.685895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:03.685895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:03.905878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:03.914775 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0f26e840-7c41-4c70-bb54-2f63b739467a tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 0.656772 Nov 03 04:20:03.918479 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2724/5340] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:03 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:04.160606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:04.164578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:04.172693 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6753e472-2181-405b-b61e-29ed0c8693bb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1316 microversion: 2.1 time: 0.518049 Nov 03 04:20:04.180019 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2617/5341] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:03 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:04.283741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:04.285287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:04.290596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=20 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:04.299230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:04.300053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:04.300871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:04.301931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:04.302902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:04.303556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:04.627488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:04.630217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:04.661410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:04.662048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:04.663129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:04.664801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:04.667464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:04.669615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:04.848039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:04.853859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:04.861118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:04.862534 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9cc4b28-b626-4f09-8483-d1343166b124 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.584351 Nov 03 04:20:04.865850 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2725/5342] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:04 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:04.941009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:04.941663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:04.960422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:04.960933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:04.961454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:04.962216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:04.962679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:04.965456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:05.001897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:05.011318 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c113e872-90aa-4f31-b4e4-8e9bd659837c tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1518 microversion: 2.1 time: 0.403572 Nov 03 04:20:05.021554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2618/5343] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:04 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1518 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:05.196342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:05.197309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:05.210200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:05.213793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:05.214497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:05.216226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:05.216884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:05.217540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:05.489438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:05.501299 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18258988-271a-407c-9963-413a0d9d1483 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 0.562874 Nov 03 04:20:05.517705 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2726/5344] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:04 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:05.678165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:05.691514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3fc34064-90bf-496e-97c4-4869f632b3fb tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1316 microversion: 2.1 time: 0.499512 Nov 03 04:20:05.698267 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2619/5345] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:05 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:05.802443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7ce24f78-ac2e-4ef9-87e4-2a1a56aecf86 req-b22d7182-3a29-4c80-8aa7-69aa9e09fe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b02fbac-d03a-4a30-81ce-7a36a84f4d88", "name": "network-vif-plugged", "status": "completed", "tag": "481d5a72-3424-478c-a834-ce8e85243b1c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:05.809908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:05.821282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7ce24f78-ac2e-4ef9-87e4-2a1a56aecf86 req-b22d7182-3a29-4c80-8aa7-69aa9e09fe83 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:05.822317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7ce24f78-ac2e-4ef9-87e4-2a1a56aecf86 req-b22d7182-3a29-4c80-8aa7-69aa9e09fe83 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:05.827567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7ce24f78-ac2e-4ef9-87e4-2a1a56aecf86 req-b22d7182-3a29-4c80-8aa7-69aa9e09fe83 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:05.834811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7ce24f78-ac2e-4ef9-87e4-2a1a56aecf86 req-b22d7182-3a29-4c80-8aa7-69aa9e09fe83 service nova] Creating event network-vif-plugged:481d5a72-3424-478c-a834-ce8e85243b1c for instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 on n-h1-854653-7 Nov 03 04:20:05.840499 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7ce24f78-ac2e-4ef9-87e4-2a1a56aecf86 req-b22d7182-3a29-4c80-8aa7-69aa9e09fe83 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043908 Nov 03 04:20:05.841178 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2727/5346] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:05.901967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:05.902984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:05.913532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:05.916793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:05.918335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:05.919326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:05.919933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:05.921369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:06.047421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:06.048605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:06.054774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:06.055577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:06.056251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:06.058383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:06.059036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:06.059694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:06.194660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:06.206259 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1a824f2-3481-48d2-bcbe-8c82a6dcdb21 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1476 microversion: 2.1 time: 0.163088 Nov 03 04:20:06.207887 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2728/5347] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:06 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:06.213288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-510dd734-6c2e-41b4-8e41-479615ac31d6 req-b90d3a26-4a3d-4346-b4c3-c2832bcf1644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b5cf5c-4513-4774-9e62-4e3b325f943f", "name": "network-vif-deleted", "tag": "2f991e9f-8437-42f3-ae00-76e68d352cb5"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:06.230356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-510dd734-6c2e-41b4-8e41-479615ac31d6 req-b90d3a26-4a3d-4346-b4c3-c2832bcf1644 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:06.230835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-510dd734-6c2e-41b4-8e41-479615ac31d6 req-b90d3a26-4a3d-4346-b4c3-c2832bcf1644 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:06.231464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-510dd734-6c2e-41b4-8e41-479615ac31d6 req-b90d3a26-4a3d-4346-b4c3-c2832bcf1644 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:06.242950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-510dd734-6c2e-41b4-8e41-479615ac31d6 req-b90d3a26-4a3d-4346-b4c3-c2832bcf1644 service nova] Creating event network-vif-deleted:2f991e9f-8437-42f3-ae00-76e68d352cb5 for instance 48b5cf5c-4513-4774-9e62-4e3b325f943f on n-h1-854653-7 Nov 03 04:20:06.248521 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-510dd734-6c2e-41b4-8e41-479615ac31d6 req-b90d3a26-4a3d-4346-b4c3-c2832bcf1644 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039156 Nov 03 04:20:06.249154 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2729/5348] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:06.281640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:06.299210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:06.308864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:06.315163 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-572be21b-b6f6-478e-adb2-8ee77adad92f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.417707 Nov 03 04:20:06.315998 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2620/5349] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:05 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:06.531282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:06.532153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:06.539835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:06.540480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:06.540988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:06.542930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:06.543769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:06.544284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:06.720724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:06.723051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:06.741614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:06.741614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:06.741614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:06.741614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:06.764178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:06.764969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:07.379169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:07.396535 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-46f8b648-caef-4d9d-958a-087e04372f59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1314 microversion: 2.1 time: 0.871305 Nov 03 04:20:07.398773 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2730/5350] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:06 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1314 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:07.404310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:07.404934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:07.414113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:07.414648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:07.423895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:07.423895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:07.423895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:07.423895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:07.469516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:07.470104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:07.470604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:07.471068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lazy-loading 'fault' on Instance uuid 48b5cf5c-4513-4774-9e62-4e3b325f943f {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:20:07.473545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:07.481680 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e061a7f-257e-4fcd-b364-96cc2ebfd19b tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1316 microversion: 2.1 time: 0.766146 Nov 03 04:20:07.482296 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2621/5351] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:06 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1316 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:07.487192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:07.490020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:07.525938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:07.532668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:07.539196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:07.539978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:07.540507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:07.540955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:07.696219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '423a17f2f7184a1f99252bb7242393e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32d3a04c36254e558e1df54a3d85d94c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:07.701921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:07.718583 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d428c2e9-6f66-4666-80ec-99608df8a03f tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 200 len: 1311 microversion: 2.1 time: 0.310729 Nov 03 04:20:07.718583 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2731/5352] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:07 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 1311 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:07.804590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:07.813417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:07.814854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:07.816053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff5eaa4e-1aee-4f95-bfa7-7b7bdaba2a16 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.332814 Nov 03 04:20:07.816567 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2622/5353] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:07 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:07.878828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1c1f7a86-c717-4a14-9a83-4afff23a5265 req-4a095a4d-2ce6-49f7-932f-bdf4ad21af15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7e7936-d980-42d1-a3e2-37a930ee5a56", "name": "network-vif-plugged", "status": "completed", "tag": "2e1d1b97-f6cd-4283-91c8-a337867bb0d1"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:07.890057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1c1f7a86-c717-4a14-9a83-4afff23a5265 req-4a095a4d-2ce6-49f7-932f-bdf4ad21af15 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:07.895528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1c1f7a86-c717-4a14-9a83-4afff23a5265 req-4a095a4d-2ce6-49f7-932f-bdf4ad21af15 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:07.895528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1c1f7a86-c717-4a14-9a83-4afff23a5265 req-4a095a4d-2ce6-49f7-932f-bdf4ad21af15 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:07.905318 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1c1f7a86-c717-4a14-9a83-4afff23a5265 req-4a095a4d-2ce6-49f7-932f-bdf4ad21af15 service nova] Creating event network-vif-plugged:2e1d1b97-f6cd-4283-91c8-a337867bb0d1 for instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 on n-h2-854653-7 Nov 03 04:20:07.910442 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1c1f7a86-c717-4a14-9a83-4afff23a5265 req-4a095a4d-2ce6-49f7-932f-bdf4ad21af15 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036236 Nov 03 04:20:07.911118 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2732/5354] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:20:08.424920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:08.425765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:08.433262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.433983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.434752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:08.435652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.436276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.436866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:08.513279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:08.514805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:08.522210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.523049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.523709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:08.525995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.526683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.527343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:08.828539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:08.836438 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6bed794-bf7e-4328-802b-5cc6acc2ace8 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1499 microversion: 2.1 time: 0.416742 Nov 03 04:20:08.853169 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2623/5355] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:08 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1499 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:08.855909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:08.856538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] [instance: 48b5cf5c-4513-4774-9e62-4e3b325f943f] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:08.866542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.866542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.866542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:08.867245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.867690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.868115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:08.891271 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] HTTP exception thrown: Instance 48b5cf5c-4513-4774-9e62-4e3b325f943f could not be found. Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Request method failure captured: Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f HTTP/1.1 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0EQi6BfL8KNa0jejljTYq5ZLYy3XoGI_Iwkp0tNCMgsGUh95n0ILYI3s_5q1Q7tQ_A6WmfOB1frf8X5aQK2T2A5w_xI9KXZ-zLrxwkIvu87L3slygNFs1rNH6DLN20fHCvR7wrBvLElitWdX-14D4FVqXoJRMjecmqbAb-C9pRUUBE Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 32d3a04c36254e558e1df54a3d85d94c Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/32d3a04c36254e558e1df54a3d85d94c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_32d3a04c36254e558e1df54a3d85d94c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/32d3a04c36254e558e1df54a3d85d94c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/32d3a04c36254e558e1df54a3d85d94c"}]}] Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 32d3a04c36254e558e1df54a3d85d94c Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-81842574 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ListServerFiltersTestJSON-81842574-project Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 423a17f2f7184a1f99252bb7242393e9 Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ListServerFiltersTestJSON-81842574-project Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 48b5cf5c-4513-4774-9e62-4e3b325f943f could not be found. Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '48b5cf5c-4513-4774-9e62-4e3b325f943f'} Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b5cf5c-4513-4774-9e62-4e3b325f943f could not be found. Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b5cf5c-4513-4774-9e62-4e3b325f943f could not be found. Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:08.896835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:08.901821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:08.901821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:08.901821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:08.901821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:08.901821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:08.901821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b5cf5c-4513-4774-9e62-4e3b325f943f could not be found. Nov 03 04:20:08.901821 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:08.906302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:08.906830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] Returning 404 to user: Instance 48b5cf5c-4513-4774-9e62-4e3b325f943f could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:08.907308 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37b6475d-4899-4cb5-a5b4-3f564de88bf8 tempest-ListServerFiltersTestJSON-81842574 tempest-ListServerFiltersTestJSON-81842574-project] 10.222.0.30 "GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f" status: 404 len: 111 microversion: 2.1 time: 0.055898 Nov 03 04:20:08.924853 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2624/5356] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:08 2022] GET /compute/v2.1/servers/48b5cf5c-4513-4774-9e62-4e3b325f943f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:08.928167 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6399693c-f7f6-46ce-8915-466278925a47 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1316 microversion: 2.1 time: 0.420497 Nov 03 04:20:08.956627 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2733/5357] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:08 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:08.960647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:08.964058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:08.968506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.968994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.969658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:08.970576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:08.971044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:08.971818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:09.291869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:09.300681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:09.307355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:09.314260 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57112a7f-6e35-4280-82b8-3d7dd37a5af5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.387622 Nov 03 04:20:09.315303 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2625/5358] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:08 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:09.954742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:09.955386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:09.967559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:09.968050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:09.968526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:09.969322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:09.969783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:09.970209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.158185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:10.159333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:10.168081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.168584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.169213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.169748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.172350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.173623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.209633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:20:10.329966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:10.345469 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42aae570-542e-41cd-895c-a3fc58692e10 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1503 microversion: 2.1 time: 0.394821 Nov 03 04:20:10.378020 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2734/5359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:09 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:10.385922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:10.386697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:10.394138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.410112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.410112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.410112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.410112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.410112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.782224 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20e15287-1ec5-4bb3-bfdf-e4f916a78440 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 204 len: 0 microversion: 2.1 time: 0.625831 Nov 03 04:20:10.782224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2626/5360] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:20:10 2022] DELETE /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:20:10.793000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:10.794673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:10.809313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:10.809526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.809947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.813251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.816614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.816614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.816614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.820722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:10.824965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:10.826343 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1cfd5a6d-ec80-4cca-9b49-7d225d1e0d0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.446903 Nov 03 04:20:10.830603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2735/5361] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:10 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:10.841871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:10.842793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:10.855409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.861364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.862003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.863094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:10.863673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:10.864311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:10.883973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:20:11.303745 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10212c56-e0a3-45ec-be15-4915b50d8b94 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 204 len: 0 microversion: 2.1 time: 0.519694 Nov 03 04:20:11.308592 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2627/5362] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:20:10 2022] DELETE /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:20:11.320010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:11.322876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:11.341190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:11.341709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:11.342165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:11.342886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:11.343347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:11.343614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:11.346065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:11.354877 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36d3cbec-a9a6-4549-b1b3-086a47ad7681 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1505 microversion: 2.1 time: 0.523076 Nov 03 04:20:11.355686 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2736/5363] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:10 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:11.860983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:11.861911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:11.868418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:11.869144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:11.870345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:11.871166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:11.871731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:11.872458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:12.004844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:12.018477 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14b8cefe-444d-4b41-8734-c718e489f06c tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1509 microversion: 2.1 time: 0.703968 Nov 03 04:20:12.021487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2628/5364] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:11 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1509 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:12.122785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:12.142694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:12.149920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:12.156366 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ff5de88a-765c-48fe-b436-0fce1d426424 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.300176 Nov 03 04:20:12.167397 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2737/5365] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:11 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:20:12.380219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:12.380849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:12.389869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:12.393428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:12.393909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:12.394648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:12.396604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:12.397091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:12.951276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:12.977308 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-58ed92c1-5cc6-49c2-8d44-c239ca5e1ffd tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1505 microversion: 2.1 time: 0.596067 Nov 03 04:20:12.980768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2629/5366] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:12 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:13.061650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:13.062817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:13.096729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:13.098276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:13.111598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:13.115396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:13.115908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:13.118926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:13.187611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:13.189428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:13.198862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:13.201655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:13.202288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:13.209127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:13.209127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:13.209127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:13.705168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:13.744120 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e01d0bb-ffa4-4a14-a310-8e89a1b40ef8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1509 microversion: 2.1 time: 0.686621 Nov 03 04:20:13.744120 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2738/5367] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:13 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1509 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:13.768974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e40dd7c5-d2ac-4ce4-b539-617cf79cbe53 req-12bae4d0-66fb-404e-a452-03b993c8ac88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b02fbac-d03a-4a30-81ce-7a36a84f4d88", "name": "network-vif-deleted", "tag": "481d5a72-3424-478c-a834-ce8e85243b1c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:13.800107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e40dd7c5-d2ac-4ce4-b539-617cf79cbe53 req-12bae4d0-66fb-404e-a452-03b993c8ac88 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:13.802277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e40dd7c5-d2ac-4ce4-b539-617cf79cbe53 req-12bae4d0-66fb-404e-a452-03b993c8ac88 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:13.802875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e40dd7c5-d2ac-4ce4-b539-617cf79cbe53 req-12bae4d0-66fb-404e-a452-03b993c8ac88 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:13.829331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:13.836779 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e40dd7c5-d2ac-4ce4-b539-617cf79cbe53 req-12bae4d0-66fb-404e-a452-03b993c8ac88 service nova] Creating event network-vif-deleted:481d5a72-3424-478c-a834-ce8e85243b1c for instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 on n-h1-854653-7 Nov 03 04:20:13.844036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:13.846696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:13.856070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e40dd7c5-d2ac-4ce4-b539-617cf79cbe53 req-12bae4d0-66fb-404e-a452-03b993c8ac88 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105480 Nov 03 04:20:13.859164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2739/5368] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:13.860200 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee1fb67c-a293-4f1e-88a9-0ebdba8abd13 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.677088 Nov 03 04:20:13.860801 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2630/5369] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:13 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:20:14.012532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:14.013473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:14.033471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.054146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.071034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.076905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.078094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.086563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.220621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.223803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.224283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.228156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lazy-loading 'fault' on Instance uuid 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:20:14.348002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:14.355683 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0493a526-4928-453f-86fc-4ec87e22f9b5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 200 len: 1304 microversion: 2.1 time: 0.353498 Nov 03 04:20:14.362049 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2740/5370] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:14 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 1304 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:14.364561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9e7181e3-76bd-4fed-b24b-9a3ad68d99fe req-f41dd19f-8547-4c69-ba8d-b9687123c6cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f7e7936-d980-42d1-a3e2-37a930ee5a56", "name": "network-vif-deleted", "tag": "2e1d1b97-f6cd-4283-91c8-a337867bb0d1"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:14.387505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e7181e3-76bd-4fed-b24b-9a3ad68d99fe req-f41dd19f-8547-4c69-ba8d-b9687123c6cb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.387847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e7181e3-76bd-4fed-b24b-9a3ad68d99fe req-f41dd19f-8547-4c69-ba8d-b9687123c6cb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.388294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e7181e3-76bd-4fed-b24b-9a3ad68d99fe req-f41dd19f-8547-4c69-ba8d-b9687123c6cb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.424744 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9e7181e3-76bd-4fed-b24b-9a3ad68d99fe req-f41dd19f-8547-4c69-ba8d-b9687123c6cb service nova] Creating event network-vif-deleted:2e1d1b97-f6cd-4283-91c8-a337867bb0d1 for instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 on n-h2-854653-7 Nov 03 04:20:14.435063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9e7181e3-76bd-4fed-b24b-9a3ad68d99fe req-f41dd19f-8547-4c69-ba8d-b9687123c6cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074963 Nov 03 04:20:14.436554 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2631/5371] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:20:14.764743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:14.765419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:14.771577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.772068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.772504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.773428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.773884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.774371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.813573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.814268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.814985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.826344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lazy-loading 'fault' on Instance uuid 8f7e7936-d980-42d1-a3e2-37a930ee5a56 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:20:14.896072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:14.897692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:14.904800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac422093d6da4d13ab7bb8b14940d371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c389e0ed09f4ef5929cbedb58ea3b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:14.911838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.912734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.916112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.917193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:14.918039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:14.919138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:14.926205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bfb2362-2051-4930-9fa1-028ef07ceaef tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 200 len: 1306 microversion: 2.1 time: 0.157549 Nov 03 04:20:14.928730 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2741/5372] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:14 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 1306 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:15.016882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:15.249214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:15.264033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:15.265895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:15.274007 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-819f3445-43eb-41a6-9203-afcb9eeae73c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.385530 Nov 03 04:20:15.284149 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2632/5373] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:14 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:15.390227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:15.391008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: 1b02fbac-d03a-4a30-81ce-7a36a84f4d88] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:15.407938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:15.408734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:15.410342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:15.411895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:15.414066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:15.415510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:15.435317 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] HTTP exception thrown: Instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 could not be found. Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Request method failure captured: Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 HTTP/1.1 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0FbA6s8QgN_bSTvlRXgY_BwRkPlsI7DiVDs6mMm5jvPdNl-Dkic4tuu4cMc14ojUBJL0QASk-M83zdca8SvOKo0zA9bRSmnFLGm12gkdzYOdVoY6Nj-qcnRV1vZdb0fldbeJCXp1OGFaYTAuvKIpRtRkHu7veYam4Zfx581-uPPdZI Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 09a3843a61274e25a32a4b4831e2e720 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesActionsTest-1034706508 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/09a3843a61274e25a32a4b4831e2e720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_09a3843a61274e25a32a4b4831e2e720", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/09a3843a61274e25a32a4b4831e2e720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/09a3843a61274e25a32a4b4831e2e720"}]}] Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesActionsTest-1034706508 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 09a3843a61274e25a32a4b4831e2e720 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesActionsTest-1034706508 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesActionsTest-1034706508-project Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fb267ab994fa4bf787afd128fb084e35 Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesActionsTest-1034706508-project Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 could not be found. Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '1b02fbac-d03a-4a30-81ce-7a36a84f4d88'} Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 could not be found. Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 could not be found. Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:15.437409 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:15.441184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:15.441184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:15.441184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:15.441184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:15.441184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:15.441184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 could not be found. Nov 03 04:20:15.441184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:15.442971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Returning 404 to user: Instance 1b02fbac-d03a-4a30-81ce-7a36a84f4d88 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:15.444072 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96939acd-d74d-4a0a-9602-6815fffccd2c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88" status: 404 len: 111 microversion: 2.1 time: 0.059353 Nov 03 04:20:15.461810 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2742/5374] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:15 2022] GET /compute/v2.1/servers/1b02fbac-d03a-4a30-81ce-7a36a84f4d88 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:15.573890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1732503590", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "8a875d70-f302-4961-9b3a-2146d99808aa"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:15.650256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] validate_networks() for [('8a875d70-f302-4961-9b3a-2146d99808aa', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:20:15.952852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:15.953617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:15.963092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:15.967274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:15.967947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:15.969221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:15.970294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:15.973639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.004623 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] HTTP exception thrown: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Request method failure captured: Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 HTTP/1.1 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Flxpb0luIKLCWUoIGjfBZtdQ2pEB3RmGENlePQe9PtbOvf8e9U7W45NGN2heDfoektsZNPr6zhILd6hu2ODgaoZNX6btQcbbH92GqPuVAup6KK9e1D9uczA0ymU2xbm6V_2_Vnp2KlJbYPsntrHQv4qlc8TuoX8QBF6llZxF8Q36s Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c389e0ed09f4ef5929cbedb58ea3b18", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c389e0ed09f4ef5929cbedb58ea3b18"}]}] Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac422093d6da4d13ab7bb8b14940d371 Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8f7e7936-d980-42d1-a3e2-37a930ee5a56'} Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.006500 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.017637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.017637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.017637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.017637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:16.017637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:16.017637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.017637 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.020254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Returning 404 to user: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:16.021349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f1f9f7d-df5a-4c93-8323-0fa837f5dd4f tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 404 len: 111 microversion: 2.1 time: 0.072392 Nov 03 04:20:16.025264 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2743/5375] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:15 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:20:16.033328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1265530494", "metadata": {"image_type": "test"}}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:16.039787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:16.053860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.054367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.054817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.059812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.060314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.060776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.088912 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] HTTP exception thrown: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Request method failure captured: Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56/action HTTP/1.1 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 112 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Flxpb0luIKLCWUoIGjfBZtdQ2pEB3RmGENlePQe9PtbOvf8e9U7W45NGN2heDfoektsZNPr6zhILd6hu2ODgaoZNX6btQcbbH92GqPuVAup6KK9e1D9uczA0ymU2xbm6V_2_Vnp2KlJbYPsntrHQv4qlc8TuoX8QBF6llZxF8Q36s Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c389e0ed09f4ef5929cbedb58ea3b18", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c389e0ed09f4ef5929cbedb58ea3b18"}]}] Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac422093d6da4d13ab7bb8b14940d371 Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1265530494", "metadata": {"image_type": "test"}}} Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8f7e7936-d980-42d1-a3e2-37a930ee5a56', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1265530494', 'metadata': {'image_type': 'test'}}}} Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:20:16.091616 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Returning 404 to user: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:16.095686 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30cf3b19-0140-408f-a3cd-4177b0c1f948 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "POST /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56/action" status: 404 len: 111 microversion: 2.1 time: 0.066604 Nov 03 04:20:16.103612 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2744/5376] 10.222.0.30 () {60 vars in 1279 bytes} [Thu Nov 3 04:20:16 2022] POST /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:16.113673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf9d7b27-204a-4075-a0bb-a247d4186be8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-751112726", "metadata": {"image_type": "test"}}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:16.119044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf9d7b27-204a-4075-a0bb-a247d4186be8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Failed to fetch instance by id tempest-invalid-1883513516 {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 03 04:20:16.119613 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-cf9d7b27-204a-4075-a0bb-a247d4186be8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] HTTP exception thrown: Instance tempest-invalid-1883513516 could not be found. Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf9d7b27-204a-4075-a0bb-a247d4186be8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Request method failure captured: Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/tempest-invalid-1883513516/action HTTP/1.1 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 111 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Flxpb0luIKLCWUoIGjfBZtdQ2pEB3RmGENlePQe9PtbOvf8e9U7W45NGN2heDfoektsZNPr6zhILd6hu2ODgaoZNX6btQcbbH92GqPuVAup6KK9e1D9uczA0ymU2xbm6V_2_Vnp2KlJbYPsntrHQv4qlc8TuoX8QBF6llZxF8Q36s Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c389e0ed09f4ef5929cbedb58ea3b18", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c389e0ed09f4ef5929cbedb58ea3b18"}]}] Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac422093d6da4d13ab7bb8b14940d371 Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-751112726", "metadata": {"image_type": "test"}}} Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance tempest-invalid-1883513516 could not be found. Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'tempest-invalid-1883513516', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-751112726', 'metadata': {'image_type': 'test'}}}} Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1883513516 could not be found. Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:16.121237 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1883513516 could not be found. Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1883513516 could not be found. Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.124979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf9d7b27-204a-4075-a0bb-a247d4186be8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Returning 404 to user: Instance tempest-invalid-1883513516 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:16.136604 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf9d7b27-204a-4075-a0bb-a247d4186be8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "POST /compute/v2.1/servers/tempest-invalid-1883513516/action" status: 404 len: 101 microversion: 2.1 time: 0.017819 Nov 03 04:20:16.139107 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2745/5377] 10.222.0.30 () {60 vars in 1249 bytes} [Thu Nov 3 04:20:16 2022] POST /compute/v2.1/servers/tempest-invalid-1883513516/action => generated 101 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:16.157085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-938ea80c-69e1-4c9e-9401-86d31d771a76 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-979163868"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:16.161069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-938ea80c-69e1-4c9e-9401-86d31d771a76 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 03 04:20:16.161847 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-938ea80c-69e1-4c9e-9401-86d31d771a76 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-938ea80c-69e1-4c9e-9401-86d31d771a76 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Request method failure captured: Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 56 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Flxpb0luIKLCWUoIGjfBZtdQ2pEB3RmGENlePQe9PtbOvf8e9U7W45NGN2heDfoektsZNPr6zhILd6hu2ODgaoZNX6btQcbbH92GqPuVAup6KK9e1D9uczA0ymU2xbm6V_2_Vnp2KlJbYPsntrHQv4qlc8TuoX8QBF6llZxF8Q36s Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c389e0ed09f4ef5929cbedb58ea3b18", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c389e0ed09f4ef5929cbedb58ea3b18"}]}] Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac422093d6da4d13ab7bb8b14940d371 Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: {"createImage": {"name": "tempest-test-snap-979163868"}} Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-979163868'}}} Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.164545 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-938ea80c-69e1-4c9e-9401-86d31d771a76 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-938ea80c-69e1-4c9e-9401-86d31d771a76 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.017699 Nov 03 04:20:16.178814 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2746/5378] 10.222.0.30 () {60 vars in 1275 bytes} [Thu Nov 3 04:20:16 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:20:16.184811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8712c41c-6f8e-43f6-be18-9b7aee49a8e8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-859614964"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:16.187255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8712c41c-6f8e-43f6-be18-9b7aee49a8e8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 03 04:20:16.188061 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-8712c41c-6f8e-43f6-be18-9b7aee49a8e8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8712c41c-6f8e-43f6-be18-9b7aee49a8e8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Request method failure captured: Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 56 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Flxpb0luIKLCWUoIGjfBZtdQ2pEB3RmGENlePQe9PtbOvf8e9U7W45NGN2heDfoektsZNPr6zhILd6hu2ODgaoZNX6btQcbbH92GqPuVAup6KK9e1D9uczA0ymU2xbm6V_2_Vnp2KlJbYPsntrHQv4qlc8TuoX8QBF6llZxF8Q36s Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c389e0ed09f4ef5929cbedb58ea3b18", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c389e0ed09f4ef5929cbedb58ea3b18"}]}] Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac422093d6da4d13ab7bb8b14940d371 Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: {"createImage": {"name": "tempest-test-snap-859614964"}} Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-859614964'}}} Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.190090 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8712c41c-6f8e-43f6-be18-9b7aee49a8e8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8712c41c-6f8e-43f6-be18-9b7aee49a8e8 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.013373 Nov 03 04:20:16.194645 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2747/5379] 10.222.0.30 () {60 vars in 1281 bytes} [Thu Nov 3 04:20:16 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:20:16.210783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:16.211417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:16.222334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.222334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.222334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.222334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.222334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.222735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.249559 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] HTTP exception thrown: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Request method failure captured: Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 HTTP/1.1 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Flxpb0luIKLCWUoIGjfBZtdQ2pEB3RmGENlePQe9PtbOvf8e9U7W45NGN2heDfoektsZNPr6zhILd6hu2ODgaoZNX6btQcbbH92GqPuVAup6KK9e1D9uczA0ymU2xbm6V_2_Vnp2KlJbYPsntrHQv4qlc8TuoX8QBF6llZxF8Q36s Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c389e0ed09f4ef5929cbedb58ea3b18", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c389e0ed09f4ef5929cbedb58ea3b18"}]}] Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac422093d6da4d13ab7bb8b14940d371 Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8f7e7936-d980-42d1-a3e2-37a930ee5a56'} Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:16.251338 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Returning 404 to user: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f4db5c3a-eff2-4aaa-99d3-a56d1fe1d986 tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 404 len: 111 microversion: 2.1 time: 0.047807 Nov 03 04:20:16.261489 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2748/5380] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:20:16 2022] DELETE /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:16.265923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:16.266669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] [instance: 8f7e7936-d980-42d1-a3e2-37a930ee5a56] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:16.275947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.276798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.278602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.282784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.283498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.284187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.310688 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] HTTP exception thrown: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Request method failure captured: Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 HTTP/1.1 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Flxpb0luIKLCWUoIGjfBZtdQ2pEB3RmGENlePQe9PtbOvf8e9U7W45NGN2heDfoektsZNPr6zhILd6hu2ODgaoZNX6btQcbbH92GqPuVAup6KK9e1D9uczA0ymU2xbm6V_2_Vnp2KlJbYPsntrHQv4qlc8TuoX8QBF6llZxF8Q36s Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c389e0ed09f4ef5929cbedb58ea3b18", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c389e0ed09f4ef5929cbedb58ea3b18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c389e0ed09f4ef5929cbedb58ea3b18"}]}] Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0c389e0ed09f4ef5929cbedb58ea3b18 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-531669701 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ac422093d6da4d13ab7bb8b14940d371 Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ImagesNegativeTestJSON-531669701-project Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8f7e7936-d980-42d1-a3e2-37a930ee5a56'} Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:16.312970 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.316796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:16.316796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:16.316796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:16.316796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:16.316796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:16.316796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. Nov 03 04:20:16.316796 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:16.320974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] Returning 404 to user: Instance 8f7e7936-d980-42d1-a3e2-37a930ee5a56 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:16.322657 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b2d88e3-c83c-4c5b-9c6a-0cf7b5cb046a tempest-ImagesNegativeTestJSON-531669701 tempest-ImagesNegativeTestJSON-531669701-project] 10.222.0.30 "GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56" status: 404 len: 111 microversion: 2.1 time: 0.062268 Nov 03 04:20:16.323749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2749/5381] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:16 2022] GET /compute/v2.1/servers/8f7e7936-d980-42d1-a3e2-37a930ee5a56 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:16.335435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:16.337445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:16.347362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.348539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.349456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.353174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.354190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.356844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.705812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:16.708405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:20:16.708824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:20:16.709475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:20:16.709890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:20:16.710486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:20:16.720569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:16.734982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.735485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.736139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.737704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:16.738731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:16.738946 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82eb4f66-afdb-4b19-a8c2-604905ff4113 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.413940 Nov 03 04:20:16.739546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:16.739839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2750/5382] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:16 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:16.741055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:16.781712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Getting quotas for project 09a3843a61274e25a32a4b4831e2e720. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:20:16.796235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Getting quotas for user fb267ab994fa4bf787afd128fb084e35 and project 09a3843a61274e25a32a4b4831e2e720. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:20:16.815288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:20:16.819442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:20:17.038203 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-751a0d3d-dcb1-4ec3-90a3-300450bd5f01 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469291 Nov 03 04:20:17.044922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2633/5383] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:20:17.050719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac7a110a-3e28-49cf-a575-17abf4903c97 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:17.056767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ac7a110a-3e28-49cf-a575-17abf4903c97 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:17.563215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac7a110a-3e28-49cf-a575-17abf4903c97 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:17.574142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac7a110a-3e28-49cf-a575-17abf4903c97 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1214 microversion: 2.1 time: 0.526419 Nov 03 04:20:17.575644 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2751/5384] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:17 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1214 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:17.770519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:17.771942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:17.779212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:17.780222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:17.781135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:17.782287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:17.783158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:17.783698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:18.126780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:18.144576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:18.152368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:18.154433 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8cd79f71-fcf7-4c36-8b16-3c4d42aed794 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.389708 Nov 03 04:20:18.163114 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2634/5385] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:17 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:18.607787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:18.607787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:18.622418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:18.622920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:18.623361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:18.624081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:18.624538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:18.624966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:18.760253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:18.768340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a48e722e-ba71-47ad-89ba-3976ab2fc0e4 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1218 microversion: 2.1 time: 0.167597 Nov 03 04:20:18.781685 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2752/5386] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:18 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1218 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:19.184722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:19.185514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:19.200057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:19.200763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:19.203792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:19.204688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:19.205612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:19.207138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:19.783506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:19.791824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:19.792638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:19.814628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:19.814966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:19.817693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:19.818016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:19.818724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:19.820070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee09d2c9-f276-4787-94ce-98ce3b2b9f95 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1745 microversion: 2.20 time: 0.640190 Nov 03 04:20:19.822106 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2635/5387] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:19 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1745 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:19.822481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:19.823914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:19.825005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:19.984858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:20.000339 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e39bca45-02fc-4825-89e3-fab8c0a2d2ae tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1266 microversion: 2.1 time: 0.212404 Nov 03 04:20:20.017533 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2753/5388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:19 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:21.059351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:21.072737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:21.744775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:21.753347 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c180bdd-e6fd-41c6-8057-d66114877432 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1272 microversion: 2.1 time: 0.722583 Nov 03 04:20:21.757766 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2754/5389] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:21 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1272 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:21.930603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-21c11024-79d4-4bd8-b032-c6866cd9ad08 req-1ddb0761-fbd4-4cb8-9174-0ecaf6be2b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "name": "network-vif-plugged", "status": "completed", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:21.951040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-21c11024-79d4-4bd8-b032-c6866cd9ad08 req-1ddb0761-fbd4-4cb8-9174-0ecaf6be2b95 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:21.957136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-21c11024-79d4-4bd8-b032-c6866cd9ad08 req-1ddb0761-fbd4-4cb8-9174-0ecaf6be2b95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:21.958454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-21c11024-79d4-4bd8-b032-c6866cd9ad08 req-1ddb0761-fbd4-4cb8-9174-0ecaf6be2b95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:21.997454 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-21c11024-79d4-4bd8-b032-c6866cd9ad08 req-1ddb0761-fbd4-4cb8-9174-0ecaf6be2b95 service nova] Creating event network-vif-plugged:6b519c86-8b5c-406f-9ed8-fed59ea01091 for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 on n-h2-854653-7 Nov 03 04:20:22.012761 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-21c11024-79d4-4bd8-b032-c6866cd9ad08 req-1ddb0761-fbd4-4cb8-9174-0ecaf6be2b95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084066 Nov 03 04:20:22.015484 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2755/5390] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:20:22.127204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:22.146919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:22.157934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:22.186699 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-69e692a0-0655-408e-9a2c-dd544bdfa0b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 1.340824 Nov 03 04:20:22.189383 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2636/5391] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:20 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:22.786693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:22.788276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:22.798329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:22.799128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:22.799866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:22.800827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:22.803474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:22.804902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:22.988683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:23.010262 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13491fb6-3c4f-493b-abb8-51c7c87ef08c tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1272 microversion: 2.1 time: 0.229799 Nov 03 04:20:23.043709 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2756/5392] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:22 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:23.217949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:23.219154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:23.236686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:23.236686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:23.236686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:23.236686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:23.238599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:23.239294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:23.777829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:23.793001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:23.798323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:23.799915 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f70cb19c-9971-43b4-b2e5-0f7ac086bb6e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.586226 Nov 03 04:20:23.818747 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2637/5393] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:23 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:24.048221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:24.049639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:24.061563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:24.063693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:24.065546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:24.066583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:24.067809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:24.075475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:24.080894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:24.589513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:24.601180 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4cf2fbcc-532f-44e9-ace4-63b93afe6452 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 0.555007 Nov 03 04:20:24.603447 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2757/5394] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:24 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:24.830872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:24.832804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:24.850510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:24.851305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:24.851733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:24.853201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:24.853820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:24.854267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:25.628545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:25.629222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:25.650638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:25.657354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:25.661900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:25.663319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:25.667373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:25.672671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:25.986556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:25.996217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:25.997699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:25.998880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d50108c-ed98-4a0a-9f16-74aeb52c9330 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 1.171968 Nov 03 04:20:26.022152 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2638/5395] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:24 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:27.017204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:27.017204 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ea190a2-481f-4b0c-879a-7cd7344edafc tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 1.263933 Nov 03 04:20:27.017204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2758/5396] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:25 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:27.050208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:27.052073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:27.056038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:27.066129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:27.067831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:27.080267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:27.080766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:27.089432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:27.094626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:27.097680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:27.098357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:27.531368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-693eddaf-2815-41f3-8865-46452a009404 req-edeb8efd-923e-4087-b9f4-916a91bcf7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8bef84a-0f9b-4294-879c-f3ad795e287a", "tag": "eef6e5d3-7470-4f3a-a67a-0905f4e80149"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:27.537661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:27.563468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:27.565047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-693eddaf-2815-41f3-8865-46452a009404 req-edeb8efd-923e-4087-b9f4-916a91bcf7a8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:27.573561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:27.586048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-693eddaf-2815-41f3-8865-46452a009404 req-edeb8efd-923e-4087-b9f4-916a91bcf7a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:27.586048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-693eddaf-2815-41f3-8865-46452a009404 req-edeb8efd-923e-4087-b9f4-916a91bcf7a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:27.588384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:27.592037 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-935a9ea8-ea5f-4b1d-9bf7-da87e4d1b3b1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.545663 Nov 03 04:20:27.594604 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2639/5397] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:27 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:27.637476 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-693eddaf-2815-41f3-8865-46452a009404 req-edeb8efd-923e-4087-b9f4-916a91bcf7a8 service nova] Creating event network-changed:eef6e5d3-7470-4f3a-a67a-0905f4e80149 for instance e8bef84a-0f9b-4294-879c-f3ad795e287a on n-h1-854653-7 Nov 03 04:20:27.659368 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-693eddaf-2815-41f3-8865-46452a009404 req-edeb8efd-923e-4087-b9f4-916a91bcf7a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134473 Nov 03 04:20:27.675893 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2759/5398] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:28.047286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:28.049129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:28.097776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:28.109711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:28.110213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:28.115223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:28.115975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:28.118124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:28.630439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:28.630439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:28.642921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:28.642921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:28.642921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:28.665861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:28.666513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:28.666789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:28.782181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:28.805252 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-969a9b21-847c-4d23-a3dc-96fe813ee47d tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 0.769942 Nov 03 04:20:28.807676 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2640/5399] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:28 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:29.102353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:29.118308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:29.123415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:29.128975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac0256d6-0b1b-4912-966a-2a1b0cc1fe27 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.511449 Nov 03 04:20:29.130131 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2760/5400] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:28 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:29.834493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:29.835133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:29.858127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:29.858911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:29.859361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:29.860292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:29.860761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:29.862148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:30.137541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:30.164190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:30.165544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:30.170398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d202935e-08fa-4b75-995c-3a0900ea7ef9 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 0.339324 Nov 03 04:20:30.180068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:30.180808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:30.186160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:30.187110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:30.187743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:30.188521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:30.189833 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2641/5401] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:29 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:31.199855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:31.201668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:31.215644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:31.219393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:31.220351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:31.223540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:31.226027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:31.229189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:31.341064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:31.351379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:31.368360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:31.368360 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e1db5bf-bb91-4762-8f44-af694341d5d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 1.207299 Nov 03 04:20:31.374729 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2761/5402] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:30 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:20:32.292464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:32.300630 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f953f8b-d584-4dd5-a64f-d34d73766bb7 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 1.105646 Nov 03 04:20:32.301309 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2642/5403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:31 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:32.404674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:32.415855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:32.431203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:32.431750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:32.432220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:32.433002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:32.446339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:32.447824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:32.927953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1902623306", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:33.085531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] validate_networks() for [('da4049c8-b410-49f2-98f9-ec02f253884f', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:20:34.236086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:34.251721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:34.262947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:34.281494 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-123bf9e6-9a86-4385-b9fa-1fcaed24b775 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 1.868678 Nov 03 04:20:34.281494 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2643/5404] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:32 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:34.292095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:34.296681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:34.325334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:34.325906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:34.327445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:34.330823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:34.331654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:34.332557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:35.510256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:35.521573 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-692d6037-4446-4933-92b8-73cb0413e630 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 1.245322 Nov 03 04:20:35.537210 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2644/5405] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:34 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:35.551228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:35.551690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:35.572681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:35.573975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:35.575769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:35.577981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:35.587899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:35.588618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:36.446192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:36.465805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:36.467770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:36.476750 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6f90e91-0301-453d-bba9-fc9e25ee4627 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.953454 Nov 03 04:20:36.497447 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2645/5406] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:35 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:36.559602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:36.561083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:36.579666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:36.580409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:36.581108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:36.582069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:36.585678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:36.589611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:37.509921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:20:37.510901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:20:37.511580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:20:37.512198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:20:37.512982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:20:37.531694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:37.532580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:37.534433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:37.536190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:37.540124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:37.541049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:37.627541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Getting quotas for project debecb0926db4a13bf27776c374e78b3. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:20:37.645050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Getting quotas for user 072281a978194e5cb7d93f5af2629b99 and project debecb0926db4a13bf27776c374e78b3. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:20:37.704856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:20:37.714944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:20:37.889700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:37.899323 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-db6eb094-00f9-4f1c-97fb-dd973f4e8098 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 1.343414 Nov 03 04:20:37.904386 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2646/5407] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:36 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:37.917767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:37.918685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:37.930763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:37.939044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:37.939044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:37.939044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:37.939044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:37.939044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:37.953155 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6bc8666b-95c1-4d41-a384-5c90b4c73818 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.834189 Nov 03 04:20:37.953829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2762/5408] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:20:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 5836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:20:38.008249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a6fc9a6-1882-4b80-8963-5f82ad2c41cb tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:38.009121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1a6fc9a6-1882-4b80-8963-5f82ad2c41cb tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:38.035373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:38.366515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1a6fc9a6-1882-4b80-8963-5f82ad2c41cb tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:38.379656 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1a6fc9a6-1882-4b80-8963-5f82ad2c41cb tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1214 microversion: 2.1 time: 0.413185 Nov 03 04:20:38.385079 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2763/5409] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:37 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1214 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:38.452528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d1f1d458-a0cc-45f6-8d88-7c918b83e8cb req-c8e06799-6643-4b5d-8319-04acdc021fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bef84a-0f9b-4294-879c-f3ad795e287a", "name": "network-vif-plugged", "status": "completed", "tag": "eef6e5d3-7470-4f3a-a67a-0905f4e80149"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:38.486326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1f1d458-a0cc-45f6-8d88-7c918b83e8cb req-c8e06799-6643-4b5d-8319-04acdc021fd1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:38.487667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1f1d458-a0cc-45f6-8d88-7c918b83e8cb req-c8e06799-6643-4b5d-8319-04acdc021fd1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:38.488967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1f1d458-a0cc-45f6-8d88-7c918b83e8cb req-c8e06799-6643-4b5d-8319-04acdc021fd1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:38.580958 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d1f1d458-a0cc-45f6-8d88-7c918b83e8cb req-c8e06799-6643-4b5d-8319-04acdc021fd1 service nova] Creating event network-vif-plugged:eef6e5d3-7470-4f3a-a67a-0905f4e80149 for instance e8bef84a-0f9b-4294-879c-f3ad795e287a on n-h1-854653-7 Nov 03 04:20:38.617193 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d1f1d458-a0cc-45f6-8d88-7c918b83e8cb req-c8e06799-6643-4b5d-8319-04acdc021fd1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163257 Nov 03 04:20:38.620294 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2764/5410] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:38.931625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:38.937462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:38.949232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:38.950009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:38.950629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:38.951556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:38.952199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:38.953770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:39.120821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:39.144635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:39.147073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:39.148989 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-514da2e1-6c12-4fe9-b8f7-5b3d97a13dfb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 1.242673 Nov 03 04:20:39.149980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2647/5411] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:37 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:39.391950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:39.406027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b310162c-6717-408c-881d-f1cd2dc69498 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:39.406256 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75ffef25-ea8d-4290-bfeb-335745702ea5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 0.482625 Nov 03 04:20:39.406660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b310162c-6717-408c-881d-f1cd2dc69498 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:39.425221 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2765/5412] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:38 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:39.706922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b310162c-6717-408c-881d-f1cd2dc69498 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:39.714630 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b310162c-6717-408c-881d-f1cd2dc69498 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1214 microversion: 2.1 time: 0.312671 Nov 03 04:20:39.715227 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2648/5413] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:39 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1214 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:40.196967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:40.198452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:40.212363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:40.214414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:40.214414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:40.216528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:40.217517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:40.221288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:40.438664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:40.439895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:40.480332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:40.480845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:40.485004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:40.486511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:40.487154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:40.487757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:41.204517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:41.220550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:41.222681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:41.229377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ddcdfd78-7435-4d7a-992e-7779503fcfdd tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 1.035737 Nov 03 04:20:41.274032 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2766/5414] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:40 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:41.279480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:41.280572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:41.298496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:41.303551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:41.316387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:41.363731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:41.365227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:41.367871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:41.544088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:41.582447 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ba0b237-dfc5-40a1-81c3-24d1ad6852e5 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1314 microversion: 2.1 time: 1.153435 Nov 03 04:20:41.609874 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2649/5415] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:40 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1314 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:41.763471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:41.772489 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d279b2b3-4c4a-4e88-95e5-5c9e5e701d8b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1266 microversion: 2.1 time: 0.497110 Nov 03 04:20:41.777654 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2767/5416] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:41 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1266 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:42.262580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:42.264725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:42.283286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:42.284782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:42.286668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:42.287546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:42.288820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:42.290270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:42.623541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:42.626841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:42.657486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:42.659351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:42.660891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:42.667052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:42.668660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:42.669573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:42.677815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:42.688570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:42.700605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:42.705586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:42.710907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e304432a-188e-4819-9009-a90b71aba350 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.451384 Nov 03 04:20:42.713007 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2650/5417] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:42 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:42.811587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:42.812517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:42.833564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:42.834363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:42.834964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:42.836440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:42.837990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:42.838738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:43.286760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:43.296461 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-504e3a53-ab8e-4da9-96c4-5c1d009c596b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1284 microversion: 2.1 time: 0.501121 Nov 03 04:20:43.297067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2651/5418] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:42 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1284 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:43.432697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:43.446274 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18614de8-379e-4585-bf27-bc8cb68ab0c3 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1498 microversion: 2.1 time: 0.832576 Nov 03 04:20:43.455557 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2768/5419] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:42 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1498 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:43.745196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:43.747406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:43.767638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:43.774658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:43.780936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:43.789456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:43.791095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:43.794483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:44.158013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:44.173651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:44.178456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:44.181948 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4d5d252-2acb-47d8-90e1-4eca489f1045 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.446523 Nov 03 04:20:44.185254 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2652/5420] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:43 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:44.322943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:44.323562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:44.336132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:44.342369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:44.342838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:44.343594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:44.344422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:44.344860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:44.589932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:44.609660 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05e66a28-6098-4489-b7c1-9fb52ec10205 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1272 microversion: 2.1 time: 0.290526 Nov 03 04:20:44.612229 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2769/5421] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:44 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:44.887619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:44.888664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:44.920641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:44.921353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:44.921973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:44.924592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:44.927487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:44.928225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:44.964394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:20:45.213681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:45.214524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:45.230639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:45.231396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:45.232357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:45.234329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:45.237546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:45.238202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:45.333138 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-445bf444-88e8-4f91-9cd4-80349b43fb00 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 204 len: 0 microversion: 2.1 time: 0.449639 Nov 03 04:20:45.335020 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2653/5422] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:20:44 2022] DELETE /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:20:45.347137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:45.348071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:45.367196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:45.367967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:45.373569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:45.373569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:45.373569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:45.373569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:46.304592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:46.324788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:46.330504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:46.340156 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-66180061-8b5f-44bc-8b6d-7233a338fd8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 1.134197 Nov 03 04:20:46.340952 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2770/5423] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:45 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:46.350425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:46.358312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:46.388074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:46.390098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:46.390796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:46.393218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:46.394981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:46.395642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:46.470542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:46.502310 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-075c8334-0e02-4a0c-babb-1079dd455136 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1504 microversion: 2.1 time: 1.141803 Nov 03 04:20:46.502310 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2654/5424] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:45 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1504 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:46.933693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:46.947325 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9df814b5-5fbe-4fec-8f3c-a67ed1cbbfdf tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1314 microversion: 2.1 time: 0.600588 Nov 03 04:20:46.948181 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2771/5425] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:46 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:47.372369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:47.373272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:47.380045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:47.380548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:47.381116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:47.390763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:47.393493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:47.415948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:47.507796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:47.508541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:47.532905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:47.536390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:47.537156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:47.538119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:47.538712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:47.594657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:47.687196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:48.094721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:48.105445 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04aacdc4-1c99-4dc4-ba07-9549a634ce92 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1504 microversion: 2.1 time: 0.603598 Nov 03 04:20:48.106573 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2772/5426] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:47 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:48.132714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:48.133837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:48.169202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:48.169707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:48.179802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:48.190616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:48.191883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:48.194565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:48.201962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:48.206254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:48.221156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:48.222891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e3ea1470-044a-4cba-9e9e-6bdd88595672 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.854389 Nov 03 04:20:48.229297 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2655/5427] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:47 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:48.267863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ee937c88-fe9b-4978-a6da-42b78e6ab51d req-380e0ad4-d07d-462d-abd6-357f8a64bf4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13159d64-69c4-458f-b9de-a05754c8bfae", "tag": "6683d99d-64cc-445a-aa19-b20fd0de209d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:48.311662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ee937c88-fe9b-4978-a6da-42b78e6ab51d req-380e0ad4-d07d-462d-abd6-357f8a64bf4a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:48.312151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ee937c88-fe9b-4978-a6da-42b78e6ab51d req-380e0ad4-d07d-462d-abd6-357f8a64bf4a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:48.316739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ee937c88-fe9b-4978-a6da-42b78e6ab51d req-380e0ad4-d07d-462d-abd6-357f8a64bf4a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:48.369219 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ee937c88-fe9b-4978-a6da-42b78e6ab51d req-380e0ad4-d07d-462d-abd6-357f8a64bf4a service nova] Creating event network-changed:6683d99d-64cc-445a-aa19-b20fd0de209d for instance 13159d64-69c4-458f-b9de-a05754c8bfae on n-h2-854653-7 Nov 03 04:20:48.374651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ee937c88-fe9b-4978-a6da-42b78e6ab51d req-380e0ad4-d07d-462d-abd6-357f8a64bf4a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119135 Nov 03 04:20:48.376365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:48.384307 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2656/5428] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:48.633483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ca77664-a61a-4847-9a27-6508cfa91162 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f8be99d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-216103290", "description": "tempest-description-1287934580"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:49.481907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:49.508126 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8a32b454-b979-44ac-9fa7-ef2ae452767b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1314 microversion: 2.1 time: 1.384970 Nov 03 04:20:49.509176 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2773/5429] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:48 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1314 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:49.516990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:49.517994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:49.537249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:49.538694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:49.540179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:49.540899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:49.541416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:49.541854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:49.715274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:49.784803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb267ab994fa4bf787afd128fb084e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09a3843a61274e25a32a4b4831e2e720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:49.802542 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c52ce13d-c59e-46dd-a346-a85012285a59 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 200 len: 1462 microversion: 2.1 time: 0.291074 Nov 03 04:20:49.849179 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2774/5430] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:49 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 1462 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:49.854745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:49.867178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:49.900945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:49.907063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:49.907724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:49.918552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:49.918552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:49.918552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:50.239241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:50.251101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:50.252553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:50.253767 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a6f61b10-ace5-46c1-99d7-ef03cd891760 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1740 microversion: 2.20 time: 0.403189 Nov 03 04:20:50.254330 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2775/5431] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:49 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1740 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:50.284342 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ca77664-a61a-4847-9a27-6508cfa91162 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.837843 Nov 03 04:20:50.284342 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2657/5432] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:20:48 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:50.285475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f68e13be-3e34-4b0f-bdbe-e17c3b879f2e req-0534eb09-f872-450d-82e3-20dac8251563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8bef84a-0f9b-4294-879c-f3ad795e287a", "name": "network-vif-deleted", "tag": "eef6e5d3-7470-4f3a-a67a-0905f4e80149"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:50.287842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73830b95-257d-4314-b92b-7f4e59182d39 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3fb7d30>, body: {"security_group_rule": {"parent_group_id": "e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:50.314075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f68e13be-3e34-4b0f-bdbe-e17c3b879f2e req-0534eb09-f872-450d-82e3-20dac8251563 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:50.314866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f68e13be-3e34-4b0f-bdbe-e17c3b879f2e req-0534eb09-f872-450d-82e3-20dac8251563 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:50.315515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f68e13be-3e34-4b0f-bdbe-e17c3b879f2e req-0534eb09-f872-450d-82e3-20dac8251563 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:50.345501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f68e13be-3e34-4b0f-bdbe-e17c3b879f2e req-0534eb09-f872-450d-82e3-20dac8251563 service nova] Creating event network-vif-deleted:eef6e5d3-7470-4f3a-a67a-0905f4e80149 for instance e8bef84a-0f9b-4294-879c-f3ad795e287a on n-h1-854653-7 Nov 03 04:20:50.393923 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f68e13be-3e34-4b0f-bdbe-e17c3b879f2e req-0534eb09-f872-450d-82e3-20dac8251563 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130249 Nov 03 04:20:50.394967 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2776/5433] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:50.536432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:50.537722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:50.580280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:50.581216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:50.582053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:50.582966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:50.583783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:50.584464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:50.614938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:51.276497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:51.293584 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f69cc0dc-2c56-4e68-b0a9-d3793d2cd464 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1314 microversion: 2.1 time: 0.765594 Nov 03 04:20:51.312635 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2777/5434] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:50 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:51.318998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:51.319953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] [instance: e8bef84a-0f9b-4294-879c-f3ad795e287a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:51.343169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:51.344837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:51.345352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:51.360026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:51.362740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:51.363368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:51.389355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] HTTP exception thrown: Instance e8bef84a-0f9b-4294-879c-f3ad795e287a could not be found. Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Request method failure captured: Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a HTTP/1.1 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0FbA6s8QgN_bSTvlRXgY_BwRkPlsI7DiVDs6mMm5jvPdNl-Dkic4tuu4cMc14ojUBJL0QASk-M83zdca8SvOKo0zA9bRSmnFLGm12gkdzYOdVoY6Nj-qcnRV1vZdb0fldbeJCXp1OGFaYTAuvKIpRtRkHu7veYam4Zfx581-uPPdZI Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 09a3843a61274e25a32a4b4831e2e720 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesActionsTest-1034706508 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/09a3843a61274e25a32a4b4831e2e720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_09a3843a61274e25a32a4b4831e2e720", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/09a3843a61274e25a32a4b4831e2e720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/09a3843a61274e25a32a4b4831e2e720"}]}] Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesActionsTest-1034706508 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 09a3843a61274e25a32a4b4831e2e720 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesActionsTest-1034706508 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesActionsTest-1034706508-project Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fb267ab994fa4bf787afd128fb084e35 Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesActionsTest-1034706508-project Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e8bef84a-0f9b-4294-879c-f3ad795e287a could not be found. Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e8bef84a-0f9b-4294-879c-f3ad795e287a'} Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8bef84a-0f9b-4294-879c-f3ad795e287a could not be found. Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8bef84a-0f9b-4294-879c-f3ad795e287a could not be found. Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:51.391421 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:51.395708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:51.395708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:51.395708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:51.395708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:51.395708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:51.395708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8bef84a-0f9b-4294-879c-f3ad795e287a could not be found. Nov 03 04:20:51.395708 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:20:51.399860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] Returning 404 to user: Instance e8bef84a-0f9b-4294-879c-f3ad795e287a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:51.400921 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bcdb6ad7-bdb4-4133-ac58-9cce8044a5f2 tempest-VolumesActionsTest-1034706508 tempest-VolumesActionsTest-1034706508-project] 10.222.0.30 "GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a" status: 404 len: 111 microversion: 2.1 time: 0.086952 Nov 03 04:20:51.402891 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2778/5435] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:51 2022] GET /compute/v2.1/servers/e8bef84a-0f9b-4294-879c-f3ad795e287a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:51.415910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:51.422009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:51.451466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:51.452374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:51.453275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:51.454243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:51.460967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:51.461866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:52.049350 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73830b95-257d-4314-b92b-7f4e59182d39 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.750203 Nov 03 04:20:52.049350 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2658/5436] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:50 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:20:52.063608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2aeea0a-88a0-4fac-add6-ef30b1f4d57a tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f6cf70>, body: {"security_group_rule": {"parent_group_id": "e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:52.209707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:52.224532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:52.226538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:52.229394 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7dc8ac69-91aa-4eee-92c1-78647d8d3ce3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1722 microversion: 2.20 time: 0.825171 Nov 03 04:20:52.229965 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2779/5437] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:51 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1722 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:52.320610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:52.321264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:52.329428 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-b2aeea0a-88a0-4fac-add6-ef30b1f4d57a tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: This rule already exists in group e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2aeea0a-88a0-4fac-add6-ef30b1f4d57a tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 138 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: {"security_group_rule": {"parent_group_id": "e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: exception: This rule already exists in group e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43 Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:52.331259 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:52.344730 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:52.344730 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:52.344730 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43 Nov 03 04:20:52.344730 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:52.344730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2aeea0a-88a0-4fac-add6-ef30b1f4d57a tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 400 to user: This rule already exists in group e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:52.344730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2aeea0a-88a0-4fac-add6-ef30b1f4d57a tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.273269 Nov 03 04:20:52.344730 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2659/5438] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:52 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:20:52.346377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:52.346377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:52.346377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:52.346377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:52.346377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:52.346377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:52.352548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fccb665-2fcf-4762-9379-8540beae431a tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Calling method '.version_select at 0x7ff7f3fbeb80>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:53.037207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:53.071616 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9fe1bc2b-ed3a-4600-aa3e-8e756d784687 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1314 microversion: 2.1 time: 0.756818 Nov 03 04:20:53.084583 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2780/5439] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:52 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:20:53.212233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2fccb665-2fcf-4762-9379-8540beae431a tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/13f98086-f8d2-4236-9cbb-3edf60a372f2" status: 202 len: 0 microversion: 2.1 time: 0.864127 Nov 03 04:20:53.213344 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2660/5440] 10.222.0.30 () {58 vars in 1287 bytes} [Thu Nov 3 04:20:52 2022] DELETE /compute/v2.1/os-security-group-rules/13f98086-f8d2-4236-9cbb-3edf60a372f2 => generated 0 bytes in 866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:20:53.224192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c3cd37a-acc9-4a70-bae2-5f9471cb1824 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f95800d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1910305952", "description": "tempest-description-900048032"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:53.282051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:53.282761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:53.315161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:53.315669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:53.316116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:53.316839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:53.318448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:53.318930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:53.749514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:53.755543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:53.758431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:53.759912 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b4f8044-c829-4f15-8acf-740cb0148119 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1722 microversion: 2.20 time: 0.481952 Nov 03 04:20:53.764153 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2661/5441] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:53 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1722 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:54.112156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:54.112795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:54.130719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:54.130719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:54.130719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:54.136190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:54.136704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:54.137202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:54.938154 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c3cd37a-acc9-4a70-bae2-5f9471cb1824 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.719748 Nov 03 04:20:54.948680 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2781/5442] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:20:53 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:54.958074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:54.961626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:54.968812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:54.969693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:54.970991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:54.972369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:54.973390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:54.974149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:55.088783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:55.101273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-622faab3-3478-4fc8-8f21-840867671738 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1314 microversion: 2.1 time: 0.992316 Nov 03 04:20:55.102712 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2662/5443] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:54 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:55.108096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a8e71c3-db97-470f-8f97-af552b3043a4 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f8945e50>, body: {"security_group_rule": {"parent_group_id": "5c7f3626-1caa-4ba9-b32f-1faf7632520f", "ip_protocol": "tcp", "from_port": 1284967628, "to_port": 22}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:55.227753 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-2a8e71c3-db97-470f-8f97-af552b3043a4 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: Invalid port range 1284967628:22. Former value cannot be greater than the later Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a8e71c3-db97-470f-8f97-af552b3043a4 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 146 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: {"security_group_rule": {"parent_group_id": "5c7f3626-1caa-4ba9-b32f-1faf7632520f", "ip_protocol": "tcp", "from_port": 1284967628, "to_port": 22}} Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid port range 1284967628:22. Former value cannot be greater than the later Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5c7f3626-1caa-4ba9-b32f-1faf7632520f', 'ip_protocol': 'tcp', 'from_port': 1284967628, 'to_port': 22}}} Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1284967628:22. Former value cannot be greater than the later Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1284967628:22. Former value cannot be greater than the later Nov 03 04:20:55.230196 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1284967628:22. Former value cannot be greater than the later Nov 03 04:20:55.234774 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.236482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a8e71c3-db97-470f-8f97-af552b3043a4 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 400 to user: Invalid port range 1284967628:22. Former value cannot be greater than the later {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:55.237748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a8e71c3-db97-470f-8f97-af552b3043a4 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.133780 Nov 03 04:20:55.238832 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2663/5444] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:55 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:20:55.250884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08bf862d-82eb-4a14-982c-0f078f0bd2f2 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f004c0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-471029053", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:55.260966 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-08bf862d-82eb-4a14-982c-0f078f0bd2f2 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: Security group id should be uuid Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08bf862d-82eb-4a14-982c-0f078f0bd2f2 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 130 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-471029053", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group id should be uuid Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-471029053', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:55.271582 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:55.278139 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 03 04:20:55.278139 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:55.286306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08bf862d-82eb-4a14-982c-0f078f0bd2f2 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 400 to user: Security group id should be uuid {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:55.290855 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-08bf862d-82eb-4a14-982c-0f078f0bd2f2 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.044533 Nov 03 04:20:55.291455 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2664/5445] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:55 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 03 04:20:55.317282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-098067c7-3302-4d6d-a74b-f4989b862848 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f83c6280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1411008830", "description": "tempest-description-1868623705"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:55.907381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:55.922482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:55.935007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:55.959041 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b5f2b5b-864d-490b-bdec-b4702917c284 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1722 microversion: 2.20 time: 1.008165 Nov 03 04:20:55.964810 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2782/5446] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:54 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1722 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:55.992570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0a686274-0294-4d35-9c65-f0a4e0bd1dd2 req-31b48f0d-e5ee-43ba-a0fe-e803c159c3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13159d64-69c4-458f-b9de-a05754c8bfae", "name": "network-vif-plugged", "status": "completed", "tag": "6683d99d-64cc-445a-aa19-b20fd0de209d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:56.019684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a686274-0294-4d35-9c65-f0a4e0bd1dd2 req-31b48f0d-e5ee-43ba-a0fe-e803c159c3e7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:56.021590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a686274-0294-4d35-9c65-f0a4e0bd1dd2 req-31b48f0d-e5ee-43ba-a0fe-e803c159c3e7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:56.023231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a686274-0294-4d35-9c65-f0a4e0bd1dd2 req-31b48f0d-e5ee-43ba-a0fe-e803c159c3e7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:56.042329 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0a686274-0294-4d35-9c65-f0a4e0bd1dd2 req-31b48f0d-e5ee-43ba-a0fe-e803c159c3e7 service nova] Creating event network-vif-plugged:6683d99d-64cc-445a-aa19-b20fd0de209d for instance 13159d64-69c4-458f-b9de-a05754c8bfae on n-h2-854653-7 Nov 03 04:20:56.056300 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0a686274-0294-4d35-9c65-f0a4e0bd1dd2 req-31b48f0d-e5ee-43ba-a0fe-e803c159c3e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089188 Nov 03 04:20:56.059021 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2783/5447] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:56.149069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:56.154608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:56.185889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:56.190497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:56.190896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:56.191654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:56.207353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:56.208140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:56.282429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-098067c7-3302-4d6d-a74b-f4989b862848 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.984898 Nov 03 04:20:56.292657 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2665/5448] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:20:55 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:56.297978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-78ab2627-1a24-4a2a-ac06-a3835a2abc79 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f005e0>, body: {"security_group_rule": {"parent_group_id": "37cc5c57-c673-4bf4-b5d5-30e3b118ed6e", "ip_protocol": "tempest-999-419962994", "from_port": 22, "to_port": 22}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:56.839611 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-78ab2627-1a24-4a2a-ac06-a3835a2abc79 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: Invalid IP protocol tempest-999-419962994. Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-78ab2627-1a24-4a2a-ac06-a3835a2abc79 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 156 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: {"security_group_rule": {"parent_group_id": "37cc5c57-c673-4bf4-b5d5-30e3b118ed6e", "ip_protocol": "tempest-999-419962994", "from_port": 22, "to_port": 22}} Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid IP protocol tempest-999-419962994. Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'security_group_rule': {'parent_group_id': '37cc5c57-c673-4bf4-b5d5-30e3b118ed6e', 'ip_protocol': 'tempest-999-419962994', 'from_port': 22, 'to_port': 22}}} Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-419962994. Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-419962994. Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:56.841858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-419962994. Nov 03 04:20:56.847207 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:56.849029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-78ab2627-1a24-4a2a-ac06-a3835a2abc79 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 400 to user: Invalid IP protocol tempest-999-419962994. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:56.850938 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-78ab2627-1a24-4a2a-ac06-a3835a2abc79 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.556218 Nov 03 04:20:56.857984 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2666/5449] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:56 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 564 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 03 04:20:56.871896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:56.886558 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a1ed138c-d82c-4167-b180-ce88c622b25a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1314 microversion: 2.1 time: 0.760071 Nov 03 04:20:56.888705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-db45abbb-1cfa-4c83-a4ea-9c0dd3038c0f tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f031f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1199698900", "description": "tempest-description-336270500"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:56.908238 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2784/5450] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:56 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1314 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:56.997408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:56.999706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:57.022244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:57.024486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:57.025919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:57.026932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:57.028599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:57.029405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:57.571403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:57.625631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:57.625631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:57.625631 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-555118be-05b8-4d2f-9f4a-f645787432e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1665 microversion: 2.20 time: 0.616197 Nov 03 04:20:57.625631 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2785/5451] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:20:56 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1665 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:20:57.655048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fad8d840-01a5-4f31-820c-910b08831b40"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:57.659351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:57.681549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:57.682703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:57.683715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:57.686642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:57.687723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:57.691752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:57.915069 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-db45abbb-1cfa-4c83-a4ea-9c0dd3038c0f tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.055344 Nov 03 04:20:57.925201 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2667/5452] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:20:56 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:57.933957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:57.937151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:57.951856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:57.954817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:57.955286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:57.956006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:57.956473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:57.956902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:58.284156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:58.292766 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c28eaae-5d18-442c-a463-d94ca67db508 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1314 microversion: 2.1 time: 0.366465 Nov 03 04:20:58.293397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2668/5453] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:57 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:58.310854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23f0fe62-637b-4852-860e-45afa59e4899 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f03af0>, body: {"security_group_rule": {"parent_group_id": "2702af21-a257-49a9-913f-3e63bd88791a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:58.425159 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-23f0fe62-637b-4852-860e-45afa59e4899 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23f0fe62-637b-4852-860e-45afa59e4899 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 138 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: {"security_group_rule": {"parent_group_id": "2702af21-a257-49a9-913f-3e63bd88791a", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2702af21-a257-49a9-913f-3e63bd88791a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 03 04:20:58.426930 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23f0fe62-637b-4852-860e-45afa59e4899 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23f0fe62-637b-4852-860e-45afa59e4899 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.134004 Nov 03 04:20:58.434703 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2669/5454] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:58 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:20:58.440777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-87459292-e33e-4a4d-8ebc-8f01705d3b26 req-5b1415fe-6e69-429f-b6d1-c6928d0743e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "name": "network-vif-unplugged", "status": "completed", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:58.457086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-87459292-e33e-4a4d-8ebc-8f01705d3b26 req-5b1415fe-6e69-429f-b6d1-c6928d0743e3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:58.457834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-87459292-e33e-4a4d-8ebc-8f01705d3b26 req-5b1415fe-6e69-429f-b6d1-c6928d0743e3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:58.458641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-87459292-e33e-4a4d-8ebc-8f01705d3b26 req-5b1415fe-6e69-429f-b6d1-c6928d0743e3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:58.477601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_external_events [req-87459292-e33e-4a4d-8ebc-8f01705d3b26 req-5b1415fe-6e69-429f-b6d1-c6928d0743e3 service nova] Unable to find a host for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15. Dropping event network-vif-unplugged {{(pid=127593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 03 04:20:58.484452 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-87459292-e33e-4a4d-8ebc-8f01705d3b26 req-5b1415fe-6e69-429f-b6d1-c6928d0743e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047558 Nov 03 04:20:58.485194 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2670/5455] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 03 04:20:58.495897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dad5a59e-d1ed-4f34-9765-18d0206139fc tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f030d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-320996349", "description": "tempest-description-629020011"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:59.275447 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dad5a59e-d1ed-4f34-9765-18d0206139fc tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.786740 Nov 03 04:20:59.276129 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2671/5456] 10.222.0.30 () {60 vars in 1180 bytes} [Thu Nov 3 04:20:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:20:59.290709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19da5297-b7be-4ea9-b102-7c2d81d02142 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f090d0>, body: {"security_group_rule": {"parent_group_id": "904d7f2a-efb9-4264-8328-d37f1d56d490", "ip_protocol": "tcp", "from_port": 22, "to_port": 957081799}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:59.378068 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6642c44-6285-489c-9bb1-885debd0578d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.730342 Nov 03 04:20:59.383131 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2786/5457] 10.222.0.30 () {62 vars in 1364 bytes} [Thu Nov 3 04:20:57 2022] POST /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 188 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:20:59.422558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:59.423627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:59.426710 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-19da5297-b7be-4ea9-b102-7c2d81d02142 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: Invalid port range 22:957081799. Valid TCP ports should be between 1-65535 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19da5297-b7be-4ea9-b102-7c2d81d02142 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 145 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: {"security_group_rule": {"parent_group_id": "904d7f2a-efb9-4264-8328-d37f1d56d490", "ip_protocol": "tcp", "from_port": 22, "to_port": 957081799}} Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid port range 22:957081799. Valid TCP ports should be between 1-65535 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'security_group_rule': {'parent_group_id': '904d7f2a-efb9-4264-8328-d37f1d56d490', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 957081799}}} Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:957081799. Valid TCP ports should be between 1-65535 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:957081799. Valid TCP ports should be between 1-65535 Nov 03 04:20:59.428494 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:957081799. Valid TCP ports should be between 1-65535 Nov 03 04:20:59.433120 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.434915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19da5297-b7be-4ea9-b102-7c2d81d02142 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 400 to user: Invalid port range 22:957081799. Valid TCP ports should be between 1-65535 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:59.436100 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19da5297-b7be-4ea9-b102-7c2d81d02142 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.150799 Nov 03 04:20:59.449532 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2672/5458] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:59 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:20:59.464415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:59.464633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42b084e2-aec4-40df-a536-27efe4233750 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Action: 'create', calling method: .version_select at 0x7ff7f3f63ee0>, body: {"security_group_rule": {"parent_group_id": "0b2191fc-084b-4945-b2fc-9e62e87127ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:59.465381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:59.468779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:59.470277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:59.472048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:59.477504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:59.571916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-42b084e2-aec4-40df-a536-27efe4233750 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:20:59.572542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.security_group_api [None req-42b084e2-aec4-40df-a536-27efe4233750 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Neutron security group 0b2191fc-084b-4945-b2fc-9e62e87127ac not found {{(pid=127593) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 03 04:20:59.573097 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-42b084e2-aec4-40df-a536-27efe4233750 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist Nov 03 04:20:59.573097 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-57ce61bb-8086-4096-8c93-58d73bc16919'] Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42b084e2-aec4-40df-a536-27efe4233750 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 138 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: {"security_group_rule": {"parent_group_id": "0b2191fc-084b-4945-b2fc-9e62e87127ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-57ce61bb-8086-4096-8c93-58d73bc16919'] Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0b2191fc-084b-4945-b2fc-9e62e87127ac', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:20:59.598298 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ce61bb-8086-4096-8c93-58d73bc16919'] Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ce61bb-8086-4096-8c93-58d73bc16919'] Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ce61bb-8086-4096-8c93-58d73bc16919'] Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ce61bb-8086-4096-8c93-58d73bc16919'] Nov 03 04:20:59.603451 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.610915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42b084e2-aec4-40df-a536-27efe4233750 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 404 to user: Security group 0b2191fc-084b-4945-b2fc-9e62e87127ac does not exist Nov 03 04:20:59.610915 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-57ce61bb-8086-4096-8c93-58d73bc16919'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:59.612717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42b084e2-aec4-40df-a536-27efe4233750 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.160104 Nov 03 04:20:59.613809 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2673/5459] 10.222.0.30 () {60 vars in 1195 bytes} [Thu Nov 3 04:20:59 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:59.626078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19017755-6041-4db6-9190-d244593db6b8 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Calling method '.version_select at 0x7ff7f3f03e50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:59.831069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG neutronclient.v2_0.client [None req-19017755-6041-4db6-9190-d244593db6b8 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist", "detail": ""}} {{(pid=127593) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 03 04:20:59.831778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.security_group_api [None req-19017755-6041-4db6-9190-d244593db6b8 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Neutron security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 not found {{(pid=127593) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 03 04:20:59.832454 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-19017755-6041-4db6-9190-d244593db6b8 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] HTTP exception thrown: Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist Nov 03 04:20:59.832454 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-9e78e41c-3076-4d63-ace0-34443ab691f4'] Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19017755-6041-4db6-9190-d244593db6b8 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Request method failure captured: Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-security-group-rules/f7678668-b41a-4c5e-b72e-c348b359eeb9 HTTP/1.1 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GgH53Bwdq6h_lQMDl6b3ACwx4ufNI--w5hD3jjS7AsGKxGQFqPwlF-upLd8NanXcY7GSv49bmPjjnITCVBOhvWktd6qGGMlCo2Sxq2jTl29MU1ZwGacdGNebxxIWblugfb8eokzv5GWLJqIDXhzd3_6XVPFFkQI0VZREjar_UrAwU Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_550b8662f702407092150b0b93defd80", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/550b8662f702407092150b0b93defd80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/550b8662f702407092150b0b93defd80"}]}] Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 550b8662f702407092150b0b93defd80 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 81d8ad442e8f4676815f7b2c075d43b8 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: exception: Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-9e78e41c-3076-4d63-ace0-34443ab691f4'] Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f7678668-b41a-4c5e-b72e-c348b359eeb9'} Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 03 04:20:59.835130 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e78e41c-3076-4d63-ace0-34443ab691f4'] Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e78e41c-3076-4d63-ace0-34443ab691f4'] Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e78e41c-3076-4d63-ace0-34443ab691f4'] Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e78e41c-3076-4d63-ace0-34443ab691f4'] Nov 03 04:20:59.839152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:20:59.846309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19017755-6041-4db6-9190-d244593db6b8 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Returning 404 to user: Security group rule f7678668-b41a-4c5e-b72e-c348b359eeb9 does not exist Nov 03 04:20:59.846309 n-d-854653-7 devstack@n-api.service[127593]: Neutron server returns request_ids: ['req-9e78e41c-3076-4d63-ace0-34443ab691f4'] {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:20:59.847901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19017755-6041-4db6-9190-d244593db6b8 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-group-rules/f7678668-b41a-4c5e-b72e-c348b359eeb9" status: 404 len: 199 microversion: 2.1 time: 0.228800 Nov 03 04:20:59.849144 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2674/5460] 10.222.0.30 () {58 vars in 1287 bytes} [Thu Nov 3 04:20:59 2022] DELETE /compute/v2.1/os-security-group-rules/f7678668-b41a-4c5e-b72e-c348b359eeb9 => generated 199 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:20:59.863463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:20:59.864391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:20:59.871921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:20:59.874738 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-52d9ed71-3933-46c3-a982-3c0dda477b21 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1500 microversion: 2.1 time: 0.489890 Nov 03 04:20:59.875330 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2787/5461] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:20:59 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1500 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:20:59.881600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae50e190-9e97-4891-8dd1-ac46182b5caf tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Calling method '.version_select at 0x7ff7f87fc8b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:20:59.899841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:20:59.899841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:59.900183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:59.902733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:20:59.904623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:20:59.907150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:20:59.916540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:00.007897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127593) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 03 04:21:00.427450 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae50e190-9e97-4891-8dd1-ac46182b5caf tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/904d7f2a-efb9-4264-8328-d37f1d56d490" status: 202 len: 0 microversion: 2.1 time: 0.551028 Nov 03 04:21:00.428109 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2788/5462] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:20:59 2022] DELETE /compute/v2.1/os-security-groups/904d7f2a-efb9-4264-8328-d37f1d56d490 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:21:00.437650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:00.440001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:00.519772 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2c7b802-812c-4df7-8f67-45294858adb4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/action" status: 202 len: 0 microversion: 2.20 time: 0.669096 Nov 03 04:21:00.537357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:00.539014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:00.539651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:00.539987 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2675/5463] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:20:59 2022] POST /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:21:00.542763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:00.543418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:00.546401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:00.572549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ffebcad-b9dc-4f9e-980a-ea75cd148508 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Calling method '.version_select at 0x7ff7f3f09040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:00.622734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lazy-loading 'flavor' on Instance uuid 13159d64-69c4-458f-b9de-a05754c8bfae {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:21:01.063294 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4bcab624-c25b-48ea-bc32-803dc3886ab9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "POST /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae/action" status: 200 len: 32 microversion: 2.1 time: 0.630043 Nov 03 04:21:01.086321 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2789/5464] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:21:00 2022] POST /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae/action => generated 32 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:21:01.096027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:01.097046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:01.123181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:01.126644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:01.127651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:01.128604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:01.131010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:01.134831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:01.182173 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:21:01.182345 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 04:21:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 (ip 10.222.0.30) !!! Nov 03 04:21:01.323003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ffebcad-b9dc-4f9e-980a-ea75cd148508 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/2702af21-a257-49a9-913f-3e63bd88791a" status: 202 len: 0 microversion: 2.1 time: 0.777421 Nov 03 04:21:01.323781 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2676/5465] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:21:00 2022] DELETE /compute/v2.1/os-security-groups/2702af21-a257-49a9-913f-3e63bd88791a => generated 0 bytes in 783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:21:01.329720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:01.330638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:01.345899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:01.349815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:01.351136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:01.351631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:01.353665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:01.354298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:01.835179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:01.847049 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c442975-cf4e-482b-a997-4013a5a6ea66 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.521930 Nov 03 04:21:01.866949 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2677/5466] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:01 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:01.866949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48e9223a-26d9-46af-8e11-4a577d9c1d72 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Calling method '.version_select at 0x7ff7f3fbeaf0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:01.982183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:01.996104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:02.001737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:02.012900 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e5fa805b-4215-4e05-afd0-ad12f71bf9d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1751 microversion: 2.20 time: 0.918855 Nov 03 04:21:02.014387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2790/5467] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:01 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1751 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:02.872490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:02.873326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:02.894192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:02.900848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:02.901629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:02.903792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:02.904390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:02.905308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:02.950267 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48e9223a-26d9-46af-8e11-4a577d9c1d72 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/37cc5c57-c673-4bf4-b5d5-30e3b118ed6e" status: 202 len: 0 microversion: 2.1 time: 1.098371 Nov 03 04:21:02.950854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2678/5468] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:21:01 2022] DELETE /compute/v2.1/os-security-groups/37cc5c57-c673-4bf4-b5d5-30e3b118ed6e => generated 0 bytes in 1100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:21:02.961541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e8e40ef-7dce-4db0-8635-c9fdc4a10eb9 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Calling method '.version_select at 0x7ff7f3fbef70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:03.435226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:03.472146 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e56908ce-1c69-4003-bbf6-8a7bb92c9325 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.603681 Nov 03 04:21:03.477261 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2791/5469] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:02 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:03.482585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:03.487148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:03.500952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:03.502608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:03.510612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:03.516004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:03.516004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:03.516004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:04.123115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:04.145734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:04.156561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:04.159738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:04.161547 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4634e58-c0ac-4571-85a1-49825ad5cd67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1751 microversion: 2.20 time: 0.682896 Nov 03 04:21:04.186010 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2792/5470] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:03 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1751 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:04.326800 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e8e40ef-7dce-4db0-8635-c9fdc4a10eb9 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/5c7f3626-1caa-4ba9-b32f-1faf7632520f" status: 202 len: 0 microversion: 2.1 time: 1.370939 Nov 03 04:21:04.327867 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2679/5471] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:21:02 2022] DELETE /compute/v2.1/os-security-groups/5c7f3626-1caa-4ba9-b32f-1faf7632520f => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:21:04.335644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db98db21-ddd7-4fa0-8485-aee88c74fda7 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] Calling method '.version_select at 0x7ff7f9456e50>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:04.499596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:04.500229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:04.526487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:04.526961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:04.527416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:04.528194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:04.528606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:04.529062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:05.002796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:05.015583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c0065e4b-8f8b-4721-8d34-f4c043e227aa tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.519719 Nov 03 04:21:05.016182 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2680/5472] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:04 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:05.070505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db98db21-ddd7-4fa0-8485-aee88c74fda7 tempest-SecurityGroupRulesNegativeTestJSON-1822432163 tempest-SecurityGroupRulesNegativeTestJSON-1822432163-project] 10.222.0.30 "DELETE /compute/v2.1/os-security-groups/e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43" status: 202 len: 0 microversion: 2.1 time: 0.738832 Nov 03 04:21:05.071091 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2793/5473] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Nov 3 04:21:04 2022] DELETE /compute/v2.1/os-security-groups/e83af2db-4b3f-4ae9-a1f0-1a83d12bdc43 => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:21:05.196898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:05.198616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:05.252055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:05.252913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:05.255286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:05.262655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:05.264367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:05.268409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:06.051473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:06.053353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:06.087236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:06.087944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:06.088183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:06.088914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:06.089424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:06.096438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:06.176871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:06.201246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:06.203796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:06.212588 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b31dfb97-aeaa-45c9-a56c-512b5d6b6967 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 1.022677 Nov 03 04:21:06.218739 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2681/5474] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:05 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:06.948112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:06.956413 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4e75618-bd20-4e3b-af8f-545c7f8f6591 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.916429 Nov 03 04:21:06.966795 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2794/5475] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:06 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:07.255569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:07.257298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:07.272985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:07.273800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:07.274438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:07.275378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:07.278653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:07.283553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:07.991509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:07.993316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:08.018435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:08.031874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:08.032715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:08.034365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:08.035083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:08.035736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:08.678165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:08.679019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:08.690643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:08.693602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:08.695437 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f284e679-4a9f-44dc-88ee-9f32e460c4a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 1.451680 Nov 03 04:21:08.696637 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2682/5476] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:07 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:08.700691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9d7bb8a0-406c-41f7-8a0b-5a551df9c54b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.714770 Nov 03 04:21:08.728039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2795/5477] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:07 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:09.726904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:09.726904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:09.736901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:09.738362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:09.742327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:09.743044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:09.743644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:09.743817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=62 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:09.744703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:09.745362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:09.746053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:09.766707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:09.773698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:09.774287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:09.774893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:09.775655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:09.779607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:09.790975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:10.445580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:10.455579 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03eab62b-6ee6-43cf-aaba-8a749de6c4b9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.724875 Nov 03 04:21:10.456173 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2796/5478] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:09 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:10.487986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:10.521331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:10.523317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:10.525220 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df3b8379-cab7-43b1-a10b-b4695f1993d6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 0.803803 Nov 03 04:21:10.528253 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2683/5479] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:09 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:11.484555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:11.487731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:11.522344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:11.524832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:11.528137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:11.530800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:11.531644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:11.532327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:11.560864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:11.561783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:11.575108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:11.575611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:11.576055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:11.576769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:11.577254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:11.577683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:12.309957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:12.319470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:12.325427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:12.332688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:12.333695 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-204d3342-3074-4006-a842-85b144615bd6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.853330 Nov 03 04:21:12.335910 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42a1158a-c20d-4a68-b393-2a5ee83a0d6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 0.779011 Nov 03 04:21:12.344526 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2684/5480] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:11 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:12.370040 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2797/5481] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:11 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:13.386886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:13.386886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:13.394664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:13.395273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:13.411127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:13.416836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:13.416836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:13.417589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:13.417589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:13.417589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:13.417589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:13.417589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:13.417589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:13.422791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:13.423387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:13.423972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:14.192187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:14.197295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:14.238141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:14.241094 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b48d8ac9-f268-452a-8894-fe029a2fb4f7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.852602 Nov 03 04:21:14.250033 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2798/5482] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:13 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:14.250232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:14.254276 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f66bd0b-311f-44f0-80d8-ea1449aca987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 0.878440 Nov 03 04:21:14.254276 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2685/5483] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:13 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:15.279751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:15.280364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:15.285676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:15.286892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:15.307327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:15.309068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:15.309577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:15.310026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:15.311255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:15.311700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:15.314773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:15.315277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:15.316181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:15.316716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:15.317181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:15.321078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:16.007226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:16.017823 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-922aba96-fa11-408c-8639-3297dec8ec0c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.741670 Nov 03 04:21:16.019384 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2799/5484] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:15 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:16.076225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:16.092298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:16.101051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:16.102974 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0dde5d56-f2ea-4c12-8beb-a94764ff3273 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 0.821333 Nov 03 04:21:16.104232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2686/5485] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:15 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:17.047741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:17.048355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:17.062056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:17.063620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:17.064265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:17.069374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:17.070218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:17.070876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:17.129821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:17.130663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:17.146912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:17.147420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:17.147872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:17.163826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:17.164555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:17.165221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:17.836750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:17.867304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:17.869787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:17.871420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:17.875718 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c37f10b-f05c-471d-9828-01f88f380aa5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 0.748523 Nov 03 04:21:17.879001 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2687/5486] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:17 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:21:17.917771 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8da46ba1-a82a-4d6d-9872-db87c7e5e243 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.872243 Nov 03 04:21:17.919225 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2800/5487] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:17 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:18.927160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:18.928829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:18.948734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:18.948986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:18.949517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:18.952383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:18.953357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:18.955410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:18.956544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:18.957870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:18.982700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:18.983210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:18.983919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:18.984646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:18.994203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:18.994740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:19.404553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:19.429083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:19.431374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:19.447745 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c7af497-4a21-40c9-b3f7-6b9ca8e0e674 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 0.538985 Nov 03 04:21:19.448856 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2688/5488] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:18 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:19.530769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:19.540329 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-474df34c-86e2-49f8-b6f9-a7b8f79584c2 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.596364 Nov 03 04:21:19.544357 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2801/5489] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:18 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:20.476406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:20.477189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:20.539535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:20.543494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:20.553739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:20.554580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:20.555072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:20.555516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:20.572167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:20.572805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:20.596444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:20.599982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:20.602404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:20.603734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:20.604879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:20.605997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:21.211257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:21.232433 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-952b359b-4faf-4e56-a5e0-7d4911c2e433 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 0.665228 Nov 03 04:21:21.238488 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2802/5490] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:20 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:21.261558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:21.271449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:21.279587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:21.283440 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30ed72a3-d9de-46a0-a972-b1787016e859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1753 microversion: 2.20 time: 0.811834 Nov 03 04:21:21.284249 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2689/5491] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:20 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1753 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:22.268622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:22.269272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:22.288889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:22.289458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:22.289879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:22.291307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:22.300310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:22.303290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:22.312899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:22.313583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:22.325993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:22.326494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:22.326944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:22.338355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:22.340436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:22.340604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:23.885474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:23.905973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:23.925037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:23.926812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:23.928358 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24dd0793-9cd3-418f-acef-ff40f9a426fe tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 1.619324 Nov 03 04:21:23.929596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2690/5492] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:22 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:23.934215 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-704e794e-58b2-4d52-8838-2aa63120ce73 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1506 microversion: 2.1 time: 1.670964 Nov 03 04:21:23.935072 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2803/5493] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:22 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1506 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:24.957084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:24.958278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:24.958718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:24.958939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:24.983778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:24.984885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:24.985529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:24.986076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:24.986836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:24.987176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:24.987298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:24.987730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:24.988435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:24.993196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:24.994611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:24.995977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:25.665330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:25.675419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:25.679568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:25.680834 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80fbc8fa-820f-4e15-a902-04613bed0de6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.729593 Nov 03 04:21:25.681475 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2691/5494] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:24 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:25.769683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:25.778127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc6325ab-b1b0-4ff0-adfa-05a612460ef5 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1486 microversion: 2.1 time: 0.823673 Nov 03 04:21:25.795930 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2804/5495] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:24 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1486 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:26.173952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1481792272", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:26.289975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] validate_networks() for [('da4049c8-b410-49f2-98f9-ec02f253884f', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:21:26.429563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4097552e-5545-452d-b658-0da443d95ba0 req-8470da8e-43c6-458f-82ee-ee9749044077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:26.467915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4097552e-5545-452d-b658-0da443d95ba0 req-8470da8e-43c6-458f-82ee-ee9749044077 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:26.475309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4097552e-5545-452d-b658-0da443d95ba0 req-8470da8e-43c6-458f-82ee-ee9749044077 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:26.475775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4097552e-5545-452d-b658-0da443d95ba0 req-8470da8e-43c6-458f-82ee-ee9749044077 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:26.568861 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4097552e-5545-452d-b658-0da443d95ba0 req-8470da8e-43c6-458f-82ee-ee9749044077 service nova] Creating event network-changed:6b519c86-8b5c-406f-9ed8-fed59ea01091 for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 on n-h1-854653-7 Nov 03 04:21:26.589329 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4097552e-5545-452d-b658-0da443d95ba0 req-8470da8e-43c6-458f-82ee-ee9749044077 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162951 Nov 03 04:21:26.589329 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2805/5496] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:21:26.742918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:26.762087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:26.786939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:26.800563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:26.803403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:26.804454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:26.805043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:26.808320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:27.377313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:21:27.378507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:21:27.379396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:21:27.379941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:21:27.381093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:21:27.420737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:27.423300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:27.424607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:27.426028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:27.428705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:27.430962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:27.472238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Getting quotas for project debecb0926db4a13bf27776c374e78b3. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:21:27.484122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Getting quotas for user 072281a978194e5cb7d93f5af2629b99 and project debecb0926db4a13bf27776c374e78b3. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:21:27.512881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:21:27.518426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:21:27.703851 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e178aa45-1241-434f-967e-ecad21b273d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.534030 Nov 03 04:21:27.706022 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2692/5497] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:21:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:21:27.737658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7e38d52-ea16-4d9b-9851-496be41178c8 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:27.741985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7e38d52-ea16-4d9b-9851-496be41178c8 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:27.806826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:27.849314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:27.849314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:27.849314 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a5c6b80-768f-47a2-bd74-7be45c0ca261 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 1.108197 Nov 03 04:21:27.865125 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2806/5498] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:26 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:27.881340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2cbcf9f4-dc38-4818-9e3a-fc606172ed06 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Action: 'create', calling method: .version_select at 0x7ff7f9456940>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1879748087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzDnckfv6CIkO9ohStlulFG8n+F3Yay6fE8OSgeFXGgThqkx/wU/vGZPyEyYaRKaYQ4wdIQ4ZqxDVPPd6cn1dEIZjU/ijDpp5ccJTInuFbBQd2IcylLK2uySDfX9xmVOA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:27.953964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-2cbcf9f4-dc38-4818-9e3a-fc606172ed06 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Getting quotas for project 169d5b1fe905496d8188ce5d40d0eb99. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:21:27.966899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-2cbcf9f4-dc38-4818-9e3a-fc606172ed06 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Getting quotas for user a461b81661ae499b88b5b260af30d161 and project 169d5b1fe905496d8188ce5d40d0eb99. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:21:28.069859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7e38d52-ea16-4d9b-9851-496be41178c8 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:28.079651 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2cbcf9f4-dc38-4818-9e3a-fc606172ed06 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.211184 Nov 03 04:21:28.082323 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7e38d52-ea16-4d9b-9851-496be41178c8 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1214 microversion: 2.1 time: 0.361982 Nov 03 04:21:28.086135 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2693/5499] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:27 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1214 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:28.086684 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2807/5500] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:21:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:21:28.873434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:28.874221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:28.898477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:28.898477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:28.898477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:28.898477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:28.898477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:28.936618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:29.110133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd83080d-4222-466a-97ac-c116746d7c85 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:29.110847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd83080d-4222-466a-97ac-c116746d7c85 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:29.375245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd83080d-4222-466a-97ac-c116746d7c85 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:29.384709 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd83080d-4222-466a-97ac-c116746d7c85 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1214 microversion: 2.1 time: 0.278544 Nov 03 04:21:29.404297 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2808/5501] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:29 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1214 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:29.790703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:29.851470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:29.855250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:29.865775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7f6bd08-dac4-4418-93a9-f29fb8541193 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.987635 Nov 03 04:21:29.878980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2694/5502] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:28 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:30.425982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:30.428656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:30.455769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:30.460656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:30.461560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:30.463899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:30.470832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:30.471464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:30.773414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:30.781743 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e022bafd-9e08-4257-9177-ee3b9618d7c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1266 microversion: 2.1 time: 0.367029 Nov 03 04:21:30.808436 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2809/5503] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:30 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1266 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:30.900170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:30.900170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:30.903660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:30.923289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:30.923289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:30.923831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:30.927281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:30.929107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:30.930826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:31.814262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:31.815764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:31.847766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:31.859021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:31.859938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:31.861738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:31.863565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:31.865490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:32.441875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:32.450896 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-70db6267-688c-48d4-83b3-a9b904475213 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1272 microversion: 2.1 time: 0.640906 Nov 03 04:21:32.459244 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2810/5504] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:31 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1272 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:33.070259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:33.087806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:33.089632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:33.091089 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2745d48a-db4b-4ae0-8096-f9f1d43b74a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 2.202021 Nov 03 04:21:33.095865 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2695/5505] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:30 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:33.492906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:33.492906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:33.535480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:33.536987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:33.537504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:33.538297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:33.544144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:33.547621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:33.939416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:33.969315 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bba62187-8ce9-46a5-9ba3-f981b1de5e38 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1272 microversion: 2.1 time: 0.492401 Nov 03 04:21:33.974798 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2811/5506] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:33 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1272 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:34.131471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:34.135026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:34.147812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:34.148864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:34.149985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:34.151075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:34.210695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:34.214356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:35.022074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:35.023464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:35.039844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:35.040676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:35.043762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:35.044991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:35.047676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:35.048958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:35.055865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=93 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:35.345855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:35.372895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:35.381295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:35.396644 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48e5a3af-96a2-4864-9498-b1fbce01bc6c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 1.274172 Nov 03 04:21:35.400461 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2696/5507] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:34 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:35.513784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:35.538139 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c12258fc-00d3-47db-a998-139ba97f6b26 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1272 microversion: 2.1 time: 0.520686 Nov 03 04:21:35.558645 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2812/5508] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:35 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1272 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:36.444892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:36.444892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:36.453322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:36.474877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:36.477103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:36.478405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:36.481097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:36.482724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:36.565962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:36.567804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:36.598028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:36.604027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:36.605412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:36.610227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:36.618167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:36.619444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:37.220445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:37.233633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:37.239986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:37.242636 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-761f83d7-4105-4a07-80a9-6d6f66361c19 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.819520 Nov 03 04:21:37.248075 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2697/5509] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:36 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:37.266949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:37.275920 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c4fefe4-793b-4dba-8a83-c8459958cc74 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.714951 Nov 03 04:21:37.276515 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2813/5510] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:36 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:38.010420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1673706247", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "92d20bf2-9e66-4d67-8c2f-b0c6e28445bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1879748087", "security_groups": [{"name": "tempest-secgroup-smoke-1637028911"}], "networks": [{"uuid": "41891b5c-7590-4320-822a-d22aeb5eb6e8"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:38.045505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:38.113345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:38.277051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:38.278432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:38.297278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:38.301757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:38.304627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:38.306682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:38.308482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:38.319222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:38.700926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] validate_networks() for [('41891b5c-7590-4320-822a-d22aeb5eb6e8', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:21:39.043488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:39.090677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:39.101069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:39.107748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-449d18e2-e521-42b4-af15-ce10dfdefb68 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.832408 Nov 03 04:21:39.112692 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2814/5511] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:38 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:39.138707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:39.139861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:39.182885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:39.183794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:39.186463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:39.190835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:39.193977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:39.197860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:39.379586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:39.705580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:39.724732 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8712f363-cd5f-44ca-be2b-18917afd0899 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.609627 Nov 03 04:21:39.725354 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2815/5512] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:39 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:39.729890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f67074fe-bf5d-4b97-bfa5-5fe52ce6550c req-0c40c165-b6ac-4718-a88f-7d7b2f466980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6ab9189-a974-4e49-8af1-a136fd4754b0", "tag": "985321e0-1586-4aca-9362-b637c558b57b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:39.775222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f67074fe-bf5d-4b97-bfa5-5fe52ce6550c req-0c40c165-b6ac-4718-a88f-7d7b2f466980 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:39.775707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f67074fe-bf5d-4b97-bfa5-5fe52ce6550c req-0c40c165-b6ac-4718-a88f-7d7b2f466980 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:39.776149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f67074fe-bf5d-4b97-bfa5-5fe52ce6550c req-0c40c165-b6ac-4718-a88f-7d7b2f466980 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:39.822453 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f67074fe-bf5d-4b97-bfa5-5fe52ce6550c req-0c40c165-b6ac-4718-a88f-7d7b2f466980 service nova] Creating event network-changed:985321e0-1586-4aca-9362-b637c558b57b for instance f6ab9189-a974-4e49-8af1-a136fd4754b0 on n-h1-854653-7 Nov 03 04:21:39.832622 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f67074fe-bf5d-4b97-bfa5-5fe52ce6550c req-0c40c165-b6ac-4718-a88f-7d7b2f466980 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105957 Nov 03 04:21:39.833281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2816/5513] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:21:40.040922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:21:40.041609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:21:40.042390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:21:40.043255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:21:40.044030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:21:40.069903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:40.071676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:40.074915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:40.077189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:40.078849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:40.081040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:40.112171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=79 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:40.144007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:40.145332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:40.160715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:40.167880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:40.168811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Getting quotas for project 169d5b1fe905496d8188ce5d40d0eb99. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:21:40.172938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:40.177503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:40.181161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:40.186097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Getting quotas for user a461b81661ae499b88b5b260af30d161 and project 169d5b1fe905496d8188ce5d40d0eb99. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:21:40.187018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:40.187936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:40.306707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:21:40.308774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92d20bf2-9e66-4d67-8c2f-b0c6e28445bc',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:21:40.563512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:40.586194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:40.592956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:40.595640 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-721a62f6-3aa4-4f89-a14e-9d10b0e4a7e0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.458813 Nov 03 04:21:40.605152 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2817/5514] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:40 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:40.752039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:40.752785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:40.763035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:40.765136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:40.767328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:40.771184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:40.772532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:40.774460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:40.990831 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a7885e4-ec9d-4e84-befb-60d96c04da42 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.984850 Nov 03 04:21:40.991547 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2698/5515] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:21:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:21:41.027997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-35029000-7f12-48a9-ac23-5a313591e311 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:41.032454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-35029000-7f12-48a9-ac23-5a313591e311 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:41.214859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-35029000-7f12-48a9-ac23-5a313591e311 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:41.233879 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-35029000-7f12-48a9-ac23-5a313591e311 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1099 microversion: 2.1 time: 0.224094 Nov 03 04:21:41.235387 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2699/5516] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:40 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1099 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:41.254172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:41.262962 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3df2ec5e-720e-44f7-8a74-6dc5384565cc tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.516180 Nov 03 04:21:41.278211 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2818/5517] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:40 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:41.629040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:41.630722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:41.646029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:41.652103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:41.652103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:41.652103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:41.657609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:41.658346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:42.262307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-222f1fe0-2f85-4e0d-8fde-9be6d44cc2d6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:42.263845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-222f1fe0-2f85-4e0d-8fde-9be6d44cc2d6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:42.373164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:42.382739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:42.394238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:42.396967 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c48e62f2-72a2-4a04-badc-c3509e67fdf4 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.772057 Nov 03 04:21:42.398139 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2700/5518] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:41 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:42.403114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:42.406054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:42.421884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:42.424830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:42.424830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:42.424830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:42.424830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:42.424830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:42.456821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-222f1fe0-2f85-4e0d-8fde-9be6d44cc2d6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:42.464229 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-222f1fe0-2f85-4e0d-8fde-9be6d44cc2d6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1099 microversion: 2.1 time: 0.210023 Nov 03 04:21:42.464821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2819/5519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:42 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1099 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:42.673335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:42.682146 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7143d1a1-599b-42dd-aca3-cef1a8ffd086 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.282659 Nov 03 04:21:42.682737 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2701/5520] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:42 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:43.446709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:43.454729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:43.487836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:43.488454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:43.500552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:43.509172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:43.511520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:43.512787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:43.513965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:43.515780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:43.516240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:43.517106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:43.521438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:43.527964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:43.530596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:43.539886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:43.704409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:43.715191 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72daf8d3-c849-4337-8c20-5984d136ee13 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1141 microversion: 2.1 time: 0.231645 Nov 03 04:21:43.722378 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2702/5521] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:43 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1141 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:43.732914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:43.734398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:43.799937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:43.800429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:43.800875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:43.816334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:43.817948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:43.818567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:44.478502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:44.503630 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-05f35290-afc5-4a2f-9a34-27c7a0b41599 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.778731 Nov 03 04:21:44.529377 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2703/5522] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:43 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:44.537193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-353848934", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "70f8c330-a36a-4416-aadc-df85b6a6b994"}, {"uuid": "aaf484aa-b7e8-4ff4-9742-353408488f61"}, {"uuid": "70f8c330-a36a-4416-aadc-df85b6a6b994"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:44.710395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] validate_networks() for [('70f8c330-a36a-4416-aadc-df85b6a6b994', None, None, None, None, None), ('aaf484aa-b7e8-4ff4-9742-353408488f61', None, None, None, None, None), ('70f8c330-a36a-4416-aadc-df85b6a6b994', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:21:45.817146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:45.844656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:45.848392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:45.848392 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1af3c0f-28a5-43e9-ad38-2e12e63ecd28 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 2.423434 Nov 03 04:21:45.854065 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2820/5523] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:43 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:45.882754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:45.882754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:45.932061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:45.945594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:45.945594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:45.945594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:45.945594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:45.945594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:46.445308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:46.470040 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ccc49a09-6462-481f-a7fa-80ac0f39a4b1 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1215 microversion: 2.1 time: 0.613887 Nov 03 04:21:46.471265 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2821/5524] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:45 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1215 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:46.482602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:46.496259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:46.515653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:46.516836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:46.517716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:46.518669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:46.519358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:46.520035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:47.869215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:47.882417 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd8d75e2-5c62-4194-95c8-bd3f9715f8fe tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 1.409498 Nov 03 04:21:47.884831 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2822/5525] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:46 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:47.919524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:47.920149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:47.934625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:47.937656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:47.938311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:47.939859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:47.941919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:47.942542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:48.599480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:48.609090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:48.620623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:48.622265 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9460b6a2-6503-42a6-b168-7574f90d9dc2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.736382 Nov 03 04:21:48.623166 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2823/5526] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:47 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:48.989206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:48.992343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:49.002276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:49.002790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:49.003312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:49.009223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:49.009921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:49.010507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:49.210627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:49.219148 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8712a3ec-7d86-4b74-9a36-e742032a1caa tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1215 microversion: 2.1 time: 0.594660 Nov 03 04:21:49.227244 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2824/5527] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:48 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1215 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:49.241855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:49.248861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:49.269687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:49.277810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:49.278557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:49.280049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:49.280722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:49.281798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:50.112876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:50.727888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:50.736894 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4909694e-c128-4e32-9a55-ff30fde7b1e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 1.507985 Nov 03 04:21:50.737603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2825/5528] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:49 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:50.758927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:50.765367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:50.776517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:50.786790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:50.789291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:50.793123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:50.793786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:50.794519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:51.224608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:51.779328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:21:51.780862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:21:51.780862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:21:51.781119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:21:51.781796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:21:51.803424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:51.804878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:51.805958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:51.809581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:51.809581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:51.809581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:51.837464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Getting quotas for project 6194edd64938459b9203e9d6ff8f6dee. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:21:51.848166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Getting quotas for user ad440b59124045949cce93306158dcd5 and project 6194edd64938459b9203e9d6ff8f6dee. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:21:51.884885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:21:51.894068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:21:52.089944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:52.111796 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31939b94-b897-41ca-878f-ec5d03f537b5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.591753 Nov 03 04:21:52.126885 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2704/5529] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:21:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 7607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:21:52.140174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:52.142578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:52.158889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:52.159656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:52.160919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:52.164541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:52.166667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:52.174890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:52.176687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:52.177805 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-06522597-347c-40b4-9f6c-56c498484e67 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 1.436195 Nov 03 04:21:52.185131 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2826/5530] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:50 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:52.203780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:52.204842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:52.221689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:52.223662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:52.239190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:52.240765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:52.245844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:52.246577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:52.251613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:52.469695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:53.416589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:53.434212 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17cc9e08-da0f-48ab-a9ee-c20d25bc338c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 1.239149 Nov 03 04:21:53.437860 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2827/5531] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:52 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:53.455804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98f880bc-eeb1-4f1d-84f7-0eb6bb4a8df4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:53.460386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98f880bc-eeb1-4f1d-84f7-0eb6bb4a8df4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:53.861618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:53.899676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-98f880bc-eeb1-4f1d-84f7-0eb6bb4a8df4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:53.913113 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98f880bc-eeb1-4f1d-84f7-0eb6bb4a8df4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1212 microversion: 2.1 time: 0.473598 Nov 03 04:21:53.913696 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2828/5532] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:53 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1212 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:53.915192 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aaf1d2c3-c553-47e8-8108-d9f1de7ca262 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1283 microversion: 2.1 time: 1.786766 Nov 03 04:21:53.919897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2705/5533] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:52 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1283 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:53.929962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:53.936485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:53.957453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:53.962847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:53.962847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:53.967964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:53.968881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:53.969365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:54.168984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6ae8d7e3-0809-4f51-b12a-590e786320d9 req-d7939b20-4480-4233-8cf6-1f7712943fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ab9189-a974-4e49-8af1-a136fd4754b0", "name": "network-vif-plugged", "status": "completed", "tag": "985321e0-1586-4aca-9362-b637c558b57b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:54.194801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6ae8d7e3-0809-4f51-b12a-590e786320d9 req-d7939b20-4480-4233-8cf6-1f7712943fdb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:54.196727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6ae8d7e3-0809-4f51-b12a-590e786320d9 req-d7939b20-4480-4233-8cf6-1f7712943fdb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:54.197702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6ae8d7e3-0809-4f51-b12a-590e786320d9 req-d7939b20-4480-4233-8cf6-1f7712943fdb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:54.243573 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6ae8d7e3-0809-4f51-b12a-590e786320d9 req-d7939b20-4480-4233-8cf6-1f7712943fdb service nova] Creating event network-vif-plugged:985321e0-1586-4aca-9362-b637c558b57b for instance f6ab9189-a974-4e49-8af1-a136fd4754b0 on n-h1-854653-7 Nov 03 04:21:54.263071 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6ae8d7e3-0809-4f51-b12a-590e786320d9 req-d7939b20-4480-4233-8cf6-1f7712943fdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101057 Nov 03 04:21:54.264507 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2829/5534] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:21:54.462553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:54.463347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:54.471637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:54.473259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:54.474336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:54.475281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:54.475964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:54.477152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:54.529143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:54.547251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:54.551928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:54.563896 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6104f6e2-8e3d-458d-be0a-753f46fc87bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.644626 Nov 03 04:21:54.564497 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2706/5535] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:53 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:54.822628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:54.830553 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d564db9c-f251-4639-994b-956c8425413f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.374218 Nov 03 04:21:54.848014 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2830/5536] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:54 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:54.940330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:54.943412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:54.944049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:54.946455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:54.960056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:54.963421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:54.974284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:54.974397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:54.975077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:54.975575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:54.976332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:54.977962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:54.978472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:54.981666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:54.985511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:54.987490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:55.252848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:55.262501 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-25585df4-0803-4d37-ac2e-ad017dfa7b74 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1216 microversion: 2.1 time: 0.330295 Nov 03 04:21:55.264135 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2707/5537] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:54 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1216 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:55.487995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:55.497170 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a37ba22-2d6e-42b3-9b35-50ffe737b211 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1283 microversion: 2.1 time: 0.557356 Nov 03 04:21:55.511390 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2831/5538] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:54 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1283 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:55.596879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:55.598113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:55.616468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:55.617289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:55.621860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:55.621860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:55.621860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:55.621860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:55.855081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:55.860222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:55.862011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:55.863375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:55.864366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:55.865098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:55.866064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:55.866737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:55.867379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:55.871000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:55.872520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:55.872888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:21:55.873756 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a3ef411-3d2a-4d2e-9e10-223d51818be9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.283600 Nov 03 04:21:55.876418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2708/5539] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:55 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:56.057614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-df2335c1-f0fd-486e-87b3-10b172f6640e req-4091a45f-b0eb-4976-93b8-442e04a9d213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50604c9a-e553-4d67-895f-12b056247522", "tag": "14f518b5-b278-4fe3-939b-74565aeb5968"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:56.103803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-df2335c1-f0fd-486e-87b3-10b172f6640e req-4091a45f-b0eb-4976-93b8-442e04a9d213 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:56.104796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-df2335c1-f0fd-486e-87b3-10b172f6640e req-4091a45f-b0eb-4976-93b8-442e04a9d213 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:56.111592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-df2335c1-f0fd-486e-87b3-10b172f6640e req-4091a45f-b0eb-4976-93b8-442e04a9d213 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:56.137585 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-df2335c1-f0fd-486e-87b3-10b172f6640e req-4091a45f-b0eb-4976-93b8-442e04a9d213 service nova] Creating event network-changed:14f518b5-b278-4fe3-939b-74565aeb5968 for instance 50604c9a-e553-4d67-895f-12b056247522 on n-h2-854653-7 Nov 03 04:21:56.150841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-df2335c1-f0fd-486e-87b3-10b172f6640e req-4091a45f-b0eb-4976-93b8-442e04a9d213 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100569 Nov 03 04:21:56.155340 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2709/5540] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:21:56.293679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:56.294760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:56.310026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:56.316912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:56.316912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:56.316912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:56.317304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:56.317943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:56.318786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:56.326732 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73f372a9-5be9-4746-a92d-997bbbf7a417 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.475319 Nov 03 04:21:56.333424 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2832/5541] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:55 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:56.481840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:56.500472 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b3607667-368b-4258-8f1e-9254fdd21a8a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1208 microversion: 2.1 time: 0.210023 Nov 03 04:21:56.500472 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2710/5542] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:56 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1208 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:56.525125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:56.525753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:56.536388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:56.540871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:56.541544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:56.545723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:56.546390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:56.548806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:56.839574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:56.851345 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e4c647e3-9b42-42eb-8513-3aa361b984bf tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1283 microversion: 2.1 time: 0.331559 Nov 03 04:21:56.865588 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2833/5543] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:56 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1283 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:56.911832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:56.912722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:56.923781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:56.930519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:56.930519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:56.930519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:56.930519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:56.930519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:57.354626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:57.355263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:57.375300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:57.377171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:57.378329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:57.382348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:57.385148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:57.385847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:57.387364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:57.402234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:57.411648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:57.414790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-031341da-a4be-4417-ae7b-6addbde9b35f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.510185 Nov 03 04:21:57.414790 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2711/5544] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:56 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:21:57.522353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:57.522969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:57.539114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:57.539630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:57.540075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:57.540796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:57.541285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:57.541721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:57.784474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:57.793129 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f8a1d860-d4b1-452e-90f7-03a19a8c0f32 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1264 microversion: 2.1 time: 0.274480 Nov 03 04:21:57.813031 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2712/5545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:57 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1264 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:57.823433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:57.837406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc7b60c9-ec67-4fa5-bdcd-5765c45d0db9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1314 microversion: 2.1 time: 0.488519 Nov 03 04:21:57.851258 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2834/5546] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:57 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:57.885397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:57.886600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:57.904623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:57.905152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:57.905767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:57.915620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:57.941170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:57.941960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:58.439834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:58.440602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:58.463368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:58.465477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:58.466086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:58.466536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:58.467269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:58.467729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:58.468161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:58.476536 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-01a17007-a04d-4315-a113-a062922bd91f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1283 microversion: 2.1 time: 0.594912 Nov 03 04:21:58.500973 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2713/5547] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:57 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1283 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:58.817283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:58.818218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:58.830190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:58.830691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:58.831133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:58.834440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:58.835192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:58.836021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:58.985151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:58.994019 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad9067a5-a042-4eac-a2e4-6972c2dde3dc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1272 microversion: 2.1 time: 0.181465 Nov 03 04:21:58.994686 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2714/5548] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:58 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:21:58.999610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:59.000459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:59.007499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.015728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.015728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:59.015728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.015728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.015728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:59.016353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:59.026916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:59.032268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:59.037904 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa99b66f-f91f-4030-bb12-eee0162bdf8b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.597715 Nov 03 04:21:59.037904 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2835/5549] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:21:58 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:21:59.346058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:21:59.355671 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1d6d780-8aef-4d81-a518-d94a531547c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1501 microversion: 2.1 time: 0.359731 Nov 03 04:21:59.356329 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2715/5550] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:58 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1501 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:21:59.380226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:21:59.382671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:59.390322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.390820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.391263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:59.393202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.393669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.394713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:59.425817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lazy-loading 'flavor' on Instance uuid f6ab9189-a974-4e49-8af1-a136fd4754b0 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:21:59.507428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:59.508052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:59.516887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.518465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.519656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:59.520554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.521809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.522534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:59.815158 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3b858192-de0b-442e-8332-ce77e6e61e61 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "POST /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0/action" status: 200 len: 32 microversion: 2.1 time: 0.439323 Nov 03 04:21:59.816937 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2836/5551] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:21:59 2022] POST /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0/action => generated 32 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:21:59.827877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:21:59.832782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:21:59.841323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.842278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.842954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:21:59.844028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:21:59.845049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:21:59.845676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:00.213287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:00.224981 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74c96bfd-ac0d-4613-8ebb-c10243604de7 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.721928 Nov 03 04:22:00.234192 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2716/5552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:59 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:00.239740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:00.240365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:00.250648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:00.251352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:00.251596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:00.261436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:00.262193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:00.262851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:00.358096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:00.368660 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cdc1db49-d21c-43fa-b6eb-660cbe455e57 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.545962 Nov 03 04:22:00.369822 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2837/5553] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:21:59 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:00.375472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:00.376293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:00.383648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:00.384427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:00.385120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:00.386111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:00.386888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:00.389217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:00.428103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:00.444557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:00.446891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b3faf82a-ec60-44fa-8201-cf6f1d82d97a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1270 microversion: 2.1 time: 0.211398 Nov 03 04:22:00.462372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2717/5554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:00 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:01.255703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:01.256486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:01.266761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:01.267265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:01.267728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:01.272191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:01.272191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:01.272191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:01.714814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:01.727928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:01.730212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:01.731837 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3b0433fd-ef2d-4cd7-96a8-05f039e98d31 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 1.360713 Nov 03 04:22:01.732631 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2838/5555] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:00 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:01.738651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:01.741170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:01.749000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:01.749949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:01.750772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:01.751894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:01.752580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:01.753309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:01.823558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:01.853407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:01.867639 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f34d7ec-9df0-4add-8b82-1530eda2c3b6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.616828 Nov 03 04:22:01.871149 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2718/5556] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:01 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:01.879401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:01.880998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:01.900206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:01.902043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:01.905233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:01.906494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:01.911503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:01.912571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:01.913341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:01.914045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:02.253835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:02.269949 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c943b376-ba1b-4787-8649-5b27b2c668d3 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1312 microversion: 2.1 time: 0.397118 Nov 03 04:22:02.273084 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2719/5557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:01 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1312 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:02.280572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:02.294700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d3e7337-7a42-49fd-bda0-23ba32e734ea tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.560246 Nov 03 04:22:02.295472 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2839/5558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:01 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:02.762453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:02.763667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:02.773348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:02.774354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:02.775041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:02.775989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:02.776670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:02.777369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:02.898077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:02.902050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:02.914988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:02.918472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:02.919163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:02.922020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:02.922768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:02.924571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:03.331140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:03.345282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:03.351352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:03.353088 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6449f4e4-100f-42d8-afbb-c675d5efc16c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.595746 Nov 03 04:22:03.353920 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2720/5559] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:02 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:03.365719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:03.368032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:03.385348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:03.386262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:03.386919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:03.389426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:03.390441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:03.391732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:03.470267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:03.493181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-182b78f6-4743-469f-ad63-484fb2e13469 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.599667 Nov 03 04:22:03.493787 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2840/5560] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:02 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:03.510064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:03.510760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:03.522823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:03.523929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:03.524888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:03.527830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:03.528523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:03.529176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:03.915457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:03.932396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:03.940425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-66f0e8f4-e916-4549-b003-43cb36495454 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1333 microversion: 2.1 time: 0.584139 Nov 03 04:22:03.941100 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2721/5561] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:03 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1333 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:03.989670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:04.006234 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ade60d72-d0c1-4b98-b5b6-b526d3eec221 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.507002 Nov 03 04:22:04.006745 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2841/5562] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:03 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:04.385471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:04.386122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:04.405743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:04.406244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:04.413473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:04.413473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:04.413473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:04.413473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:04.528030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:04.528485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:04.538519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:04.538926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:04.539363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:04.542658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:04.545242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:04.549683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:04.940713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:04.944114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:04.966578 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-390958e4-7338-4cb0-8bcb-6338961dbb0c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.438145 Nov 03 04:22:04.967407 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2842/5563] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:04 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:04.970959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:04.974129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:04.977794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:04.979859 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-58a874a8-3630-426a-bd19-f2fc0fa89fe0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.601878 Nov 03 04:22:04.984317 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2722/5564] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:04 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:04.986803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:05.003788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:05.004704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:05.005398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:05.007860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:05.009265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:05.010503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:05.030245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:05.031226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:05.046596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:05.047689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:05.049521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:05.053523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:05.058435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:05.060220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:05.464920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:05.477553 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5f0e7609-1ff9-4d16-a1d3-d6cff7cfb211 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1333 microversion: 2.1 time: 0.505282 Nov 03 04:22:05.478637 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2843/5565] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:04 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1333 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:05.566469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:05.604239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3f4646e-05f8-4131-b733-a989cf59e92e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.578132 Nov 03 04:22:05.621053 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2723/5566] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:05 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:05.990808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:05.991489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:06.005197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.005939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.006572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:06.013180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:06.013950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:06.014382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.015029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.015625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:06.026556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.029660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.030844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:06.033821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.034655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.037210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:06.405990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:06.449962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:06.452278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf33f0eb-93a0-4ebf-855e-823055810135 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.463788 Nov 03 04:22:06.452958 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2844/5567] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:05 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:06.505120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:06.505756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:06.508690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:06.516410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:06.517898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a8696bc-f96d-4f70-af92-4272c36b1182 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.508675 Nov 03 04:22:06.525169 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2724/5568] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:06 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:06.525441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.525441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.527819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:06.529804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.537553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.545095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:06.639861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:06.641205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:06.655001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.655001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.655001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:06.655001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:06.655001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:06.655001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:07.419253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:07.427634 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72de885b-fc45-44b7-966e-503590116b8b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.928723 Nov 03 04:22:07.428206 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2845/5569] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:06 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:07.448037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-30155721-2ced-4703-825a-d9c7a9681997 req-9c66f687-af78-4243-b759-c689157eb0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "name": "network-vif-plugged", "status": "completed", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:07.479215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-30155721-2ced-4703-825a-d9c7a9681997 req-9c66f687-af78-4243-b759-c689157eb0fa service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:07.479680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-30155721-2ced-4703-825a-d9c7a9681997 req-9c66f687-af78-4243-b759-c689157eb0fa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:07.480104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-30155721-2ced-4703-825a-d9c7a9681997 req-9c66f687-af78-4243-b759-c689157eb0fa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:07.527432 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-30155721-2ced-4703-825a-d9c7a9681997 req-9c66f687-af78-4243-b759-c689157eb0fa service nova] Creating event network-vif-plugged:6b519c86-8b5c-406f-9ed8-fed59ea01091 for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 on n-h1-854653-7 Nov 03 04:22:07.555011 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-30155721-2ced-4703-825a-d9c7a9681997 req-9c66f687-af78-4243-b759-c689157eb0fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118785 Nov 03 04:22:07.555648 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2846/5570] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:07.581902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:07.586927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:07.602243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:07.602766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:07.603207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:07.603918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:07.604374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:07.604801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:07.611655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:07.642784 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24cf44d6-5cc1-426e-977a-815284ac4f82 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 1.003476 Nov 03 04:22:07.645331 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2725/5571] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:06 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:07.648287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:07.697910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:07.699952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:07.716574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:07.719112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:07.719800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:07.722489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:07.723830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:07.724822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:07.979379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:07.992353 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5af74b6e-a5d5-4a65-a0a8-6023f79cdda6 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.432976 Nov 03 04:22:07.994117 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2847/5572] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:07 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:08.174637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:08.185432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:08.187783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:08.189755 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0babca46-e1ec-4d8e-bb17-75aa3f4dae2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.514303 Nov 03 04:22:08.190206 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2726/5573] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:07 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:08.450571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:08.451196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:08.460034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:08.464479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:08.465060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:08.465859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:08.466343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:08.466871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:08.672565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:08.673232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:08.688457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:08.689486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:08.690131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:08.691132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:08.691766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:08.692384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:09.048923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:09.065738 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a723dbec-7906-4855-8352-c70e7e3d4a3f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.618550 Nov 03 04:22:09.078197 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2848/5574] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:08 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:09.088466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:09.091589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:09.105649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:09.106493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:09.107977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:09.108973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:09.109451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:09.113278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:09.147973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:09.166214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-319bd6cd-a5d7-4400-970f-a7936a4e561e tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.496120 Nov 03 04:22:09.167584 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2727/5575] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:08 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:09.218315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:09.218946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:09.228575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:09.230271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:09.233543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:09.236342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:09.236835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:09.237501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:09.663278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:09.673239 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40d86f75-cb80-401b-98e1-9cfa4bade02b tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.593070 Nov 03 04:22:09.674850 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2849/5576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:09 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:09.783881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:09.797141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:09.801008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:09.802952 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04965834-ec98-4415-b4d6-cae3251e9c77 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.588825 Nov 03 04:22:09.805766 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2728/5577] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:09 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:10.059794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-72bf0138-32a1-4a97-9de9-418b1f8733b0 req-02c32fc9-22f6-4951-933d-8f1d97e6db6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "tag": "336332db-ada1-4c80-ae46-19ec271842ac"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:10.078210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72bf0138-32a1-4a97-9de9-418b1f8733b0 req-02c32fc9-22f6-4951-933d-8f1d97e6db6a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.078716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72bf0138-32a1-4a97-9de9-418b1f8733b0 req-02c32fc9-22f6-4951-933d-8f1d97e6db6a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.079166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72bf0138-32a1-4a97-9de9-418b1f8733b0 req-02c32fc9-22f6-4951-933d-8f1d97e6db6a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.092191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:10.094905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:10.118615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.123172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.123805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.127810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.129554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.135303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.161411 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-72bf0138-32a1-4a97-9de9-418b1f8733b0 req-02c32fc9-22f6-4951-933d-8f1d97e6db6a service nova] Creating event network-changed:336332db-ada1-4c80-ae46-19ec271842ac for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:10.174850 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-72bf0138-32a1-4a97-9de9-418b1f8733b0 req-02c32fc9-22f6-4951-933d-8f1d97e6db6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496794 Nov 03 04:22:10.177331 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2850/5578] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:10.201219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:10.203734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:10.223769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.224435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.225157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.229367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.230191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.230863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.766526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:10.797723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6eb24ea0-585a-40cf-9cd0-81d45fb4197a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.604737 Nov 03 04:22:10.799438 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2851/5579] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:10 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:10.805511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:10.806435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:10.813418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=74 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:10.815304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.816521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.819512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.819512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.819512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.819512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.902160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:10.915114 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f5aad71-ea87-4bb1-8a97-2c3eb49cbcf9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.824408 Nov 03 04:22:10.926372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2729/5580] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:10 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:10.934620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:10.935238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:10.943612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.944372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.944824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:10.945581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:10.946587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:10.947037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:11.287889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:11.302667 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a0f81c8-1222-461c-8e09-5df153c7512e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.501114 Nov 03 04:22:11.303536 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2852/5581] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:10 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:11.368037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:11.389960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:11.392671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:11.395537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a41c263c-2b4b-477a-9eec-6f2b4dac15a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1809 microversion: 2.20 time: 0.468042 Nov 03 04:22:11.396733 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2730/5582] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:10 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1809 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:11.830509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:11.831999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:11.845580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:11.846439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:11.848744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:11.851205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:11.851941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:11.853584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:11.934904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-94c14f72-8059-4850-94a2-7eec48cf1ad7 req-5d8b31ce-fb2d-42b5-b944-3d372d54ff6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50604c9a-e553-4d67-895f-12b056247522", "name": "network-vif-plugged", "status": "completed", "tag": "14f518b5-b278-4fe3-939b-74565aeb5968"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:11.950001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-94c14f72-8059-4850-94a2-7eec48cf1ad7 req-5d8b31ce-fb2d-42b5-b944-3d372d54ff6d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:11.950810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-94c14f72-8059-4850-94a2-7eec48cf1ad7 req-5d8b31ce-fb2d-42b5-b944-3d372d54ff6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:11.955411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-94c14f72-8059-4850-94a2-7eec48cf1ad7 req-5d8b31ce-fb2d-42b5-b944-3d372d54ff6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:11.971117 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-94c14f72-8059-4850-94a2-7eec48cf1ad7 req-5d8b31ce-fb2d-42b5-b944-3d372d54ff6d service nova] Creating event network-vif-plugged:14f518b5-b278-4fe3-939b-74565aeb5968 for instance 50604c9a-e553-4d67-895f-12b056247522 on n-h2-854653-7 Nov 03 04:22:11.979838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-94c14f72-8059-4850-94a2-7eec48cf1ad7 req-5d8b31ce-fb2d-42b5-b944-3d372d54ff6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059418 Nov 03 04:22:11.986752 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2731/5583] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:12.043673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:12.048246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:12.072412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:12.076693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:12.081848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:12.081848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:12.082602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:12.082684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:12.509447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:12.541155 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-67effa27-a21b-4204-ae6b-33170e25d9e7 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.700365 Nov 03 04:22:12.557200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2853/5584] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:11 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:12.563173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:12.564011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:12.571528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:12.572024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:12.572498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:12.578753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:12.578753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:12.578753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:12.579216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:12.585271 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ba30477-9753-4a4d-abfe-50758e730e4a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.602303 Nov 03 04:22:12.586447 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2732/5585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:11 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:12.591648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:12.592492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:12.605483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:12.606236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:12.607266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:12.608164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:12.609103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:12.610426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:13.326889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:13.335408 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7bbfa62-b0db-4bcf-80e1-0989f7b365db tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1271 microversion: 2.1 time: 0.776873 Nov 03 04:22:13.335996 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2854/5586] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:12 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1271 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:13.349821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2e9eab38-c4b7-4b98-9612-1a7d686b71b8 req-d11d43ea-84c9-45d0-879b-801c59a08c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "tag": "e8397bb4-e909-4162-b620-f46c6036969c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:13.350657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2e9eab38-c4b7-4b98-9612-1a7d686b71b8 req-d11d43ea-84c9-45d0-879b-801c59a08c5e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:13.351341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2e9eab38-c4b7-4b98-9612-1a7d686b71b8 req-d11d43ea-84c9-45d0-879b-801c59a08c5e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:13.351897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2e9eab38-c4b7-4b98-9612-1a7d686b71b8 req-d11d43ea-84c9-45d0-879b-801c59a08c5e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:13.387152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:13.401128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:13.402966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:13.404282 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f8a3d6fe-6f4e-4498-9528-0f3d06ae859c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1796 microversion: 2.20 time: 0.816598 Nov 03 04:22:13.415666 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2733/5587] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:22:12 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1796 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:22:13.571759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:13.571922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:13.578568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:13.580155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:13.581407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:13.582352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:13.584653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:13.585350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:13.660391 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2e9eab38-c4b7-4b98-9612-1a7d686b71b8 req-d11d43ea-84c9-45d0-879b-801c59a08c5e service nova] Creating event network-changed:e8397bb4-e909-4162-b620-f46c6036969c for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:13.666930 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2e9eab38-c4b7-4b98-9612-1a7d686b71b8 req-d11d43ea-84c9-45d0-879b-801c59a08c5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.329586 Nov 03 04:22:13.671179 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2855/5588] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:13.677514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:13.678458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:13.689736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:13.692437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:13.692895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:13.693893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:13.694530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:13.695171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:14.223758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:14.250289 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d5e458a-719f-4609-a8a0-de140e9ff915 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.683618 Nov 03 04:22:14.265824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:14.273607 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2734/5589] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:13 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:14.276696 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2746c34-a2e9-44b4-9308-3bc153f2db89 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.603915 Nov 03 04:22:14.277712 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2856/5590] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:13 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:14.360699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:14.361354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:14.375310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:14.377681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:14.378143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:14.399246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:14.401569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:14.405315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:14.418617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:14.617638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:14.625464 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-411378e3-b0e1-4aa3-98e2-43ad43bfe618 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1461 microversion: 2.1 time: 0.270656 Nov 03 04:22:14.626053 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2735/5591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:14 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1461 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:14.655755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:14.656531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:14.663419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:14.664183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:14.664794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:14.665617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:14.666235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:14.666830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:14.870255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:14.879100 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41db70f9-4810-4904-821e-7574b393ef47 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1461 microversion: 2.1 time: 0.228624 Nov 03 04:22:14.880427 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2857/5592] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:14 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1461 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:15.280302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:15.281554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:15.295420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:15.296694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:15.297376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:15.305044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:15.306126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:15.312432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:15.314954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:15.315568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:15.320465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:15.321084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:15.321772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:15.324949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:15.325704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:15.326366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:15.667037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:15.676695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:15.677770 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c4c293b6-b0f9-4b8e-b788-88d6c4c278ba tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.403702 Nov 03 04:22:15.678918 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2736/5593] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:15 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:15.692643 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e1af05e8-371c-40dc-9285-2b8de6079e45 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.387678 Nov 03 04:22:15.695196 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2858/5594] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:15 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:15.748208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8f4f86ee-997a-4852-b6d1-00fd8c2af5bf req-a85c005b-f709-4df6-b572-351ae90d928f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "tag": "07b7a9f1-28c8-46e8-8640-86dd838bf2af"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:15.775063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8f4f86ee-997a-4852-b6d1-00fd8c2af5bf req-a85c005b-f709-4df6-b572-351ae90d928f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:15.775844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8f4f86ee-997a-4852-b6d1-00fd8c2af5bf req-a85c005b-f709-4df6-b572-351ae90d928f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:15.776485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8f4f86ee-997a-4852-b6d1-00fd8c2af5bf req-a85c005b-f709-4df6-b572-351ae90d928f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:15.815679 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8f4f86ee-997a-4852-b6d1-00fd8c2af5bf req-a85c005b-f709-4df6-b572-351ae90d928f service nova] Creating event network-changed:07b7a9f1-28c8-46e8-8640-86dd838bf2af for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:15.818641 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8f4f86ee-997a-4852-b6d1-00fd8c2af5bf req-a85c005b-f709-4df6-b572-351ae90d928f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073996 Nov 03 04:22:15.819293 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2737/5595] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:16.704381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:16.706195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:16.723701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:16.724162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:16.724610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:16.725368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:16.725818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:16.726525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:16.732101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:16.732928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:16.742064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:16.742569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:16.743346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:16.744235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:16.744869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:16.745505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:17.013310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:17.015604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:17.023184 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-534104ed-a2da-40a1-a2cb-c89e8de7cd5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.306696 Nov 03 04:22:17.026137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9246c6f-7e13-4734-986e-354132d611e1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.326951 Nov 03 04:22:17.027055 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2859/5596] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:16 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:17.029528 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2738/5597] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:16 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:18.051320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:18.054099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:18.060333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:18.061105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:18.070598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:18.071149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:18.071593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:18.072481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:18.072769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:18.073579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:18.074277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:18.074864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:18.079432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:18.079432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:18.079432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:18.079786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:18.513251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:18.532294 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b09ee554-d496-4724-b9ca-46bb0825e8f9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.485028 Nov 03 04:22:18.551787 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2739/5598] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:18 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:18.620155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:18.632980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b662f8f-2232-43f5-8792-30d8c9dac6a9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.589987 Nov 03 04:22:18.633659 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2860/5599] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:18 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:18.649935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-307880ed-d0fe-4437-9e72-94b7f24cf1ba req-0364140d-e191-48f5-9529-db3fe0b31638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50604c9a-e553-4d67-895f-12b056247522", "tag": "14f518b5-b278-4fe3-939b-74565aeb5968"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:18.671976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-307880ed-d0fe-4437-9e72-94b7f24cf1ba req-0364140d-e191-48f5-9529-db3fe0b31638 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:18.672702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-307880ed-d0fe-4437-9e72-94b7f24cf1ba req-0364140d-e191-48f5-9529-db3fe0b31638 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:18.672911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-307880ed-d0fe-4437-9e72-94b7f24cf1ba req-0364140d-e191-48f5-9529-db3fe0b31638 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:18.706332 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-307880ed-d0fe-4437-9e72-94b7f24cf1ba req-0364140d-e191-48f5-9529-db3fe0b31638 service nova] Creating event network-changed:14f518b5-b278-4fe3-939b-74565aeb5968 for instance 50604c9a-e553-4d67-895f-12b056247522 on n-h2-854653-7 Nov 03 04:22:18.720252 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-307880ed-d0fe-4437-9e72-94b7f24cf1ba req-0364140d-e191-48f5-9529-db3fe0b31638 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074665 Nov 03 04:22:18.721158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2740/5600] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:19.586029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:19.587260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:19.606592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:19.608971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:19.610916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:19.613896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:19.614517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:19.614975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:19.662283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:19.663497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:19.678327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:19.678828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:19.680145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:19.681127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:19.681863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:19.682515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:20.986503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:21.001672 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d735c735-ebfe-4eca-9443-9c3f1f4fe20a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 1.425254 Nov 03 04:22:21.004347 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2861/5601] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:19 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:21.021006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-774f982e-3473-42cd-ae61-be8103ff339b req-5ae095f7-6635-45d4-9685-dcce848b8e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50604c9a-e553-4d67-895f-12b056247522", "tag": "14f518b5-b278-4fe3-939b-74565aeb5968"}, {"name": "network-changed", "server_uuid": "50604c9a-e553-4d67-895f-12b056247522", "tag": "14f518b5-b278-4fe3-939b-74565aeb5968"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:21.031725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-774f982e-3473-42cd-ae61-be8103ff339b req-5ae095f7-6635-45d4-9685-dcce848b8e53 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:21.031900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:21.032993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-774f982e-3473-42cd-ae61-be8103ff339b req-5ae095f7-6635-45d4-9685-dcce848b8e53 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:21.033836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-774f982e-3473-42cd-ae61-be8103ff339b req-5ae095f7-6635-45d4-9685-dcce848b8e53 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:21.054729 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-774f982e-3473-42cd-ae61-be8103ff339b req-5ae095f7-6635-45d4-9685-dcce848b8e53 service nova] Creating event network-changed:14f518b5-b278-4fe3-939b-74565aeb5968 for instance 50604c9a-e553-4d67-895f-12b056247522 on n-h2-854653-7 Nov 03 04:22:21.055505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-774f982e-3473-42cd-ae61-be8103ff339b req-5ae095f7-6635-45d4-9685-dcce848b8e53 service nova] Creating event network-changed:14f518b5-b278-4fe3-939b-74565aeb5968 for instance 50604c9a-e553-4d67-895f-12b056247522 on n-h2-854653-7 Nov 03 04:22:21.064020 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-774f982e-3473-42cd-ae61-be8103ff339b req-5ae095f7-6635-45d4-9685-dcce848b8e53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057044 Nov 03 04:22:21.066141 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2862/5602] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:21.069937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a6ce99e-4f18-471c-b7e1-c5546d51e724 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 1.414419 Nov 03 04:22:21.071146 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2741/5603] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:19 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:22.032102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:22.032880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:22.049985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:22.051395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:22.056172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:22.056172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:22.056172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:22.056172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:22.094831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:22.097900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:22.108113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:22.108879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:22.109356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:22.110089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:22.110679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:22.111127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:22.627243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:22.636598 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35fbbb5f-98c3-472d-b3f9-00dc8c6639c4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.610896 Nov 03 04:22:22.650602 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2863/5604] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:22 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:22.685615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:22.695864 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f108e1c-a6fb-4632-a82c-1154bb3b32f7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.605716 Nov 03 04:22:22.697380 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2742/5605] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:22 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:23.668111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:23.669434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:23.678478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:23.679404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:23.680082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:23.681265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:23.681975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:23.682810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:23.722946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:23.723506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:23.739247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:23.739751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:23.741003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:23.741748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:23.742213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:23.742727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:24.427939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:24.435016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:24.436160 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69c3d54d-6608-4fb7-8cb0-709bd9b53ce6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.773310 Nov 03 04:22:24.436832 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2864/5606] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:23 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:24.453415 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-09fb134d-7478-4e97-aada-be61230defdd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.735299 Nov 03 04:22:24.459160 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2743/5607] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:23 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:25.302525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-63999a2a-b2a7-4119-acc6-275e4e10f91d req-b2c0fd1d-bd54-4d3b-80ce-200bd2f76ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "name": "network-vif-plugged", "status": "completed", "tag": "e8397bb4-e909-4162-b620-f46c6036969c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:25.313801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-63999a2a-b2a7-4119-acc6-275e4e10f91d req-b2c0fd1d-bd54-4d3b-80ce-200bd2f76ac3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:25.314379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-63999a2a-b2a7-4119-acc6-275e4e10f91d req-b2c0fd1d-bd54-4d3b-80ce-200bd2f76ac3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:25.315416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-63999a2a-b2a7-4119-acc6-275e4e10f91d req-b2c0fd1d-bd54-4d3b-80ce-200bd2f76ac3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:25.331394 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-63999a2a-b2a7-4119-acc6-275e4e10f91d req-b2c0fd1d-bd54-4d3b-80ce-200bd2f76ac3 service nova] Creating event network-vif-plugged:e8397bb4-e909-4162-b620-f46c6036969c for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:25.337110 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-63999a2a-b2a7-4119-acc6-275e4e10f91d req-b2c0fd1d-bd54-4d3b-80ce-200bd2f76ac3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038740 Nov 03 04:22:25.338321 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2865/5608] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:25.462541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:25.463174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:25.473279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:25.473832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:25.474470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:25.475421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:25.476046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:25.476633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:25.490290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:25.491018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:25.505928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:25.506481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:25.506930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:25.507651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:25.508179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:25.508619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:25.868465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:25.881476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:25.891106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:25.896100 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-836898a8-ef33-4bf0-aca6-4777d39f7e4b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.437782 Nov 03 04:22:25.897362 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2744/5609] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:25 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:25.901414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-220ad590-002a-4d25-a8c9-50c333f43a72 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.421134 Nov 03 04:22:25.906049 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2866/5610] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:25 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:26.928695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:26.930495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:26.930951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:26.932173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:26.939141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:26.940490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:26.941154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:26.942128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:26.942255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:26.942687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:26.943216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:26.943590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:26.943993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:26.944498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:26.944736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:26.944935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:27.190535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:27.203799 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3be622c3-7827-4cac-894a-6d4f19f44643 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.278626 Nov 03 04:22:27.208264 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2867/5611] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:26 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:27.234510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:27.243859 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-66099638-d465-4194-b721-9e6db5b683e6 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.322978 Nov 03 04:22:27.244782 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2745/5612] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:26 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:27.360564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0f189298-f294-4198-ad4a-14689a7d3c39 req-f260e06b-e9a7-4ed7-9bd5-8a3a9bf7d40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "name": "network-vif-plugged", "status": "completed", "tag": "336332db-ada1-4c80-ae46-19ec271842ac"}, {"server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "name": "network-vif-plugged", "status": "completed", "tag": "07b7a9f1-28c8-46e8-8640-86dd838bf2af"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:27.392507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f189298-f294-4198-ad4a-14689a7d3c39 req-f260e06b-e9a7-4ed7-9bd5-8a3a9bf7d40d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:27.393555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f189298-f294-4198-ad4a-14689a7d3c39 req-f260e06b-e9a7-4ed7-9bd5-8a3a9bf7d40d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:27.394367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0f189298-f294-4198-ad4a-14689a7d3c39 req-f260e06b-e9a7-4ed7-9bd5-8a3a9bf7d40d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:27.413096 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0f189298-f294-4198-ad4a-14689a7d3c39 req-f260e06b-e9a7-4ed7-9bd5-8a3a9bf7d40d service nova] Creating event network-vif-plugged:336332db-ada1-4c80-ae46-19ec271842ac for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:27.413964 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0f189298-f294-4198-ad4a-14689a7d3c39 req-f260e06b-e9a7-4ed7-9bd5-8a3a9bf7d40d service nova] Creating event network-vif-plugged:07b7a9f1-28c8-46e8-8640-86dd838bf2af for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:27.422687 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0f189298-f294-4198-ad4a-14689a7d3c39 req-f260e06b-e9a7-4ed7-9bd5-8a3a9bf7d40d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067568 Nov 03 04:22:27.424657 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2868/5613] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:28.237520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:28.237520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:28.241527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:28.242123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:28.242581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:28.243304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:28.243770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:28.244205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:28.274608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:28.276219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:28.284582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:28.285495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:28.286378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:28.287447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:28.288097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:28.288680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:28.682402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:28.691081 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f488bddf-7569-42ee-829f-c753cbe668f9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1354 microversion: 2.1 time: 0.465942 Nov 03 04:22:28.694220 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2746/5614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:28 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1354 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:28.727786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:28.740234 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e36ccd4-9a41-45ce-aa0f-15c930d83426 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.472614 Nov 03 04:22:28.749127 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2869/5615] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:28 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:29.716436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:29.717197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:29.730281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:29.730808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:29.731255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:29.731976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:29.732441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:29.732875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:29.764599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:29.765167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:29.778794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:29.779292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:29.779742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:29.780467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:29.780933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:29.781398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:30.416519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:30.441128 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb574a0c-c64b-40a0-b594-b716b60be826 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.680979 Nov 03 04:22:30.442052 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2870/5616] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:29 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:30.513987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:30.529957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-805c520b-9534-496c-9e16-b71726e46e5a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1802 microversion: 2.1 time: 0.812831 Nov 03 04:22:30.532218 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2747/5617] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:29 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1802 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:30.557967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:30.558944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:30.583075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:30.584753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:30.585393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:30.586286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:30.586915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:30.587995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:30.621427 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f76f32d2-bde3-4284-a039-f7b4c3cca827 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371/ips" status: 200 len: 216 microversion: 2.1 time: 0.070091 Nov 03 04:22:30.636510 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2871/5618] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:22:30 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371/ips => generated 216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:30.650525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:30.652026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:30.660032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:30.660851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:30.661551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:30.662487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:30.663167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:30.663837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:30.700909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:22:31.152526 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e492a055-ee72-4802-91e7-992ccfba5b7e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 204 len: 0 microversion: 2.1 time: 0.510141 Nov 03 04:22:31.153759 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2748/5619] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:22:30 2022] DELETE /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:22:31.163125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:31.163758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:31.178589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:31.181323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:31.181994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:31.183024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:31.183706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:31.184365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:31.463694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:31.467027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:31.467974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:31.476918 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f717dcc-83e1-4c2f-a7a7-deb85c992295 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1808 microversion: 2.1 time: 0.318522 Nov 03 04:22:31.478496 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2872/5620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:31 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:31.484965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:31.487020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:31.487479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:31.488214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:31.488677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:31.492847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:31.694234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:31.703228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f02c433-a9bf-47bf-ab07-fbc8126262f4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.241042 Nov 03 04:22:31.704628 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2749/5621] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:31 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:32.509345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:32.513587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:32.532296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:32.537414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:32.540037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:32.541313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:32.541912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:32.542440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:32.729777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:32.730472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:32.742332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:32.745447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:32.746408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:32.746860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:32.751797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:32.754125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:32.757169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:32.855678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:32.868334 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce56bd5f-4a1b-4872-ac15-827a9b164cdb tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1808 microversion: 2.1 time: 0.363340 Nov 03 04:22:32.887436 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2873/5622] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:32 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1808 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:33.048467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:33.061754 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ecf8b33f-8ebe-4a45-9334-1c601c4eb36b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.336489 Nov 03 04:22:33.077427 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2750/5623] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:32 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:33.895071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:33.896303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:33.910027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:33.919046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:33.919524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:33.920845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:33.926023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:33.927874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:34.086913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:34.087646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:34.105916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:34.106427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:34.106920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:34.125414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:34.125987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:34.126456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:34.210002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:34.750929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:34.771699 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9fa0796-2a50-4ac3-876f-f6b3bcce53e9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1487 microversion: 2.1 time: 0.689392 Nov 03 04:22:34.791855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2751/5624] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:34 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1487 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:34.800822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-06c5b152-90fb-437d-bca8-1f6a7ff71f74 req-7666ff27-a0f4-46c2-9f64-d8652d4b8710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "name": "network-vif-deleted", "tag": "336332db-ada1-4c80-ae46-19ec271842ac"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:34.817777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:34.828224 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a13fdbe6-3a69-404c-a934-14145ada5b28 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1787 microversion: 2.1 time: 0.937790 Nov 03 04:22:34.829179 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2874/5625] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:33 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1787 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:34.837208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:34.838720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:34.850121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:34.851129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:34.851834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:34.852810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:34.853555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:34.854835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-06c5b152-90fb-437d-bca8-1f6a7ff71f74 req-7666ff27-a0f4-46c2-9f64-d8652d4b8710 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:34.863286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:34.863423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-06c5b152-90fb-437d-bca8-1f6a7ff71f74 req-7666ff27-a0f4-46c2-9f64-d8652d4b8710 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:34.863784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-06c5b152-90fb-437d-bca8-1f6a7ff71f74 req-7666ff27-a0f4-46c2-9f64-d8652d4b8710 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:34.912837 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-06c5b152-90fb-437d-bca8-1f6a7ff71f74 req-7666ff27-a0f4-46c2-9f64-d8652d4b8710 service nova] Creating event network-vif-deleted:336332db-ada1-4c80-ae46-19ec271842ac for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:34.927784 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-06c5b152-90fb-437d-bca8-1f6a7ff71f74 req-7666ff27-a0f4-46c2-9f64-d8652d4b8710 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130899 Nov 03 04:22:34.928622 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2752/5626] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:35.158314 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f1a8b7f-68bc-4863-a3d8-76a82e633249 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "POST /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0/action" status: 202 len: 0 microversion: 2.1 time: 0.326485 Nov 03 04:22:35.161165 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2875/5627] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:22:34 2022] POST /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:22:35.170835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:35.171514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:35.188999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:35.197602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:35.198082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:35.198910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:35.205681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:35.206276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:35.863595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:35.864280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:35.873387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:35.874326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:35.875019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:35.875964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:35.876698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:35.877370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:35.920091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:35.937834 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-98c9f0cd-dc31-4849-9398-e86ad84ca778 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1495 microversion: 2.1 time: 0.772691 Nov 03 04:22:35.938433 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2753/5628] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:35 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1495 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:36.202923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:36.213100 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b9f2685-aff4-480a-9335-9d8d13a00829 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1651 microversion: 2.1 time: 0.356488 Nov 03 04:22:36.242588 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2876/5629] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:35 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1651 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:36.962019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:36.962905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:36.974569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:36.978090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:36.978649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:36.979505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:36.980249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:36.981107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:36.993999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4c3fd886-b6a7-4656-8a96-52b66a517b8c req-50326562-dc83-4445-851f-bc0388f2fde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "name": "network-vif-deleted", "tag": "07b7a9f1-28c8-46e8-8640-86dd838bf2af"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:37.010134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c3fd886-b6a7-4656-8a96-52b66a517b8c req-50326562-dc83-4445-851f-bc0388f2fde1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:37.014505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c3fd886-b6a7-4656-8a96-52b66a517b8c req-50326562-dc83-4445-851f-bc0388f2fde1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:37.014970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c3fd886-b6a7-4656-8a96-52b66a517b8c req-50326562-dc83-4445-851f-bc0388f2fde1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:37.054074 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4c3fd886-b6a7-4656-8a96-52b66a517b8c req-50326562-dc83-4445-851f-bc0388f2fde1 service nova] Creating event network-vif-deleted:07b7a9f1-28c8-46e8-8640-86dd838bf2af for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:37.065630 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4c3fd886-b6a7-4656-8a96-52b66a517b8c req-50326562-dc83-4445-851f-bc0388f2fde1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085827 Nov 03 04:22:37.066254 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2877/5630] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:37.244289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:37.245027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:37.256075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:37.256580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:37.257117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:37.266727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:37.268549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:37.270764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:37.333193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:37.342274 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f4857ed7-ef53-477d-91ea-cef090af2b83 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1495 microversion: 2.1 time: 0.384085 Nov 03 04:22:37.373429 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2754/5631] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:36 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1495 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:37.406025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:37.422688 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f677c008-bf60-447b-b030-d9475704990c tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1452 microversion: 2.1 time: 0.182080 Nov 03 04:22:37.424577 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2878/5632] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:37 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:38.372052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:38.372664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:38.380331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:38.380911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:38.381449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:38.382231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:38.382695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:38.383412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:38.451350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:38.453688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:38.461401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:38.462408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:38.463097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:38.464035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:38.464715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:38.465409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:38.563519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:38.574911 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3d1e780-deb7-4e0e-933d-f6fb908a476f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1452 microversion: 2.1 time: 0.127619 Nov 03 04:22:38.576114 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2879/5633] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:38 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:38.596667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:38.612308 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0dd03e0-3ca9-48f3-9b99-d29ba06d429a tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1495 microversion: 2.1 time: 0.244031 Nov 03 04:22:38.613226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2755/5634] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:38 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1495 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:39.157386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-252c7c4e-4f4a-482e-a8ea-9c918f8ebbc5 req-3920a6ed-edd5-4990-b5bb-2d8d0f0d6a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3934dadc-664b-44e0-b716-22e63e790371", "name": "network-vif-deleted", "tag": "e8397bb4-e909-4162-b620-f46c6036969c"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:39.171469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-252c7c4e-4f4a-482e-a8ea-9c918f8ebbc5 req-3920a6ed-edd5-4990-b5bb-2d8d0f0d6a64 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.171960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-252c7c4e-4f4a-482e-a8ea-9c918f8ebbc5 req-3920a6ed-edd5-4990-b5bb-2d8d0f0d6a64 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.186665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-252c7c4e-4f4a-482e-a8ea-9c918f8ebbc5 req-3920a6ed-edd5-4990-b5bb-2d8d0f0d6a64 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.210854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-252c7c4e-4f4a-482e-a8ea-9c918f8ebbc5 req-3920a6ed-edd5-4990-b5bb-2d8d0f0d6a64 service nova] Creating event network-vif-deleted:e8397bb4-e909-4162-b620-f46c6036969c for instance 3934dadc-664b-44e0-b716-22e63e790371 on n-h1-854653-7 Nov 03 04:22:39.219700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-252c7c4e-4f4a-482e-a8ea-9c918f8ebbc5 req-3920a6ed-edd5-4990-b5bb-2d8d0f0d6a64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069266 Nov 03 04:22:39.220965 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2880/5635] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:39.611781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:39.621872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:39.621872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.621872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.621872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.621872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.622574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.622574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.637605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:39.638957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:39.662326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.662326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.662700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.663750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.664069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.664725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.665338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.665779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.666587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lazy-loading 'fault' on Instance uuid 3934dadc-664b-44e0-b716-22e63e790371 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:22:39.667351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.715180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:39.726555 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fd9d164c-a362-446a-b961-f5846b18741a tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 200 len: 1302 microversion: 2.1 time: 0.119812 Nov 03 04:22:39.727813 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2756/5636] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:39 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 1302 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:39.877107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:39.885471 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-160076c7-924e-4483-a12e-e37b3f96e40f tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1501 microversion: 2.1 time: 0.253104 Nov 03 04:22:39.886329 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2881/5637] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:39 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:39.923450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:39.924071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:39.930300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.930870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.931408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.932182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:39.932730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:39.933248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:39.965972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:22:40.260959 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d1a0ef9-211c-4755-9db4-78e6d4f36671 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 204 len: 0 microversion: 2.1 time: 0.340888 Nov 03 04:22:40.280448 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2757/5638] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:22:39 2022] DELETE /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:40.280765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:40.454893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:40.477257 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fde8abc9-4ef3-4c15-8efa-19823b9b0960 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.210370 Nov 03 04:22:40.479266 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2882/5639] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:40 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:40.752386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:40.753352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:40.765870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:40.768062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:40.769640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:40.773111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:40.773111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:40.773111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:40.808420 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] HTTP exception thrown: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Request method failure captured: Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 HTTP/1.1 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0HS4g-z85Rnk-_9ulw_nJ9FRSpLtHm-iCt9Po3P3YLdgtsAQ8uOJw0LWFNQS0pdmVXadfpbqs4S0vU5E-HV8LgdJFu5AhZLWSjNcQZe1pWfDfrwVcKUkl5lyJmqsBLyzFEFRZzf3vT9i0FospgBnDF7ok0Y71ZwrS0XWxGKNFJdQiU Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6194edd64938459b9203e9d6ff8f6dee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6194edd64938459b9203e9d6ff8f6dee"}]}] Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestMultiNic-406991733 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestMultiNic-406991733-project Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ad440b59124045949cce93306158dcd5 Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestMultiNic-406991733-project Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '3934dadc-664b-44e0-b716-22e63e790371'} Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:22:40.810352 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:40.818703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Returning 404 to user: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:22:40.820359 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c8dbfc7-96a3-4c15-a5d1-8d89283698f0 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 404 len: 111 microversion: 2.1 time: 0.064562 Nov 03 04:22:40.820748 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2758/5640] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:40 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:22:41.508089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:41.508719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:41.514657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=62 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:41.520675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:41.526820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:41.526820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:41.526820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:41.526820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:41.526820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:41.774794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:41.784736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7565322c-bb1e-48c3-987c-04c5943705d9 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.286299 Nov 03 04:22:41.785616 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2883/5641] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:41 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:42.809926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:42.818036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:42.818630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:42.819293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:42.819898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:42.820604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:42.821248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:42.821833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:43.082744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:43.091530 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79b18f48-4df7-426d-a4a2-5e9590484235 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1507 microversion: 2.1 time: 0.285473 Nov 03 04:22:43.111026 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2759/5642] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:42 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:44.122439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:44.123659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:44.135197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:44.137691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:44.143102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:44.143102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:44.143102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:44.143102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:44.332064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-37261504-250a-4b6e-8cff-87361b7ec89b req-0b495e21-88f2-4522-898c-9b5468b99e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6ab9189-a974-4e49-8af1-a136fd4754b0", "name": "network-vif-deleted", "tag": "985321e0-1586-4aca-9362-b637c558b57b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:44.342888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:44.346420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:22:44.352500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-37261504-250a-4b6e-8cff-87361b7ec89b req-0b495e21-88f2-4522-898c-9b5468b99e44 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:44.352991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-37261504-250a-4b6e-8cff-87361b7ec89b req-0b495e21-88f2-4522-898c-9b5468b99e44 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:44.353478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-37261504-250a-4b6e-8cff-87361b7ec89b req-0b495e21-88f2-4522-898c-9b5468b99e44 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:44.354460 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01e01d52-c515-45d4-8f06-b101dc96361c tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1465 microversion: 2.1 time: 0.235861 Nov 03 04:22:44.355584 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2884/5643] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:44 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1465 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:44.381060 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-37261504-250a-4b6e-8cff-87361b7ec89b req-0b495e21-88f2-4522-898c-9b5468b99e44 service nova] Creating event network-vif-deleted:985321e0-1586-4aca-9362-b637c558b57b for instance f6ab9189-a974-4e49-8af1-a136fd4754b0 on n-h1-854653-7 Nov 03 04:22:44.386536 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-37261504-250a-4b6e-8cff-87361b7ec89b req-0b495e21-88f2-4522-898c-9b5468b99e44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058282 Nov 03 04:22:44.387721 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2760/5644] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:22:45.395019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:45.395019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:45.409340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:45.410173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:45.410613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:45.411330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:45.411910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:45.412690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:45.452582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:45.453754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:45.455080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:45.455702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lazy-loading 'fault' on Instance uuid f6ab9189-a974-4e49-8af1-a136fd4754b0 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:22:45.505340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:45.514788 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f19d72e3-cd31-4296-ba5b-63b06ba3c4f1 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 200 len: 1304 microversion: 2.1 time: 0.129791 Nov 03 04:22:45.517394 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2885/5645] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:45 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:46.562165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:46.562890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: f6ab9189-a974-4e49-8af1-a136fd4754b0] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:46.581176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:46.581689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:46.582550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:46.582863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:46.583328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:46.583767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:46.623031 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] HTTP exception thrown: Instance f6ab9189-a974-4e49-8af1-a136fd4754b0 could not be found. Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Request method failure captured: Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 HTTP/1.1 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GPabyLNIUzWmlmy1P_MREpRSCFwD6nbu1fsrSNGDub1Td5lRdihR4V0XvacjybOspubeZSbHXpHUo5X0G4bw3MzaZ8gQmnx8BiX9UW3JZsWnk-hCZ0hNMRUN-wmHgVMtAlq4lSSfXqqXup7Kdh7aow3zurmCIUpQXrT0-geWq5eBY Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: debecb0926db4a13bf27776c374e78b3 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueTestJSON-885975895 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/debecb0926db4a13bf27776c374e78b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_debecb0926db4a13bf27776c374e78b3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/debecb0926db4a13bf27776c374e78b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/debecb0926db4a13bf27776c374e78b3"}]}] Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueTestJSON-885975895 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: debecb0926db4a13bf27776c374e78b3 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueTestJSON-885975895 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueTestJSON-885975895-project Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 072281a978194e5cb7d93f5af2629b99 Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueTestJSON-885975895-project Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f6ab9189-a974-4e49-8af1-a136fd4754b0 could not be found. Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f6ab9189-a974-4e49-8af1-a136fd4754b0'} Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6ab9189-a974-4e49-8af1-a136fd4754b0 could not be found. Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6ab9189-a974-4e49-8af1-a136fd4754b0 could not be found. Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:22:46.625184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:46.630313 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:46.630313 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:22:46.630313 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:22:46.630313 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:22:46.630313 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:22:46.630313 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6ab9189-a974-4e49-8af1-a136fd4754b0 could not be found. Nov 03 04:22:46.630313 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:46.632383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Returning 404 to user: Instance f6ab9189-a974-4e49-8af1-a136fd4754b0 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:22:46.633566 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31c46dfb-f905-4e81-bc4d-efa5d5a84a63 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0" status: 404 len: 111 microversion: 2.1 time: 0.076661 Nov 03 04:22:46.638437 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2761/5646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:46 2022] GET /compute/v2.1/servers/f6ab9189-a974-4e49-8af1-a136fd4754b0 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:22:46.644464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:46.644987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:46.660886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:46.661983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:46.663255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:46.664238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:46.665145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:46.665808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:46.708581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:22:47.124636 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5a10dd33-0393-4f33-87a5-c18dc9585152 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "DELETE /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 204 len: 0 microversion: 2.1 time: 0.485668 Nov 03 04:22:47.126075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2886/5647] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:22:46 2022] DELETE /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:22:47.134540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:47.135219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:47.145143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:47.145968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:47.146634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:47.147375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:47.147841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:47.148276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:47.690698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:47.692372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1051998618", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "2b25b60a-ebe4-4953-949f-4f27fd142224"}, {"uuid": "a264930f-08ed-47e6-9cf5-869b46886f22"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:47.719035 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f4ddc0e-1b46-432a-9809-eca3c8507b5b tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1492 microversion: 2.1 time: 0.588332 Nov 03 04:22:47.719955 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2762/5648] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:47 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1492 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:47.794029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] validate_networks() for [('2b25b60a-ebe4-4953-949f-4f27fd142224', None, None, None, None, None), ('a264930f-08ed-47e6-9cf5-869b46886f22', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:22:48.743985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:48.744626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:48.769760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:48.771347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:48.771347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:48.778921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:48.779424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:48.779873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:49.352959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:49.366683 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7a4c0b71-97d3-4529-af4e-34f1a7700dc4 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1492 microversion: 2.1 time: 0.626720 Nov 03 04:22:49.386449 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2763/5649] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:48 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1492 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:22:49.559112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:22:49.559663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:22:49.560054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:22:49.560479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:22:49.560903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:22:49.582801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:49.583493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:49.583957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:49.588514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:49.588514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:49.588514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:49.623100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Getting quotas for project 6194edd64938459b9203e9d6ff8f6dee. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:22:49.633431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Getting quotas for user ad440b59124045949cce93306158dcd5 and project 6194edd64938459b9203e9d6ff8f6dee. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:22:49.656370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:22:49.660683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:22:49.816275 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f98227da-6e03-4b58-8f34-06cd8b4081d2 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.122433 Nov 03 04:22:49.816275 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2887/5650] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:22:49.820893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ca6634c-3364-4537-8785-35ec66c97b4b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:49.821549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4ca6634c-3364-4537-8785-35ec66c97b4b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:50.039181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ca6634c-3364-4537-8785-35ec66c97b4b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:50.052143 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ca6634c-3364-4537-8785-35ec66c97b4b tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1213 microversion: 2.1 time: 0.235118 Nov 03 04:22:50.053841 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2764/5651] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:49 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:50.416555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:50.429087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:50.474089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:50.478576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:50.479185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:50.481913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:50.482409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:50.482855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:51.077944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf0404d5-eb5d-453d-9705-af8b47ce8b46 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:51.078601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf0404d5-eb5d-453d-9705-af8b47ce8b46 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:51.224891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf0404d5-eb5d-453d-9705-af8b47ce8b46 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:51.240282 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf0404d5-eb5d-453d-9705-af8b47ce8b46 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1213 microversion: 2.1 time: 0.166788 Nov 03 04:22:51.248114 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2765/5652] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:51 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:51.388545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:51.405681 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ecebf654-a255-434f-b927-b464e3006d46 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1492 microversion: 2.1 time: 0.997340 Nov 03 04:22:51.421061 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2888/5653] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:50 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1492 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:51.640751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2ff883f5-63e5-4d7c-b691-7e3c69d280f0 req-4a2f90ec-b2c8-4c82-a686-71bf6769f368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13159d64-69c4-458f-b9de-a05754c8bfae", "name": "network-vif-deleted", "tag": "6683d99d-64cc-445a-aa19-b20fd0de209d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:22:51.666370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ff883f5-63e5-4d7c-b691-7e3c69d280f0 req-4a2f90ec-b2c8-4c82-a686-71bf6769f368 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:51.668359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ff883f5-63e5-4d7c-b691-7e3c69d280f0 req-4a2f90ec-b2c8-4c82-a686-71bf6769f368 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:51.669838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2ff883f5-63e5-4d7c-b691-7e3c69d280f0 req-4a2f90ec-b2c8-4c82-a686-71bf6769f368 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:51.695473 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2ff883f5-63e5-4d7c-b691-7e3c69d280f0 req-4a2f90ec-b2c8-4c82-a686-71bf6769f368 service nova] Creating event network-vif-deleted:6683d99d-64cc-445a-aa19-b20fd0de209d for instance 13159d64-69c4-458f-b9de-a05754c8bfae on n-h2-854653-7 Nov 03 04:22:51.702505 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2ff883f5-63e5-4d7c-b691-7e3c69d280f0 req-4a2f90ec-b2c8-4c82-a686-71bf6769f368 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068127 Nov 03 04:22:51.706536 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2766/5654] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:22:52.272722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:52.272876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:52.294750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:52.295171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:52.295619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:52.296469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:52.305695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:52.310623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:52.433802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:52.435198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:52.454995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:52.455498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:52.464041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:52.465215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:52.465943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:52.466566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:52.549557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:52.550322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:52.551016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:52.552299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lazy-loading 'fault' on Instance uuid 13159d64-69c4-458f-b9de-a05754c8bfae {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:22:53.162973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:53.177638 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d87d40e-c842-4bbf-ad91-05c817969d24 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1209 microversion: 2.1 time: 0.907856 Nov 03 04:22:53.180199 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2889/5655] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:52 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1209 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:53.180881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072281a978194e5cb7d93f5af2629b99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'debecb0926db4a13bf27776c374e78b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:53.202962 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d296109c-dcf1-4320-bcc9-77881c14f008 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 200 len: 1304 microversion: 2.1 time: 0.774721 Nov 03 04:22:53.211995 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2767/5656] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:52 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 1304 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:54.204774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:54.205528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:54.215457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:54.225324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:54.228268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:54.229268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:54.230233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:54.231658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:54.244417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:54.245803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] [instance: 13159d64-69c4-458f-b9de-a05754c8bfae] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:54.263792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:54.264452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:54.265056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:54.265857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:54.273593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:54.274344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:54.318063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] HTTP exception thrown: Instance 13159d64-69c4-458f-b9de-a05754c8bfae could not be found. Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Request method failure captured: Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae HTTP/1.1 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0GPabyLNIUzWmlmy1P_MREpRSCFwD6nbu1fsrSNGDub1Td5lRdihR4V0XvacjybOspubeZSbHXpHUo5X0G4bw3MzaZ8gQmnx8BiX9UW3JZsWnk-hCZ0hNMRUN-wmHgVMtAlq4lSSfXqqXup7Kdh7aow3zurmCIUpQXrT0-geWq5eBY Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: debecb0926db4a13bf27776c374e78b3 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerRescueTestJSON-885975895 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/debecb0926db4a13bf27776c374e78b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_debecb0926db4a13bf27776c374e78b3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/debecb0926db4a13bf27776c374e78b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/debecb0926db4a13bf27776c374e78b3"}]}] Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerRescueTestJSON-885975895 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: debecb0926db4a13bf27776c374e78b3 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerRescueTestJSON-885975895 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerRescueTestJSON-885975895-project Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 072281a978194e5cb7d93f5af2629b99 Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerRescueTestJSON-885975895-project Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 13159d64-69c4-458f-b9de-a05754c8bfae could not be found. Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '13159d64-69c4-458f-b9de-a05754c8bfae'} Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13159d64-69c4-458f-b9de-a05754c8bfae could not be found. Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13159d64-69c4-458f-b9de-a05754c8bfae could not be found. Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:22:54.321933 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:54.330405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:22:54.330405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:22:54.330405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:22:54.330405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:22:54.330405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:22:54.330405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13159d64-69c4-458f-b9de-a05754c8bfae could not be found. Nov 03 04:22:54.330405 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:22:54.332747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] Returning 404 to user: Instance 13159d64-69c4-458f-b9de-a05754c8bfae could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:22:54.336253 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b87cb845-ce8d-4210-bb22-63a4c74c2263 tempest-ServerRescueTestJSON-885975895 tempest-ServerRescueTestJSON-885975895-project] 10.222.0.30 "GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae" status: 404 len: 111 microversion: 2.1 time: 0.100686 Nov 03 04:22:54.338478 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2768/5657] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:54 2022] GET /compute/v2.1/servers/13159d64-69c4-458f-b9de-a05754c8bfae => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:22:54.490829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:54.513181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-93b68343-1262-42b9-a55e-718b9c69b094 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1271 microversion: 2.1 time: 0.312932 Nov 03 04:22:54.529246 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2890/5658] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:54 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:55.538127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:55.538661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:55.550803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:55.552006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:55.554533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:55.555291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:55.555767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:55.558398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:56.090114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:56.104315 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-62665c81-4c56-423c-9eed-efd24d249ac9 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1313 microversion: 2.1 time: 0.570366 Nov 03 04:22:56.105542 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2769/5659] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:55 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1313 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:57.133127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:57.134298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:57.156197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:57.157751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:57.159813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:57.160751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:57.161416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:57.162169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:57.947843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:57.968754 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04e28bec-79dc-4b20-9ed0-5b1e729dead7 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1313 microversion: 2.1 time: 0.829912 Nov 03 04:22:57.983678 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2891/5660] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:57 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1313 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:22:59.002888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:22:59.007499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:22:59.020328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:59.036466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:59.037826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:59.044806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:22:59.046112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:22:59.048110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:22:59.815866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:22:59.827534 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8a1c06a-dcde-49a2-8272-b40a8e5721cc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.828435 Nov 03 04:22:59.828556 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2770/5661] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:22:58 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:00.853336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:00.854315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:00.859549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:00.861751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:00.865171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:00.865662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:00.866103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:00.866814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:00.867270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:00.867695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:01.000798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c845f512-3019-428d-970e-0412aebf0c6f req-160e70a5-6839-42c0-b862-72e86e4b55d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48a3170-0d74-478c-a39e-b0268ab6a6f8", "tag": "cb969ba0-996c-40f5-afed-edc11ed8cf9a"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:01.021487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c845f512-3019-428d-970e-0412aebf0c6f req-160e70a5-6839-42c0-b862-72e86e4b55d1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:01.021593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c845f512-3019-428d-970e-0412aebf0c6f req-160e70a5-6839-42c0-b862-72e86e4b55d1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:01.025371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c845f512-3019-428d-970e-0412aebf0c6f req-160e70a5-6839-42c0-b862-72e86e4b55d1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:01.047768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c845f512-3019-428d-970e-0412aebf0c6f req-160e70a5-6839-42c0-b862-72e86e4b55d1 service nova] Creating event network-changed:cb969ba0-996c-40f5-afed-edc11ed8cf9a for instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 on n-h1-854653-7 Nov 03 04:23:01.058007 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c845f512-3019-428d-970e-0412aebf0c6f req-160e70a5-6839-42c0-b862-72e86e4b55d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061000 Nov 03 04:23:01.059084 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2771/5662] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:23:01.337792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:01.346371 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7869917d-70f1-4f5e-bdce-e5be9a3e80ff tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.498458 Nov 03 04:23:01.347276 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2892/5663] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:00 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:02.373204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:02.373934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:02.385131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:02.393104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:02.396541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:02.396541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:02.397592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:02.398539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:02.399212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:02.429233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:02.927776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:02.938873 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c74e289-7d17-4a18-8c10-141a77fcbf65 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.572711 Nov 03 04:23:02.940470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2772/5664] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:02 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:03.203064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e6c8470e-b58d-4759-84a7-d148cbb3b508 req-0c9c2f0c-f907-46a8-a75e-db0bafd15afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a48a3170-0d74-478c-a39e-b0268ab6a6f8", "tag": "0f021d2c-86ae-492d-9698-e9080e27f7e6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:03.224218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e6c8470e-b58d-4759-84a7-d148cbb3b508 req-0c9c2f0c-f907-46a8-a75e-db0bafd15afc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:03.224218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e6c8470e-b58d-4759-84a7-d148cbb3b508 req-0c9c2f0c-f907-46a8-a75e-db0bafd15afc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:03.224624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e6c8470e-b58d-4759-84a7-d148cbb3b508 req-0c9c2f0c-f907-46a8-a75e-db0bafd15afc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:03.260937 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e6c8470e-b58d-4759-84a7-d148cbb3b508 req-0c9c2f0c-f907-46a8-a75e-db0bafd15afc service nova] Creating event network-changed:0f021d2c-86ae-492d-9698-e9080e27f7e6 for instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 on n-h1-854653-7 Nov 03 04:23:03.274715 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e6c8470e-b58d-4759-84a7-d148cbb3b508 req-0c9c2f0c-f907-46a8-a75e-db0bafd15afc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076191 Nov 03 04:23:03.279259 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2893/5665] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:03.966559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:03.967405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:03.980546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:03.984578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:03.985186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:03.985998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:03.989724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:03.990265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:04.010449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-81ef368d-376a-4202-95ad-118c3859f08f tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] Calling method '.version_select at 0x7ff7fd4a6940>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:04.113566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:04.120362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-81ef368d-376a-4202-95ad-118c3859f08f tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.365635 Nov 03 04:23:04.123169 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2773/5666] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:23:03 2022] GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9/defaults => generated 371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:04.138855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed0cb828-40d5-4e86-927f-89c5786153d3 tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] Calling method '.version_select at 0x7ff7f9cf6ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:04.264958 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed0cb828-40d5-4e86-927f-89c5786153d3 tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9" status: 200 len: 371 microversion: 2.1 time: 0.133553 Nov 03 04:23:04.265801 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2774/5667] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 04:23:04 2022] GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9 => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:04.287948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65bc215b-4a19-4258-b98d-9cc6d5c1014f tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] Calling method '.version_select at 0x7ff7f9c9d8b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:04.404561 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65bc215b-4a19-4258-b98d-9cc6d5c1014f tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.125976 Nov 03 04:23:04.414397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2775/5668] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:23:04 2022] GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9/defaults => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:04.449571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7fd8a47a-588f-41d6-9006-b5e7b4c696e0 tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] Calling method '.version_select at 0x7ff7f89e0b80>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:04.616999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7fd8a47a-588f-41d6-9006-b5e7b4c696e0 tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9" status: 200 len: 371 microversion: 2.1 time: 0.186616 Nov 03 04:23:04.620214 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2776/5669] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 04:23:04 2022] GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9 => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:04.635976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6ac7bd0-0fda-49b2-9a0d-5754576ee45b tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] Calling method '.version_select at 0x7ff7f9cc33a0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:04.749232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:04.791912 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80bb1247-e392-40da-9998-593719bef52d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.832024 Nov 03 04:23:04.795348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2894/5670] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:03 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:04.813046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6ac7bd0-0fda-49b2-9a0d-5754576ee45b tempest-QuotasTestJSON-270884864 tempest-QuotasTestJSON-270884864-project] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9?user_id=c75fd9cb02764c90b5ce5aea5033e7f4" status: 200 len: 371 microversion: 2.1 time: 0.184203 Nov 03 04:23:04.814602 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2777/5671] 10.222.0.30 () {58 vars in 1323 bytes} [Thu Nov 3 04:23:04 2022] GET /compute/v2.1/os-quota-sets/f6b6fdf6424643008189d5f2700775d9?user_id=c75fd9cb02764c90b5ce5aea5033e7f4 => generated 371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:05.821130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:05.821853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:05.844968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:05.846591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:05.848681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:05.850666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:05.851175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:05.851633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:06.992373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:07.041623 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2fdcd92e-eeed-4333-a2e4-40731ac4acf5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 1.224378 Nov 03 04:23:07.070321 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2895/5672] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:05 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:08.079240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:08.079926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:08.095487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:08.104743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:08.104743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:08.104743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:08.104743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:08.104743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:08.429470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:08.449001 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-595214d9-8dbd-4e50-ae83-d1a6306965e5 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.374244 Nov 03 04:23:08.467347 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2778/5673] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:08 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:09.480507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:09.481506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:09.504638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:09.508901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:09.509566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:09.510434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:09.516883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:09.517717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:09.930317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:09.938990 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97d54747-6050-4c5e-93d9-6797eade9675 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.462683 Nov 03 04:23:09.940248 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2896/5674] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:09 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:10.964279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:10.964869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:10.977076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:10.977591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:10.978045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:10.978779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:10.979247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:10.993691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:11.521445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:11.585681 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e47dba88-bd40-4f7c-b35c-759fe99252dd tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.620294 Nov 03 04:23:11.611469 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2779/5675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:10 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:12.280464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dfa9d035-674c-4162-8a4e-01f56e321166 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Action: 'create', calling method: .version_select at 0x7ff7f95bdb80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-782121782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqCy/Q257jrRT6fUGdO2Pp/OHaz8goS+FYsGtwYqF1X5J4Yz/+jGyIqNRaHyNn/HoL5cmJKjHH6oEBB63vSny4ep5ze+BGfIZd1+GWjOv+7o53lmP1N6OVBcuq6OQc2zA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:12.295966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:12.311411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-dfa9d035-674c-4162-8a4e-01f56e321166 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Getting quotas for project f9fd27297a054435babece0659425d98. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:23:12.332251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-dfa9d035-674c-4162-8a4e-01f56e321166 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Getting quotas for user 11c657226ac14f82950b672d7eafee9f and project f9fd27297a054435babece0659425d98. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:23:12.420656 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dfa9d035-674c-4162-8a4e-01f56e321166 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.367545 Nov 03 04:23:12.422523 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2897/5676] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:23:12 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:12.616522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:12.628234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:12.659846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:12.663675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:12.664460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:12.668033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:12.668845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:12.669532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:12.939460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:12.950288 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af8b9dad-826b-4be0-a50e-c290fbff5ff8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.338458 Nov 03 04:23:12.951634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2780/5677] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:12 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:13.996068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:14.003090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:14.033462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:14.034265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:14.036575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:14.039925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:14.042452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:14.043829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:14.330626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:14.350429 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-722eca25-e03d-4469-a5fa-46d53bbce851 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.373344 Nov 03 04:23:14.361328 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2898/5678] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:13 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:15.381883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:15.383222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:15.387766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:15.392658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:15.394242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:15.398525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:15.398525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:15.398525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:15.398525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:15.812549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ac58a1b4-f2f7-4616-9ec9-b821ad45ed29 req-07573a5f-f117-4690-b1c9-396851c7d3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48a3170-0d74-478c-a39e-b0268ab6a6f8", "name": "network-vif-plugged", "status": "completed", "tag": "cb969ba0-996c-40f5-afed-edc11ed8cf9a"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:15.837707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ac58a1b4-f2f7-4616-9ec9-b821ad45ed29 req-07573a5f-f117-4690-b1c9-396851c7d3ca service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:15.839715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ac58a1b4-f2f7-4616-9ec9-b821ad45ed29 req-07573a5f-f117-4690-b1c9-396851c7d3ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:15.840681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ac58a1b4-f2f7-4616-9ec9-b821ad45ed29 req-07573a5f-f117-4690-b1c9-396851c7d3ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:15.865161 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ac58a1b4-f2f7-4616-9ec9-b821ad45ed29 req-07573a5f-f117-4690-b1c9-396851c7d3ca service nova] Creating event network-vif-plugged:cb969ba0-996c-40f5-afed-edc11ed8cf9a for instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 on n-h1-854653-7 Nov 03 04:23:15.873825 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ac58a1b4-f2f7-4616-9ec9-b821ad45ed29 req-07573a5f-f117-4690-b1c9-396851c7d3ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277776 Nov 03 04:23:15.875110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2899/5679] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:23:16.048333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1213130197", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-782121782", "security_groups": [{"name": "tempest-secgroup-smoke-1281030089"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "7503560d-86f2-407f-9911-5299669bd9f1"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:16.225681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:16.235302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a8206c8-8266-4e85-acaf-6bd2f1606c5d tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.857551 Nov 03 04:23:16.239754 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2781/5680] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:15 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:16.274892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] validate_networks() for [('7503560d-86f2-407f-9911-5299669bd9f1', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:23:16.991473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Getting quotas for project f9fd27297a054435babece0659425d98. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:23:16.997290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Getting quotas for user 11c657226ac14f82950b672d7eafee9f and project f9fd27297a054435babece0659425d98. Resources: dict_keys(['metadata_items']) {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:23:17.013448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:23:17.013908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:23:17.014415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:23:17.014827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:23:17.015322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:23:17.029331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.032584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.032584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.032584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.032584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.032980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.053902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Getting quotas for project f9fd27297a054435babece0659425d98. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:23:17.059630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Getting quotas for user 11c657226ac14f82950b672d7eafee9f and project f9fd27297a054435babece0659425d98. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:23:17.072875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:23:17.075366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:23:17.264715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:17.266291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:17.274525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.275459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.276856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.288427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.288427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.288427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.333592 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53725083-c9a3-4e76-8fce-bcee2e8bf88b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.290486 Nov 03 04:23:17.344413 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2900/5681] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:23:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:23:17.371436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3e0b10b-3773-488a-bf8d-ea0a53b9c384 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:17.371436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c3e0b10b-3773-488a-bf8d-ea0a53b9c384 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:17.496895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c3e0b10b-3773-488a-bf8d-ea0a53b9c384 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:17.505563 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3e0b10b-3773-488a-bf8d-ea0a53b9c384 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1302 microversion: 2.1 time: 0.154811 Nov 03 04:23:17.508525 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2901/5682] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:17 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1302 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:17.532535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:17.541413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:17.554766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.554766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.554766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.554766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.554766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.564183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.665082 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-786856fc-5bc2-4e08-ba29-098de7563240 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments/fad8d840-01a5-4f31-820c-910b08831b40" status: 200 len: 194 microversion: 2.20 time: 0.153934 Nov 03 04:23:17.668818 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2902/5683] 10.222.0.30 () {60 vars in 1454 bytes} [Thu Nov 3 04:23:17 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments/fad8d840-01a5-4f31-820c-910b08831b40 => generated 194 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:23:17.762387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:17.774638 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f16e7ad3-1d48-48e2-b9cc-3a516b6f38ca tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.513981 Nov 03 04:23:17.796588 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2782/5684] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:17 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:17.829767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:17.830784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:17.842358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.843365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.845360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.846836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.847820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.849482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.901872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:17.927142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e0b25339-1062-42b7-84ef-8574644870a0 req-bbbd8162-b1d8-4e10-8c89-bd81d79f8372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48a3170-0d74-478c-a39e-b0268ab6a6f8", "name": "network-vif-plugged", "status": "completed", "tag": "0f021d2c-86ae-492d-9698-e9080e27f7e6"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:17.940903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e0b25339-1062-42b7-84ef-8574644870a0 req-bbbd8162-b1d8-4e10-8c89-bd81d79f8372 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:17.941431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e0b25339-1062-42b7-84ef-8574644870a0 req-bbbd8162-b1d8-4e10-8c89-bd81d79f8372 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:17.941873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e0b25339-1062-42b7-84ef-8574644870a0 req-bbbd8162-b1d8-4e10-8c89-bd81d79f8372 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:17.954281 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e0b25339-1062-42b7-84ef-8574644870a0 req-bbbd8162-b1d8-4e10-8c89-bd81d79f8372 service nova] Creating event network-vif-plugged:0f021d2c-86ae-492d-9698-e9080e27f7e6 for instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 on n-h1-854653-7 Nov 03 04:23:17.963912 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e0b25339-1062-42b7-84ef-8574644870a0 req-bbbd8162-b1d8-4e10-8c89-bd81d79f8372 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036570 Nov 03 04:23:17.971609 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2783/5685] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:23:18.050677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lazy-loading 'services' on Instance uuid ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:23:18.370832 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-de0ad0a5-077b-48ca-aded-c28e98eb9564 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments/fad8d840-01a5-4f31-820c-910b08831b40" status: 202 len: 0 microversion: 2.20 time: 0.554991 Nov 03 04:23:18.377071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2903/5686] 10.222.0.30 () {60 vars in 1457 bytes} [Thu Nov 3 04:23:17 2022] DELETE /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments/fad8d840-01a5-4f31-820c-910b08831b40 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:23:18.387519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:18.393670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:18.408636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:18.408952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:18.409424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:18.410148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:18.410612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:18.411072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:18.498068 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d3f6744a-6957-4eb4-af5a-9075bde69072 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115705 Nov 03 04:23:18.504379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2784/5687] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:18 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:23:18.535219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a4a4bd42-0fc5-49d1-98e7-1b9bd1791a62 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:18.536196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a4a4bd42-0fc5-49d1-98e7-1b9bd1791a62 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:18.654613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a4a4bd42-0fc5-49d1-98e7-1b9bd1791a62 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:18.665924 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a4a4bd42-0fc5-49d1-98e7-1b9bd1791a62 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1302 microversion: 2.1 time: 0.134929 Nov 03 04:23:18.667336 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2904/5688] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:18 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1302 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:18.805612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:18.807119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:18.816421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:18.818106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:18.823276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:18.824146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:18.824702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:18.825550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:19.067323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:19.075320 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-593d4e0c-a621-4e26-8ca4-2e61d5baf5fc tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1334 microversion: 2.1 time: 0.275229 Nov 03 04:23:19.085330 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2785/5689] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:18 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1334 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:19.511854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:19.514123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:19.522539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:19.523414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:19.524112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:19.525108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:19.525797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:19.526447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:19.574784 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-368e3e82-7cb8-49af-b013-699313c27289 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064732 Nov 03 04:23:19.574784 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2905/5690] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:19 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:23:19.697448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:19.698875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:19.727527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:19.727527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:19.727527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:19.727527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:19.727527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:19.727527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:19.926194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:19.947049 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c060c674-908f-4813-a535-4b9097862d55 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1298 microversion: 2.1 time: 0.258231 Nov 03 04:23:19.950109 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2786/5691] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:19 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:20.115884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:20.118303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:20.127624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.128133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.128586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.129533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.130165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.130610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.372900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:20.383140 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0bdac08e-c63d-4fb7-b88a-1f599581f83e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1671 microversion: 2.1 time: 0.274692 Nov 03 04:23:20.385072 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2906/5692] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:20 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1671 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:20.409536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:20.410047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:20.423289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.423816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.424300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.425297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.426068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.426711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.465991 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6eb01da2-89ba-489f-8c16-1f55b2d125b8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8/ips" status: 200 len: 181 microversion: 2.1 time: 0.060423 Nov 03 04:23:20.478598 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2787/5693] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:23:20 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8/ips => generated 181 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:20.482965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:20.483826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:20.490126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.500569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.500569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.500569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.500569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.500569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.529407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:23:20.590569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:20.593055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:20.601040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.604323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.604323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.604323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:20.604323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:20.604323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:20.643947 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb4701ed-0104-44b7-b9c3-19ef56a03d00 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061471 Nov 03 04:23:20.644542 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2788/5694] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:20 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:23:20.986537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:20.987212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:20.991067 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27cadf60-2404-4a62-a38c-613ea16fed40 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 204 len: 0 microversion: 2.1 time: 0.511760 Nov 03 04:23:20.991751 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2907/5695] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:23:20 2022] DELETE /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:23:21.003578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:21.006162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:21.006781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:21.007655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:21.008240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:21.008347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:21.008862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:21.009082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:21.022100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:21.022843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:21.023751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:21.023933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:21.024389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:21.024849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:21.207882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:21.221821 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2133fba1-1db9-4877-8795-edd457cb0270 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1354 microversion: 2.1 time: 0.239662 Nov 03 04:23:21.223873 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2789/5696] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:20 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1354 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:21.400864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:21.422178 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-315eed0d-3ed2-47a3-88a5-222157c5979f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1677 microversion: 2.1 time: 0.422396 Nov 03 04:23:21.434272 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2908/5697] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:20 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1677 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:21.659621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:21.663432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:21.676789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:21.677327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:21.679712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:21.684005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:21.684714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:21.685370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:21.739617 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-598e79ee-f95b-4e58-8ec5-d4400bf0250b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086409 Nov 03 04:23:21.740600 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2790/5698] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:21 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:23:22.248257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:22.250492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:22.260631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:22.263343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:22.269205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:22.269205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:22.269205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:22.269205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:22.410084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:22.418388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-101b32f3-5c57-4abf-b937-6dcd7ea545c8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1360 microversion: 2.1 time: 0.174141 Nov 03 04:23:22.425211 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2909/5699] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:22 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1360 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:22.452129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:22.461860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:22.488648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:22.490331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:22.491668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:22.493051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:22.493896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:22.494608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:22.752986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:22.764664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:22.764664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:22.764664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:22.764664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:22.764664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:22.764664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:22.764664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:22.838333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb10bdd8-a030-4bdd-b787-d6051e6e67bf tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090172 Nov 03 04:23:22.840550 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2910/5700] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:22 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:23:22.903544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:22.919327 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9f47e40-6203-4d83-af6a-45d08925bca8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1677 microversion: 2.1 time: 0.473559 Nov 03 04:23:22.919327 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2791/5701] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:22 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1677 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:23.443343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:23.443893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:23.455945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:23.456455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:23.456910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:23.457688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:23.458174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:23.458595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:23.852115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:23.855021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:23.863377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:23.866961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:23.868874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:23.874015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:23.875291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:23.876457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:23.948344 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89f0257b-3902-43fb-8163-77d1c12e07e6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100179 Nov 03 04:23:23.958463 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2792/5702] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:23 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:23:23.964440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:23.966008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:23.973194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:23.974000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:23.980309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:23.980309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:23.980309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:23.980309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:24.182754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:24.202736 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f651760c-f957-4f7c-842b-f2f7f03b1b68 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.755996 Nov 03 04:23:24.202736 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2911/5703] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:23 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:24.466458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:24.476541 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61acfd24-81c0-40e6-9811-44adacd00cb4 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1677 microversion: 2.1 time: 0.516615 Nov 03 04:23:24.489445 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2793/5704] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:23 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1677 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:24.602522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dbe7ccb5-8298-4e7d-9cc2-84f924287e33 req-830e7476-681b-4eaf-b56a-b43e02f5cfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48a3170-0d74-478c-a39e-b0268ab6a6f8", "name": "network-vif-deleted", "tag": "0f021d2c-86ae-492d-9698-e9080e27f7e6"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:24.621435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbe7ccb5-8298-4e7d-9cc2-84f924287e33 req-830e7476-681b-4eaf-b56a-b43e02f5cfb9 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:24.621435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbe7ccb5-8298-4e7d-9cc2-84f924287e33 req-830e7476-681b-4eaf-b56a-b43e02f5cfb9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:24.621735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbe7ccb5-8298-4e7d-9cc2-84f924287e33 req-830e7476-681b-4eaf-b56a-b43e02f5cfb9 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:24.690492 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dbe7ccb5-8298-4e7d-9cc2-84f924287e33 req-830e7476-681b-4eaf-b56a-b43e02f5cfb9 service nova] Creating event network-vif-deleted:0f021d2c-86ae-492d-9698-e9080e27f7e6 for instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 on n-h1-854653-7 Nov 03 04:23:24.698134 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dbe7ccb5-8298-4e7d-9cc2-84f924287e33 req-830e7476-681b-4eaf-b56a-b43e02f5cfb9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099088 Nov 03 04:23:24.699037 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2912/5705] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:24.971136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:24.974072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:24.982030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:24.982839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:24.983800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:24.984754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:24.985456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:24.986101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:25.033693 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b91fd84-bc07-4d37-983e-c91f654167a9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067557 Nov 03 04:23:25.034637 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2794/5706] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:24 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:23:25.230227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:25.232712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:25.248317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:25.249653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:25.250645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:25.261775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:25.262526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:25.263121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:25.509745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:25.510589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:25.521337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:25.522082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:25.522754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:25.523712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:25.542487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:25.543312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:25.549596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:25.633660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:25.645119 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-63e96f66-e1d0-4206-90c6-b48cc36d35cb tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.425619 Nov 03 04:23:25.659440 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2913/5707] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:25 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:25.690453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:25.698967 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-03a656f5-e634-4eba-81ee-99b57510d512 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1455 microversion: 2.1 time: 0.193465 Nov 03 04:23:25.700363 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2795/5708] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:25 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1455 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:26.049265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:26.052961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:26.060853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.061507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.062164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.069105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.069948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.070893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.115024 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b83b5668-1b43-45de-bb7f-08ab71fecf44 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.071970 Nov 03 04:23:26.116112 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2914/5709] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:23:26 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:26.242270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:26.242909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:26.254752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.255340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.255863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.256705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.257279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.257832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.303719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:23:26.670395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:26.671716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:26.678617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.679105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.679546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.680238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.680695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.681154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.737295 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-742ae635-4d09-42b2-a993-3c7eb1421622 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 204 len: 0 microversion: 2.20 time: 0.499177 Nov 03 04:23:26.742633 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2796/5710] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:23:26 2022] DELETE /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:23:26.744419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:26.745304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:26.753077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.753804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.754602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.755364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.755848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.756319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.803912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.804404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.804861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.805368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lazy-loading 'fault' on Instance uuid a48a3170-0d74-478c-a39e-b0268ab6a6f8 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:23:26.857794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:26.866741 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa1f9dca-3c69-4512-908e-ff5c836c70f8 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1303 microversion: 2.1 time: 0.127707 Nov 03 04:23:26.867327 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2797/5711] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:26 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1303 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:26.871818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5bc8552a-469e-4b4b-9ae1-ca7cbbae5969 req-c3420d24-21bb-4fd0-a8ec-4410ec7209d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a48a3170-0d74-478c-a39e-b0268ab6a6f8", "name": "network-vif-deleted", "tag": "cb969ba0-996c-40f5-afed-edc11ed8cf9a"}, {"name": "network-changed", "server_uuid": "cdb4caab-b5cf-4886-8732-e5b0a4fcda95", "tag": "5b322d53-3925-4cfa-8473-cab5d1f86860"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:26.882590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5bc8552a-469e-4b4b-9ae1-ca7cbbae5969 req-c3420d24-21bb-4fd0-a8ec-4410ec7209d3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.883147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5bc8552a-469e-4b4b-9ae1-ca7cbbae5969 req-c3420d24-21bb-4fd0-a8ec-4410ec7209d3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.883504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:26.883649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5bc8552a-469e-4b4b-9ae1-ca7cbbae5969 req-c3420d24-21bb-4fd0-a8ec-4410ec7209d3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.891391 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-76a7ec1e-abde-4ac9-9a2d-4020559941b6 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.225415 Nov 03 04:23:26.896437 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5bc8552a-469e-4b4b-9ae1-ca7cbbae5969 req-c3420d24-21bb-4fd0-a8ec-4410ec7209d3 service nova] Creating event network-vif-deleted:cb969ba0-996c-40f5-afed-edc11ed8cf9a for instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 on n-h1-854653-7 Nov 03 04:23:26.896965 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5bc8552a-469e-4b4b-9ae1-ca7cbbae5969 req-c3420d24-21bb-4fd0-a8ec-4410ec7209d3 service nova] Creating event network-changed:5b322d53-3925-4cfa-8473-cab5d1f86860 for instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 on n-h2-854653-7 Nov 03 04:23:26.906312 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2915/5712] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:26 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:26.908098 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5bc8552a-469e-4b4b-9ae1-ca7cbbae5969 req-c3420d24-21bb-4fd0-a8ec-4410ec7209d3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039401 Nov 03 04:23:26.908836 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2798/5713] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:26.921996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:26.921996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:26.921996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.921996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.921996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:26.922404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:26.922671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:26.923101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:27.043562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:27.078792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:27.087974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:27.089670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:27.104013 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-445c51a8-72b3-4856-b563-ff197d42e3b8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.183858 Nov 03 04:23:27.104013 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2916/5714] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:26 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:27.892942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:27.898911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:27.915593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:27.917534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:27.919636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:27.920908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:27.922064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:27.925890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:27.926475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:27.926973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:27.932503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:27.933549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:27.934167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:27.936064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:27.940591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:27.942193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:28.008415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:28.009673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:28.010141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:28.010623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lazy-loading 'fault' on Instance uuid a48a3170-0d74-478c-a39e-b0268ab6a6f8 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:23:28.099310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad440b59124045949cce93306158dcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6194edd64938459b9203e9d6ff8f6dee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:28.110014 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c472f2f-9d98-4e7e-b820-bd5d16657d5f tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 200 len: 1303 microversion: 2.1 time: 0.222824 Nov 03 04:23:28.111311 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2799/5715] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:27 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 1303 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:28.124852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:28.125957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:28.132885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:28.133424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:28.133868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:28.134611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:28.135074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:28.136648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:28.298347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:28.314719 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23d93434-c64e-4de0-ba20-0e36a21ad490 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.399936 Nov 03 04:23:28.320744 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2917/5716] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:27 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:28.435967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:28.454544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:28.456034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:28.457388 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-989824fa-d022-4a13-a1b8-c66440ec9bc3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1724 microversion: 2.20 time: 0.341583 Nov 03 04:23:28.462522 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2800/5717] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:28 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:29.135857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:29.137206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:29.139207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=18 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:29.145508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:29.146005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:29.146451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:29.147300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:29.147925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:29.148513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:29.164835 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] HTTP exception thrown: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Request method failure captured: Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 HTTP/1.1 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0HS4g-z85Rnk-_9ulw_nJ9FRSpLtHm-iCt9Po3P3YLdgtsAQ8uOJw0LWFNQS0pdmVXadfpbqs4S0vU5E-HV8LgdJFu5AhZLWSjNcQZe1pWfDfrwVcKUkl5lyJmqsBLyzFEFRZzf3vT9i0FospgBnDF7ok0Y71ZwrS0XWxGKNFJdQiU Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6194edd64938459b9203e9d6ff8f6dee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6194edd64938459b9203e9d6ff8f6dee"}]}] Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ad440b59124045949cce93306158dcd5 Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a48a3170-0d74-478c-a39e-b0268ab6a6f8'} Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:29.166450 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:29.171833 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:29.171833 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:29.171833 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:29.171833 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:23:29.171833 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:23:29.171833 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:29.171833 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:29.173510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Returning 404 to user: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:23:29.174592 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c0d0e11-0e24-4f6d-829c-d9ab4e564f6e tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 404 len: 111 microversion: 2.1 time: 0.042666 Nov 03 04:23:29.178510 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2918/5718] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:29 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:23:29.342844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:29.344222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:29.351617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:29.352407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:29.353076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:29.359997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:29.359997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:29.359997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:29.488090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:29.488757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:29.511015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:29.511532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:29.511986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:29.512725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:29.523045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:29.523607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:29.669867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:29.681971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:29.693418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:29.705716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:29.733988 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7fd4bf49-6df4-497a-97b1-0cc063ab3c87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1656 microversion: 2.20 time: 0.239146 Nov 03 04:23:29.733988 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2919/5719] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:29 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1656 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:29.827802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:29.843218 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-583b1833-1ba4-4580-9371-2d8f3c590eee tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.501758 Nov 03 04:23:29.854955 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2801/5720] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:29 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:30.781472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:30.787926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:30.818278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:30.818787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:30.839087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:30.840533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:30.843216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:30.844121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:30.876180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:30.880502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:30.900675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:30.901566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:30.904628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:30.906221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lazy-loading 'fault' on Instance uuid ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:23:30.926653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:30.929307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:30.929927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:30.930537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:30.943843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:30.943843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:31.096063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:31.111704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:31.113301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:31.114751 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b71da49c-7599-4364-a168-0e6ee66c15a2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 200 len: 1372 microversion: 2.20 time: 0.358753 Nov 03 04:23:31.115708 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2920/5721] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:30 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 1372 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:31.120636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f52adbe9-6acb-4020-a63f-3224ae4f4748 req-69321687-84d9-406a-a3a3-468dd8cec1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca3ffb7c-7bf8-4a22-923a-055c3a5eae15", "name": "network-vif-deleted", "tag": "6b519c86-8b5c-406f-9ed8-fed59ea01091"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:31.143959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f52adbe9-6acb-4020-a63f-3224ae4f4748 req-69321687-84d9-406a-a3a3-468dd8cec1bd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:31.144745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f52adbe9-6acb-4020-a63f-3224ae4f4748 req-69321687-84d9-406a-a3a3-468dd8cec1bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:31.146513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f52adbe9-6acb-4020-a63f-3224ae4f4748 req-69321687-84d9-406a-a3a3-468dd8cec1bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:31.189362 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f52adbe9-6acb-4020-a63f-3224ae4f4748 req-69321687-84d9-406a-a3a3-468dd8cec1bd service nova] Creating event network-vif-deleted:6b519c86-8b5c-406f-9ed8-fed59ea01091 for instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 on n-h1-854653-7 Nov 03 04:23:31.198127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f52adbe9-6acb-4020-a63f-3224ae4f4748 req-69321687-84d9-406a-a3a3-468dd8cec1bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078792 Nov 03 04:23:31.199287 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2921/5722] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:31.597582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:31.618175 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d898b056-9b17-458c-8a4f-2e7239da48a9 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.747082 Nov 03 04:23:31.619090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2802/5723] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:30 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:32.157231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:32.157958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:32.165280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:32.165774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:32.166254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:32.174605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:32.174605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:32.174605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:32.182175 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] HTTP exception thrown: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Request method failure captured: Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 HTTP/1.1 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0El5ZXBgerY91p46f_bYYCXXRqPFoPy8F8cPP630-UpfdI7uwhjiy7iM1psv1PikzbVL_biMSz-YH0aq4MCjHPGLoSrtxKTncQ_D4wcvhmUfLbkptAwNgiRU-vbrMegfUot8RtjvWDWuNaM5o0VpFNm4v7mTzGaBJlbp0-sJ6Fqd64 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.20 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a2e39fc670a24c958ef2e52d6dedb2fc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a2e39fc670a24c958ef2e52d6dedb2fc"}]}] Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 0e6a65ca09f54e1eb3e3ee5cc9c7e64f Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ca3ffb7c-7bf8-4a22-923a-055c3a5eae15'} Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:32.183870 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Returning 404 to user: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f9879be4-f8af-4aba-a85a-5a16874aa6d0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 404 len: 111 microversion: 2.20 time: 0.034723 Nov 03 04:23:32.189431 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2922/5724] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:32 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:23:32.196093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85f41816-5b3e-4573-9bcc-29c567fad277 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '.version_select at 0x7ff7f9cc3e50>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:32.357445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85f41816-5b3e-4573-9bcc-29c567fad277 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869445121" status: 204 len: 0 microversion: 2.20 time: 0.166475 Nov 03 04:23:32.366626 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2803/5725] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Nov 3 04:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869445121 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:23:32.584374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9e20c00f-1cb7-4066-880a-8dd641d2303c req-87d07ac9-efd3-4a52-97aa-f566d5b864f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb4caab-b5cf-4886-8732-e5b0a4fcda95", "name": "network-vif-plugged", "status": "completed", "tag": "5b322d53-3925-4cfa-8473-cab5d1f86860"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:32.609999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9e20c00f-1cb7-4066-880a-8dd641d2303c req-87d07ac9-efd3-4a52-97aa-f566d5b864f1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:32.610865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9e20c00f-1cb7-4066-880a-8dd641d2303c req-87d07ac9-efd3-4a52-97aa-f566d5b864f1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:32.611633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9e20c00f-1cb7-4066-880a-8dd641d2303c req-87d07ac9-efd3-4a52-97aa-f566d5b864f1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:32.635810 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9e20c00f-1cb7-4066-880a-8dd641d2303c req-87d07ac9-efd3-4a52-97aa-f566d5b864f1 service nova] Creating event network-vif-plugged:5b322d53-3925-4cfa-8473-cab5d1f86860 for instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 on n-h2-854653-7 Nov 03 04:23:32.643838 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9e20c00f-1cb7-4066-880a-8dd641d2303c req-87d07ac9-efd3-4a52-97aa-f566d5b864f1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069462 Nov 03 04:23:32.644617 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2923/5726] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:32.647134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:32.654141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:32.667791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:32.669401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:32.670217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:32.672980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:32.675784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:32.676245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.188030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:33.197961 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5533cfe6-dd1c-4cf4-bdc6-f632d8b770da tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.554985 Nov 03 04:23:33.198684 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2804/5727] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:32 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:33.654152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:33.656137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:33.667619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:33.674257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.674678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.675347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.676398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.677051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.677651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.694777 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] HTTP exception thrown: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Request method failure captured: Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 HTTP/1.1 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0HS4g-z85Rnk-_9ulw_nJ9FRSpLtHm-iCt9Po3P3YLdgtsAQ8uOJw0LWFNQS0pdmVXadfpbqs4S0vU5E-HV8LgdJFu5AhZLWSjNcQZe1pWfDfrwVcKUkl5lyJmqsBLyzFEFRZzf3vT9i0FospgBnDF7ok0Y71ZwrS0XWxGKNFJdQiU Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6194edd64938459b9203e9d6ff8f6dee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6194edd64938459b9203e9d6ff8f6dee"}]}] Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ad440b59124045949cce93306158dcd5 Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a48a3170-0d74-478c-a39e-b0268ab6a6f8'} Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:23:33.696517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Returning 404 to user: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-43588e41-e6e5-4b90-8af5-4b835161f1de tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 404 len: 111 microversion: 2.1 time: 0.051464 Nov 03 04:23:33.710984 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2924/5728] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:23:33 2022] DELETE /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:23:33.712085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:33.712085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: a48a3170-0d74-478c-a39e-b0268ab6a6f8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:33.715720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.716443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.717121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.718227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.719564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.720195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.740808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] HTTP exception thrown: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Request method failure captured: Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 HTTP/1.1 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0HS4g-z85Rnk-_9ulw_nJ9FRSpLtHm-iCt9Po3P3YLdgtsAQ8uOJw0LWFNQS0pdmVXadfpbqs4S0vU5E-HV8LgdJFu5AhZLWSjNcQZe1pWfDfrwVcKUkl5lyJmqsBLyzFEFRZzf3vT9i0FospgBnDF7ok0Y71ZwrS0XWxGKNFJdQiU Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6194edd64938459b9203e9d6ff8f6dee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6194edd64938459b9203e9d6ff8f6dee"}]}] Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ad440b59124045949cce93306158dcd5 Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a48a3170-0d74-478c-a39e-b0268ab6a6f8'} Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.743665 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Returning 404 to user: Instance a48a3170-0d74-478c-a39e-b0268ab6a6f8 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:23:33.747925 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60071657-d67c-4852-882b-1d532ca1c0ba tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8" status: 404 len: 111 microversion: 2.1 time: 0.042339 Nov 03 04:23:33.749859 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2805/5729] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:33 2022] GET /compute/v2.1/servers/a48a3170-0d74-478c-a39e-b0268ab6a6f8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:23:33.760986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:33.761695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:33.770457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.771541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.773688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.781153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.781767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.782339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.832196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] HTTP exception thrown: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Request method failure captured: Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 HTTP/1.1 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0HS4g-z85Rnk-_9ulw_nJ9FRSpLtHm-iCt9Po3P3YLdgtsAQ8uOJw0LWFNQS0pdmVXadfpbqs4S0vU5E-HV8LgdJFu5AhZLWSjNcQZe1pWfDfrwVcKUkl5lyJmqsBLyzFEFRZzf3vT9i0FospgBnDF7ok0Y71ZwrS0XWxGKNFJdQiU Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6194edd64938459b9203e9d6ff8f6dee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6194edd64938459b9203e9d6ff8f6dee"}]}] Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: ad440b59124045949cce93306158dcd5 Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '3934dadc-664b-44e0-b716-22e63e790371'} Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:23:33.834159 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.838230 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.839990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Returning 404 to user: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:23:33.848860 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a3a214b0-4ad2-410c-b49f-eafc4019ca54 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 404 len: 111 microversion: 2.1 time: 0.092010 Nov 03 04:23:33.851642 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2925/5730] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:23:33 2022] DELETE /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:23:33.861911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:33.864088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] [instance: 3934dadc-664b-44e0-b716-22e63e790371] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:33.877188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.877831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9fb80ef6-0c5a-4cd0-9c92-d0c0b9a28f54 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'create', calling method: .version_select at 0x7ff7fd5d50d0>, body: {"keypair": {"name": "tempest-keypair-88452943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNnKg1n8b7yltPTLXiMqmX9Pwc70Npxaec6yAfUSQKnZ/KXoxaPLKOaYZnw9rUXJDcw9lrdKpVcweovNEn6fkAowqcT8qK4dtT9NhK4AsnzVAN31ZYFejPU8xBUIU1aHA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:33.878213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.878887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.881668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:33.882580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:33.883438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] HTTP exception thrown: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Request method failure captured: Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 HTTP/1.1 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0HS4g-z85Rnk-_9ulw_nJ9FRSpLtHm-iCt9Po3P3YLdgtsAQ8uOJw0LWFNQS0pdmVXadfpbqs4S0vU5E-HV8LgdJFu5AhZLWSjNcQZe1pWfDfrwVcKUkl5lyJmqsBLyzFEFRZzf3vT9i0FospgBnDF7ok0Y71ZwrS0XWxGKNFJdQiU Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6194edd64938459b9203e9d6ff8f6dee", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6194edd64938459b9203e9d6ff8f6dee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6194edd64938459b9203e9d6ff8f6dee"}]}] Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 6194edd64938459b9203e9d6ff8f6dee Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersTestMultiNic-406991733 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ad440b59124045949cce93306158dcd5 Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersTestMultiNic-406991733-project Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '3934dadc-664b-44e0-b716-22e63e790371'} Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:23:33.922340 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] Returning 404 to user: Instance 3934dadc-664b-44e0-b716-22e63e790371 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c85364d-4b04-4347-933e-91174a879c88 tempest-ServersTestMultiNic-406991733 tempest-ServersTestMultiNic-406991733-project] 10.222.0.30 "GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371" status: 404 len: 111 microversion: 2.1 time: 0.070826 Nov 03 04:23:33.930738 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2806/5731] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:33 2022] GET /compute/v2.1/servers/3934dadc-664b-44e0-b716-22e63e790371 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:23:33.941748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-9fb80ef6-0c5a-4cd0-9c92-d0c0b9a28f54 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:23:33.957642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-9fb80ef6-0c5a-4cd0-9c92-d0c0b9a28f54 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for user 0e6a65ca09f54e1eb3e3ee5cc9c7e64f and project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:23:34.168018 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9fb80ef6-0c5a-4cd0-9c92-d0c0b9a28f54 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.303496 Nov 03 04:23:34.168727 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2926/5732] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Nov 3 04:23:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 306 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 03 04:23:34.223056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:34.224935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:34.246582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:34.247589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:34.248771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:34.249764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:34.250685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:34.251610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:35.016585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:35.027909 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50d48291-ee25-4886-9d45-8ea1c481ba03 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1428 microversion: 2.1 time: 0.809150 Nov 03 04:23:35.030791 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2807/5733] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:34 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1428 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:36.056194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:36.058073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:36.072141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:36.072888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:36.077363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:36.078353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:36.079100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:36.080095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:36.476353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:36.493617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:36.498284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:36.516293 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ef34731-0097-4ab0-9a65-356d587964d4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1608 microversion: 2.1 time: 0.467188 Nov 03 04:23:36.527978 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2927/5734] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:36 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1608 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:36.529436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:36.530350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:36.531048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:36.532449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:36.533104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:36.533703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:36.549567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-bdf15cb0-21c6-414d-98f9-d3527c168a8b req-d7b1639e-879e-4469-b123-ffd3d834e19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50604c9a-e553-4d67-895f-12b056247522", "tag": "14f518b5-b278-4fe3-939b-74565aeb5968"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:36.601386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bdf15cb0-21c6-414d-98f9-d3527c168a8b req-d7b1639e-879e-4469-b123-ffd3d834e19e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:36.604778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bdf15cb0-21c6-414d-98f9-d3527c168a8b req-d7b1639e-879e-4469-b123-ffd3d834e19e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:36.605447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bdf15cb0-21c6-414d-98f9-d3527c168a8b req-d7b1639e-879e-4469-b123-ffd3d834e19e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:36.642667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:23:36.678888 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-bdf15cb0-21c6-414d-98f9-d3527c168a8b req-d7b1639e-879e-4469-b123-ffd3d834e19e service nova] Creating event network-changed:14f518b5-b278-4fe3-939b-74565aeb5968 for instance 50604c9a-e553-4d67-895f-12b056247522 on n-h2-854653-7 Nov 03 04:23:36.700286 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-bdf15cb0-21c6-414d-98f9-d3527c168a8b req-d7b1639e-879e-4469-b123-ffd3d834e19e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166810 Nov 03 04:23:36.705497 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2928/5735] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:36.738043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:36.739434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:36.762042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:36.762549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:36.762995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:36.768996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:36.769507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:36.772964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:37.239933 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89a29c6a-291c-4e13-bfbc-9936df3dc04c tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 204 len: 0 microversion: 2.1 time: 0.756981 Nov 03 04:23:37.240590 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2808/5736] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:23:36 2022] DELETE /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:23:37.251512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:37.252315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:37.278475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:37.280549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:37.281073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:37.281847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:37.285433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:37.286255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:37.492915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:37.511831 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-11265158-efee-44f8-a5bd-f4f6c92d4ef8 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1608 microversion: 2.1 time: 0.794019 Nov 03 04:23:37.518723 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2929/5737] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:36 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1608 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:37.547537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:37.548168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:37.564415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:37.565094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:37.565885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:37.566983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:37.567615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:37.568230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:37.837393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:37.864429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c68a5d38-d62c-48c8-be70-a8f05e6f828f tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1586 microversion: 2.1 time: 0.614509 Nov 03 04:23:37.868383 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2809/5738] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:37 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1586 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:37.964406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:37.972872 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-63ae33fd-828c-4ae0-ba7a-9abcc2974a49 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1608 microversion: 2.1 time: 0.432428 Nov 03 04:23:37.973781 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2930/5739] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:37 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1608 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:38.899214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:38.901099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:38.926082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:38.928697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:38.929461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:38.930863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:38.932708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:38.934950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:38.935876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:40.126842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b3c4a44f-09dc-49be-851e-b12841a6b027 req-80cfad84-1c1d-4b0c-82b3-c1d5369761c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50604c9a-e553-4d67-895f-12b056247522", "name": "network-vif-deleted", "tag": "14f518b5-b278-4fe3-939b-74565aeb5968"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:40.141826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b3c4a44f-09dc-49be-851e-b12841a6b027 req-80cfad84-1c1d-4b0c-82b3-c1d5369761c4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:40.142575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b3c4a44f-09dc-49be-851e-b12841a6b027 req-80cfad84-1c1d-4b0c-82b3-c1d5369761c4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:40.143187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b3c4a44f-09dc-49be-851e-b12841a6b027 req-80cfad84-1c1d-4b0c-82b3-c1d5369761c4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:40.164385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:40.166726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:40.168901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b3c4a44f-09dc-49be-851e-b12841a6b027 req-80cfad84-1c1d-4b0c-82b3-c1d5369761c4 service nova] Creating event network-vif-deleted:14f518b5-b278-4fe3-939b-74565aeb5968 for instance 50604c9a-e553-4d67-895f-12b056247522 on n-h2-854653-7 Nov 03 04:23:40.176096 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b3c4a44f-09dc-49be-851e-b12841a6b027 req-80cfad84-1c1d-4b0c-82b3-c1d5369761c4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271944 Nov 03 04:23:40.177717 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2931/5740] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:23:40.183014 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad0256fc-02e3-400a-89df-cd4c0421a5f0 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1586 microversion: 2.1 time: 1.288361 Nov 03 04:23:40.183014 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2810/5741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:38 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1586 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:40.876626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-622165080", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "311009ff-5554-431b-969f-71038bba448a"}], "security_groups": [{"name": "tempest-securitygroup--1281364719"}], "key_name": "tempest-keypair-88452943", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:41.208196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:41.208827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:41.219861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:41.236531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:41.237507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:41.245455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:41.247162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:41.247838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:41.482057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] validate_networks() for [('311009ff-5554-431b-969f-71038bba448a', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:23:41.490474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:41.502226 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1a347c8-6d02-4112-9709-a93685c6e296 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1230 microversion: 2.1 time: 0.298142 Nov 03 04:23:41.503197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2811/5742] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:41 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1230 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:42.536470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:42.537648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:42.564359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:42.566445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:42.567479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:42.569236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:42.570529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:42.571493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:43.008091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:43.035732 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7cb530b-8df7-4a56-8784-0806e18fbc86 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1399 microversion: 2.1 time: 0.505725 Nov 03 04:23:43.036470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2812/5743] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:42 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1399 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:43.265168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:23:43.266233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:23:43.266976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:23:43.271818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:23:43.276163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:23:43.294691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:43.296002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:43.296447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:43.297706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:43.298624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:43.299371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:43.323781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:23:43.331445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Getting quotas for user 0e6a65ca09f54e1eb3e3ee5cc9c7e64f and project a2e39fc670a24c958ef2e52d6dedb2fc. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:23:43.350319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:23:43.353922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:23:43.604665 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8e20611-016d-40b5-a6f8-b8d8acf5c4a1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.733190 Nov 03 04:23:43.605249 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2932/5744] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:23:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:23:43.617494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-947baba3-efce-4574-a9ae-854cb0e42f6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:43.618764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-947baba3-efce-4574-a9ae-854cb0e42f6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:43.860012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-947baba3-efce-4574-a9ae-854cb0e42f6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:43.869823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-947baba3-efce-4574-a9ae-854cb0e42f6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:43.875187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-947baba3-efce-4574-a9ae-854cb0e42f6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:43.876574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-947baba3-efce-4574-a9ae-854cb0e42f6a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1279 microversion: 2.20 time: 0.263264 Nov 03 04:23:43.879013 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2813/5745] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:43 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1279 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:44.069699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:44.074489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:44.095947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:44.096810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:44.097621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:44.098502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:44.105204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:44.106458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:44.821752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:44.836415 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a769823-6849-4f77-9de1-35dfac3384be tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1399 microversion: 2.1 time: 0.779766 Nov 03 04:23:44.837213 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2933/5746] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:44 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1399 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:44.920334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:44.921549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:44.958562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:44.961708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:44.972519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:44.972519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:44.972519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:44.972519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:45.302119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:45.317001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:45.318550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:45.319727 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2cd274dc-356c-4a00-953e-9c45ef9c1639 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1283 microversion: 2.20 time: 0.411853 Nov 03 04:23:45.325989 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2814/5747] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:44 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1283 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:45.870122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:45.875036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:45.934987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:45.941189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:45.942243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:45.943096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:45.944639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:45.945452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:46.104258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-959d40ce-c8ec-4d6e-bae5-9c9454beb89f req-55740b81-67fb-4128-9d14-aa88a7543539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb4caab-b5cf-4886-8732-e5b0a4fcda95", "tag": "5b322d53-3925-4cfa-8473-cab5d1f86860"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:46.119934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-959d40ce-c8ec-4d6e-bae5-9c9454beb89f req-55740b81-67fb-4128-9d14-aa88a7543539 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:46.121946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-959d40ce-c8ec-4d6e-bae5-9c9454beb89f req-55740b81-67fb-4128-9d14-aa88a7543539 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:46.122674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-959d40ce-c8ec-4d6e-bae5-9c9454beb89f req-55740b81-67fb-4128-9d14-aa88a7543539 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:46.158849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:46.192030 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a6db2ed3-1949-411a-950f-b79895fe2eb2 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1399 microversion: 2.1 time: 0.330634 Nov 03 04:23:46.192631 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2934/5748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:45 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1399 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:46.205599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-959d40ce-c8ec-4d6e-bae5-9c9454beb89f req-55740b81-67fb-4128-9d14-aa88a7543539 service nova] Creating event network-changed:5b322d53-3925-4cfa-8473-cab5d1f86860 for instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 on n-h2-854653-7 Nov 03 04:23:46.223775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-959d40ce-c8ec-4d6e-bae5-9c9454beb89f req-55740b81-67fb-4128-9d14-aa88a7543539 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127961 Nov 03 04:23:46.225199 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2815/5749] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:23:46.850936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:46.854950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:46.881229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:46.884078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:46.884819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:46.886875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:46.895722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:46.896548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:47.197317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:47.214509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:47.216443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:47.217787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:47.217916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:47.219412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-570a20b6-f2f8-430f-bad1-fb67adc3ed0c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1339 microversion: 2.20 time: 0.876251 Nov 03 04:23:47.223542 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2935/5750] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:46 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1339 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:47.245634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:47.246445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:47.247600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:47.249096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:47.249733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:47.250333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:47.292725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:47.293822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:47.294437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:47.295144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lazy-loading 'fault' on Instance uuid 50604c9a-e553-4d67-895f-12b056247522 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:23:47.376087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:47.388658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c993a9f9-c185-4b82-8812-e4468aa5768e tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1404 microversion: 2.1 time: 0.175704 Nov 03 04:23:47.391521 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2816/5751] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:47 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1404 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:23:48.251233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:48.251878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:48.268377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:48.269257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:48.270641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:48.273687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:48.275072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:48.276772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:48.421575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:48.423275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:48.470778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:48.471432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:48.471855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:48.476112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:48.482113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:48.486911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:48.614865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:48.615571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:48.616242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:48.616868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lazy-loading 'fault' on Instance uuid 50604c9a-e553-4d67-895f-12b056247522 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:23:48.633687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:48.716406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:48.716406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:48.735467 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3927cf79-e997-4466-835a-337a9ab766f6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1337 microversion: 2.20 time: 0.489721 Nov 03 04:23:48.749767 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2936/5752] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:48 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1337 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:48.805355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a461b81661ae499b88b5b260af30d161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '169d5b1fe905496d8188ce5d40d0eb99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:48.822431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41a6031f-6085-4ff2-af43-0a6872473dda tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 200 len: 1358 microversion: 2.1 time: 0.405066 Nov 03 04:23:48.824583 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2817/5753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:48 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:23:49.777079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:49.779562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:49.807920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:49.814011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:49.814011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:49.814963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:49.816798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:49.820075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:49.850165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:49.850938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] [instance: 50604c9a-e553-4d67-895f-12b056247522] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:49.878976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:49.878976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:49.878976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:49.878976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:49.878976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:49.878976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:49.910711 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] HTTP exception thrown: Instance 50604c9a-e553-4d67-895f-12b056247522 could not be found. Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Request method failure captured: Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 HTTP/1.1 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0CVYmfo6r_b8RjBGOnn78EhW-RP_AoKhvcbGXEmeIWYILOWU-T9v-0H_aDJI1NCCvuJY5XEdlWtToal59I_gjhxYh69XZyKGhhMnRAZOBpkno1PYKhy57h-hRVwo95PM7EJZTVyi4u4nkUYpEFXYNInQPcIKNEO1Vgk5V_rF-mIRN8 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 169d5b1fe905496d8188ce5d40d0eb99 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBackupRestore-2015324167 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/169d5b1fe905496d8188ce5d40d0eb99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_169d5b1fe905496d8188ce5d40d0eb99", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/169d5b1fe905496d8188ce5d40d0eb99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/169d5b1fe905496d8188ce5d40d0eb99"}]}] Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBackupRestore-2015324167 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 169d5b1fe905496d8188ce5d40d0eb99 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2015324167 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBackupRestore-2015324167-project Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a461b81661ae499b88b5b260af30d161 Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBackupRestore-2015324167-project Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 50604c9a-e553-4d67-895f-12b056247522 could not be found. Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '50604c9a-e553-4d67-895f-12b056247522'} Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50604c9a-e553-4d67-895f-12b056247522 could not be found. Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50604c9a-e553-4d67-895f-12b056247522 could not be found. Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:23:49.922172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:49.926703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:23:49.926703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:23:49.926703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:23:49.926703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:23:49.926703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:23:49.926703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50604c9a-e553-4d67-895f-12b056247522 could not be found. Nov 03 04:23:49.926703 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:23:49.929529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Returning 404 to user: Instance 50604c9a-e553-4d67-895f-12b056247522 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:23:49.930721 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d07b04b6-d017-4c14-9188-3a3107e26602 tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522" status: 404 len: 111 microversion: 2.1 time: 0.086150 Nov 03 04:23:49.932011 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2818/5754] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:23:49 2022] GET /compute/v2.1/servers/50604c9a-e553-4d67-895f-12b056247522 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:23:50.316423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:50.332958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:50.335980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:50.340723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50d5a986-c6fb-4de0-afb2-3a8fea9fd021 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.575268 Nov 03 04:23:50.343242 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2937/5755] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:49 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:50.767990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-77d89bfa-1177-49b2-9119-9defdcf903fe tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] Calling method '.version_select at 0x7ff7fd519040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:50.889702 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-77d89bfa-1177-49b2-9119-9defdcf903fe tempest-TestVolumeBackupRestore-2015324167 tempest-TestVolumeBackupRestore-2015324167-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1879748087" status: 202 len: 0 microversion: 2.1 time: 0.125237 Nov 03 04:23:50.890346 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2819/5756] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 04:23:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1879748087 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:23:51.380318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:51.380318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:51.397938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:51.399728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:51.400351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:51.406071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:51.406868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:51.409454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:51.562775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ecec3f4b-549c-4d10-b171-f91a98a44d81 req-9ec5ee91-7c19-4b30-a010-ad56637a0c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aaced6c-4fb6-4299-aab5-66cfac456794", "tag": "eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:23:51.588762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ecec3f4b-549c-4d10-b171-f91a98a44d81 req-9ec5ee91-7c19-4b30-a010-ad56637a0c61 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:51.594515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ecec3f4b-549c-4d10-b171-f91a98a44d81 req-9ec5ee91-7c19-4b30-a010-ad56637a0c61 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:51.594975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ecec3f4b-549c-4d10-b171-f91a98a44d81 req-9ec5ee91-7c19-4b30-a010-ad56637a0c61 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:51.634424 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ecec3f4b-549c-4d10-b171-f91a98a44d81 req-9ec5ee91-7c19-4b30-a010-ad56637a0c61 service nova] Creating event network-changed:eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25 for instance 6aaced6c-4fb6-4299-aab5-66cfac456794 on n-h1-854653-7 Nov 03 04:23:51.656167 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ecec3f4b-549c-4d10-b171-f91a98a44d81 req-9ec5ee91-7c19-4b30-a010-ad56637a0c61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096979 Nov 03 04:23:51.671899 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2820/5757] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:23:52.343515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:52.359679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:52.361203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:52.362894 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e0768df7-6f93-457d-b8a0-a6dc953f91c1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.995530 Nov 03 04:23:52.386429 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2938/5758] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:51 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:53.414440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:53.414440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:53.424591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:53.425523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:53.426192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:53.427207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:53.427914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:53.428786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:53.748833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:53.767011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:53.770802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:53.773712 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-833a05b6-e233-41ae-a596-dd5a433ea66c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.383465 Nov 03 04:23:53.781047 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2821/5759] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:53 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:54.802286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:54.802837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:54.807300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:54.807300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:54.824919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:54.824919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:54.824919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:54.824919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:54.825416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:54.826267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:55.344632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:55.363248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:55.365978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:55.369608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b75ef16-13b8-43e5-925a-2631e5127d65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.571682 Nov 03 04:23:55.370200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2939/5760] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:54 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:56.395567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:56.397791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:56.398554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:23:56.420609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:56.423068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:56.424139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:56.428907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:56.430092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:56.431261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:56.884340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:56.893741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:56.898399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:56.912577 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba01ed39-1944-4503-876f-287ba94890e1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.519760 Nov 03 04:23:56.919706 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2822/5761] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:56 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:23:57.943759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:23:57.947379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:23:57.964503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:57.965210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:57.973004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:57.978432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:23:57.983877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:23:57.984988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:23:59.215116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:59.231054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:59.236541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:23:59.248046 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23a1662b-f064-41fa-9e77-9a02143bd723 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 1.308033 Nov 03 04:23:59.249083 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2940/5762] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:23:57 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:00.274259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:00.274914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:00.292158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:00.292657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:00.293131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:00.296419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:00.296419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:00.296419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:00.726443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:00.754060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:00.763794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:00.768378 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31319f91-b567-4394-a2cc-f3bd529546d2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.498008 Nov 03 04:24:00.771628 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2823/5763] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:00 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:01.804735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:01.806220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:01.824464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:01.826797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:01.827325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:01.828636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:01.830645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:01.831467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:02.235247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:02.237998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:02.253432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:02.258302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:02.259966 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7394dd91-4c18-4050-a75c-24c9534ef236 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.460714 Nov 03 04:24:02.262623 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2941/5764] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:01 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:02.569751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fbd0f510-1c82-4190-89e9-e7b48b313295 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Action: 'create', calling method: .version_select at 0x7ff7f989a9d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-620287354", "policies": ["affinity"]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:02.610876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fbd0f510-1c82-4190-89e9-e7b48b313295 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:02.632439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fbd0f510-1c82-4190-89e9-e7b48b313295 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:02.764825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fbd0f510-1c82-4190-89e9-e7b48b313295 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:02.780870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-fbd0f510-1c82-4190-89e9-e7b48b313295 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:02.816258 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fbd0f510-1c82-4190-89e9-e7b48b313295 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.782610 Nov 03 04:24:02.816258 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2824/5765] 10.222.0.30 () {60 vars in 1174 bytes} [Thu Nov 3 04:24:02 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:24:02.831291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b0c9b0f2-03df-4465-9bc8-0cbf23f3d285 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Action: 'create', calling method: .version_select at 0x7ff7f9ad5700>, body: {"server_group": {"name": "tempest-server-group-2007841343", "policies": ["affinity"]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:02.870451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b0c9b0f2-03df-4465-9bc8-0cbf23f3d285 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:02.878704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5291c2ba-b1bb-440b-948b-9a339c257615 req-55395f02-e271-4f3a-82b4-5dc3125c3468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaced6c-4fb6-4299-aab5-66cfac456794", "name": "network-vif-plugged", "status": "completed", "tag": "eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:02.891552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b0c9b0f2-03df-4465-9bc8-0cbf23f3d285 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:02.894958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5291c2ba-b1bb-440b-948b-9a339c257615 req-55395f02-e271-4f3a-82b4-5dc3125c3468 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:02.895657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5291c2ba-b1bb-440b-948b-9a339c257615 req-55395f02-e271-4f3a-82b4-5dc3125c3468 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:02.896267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5291c2ba-b1bb-440b-948b-9a339c257615 req-55395f02-e271-4f3a-82b4-5dc3125c3468 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:02.940556 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5291c2ba-b1bb-440b-948b-9a339c257615 req-55395f02-e271-4f3a-82b4-5dc3125c3468 service nova] Creating event network-vif-plugged:eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25 for instance 6aaced6c-4fb6-4299-aab5-66cfac456794 on n-h1-854653-7 Nov 03 04:24:02.954833 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5291c2ba-b1bb-440b-948b-9a339c257615 req-55395f02-e271-4f3a-82b4-5dc3125c3468 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080573 Nov 03 04:24:02.955760 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2825/5766] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:24:03.087414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b0c9b0f2-03df-4465-9bc8-0cbf23f3d285 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:03.103653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b0c9b0f2-03df-4465-9bc8-0cbf23f3d285 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:03.134473 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b0c9b0f2-03df-4465-9bc8-0cbf23f3d285 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.313228 Nov 03 04:24:03.139630 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2942/5767] 10.222.0.30 () {60 vars in 1173 bytes} [Thu Nov 3 04:24:02 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:03.149690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c6e52bbd-d8dd-4719-b4c8-725a1e35c0c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Action: 'create', calling method: .version_select at 0x7ff7f9f30280>, body: {"server_group": {"name": "tempest-server-group-2007841343", "policies": ["affinity"]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:03.192411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c6e52bbd-d8dd-4719-b4c8-725a1e35c0c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:03.214996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c6e52bbd-d8dd-4719-b4c8-725a1e35c0c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:03.290781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:03.291716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:03.321705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:03.323648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:03.326758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:03.328565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:03.329089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:03.329547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:03.494595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c6e52bbd-d8dd-4719-b4c8-725a1e35c0c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:03.515607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c6e52bbd-d8dd-4719-b4c8-725a1e35c0c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:03.543101 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c6e52bbd-d8dd-4719-b4c8-725a1e35c0c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.398336 Nov 03 04:24:03.544364 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2826/5768] 10.222.0.30 () {60 vars in 1173 bytes} [Thu Nov 3 04:24:03 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:03.554783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0dcf85b8-9f79-4f4e-b97e-6b8dc3ca5bd8 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:03.751767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:03.779701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0dcf85b8-9f79-4f4e-b97e-6b8dc3ca5bd8 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/4b2d3425-ca06-4247-8a06-59a1e220c98b" status: 204 len: 0 microversion: 2.1 time: 0.228283 Nov 03 04:24:03.780252 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2827/5769] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:03 2022] DELETE /compute/v2.1/os-server-groups/4b2d3425-ca06-4247-8a06-59a1e220c98b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:24:03.792863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:03.793745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-067b90cc-d158-4688-a44b-1d77bc6b04c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:03.799319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:03.803403 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8fafc8d4-b1b7-4773-8875-9fe1dbb4d07d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.517105 Nov 03 04:24:03.816518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2943/5770] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:03 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:03.846668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:03.860551 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-067b90cc-d158-4688-a44b-1d77bc6b04c0 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.062438 Nov 03 04:24:03.860551 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2828/5771] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:24:03 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:03.867315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c287e5b-9e59-4686-b251-4e8674129b3b tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:04.121609 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c287e5b-9e59-4686-b251-4e8674129b3b tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/29a314ff-96a7-4555-8094-beda278f73aa" status: 204 len: 0 microversion: 2.1 time: 0.264087 Nov 03 04:24:04.122803 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2944/5772] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:03 2022] DELETE /compute/v2.1/os-server-groups/29a314ff-96a7-4555-8094-beda278f73aa => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:24:04.132577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e1f8c9c-4c41-4803-9c77-a6f95253f853 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:04.152583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e1f8c9c-4c41-4803-9c77-a6f95253f853 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025129 Nov 03 04:24:04.153960 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2829/5773] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:24:04 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:04.168520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-096e6a07-88c9-44db-8adf-8ecd95e0f1db tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Action: 'create', calling method: .version_select at 0x7ff7f94e9310>, body: {"server_group": {"name": "tempest-server-group-556204987", "policies": ["affinity"]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:04.188112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:04.209492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-096e6a07-88c9-44db-8adf-8ecd95e0f1db tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:04.221975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-096e6a07-88c9-44db-8adf-8ecd95e0f1db tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:04.475863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-096e6a07-88c9-44db-8adf-8ecd95e0f1db tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:04.483379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-096e6a07-88c9-44db-8adf-8ecd95e0f1db tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:04.502428 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-096e6a07-88c9-44db-8adf-8ecd95e0f1db tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.339468 Nov 03 04:24:04.508691 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2945/5774] 10.222.0.30 () {60 vars in 1173 bytes} [Thu Nov 3 04:24:04 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:04.514736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bac32db4-814a-4aca-b9f8-9040e142f05c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:04.661093 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bac32db4-814a-4aca-b9f8-9040e142f05c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da" status: 204 len: 0 microversion: 2.1 time: 0.150918 Nov 03 04:24:04.665876 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2830/5775] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:04 2022] DELETE /compute/v2.1/os-server-groups/3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:24:04.672145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e66055c5-6ac6-4920-861a-bf8d8214be62 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:04.708972 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e66055c5-6ac6-4920-861a-bf8d8214be62 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042162 Nov 03 04:24:04.709722 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2946/5776] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:24:04 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:04.739068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48fee954-6e81-4b58-bea0-c8139e668025 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Action: 'create', calling method: .version_select at 0x7ff7f86699d0>, body: {"server_group": {"name": "tempest-server-group-650655749", "policies": ["anti-affinity"]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:04.768740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-48fee954-6e81-4b58-bea0-c8139e668025 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:04.775947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-48fee954-6e81-4b58-bea0-c8139e668025 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:04.844124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:04.845847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:04.854305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:04.856156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:04.857444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:04.859610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:04.860328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:04.861140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:04.961418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-48fee954-6e81-4b58-bea0-c8139e668025 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:04.968968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-48fee954-6e81-4b58-bea0-c8139e668025 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_groups'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:05.008649 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48fee954-6e81-4b58-bea0-c8139e668025 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.283994 Nov 03 04:24:05.010134 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2831/5777] 10.222.0.30 () {60 vars in 1173 bytes} [Thu Nov 3 04:24:04 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:05.029721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-504e64c5-31c6-472f-a123-45b9cf121c5a tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:05.181223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:05.197004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:05.201548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:05.205550 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7122f595-8202-48f0-8a9c-cc4aad032791 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1405 microversion: 2.20 time: 0.364486 Nov 03 04:24:05.208048 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2947/5778] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:04 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1405 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:05.280076 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-504e64c5-31c6-472f-a123-45b9cf121c5a tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/e1df72c9-1a93-4d51-ac64-97dc427eb3e2" status: 204 len: 0 microversion: 2.1 time: 0.256543 Nov 03 04:24:05.280682 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2832/5779] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:05 2022] DELETE /compute/v2.1/os-server-groups/e1df72c9-1a93-4d51-ac64-97dc427eb3e2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:24:05.317409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba8a9935-8e88-429e-8c9c-ce41ddfaa568 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:05.343427 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ba8a9935-8e88-429e-8c9c-ce41ddfaa568 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.058278 Nov 03 04:24:05.349783 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2948/5780] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:24:05 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:05.591476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1315455454", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "eb477df2-b35b-4ce5-91f7-1a5b15af116e"}]}, "os:scheduler_hints": {"group": "5debecff-c3b0-4774-a08c-873abc4a7548"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:05.725453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] validate_networks() for [('eb477df2-b35b-4ce5-91f7-1a5b15af116e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:24:06.245722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:06.245722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:06.257919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:06.260204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:06.262630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:06.268099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:06.268099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:06.269263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:06.984009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:07.001131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:07.002629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:07.008895 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58cce2a9-b077-4a45-a1a4-b8136302cd49 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1597 microversion: 2.20 time: 0.777968 Nov 03 04:24:07.013165 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2949/5781] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:06 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1597 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:07.040682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:07.042027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:07.052911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:07.054338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:07.056026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:07.058373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:07.059940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:07.060229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:07.382855 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4171c3e8-c4a8-4b04-bd3a-dc0a5f4c0bae tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.346838 Nov 03 04:24:07.383778 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2950/5782] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Nov 3 04:24:07 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-interface => generated 285 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:24:07.443512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:24:07.444620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:24:07.447503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:24:07.447503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:24:07.448275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:24:07.490951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:07.491459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:07.491908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:07.495919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:07.497886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:07.498521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:07.566221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:07.581652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:07.611031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:24:07.615237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:24:07.853576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:07.869779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:08.127262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:08.144394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Getting quotas for user 3075dc2d6032442685d84366a087e602 and project aaeedd5efeba49ccaa3d3b29debdcbc8. Resources: {'server_group_members'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:08.251921 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5eff0ab7-0303-48d0-88ab-7da110e8b7fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.666125 Nov 03 04:24:08.261770 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2833/5783] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:24:08.273209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b0294205-01b6-4cae-b8b1-be2589f9e0cc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:08.274149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b0294205-01b6-4cae-b8b1-be2589f9e0cc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:08.447159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b0294205-01b6-4cae-b8b1-be2589f9e0cc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:08.462020 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b0294205-01b6-4cae-b8b1-be2589f9e0cc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1213 microversion: 2.1 time: 0.193043 Nov 03 04:24:08.462620 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2951/5784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:08 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1213 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:09.501183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ee68335-5bf4-484c-b055-beac3d6109fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:09.507763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7ee68335-5bf4-484c-b055-beac3d6109fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:10.158061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7ee68335-5bf4-484c-b055-beac3d6109fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:10.174641 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ee68335-5bf4-484c-b055-beac3d6109fb tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1213 microversion: 2.1 time: 0.687238 Nov 03 04:24:10.191478 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2834/5785] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:09 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1213 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:10.895877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-380da60f-0642-4743-bc5a-31ef28fb138f req-35177f67-19b3-40cc-ac22-fc149f2866bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aaced6c-4fb6-4299-aab5-66cfac456794", "tag": "eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:10.938467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-380da60f-0642-4743-bc5a-31ef28fb138f req-35177f67-19b3-40cc-ac22-fc149f2866bc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:10.941433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-380da60f-0642-4743-bc5a-31ef28fb138f req-35177f67-19b3-40cc-ac22-fc149f2866bc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:10.946708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-380da60f-0642-4743-bc5a-31ef28fb138f req-35177f67-19b3-40cc-ac22-fc149f2866bc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:10.969633 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-380da60f-0642-4743-bc5a-31ef28fb138f req-35177f67-19b3-40cc-ac22-fc149f2866bc service nova] Creating event network-changed:eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25 for instance 6aaced6c-4fb6-4299-aab5-66cfac456794 on n-h1-854653-7 Nov 03 04:24:10.985568 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-380da60f-0642-4743-bc5a-31ef28fb138f req-35177f67-19b3-40cc-ac22-fc149f2866bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091525 Nov 03 04:24:10.985890 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2952/5786] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:11.202151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:11.202900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:11.217319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:11.222058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:11.222763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:11.223741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:11.231973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:11.233294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:11.862240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:11.876335 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f46ffd00-5270-4993-829c-1532eca06f9c tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1265 microversion: 2.1 time: 0.678592 Nov 03 04:24:11.891828 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2835/5787] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:11 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1265 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:12.913666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:12.915035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:12.931723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:12.932570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:12.933055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:12.933803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:12.934331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:12.934765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:13.086836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:13.101989 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f5eeae30-828e-46ea-acda-486775c31997 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1271 microversion: 2.1 time: 0.192936 Nov 03 04:24:13.104656 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2953/5788] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:12 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:14.136292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:14.136960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:14.156792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:14.159704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:14.160486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:14.168391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:14.168391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:14.168391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:14.178695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=70 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:14.501484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:14.513971 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-497f6a90-c8b4-4e3e-b045-bfbe2359c794 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1313 microversion: 2.1 time: 0.388089 Nov 03 04:24:14.524293 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2836/5789] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:14 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:15.544082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:15.545372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:15.559315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:15.563609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:15.564411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:15.565733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:15.566968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:15.568317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:16.303990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:16.307706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d8d40a88-50ef-48a0-8ac2-ad8cc65814d2 req-5dc5907b-5d04-44d6-b361-383ca6ddb75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091049f3-1734-43db-9ebd-42aa9af4835c", "tag": "a210882e-0ec5-4e2a-b40b-6037b21a80a2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:16.320308 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bef1ac16-14fc-4995-a5b3-ecff362f9a88 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1313 microversion: 2.1 time: 0.780210 Nov 03 04:24:16.322059 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2954/5790] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:15 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:24:16.352755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8d40a88-50ef-48a0-8ac2-ad8cc65814d2 req-5dc5907b-5d04-44d6-b361-383ca6ddb75c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:16.357523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8d40a88-50ef-48a0-8ac2-ad8cc65814d2 req-5dc5907b-5d04-44d6-b361-383ca6ddb75c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:16.357523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8d40a88-50ef-48a0-8ac2-ad8cc65814d2 req-5dc5907b-5d04-44d6-b361-383ca6ddb75c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:16.406025 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d8d40a88-50ef-48a0-8ac2-ad8cc65814d2 req-5dc5907b-5d04-44d6-b361-383ca6ddb75c service nova] Creating event network-changed:a210882e-0ec5-4e2a-b40b-6037b21a80a2 for instance 091049f3-1734-43db-9ebd-42aa9af4835c on n-h2-854653-7 Nov 03 04:24:16.419350 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d8d40a88-50ef-48a0-8ac2-ad8cc65814d2 req-5dc5907b-5d04-44d6-b361-383ca6ddb75c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119597 Nov 03 04:24:16.419989 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2837/5791] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:24:17.348631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:17.349225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:17.360488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:17.363962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:17.364828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:17.366657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:17.367971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:17.369713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:17.721173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:17.737636 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53b2721e-116b-48cc-b584-c09dcf45bb91 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1313 microversion: 2.1 time: 0.391343 Nov 03 04:24:17.739314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2955/5792] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:17 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:18.787442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:18.788989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:18.797057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:18.802723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:18.805570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:18.806181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:18.806734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:18.807533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:18.808066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:18.808612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:19.163201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:19.163812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:19.170554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=18 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:19.172777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:19.173281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:19.173498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:19.174221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:19.174686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:19.175123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:19.207724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:24:19.247533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:19.268094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1183aa5c-50d2-40b4-ba79-20e6a1efc2b9 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1313 microversion: 2.1 time: 0.486297 Nov 03 04:24:19.268759 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2838/5793] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:18 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:19.273595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0b1f6423-7d5e-4ec3-be1b-2b3e3ea22f40 req-bcbb87f0-7d46-4bca-9363-9ee07175d6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb4caab-b5cf-4886-8732-e5b0a4fcda95", "tag": "5b322d53-3925-4cfa-8473-cab5d1f86860"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:19.314912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0b1f6423-7d5e-4ec3-be1b-2b3e3ea22f40 req-bcbb87f0-7d46-4bca-9363-9ee07175d6c6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:19.316865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0b1f6423-7d5e-4ec3-be1b-2b3e3ea22f40 req-bcbb87f0-7d46-4bca-9363-9ee07175d6c6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:19.318463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0b1f6423-7d5e-4ec3-be1b-2b3e3ea22f40 req-bcbb87f0-7d46-4bca-9363-9ee07175d6c6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:19.360773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0b1f6423-7d5e-4ec3-be1b-2b3e3ea22f40 req-bcbb87f0-7d46-4bca-9363-9ee07175d6c6 service nova] Creating event network-changed:5b322d53-3925-4cfa-8473-cab5d1f86860 for instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 on n-h2-854653-7 Nov 03 04:24:19.368551 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0b1f6423-7d5e-4ec3-be1b-2b3e3ea22f40 req-bcbb87f0-7d46-4bca-9363-9ee07175d6c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098113 Nov 03 04:24:19.372282 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2839/5794] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:19.560977 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ecd2bb1-24d0-40cf-8b7e-66adfd68bf4d tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 204 len: 0 microversion: 2.1 time: 0.401391 Nov 03 04:24:19.563040 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2956/5795] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:24:19 2022] DELETE /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:24:19.573231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:19.574468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:19.597829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:19.597829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:19.597829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:19.597829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:19.597829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:19.598611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:19.855472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:19.862695 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-66565304-f1c9-47e8-9b6c-d26afb13c31b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1733 microversion: 2.1 time: 0.295716 Nov 03 04:24:19.863868 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2840/5796] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:19 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1733 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:20.296949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:20.299164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:20.318544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:20.319053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:20.320532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:20.324241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:20.326155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:20.327086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:20.623123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:20.635110 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-acdc2586-7f3d-4b5a-a3b0-0fec79b4c3a6 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1313 microversion: 2.1 time: 0.345458 Nov 03 04:24:20.635731 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2957/5797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:20 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:20.890674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:20.892903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:20.906257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=40 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:20.933839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:20.935128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:20.935781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:20.937158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:20.937795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:20.939096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:21.157476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:21.181412 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7e9d712-5cb4-432a-8405-5107f0755a0e tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1733 microversion: 2.1 time: 0.298540 Nov 03 04:24:21.182331 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2841/5798] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:20 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1733 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:21.658818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:21.661045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:21.670043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:21.670796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:21.671239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:21.672115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:21.672736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:21.673413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:21.895327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:21.903617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f3b31bf1-cdf8-4c33-aff8-cdb4574b3161 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1313 microversion: 2.1 time: 0.249098 Nov 03 04:24:21.904220 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2958/5799] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:21 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:22.072210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ce99b083-c094-464b-8765-e9073bce2152 req-13aea862-d023-4ea8-9283-8dcaa63a8b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb4caab-b5cf-4886-8732-e5b0a4fcda95", "name": "network-vif-deleted", "tag": "5b322d53-3925-4cfa-8473-cab5d1f86860"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:22.085173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce99b083-c094-464b-8765-e9073bce2152 req-13aea862-d023-4ea8-9283-8dcaa63a8b42 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:22.085763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce99b083-c094-464b-8765-e9073bce2152 req-13aea862-d023-4ea8-9283-8dcaa63a8b42 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:22.086292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ce99b083-c094-464b-8765-e9073bce2152 req-13aea862-d023-4ea8-9283-8dcaa63a8b42 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:22.106256 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ce99b083-c094-464b-8765-e9073bce2152 req-13aea862-d023-4ea8-9283-8dcaa63a8b42 service nova] Creating event network-vif-deleted:5b322d53-3925-4cfa-8473-cab5d1f86860 for instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 on n-h2-854653-7 Nov 03 04:24:22.109879 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ce99b083-c094-464b-8765-e9073bce2152 req-13aea862-d023-4ea8-9283-8dcaa63a8b42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041418 Nov 03 04:24:22.114976 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2842/5800] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:22.204995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:22.205656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:22.211722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:22.212464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:22.212914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:22.213656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:22.214128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:22.214570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:22.286984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:22.294871 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65e5dbac-dcdd-4a4d-af25-185bc07b4e9a tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1546 microversion: 2.1 time: 0.093933 Nov 03 04:24:22.299000 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2959/5801] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:22 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1546 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:22.475823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5996edbf-d0b4-4818-96b0-68ea46d16f05 req-b79cf792-dbe5-4fb0-aad0-76a6ca84b40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091049f3-1734-43db-9ebd-42aa9af4835c", "name": "network-vif-plugged", "status": "completed", "tag": "a210882e-0ec5-4e2a-b40b-6037b21a80a2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:22.508052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5996edbf-d0b4-4818-96b0-68ea46d16f05 req-b79cf792-dbe5-4fb0-aad0-76a6ca84b40a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:22.508548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5996edbf-d0b4-4818-96b0-68ea46d16f05 req-b79cf792-dbe5-4fb0-aad0-76a6ca84b40a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:22.508992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5996edbf-d0b4-4818-96b0-68ea46d16f05 req-b79cf792-dbe5-4fb0-aad0-76a6ca84b40a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:22.537471 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5996edbf-d0b4-4818-96b0-68ea46d16f05 req-b79cf792-dbe5-4fb0-aad0-76a6ca84b40a service nova] Creating event network-vif-plugged:a210882e-0ec5-4e2a-b40b-6037b21a80a2 for instance 091049f3-1734-43db-9ebd-42aa9af4835c on n-h2-854653-7 Nov 03 04:24:22.543082 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5996edbf-d0b4-4818-96b0-68ea46d16f05 req-b79cf792-dbe5-4fb0-aad0-76a6ca84b40a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073887 Nov 03 04:24:22.544880 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2843/5802] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:22.929520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:22.930811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:22.942849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:22.943835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:22.944574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:22.946081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:22.946810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:22.947462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:23.234948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:23.242174 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5abba858-5485-4d33-ba73-e754d1090022 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1313 microversion: 2.1 time: 0.317469 Nov 03 04:24:23.249169 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2960/5803] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:22 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:23.345046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:23.345879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:23.369399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:23.372221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:23.372727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:23.373599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:23.374073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:23.374513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:23.554947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:23.554947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:23.554947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:23.554947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lazy-loading 'fault' on Instance uuid cdb4caab-b5cf-4886-8732-e5b0a4fcda95 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:24:23.554947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c657226ac14f82950b672d7eafee9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9fd27297a054435babece0659425d98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:23.554947 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b2717e7-c6c7-4502-aee1-d8793c16f5d0 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 200 len: 1388 microversion: 2.1 time: 0.163085 Nov 03 04:24:23.554947 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2844/5804] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:23 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:24.272654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:24.273354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:24.283543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:24.297171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:24.297171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:24.297171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:24.297171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:24.297171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:24.430177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:24.438530 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86462a75-80b9-41ba-bd0b-059a27e521c7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1497 microversion: 2.1 time: 0.170102 Nov 03 04:24:24.439099 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2961/5805] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:24 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:24:24.465782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff7e181b-df75-47c4-8e24-61bfa89f13e7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:24.476795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_groups [None req-ff7e181b-df75-47c4-8e24-61bfa89f13e7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Querying cell 464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) for 1 instances {{(pid=127593) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 03 04:24:24.477567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7e181b-df75-47c4-8e24-61bfa89f13e7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:24.478060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7e181b-df75-47c4-8e24-61bfa89f13e7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:24.478505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff7e181b-df75-47c4-8e24-61bfa89f13e7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:24.508337 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff7e181b-df75-47c4-8e24-61bfa89f13e7 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/5debecff-c3b0-4774-a08c-873abc4a7548" status: 200 len: 221 microversion: 2.1 time: 0.050581 Nov 03 04:24:24.513588 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2845/5806] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:24:24 2022] GET /compute/v2.1/os-server-groups/5debecff-c3b0-4774-a08c-873abc4a7548 => generated 221 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:24.522880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:24.523469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:24.532596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:24.533804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:24.539469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:24.539469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:24.539469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:24.539469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:24.549300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:24.550095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] [instance: cdb4caab-b5cf-4886-8732-e5b0a4fcda95] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:24.566557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:24.567061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:24.568750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:24.568750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:24.569275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:24.569892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:24.586428 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] HTTP exception thrown: Instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 could not be found. Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Request method failure captured: Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 HTTP/1.1 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Ihb6GFePCXa_rm0XhyOc93Y4z2rjOINgWtmXMmX0RA0p4tjGUcB8rZKEx-PX8b61-QU9urRaec6nCQgk9hnNMhFATDjKmJ9YVLHEAyn81WQzLiIDOqvrBvO8MmqRFoJGg4DQrYlbRKgcQ3Bfc_1iWu37UhN_8nT6Ewn0H30VAJBmE Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: f9fd27297a054435babece0659425d98 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestServerBasicOps-363631769 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f9fd27297a054435babece0659425d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f9fd27297a054435babece0659425d98", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f9fd27297a054435babece0659425d98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f9fd27297a054435babece0659425d98"}]}] Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestServerBasicOps-363631769 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: f9fd27297a054435babece0659425d98 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestServerBasicOps-363631769 Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestServerBasicOps-363631769-project Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 11c657226ac14f82950b672d7eafee9f Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestServerBasicOps-363631769-project Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 could not be found. Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'cdb4caab-b5cf-4886-8732-e5b0a4fcda95'} Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 could not be found. Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 could not be found. Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:24.591065 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 could not be found. Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Returning 404 to user: Instance cdb4caab-b5cf-4886-8732-e5b0a4fcda95 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f098c15-2024-472c-aa16-3afed8b9ab2b tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95" status: 404 len: 111 microversion: 2.1 time: 0.049472 Nov 03 04:24:24.596877 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2846/5807] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:24 2022] GET /compute/v2.1/servers/cdb4caab-b5cf-4886-8732-e5b0a4fcda95 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:24.598419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:24:24.677645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:24.907057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0f7d3a6-31ef-4edf-855e-071418277cc4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] Calling method '.version_select at 0x7ff7f9c9d790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:24.984286 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f321628-f260-43e5-b2e4-27d6194f9434 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 204 len: 0 microversion: 2.1 time: 0.465768 Nov 03 04:24:24.985103 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2962/5808] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:24:24 2022] DELETE /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:24:24.994558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:24.995404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:25.001864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:25.002426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:25.002983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:25.003712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:25.004169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:25.004639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:25.013279 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0f7d3a6-31ef-4edf-855e-071418277cc4 tempest-TestServerBasicOps-363631769 tempest-TestServerBasicOps-363631769-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-782121782" status: 202 len: 0 microversion: 2.1 time: 0.113814 Nov 03 04:24:25.018424 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2847/5809] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-782121782 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:24:25.194711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:25.206333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-47e862ae-80ba-45bb-9930-2a85c7217061 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1503 microversion: 2.1 time: 0.215431 Nov 03 04:24:25.207037 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2963/5810] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:24 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:24:26.239901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:26.241879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:26.260334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:26.260825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:26.261301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:26.263247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:26.265961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:26.266823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:26.609931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:26.622336 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e427d28-ee06-4b80-b565-b4c16291f773 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1503 microversion: 2.1 time: 0.396362 Nov 03 04:24:26.624303 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2848/5811] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:26 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1503 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:27.626948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-0a38f332-c2e2-4113-aeab-e0c2e8385596 req-f20a3dff-4bd2-4082-ba2e-da98f25d16e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091049f3-1734-43db-9ebd-42aa9af4835c", "name": "network-vif-deleted", "tag": "a210882e-0ec5-4e2a-b40b-6037b21a80a2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:27.649358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:27.650937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:27.665381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a38f332-c2e2-4113-aeab-e0c2e8385596 req-f20a3dff-4bd2-4082-ba2e-da98f25d16e3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:27.667231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a38f332-c2e2-4113-aeab-e0c2e8385596 req-f20a3dff-4bd2-4082-ba2e-da98f25d16e3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:27.667687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-0a38f332-c2e2-4113-aeab-e0c2e8385596 req-f20a3dff-4bd2-4082-ba2e-da98f25d16e3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:27.669543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:27.670393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:27.671030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:27.671937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:27.672807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:27.689934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:27.724212 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-0a38f332-c2e2-4113-aeab-e0c2e8385596 req-f20a3dff-4bd2-4082-ba2e-da98f25d16e3 service nova] Creating event network-vif-deleted:a210882e-0ec5-4e2a-b40b-6037b21a80a2 for instance 091049f3-1734-43db-9ebd-42aa9af4835c on n-h2-854653-7 Nov 03 04:24:27.742199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-0a38f332-c2e2-4113-aeab-e0c2e8385596 req-f20a3dff-4bd2-4082-ba2e-da98f25d16e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121608 Nov 03 04:24:27.747066 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2964/5812] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:27.879817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3075dc2d6032442685d84366a087e602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaeedd5efeba49ccaa3d3b29debdcbc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:27.891673 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c13d28c0-296b-4ffa-a509-ba18e57609c2 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 200 len: 1461 microversion: 2.1 time: 0.246896 Nov 03 04:24:27.893328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2849/5813] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:27 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 1461 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:24:28.918632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:28.919409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:28.928100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:28.928588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:28.929050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:28.929803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:28.930370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:28.930807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:28.954064 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] HTTP exception thrown: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Request method failure captured: Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c HTTP/1.1 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0JhlLG_ZUWp0LkHZSu2kII0s5p34D-PwhA-mvmnlZJJKwl4MxyqDXYOd7gfpeJSfel8c_TmOH0_FfnnraS15b19x5-rnDjRvduIY6ehUsyUEeJYJIvGo2-XNMMrqGmDG_WYJvyvylJmg-SJdemtB1Pkryy48WOuDFQG1H5qTsvMtX8 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aaeedd5efeba49ccaa3d3b29debdcbc8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}] Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3075dc2d6032442685d84366a087e602 Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '091049f3-1734-43db-9ebd-42aa9af4835c'} Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:28.960111 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Returning 404 to user: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:28.965215 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a71d421-75f6-4620-a70a-496ac23c48ee tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 404 len: 111 microversion: 2.1 time: 0.050072 Nov 03 04:24:28.973278 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2965/5814] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:28 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:28.976114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9aff0144-8f4a-4215-af00-d634f77af59d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.006412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_groups [None req-9aff0144-8f4a-4215-af00-d634f77af59d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Querying cell 464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) for 1 instances {{(pid=127593) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 03 04:24:29.007370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9aff0144-8f4a-4215-af00-d634f77af59d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:29.007864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9aff0144-8f4a-4215-af00-d634f77af59d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:29.008309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9aff0144-8f4a-4215-af00-d634f77af59d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:29.023449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9aff0144-8f4a-4215-af00-d634f77af59d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.050650 Nov 03 04:24:29.024368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2850/5815] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:24:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:24:29.037470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dac1882e-eacf-405d-8db4-3ab665899cbc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.064523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.compute.server_groups [None req-dac1882e-eacf-405d-8db4-3ab665899cbc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Querying cell 464d8109-3dad-41a5-aa6d-0cb4baaae295(cell1) for 1 instances {{(pid=127594) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 03 04:24:29.065806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac1882e-eacf-405d-8db4-3ab665899cbc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:29.074747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac1882e-eacf-405d-8db4-3ab665899cbc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:29.074747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac1882e-eacf-405d-8db4-3ab665899cbc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:29.079658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dac1882e-eacf-405d-8db4-3ab665899cbc tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/os-server-groups/5debecff-c3b0-4774-a08c-873abc4a7548" status: 200 len: 183 microversion: 2.1 time: 0.047317 Nov 03 04:24:29.080648 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2966/5816] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:24:29 2022] GET /compute/v2.1/os-server-groups/5debecff-c3b0-4774-a08c-873abc4a7548 => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:29.092849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.093377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:29.099892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:29.100618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:29.101167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:29.102059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:29.103847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:29.104311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] HTTP exception thrown: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Request method failure captured: Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c HTTP/1.1 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0JhlLG_ZUWp0LkHZSu2kII0s5p34D-PwhA-mvmnlZJJKwl4MxyqDXYOd7gfpeJSfel8c_TmOH0_FfnnraS15b19x5-rnDjRvduIY6ehUsyUEeJYJIvGo2-XNMMrqGmDG_WYJvyvylJmg-SJdemtB1Pkryy48WOuDFQG1H5qTsvMtX8 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aaeedd5efeba49ccaa3d3b29debdcbc8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}] Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3075dc2d6032442685d84366a087e602 Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '091049f3-1734-43db-9ebd-42aa9af4835c'} Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:24:29.124149 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Returning 404 to user: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e3c0b26-da39-49fc-828a-ce247a326554 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 404 len: 111 microversion: 2.1 time: 0.035560 Nov 03 04:24:29.130435 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2851/5817] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:24:29 2022] DELETE /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:29.132843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.134287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] [instance: 091049f3-1734-43db-9ebd-42aa9af4835c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:29.145257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:29.149155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:29.149155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:29.149816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:29.149816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:29.150199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:29.170927 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] HTTP exception thrown: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Request method failure captured: Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c HTTP/1.1 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0JhlLG_ZUWp0LkHZSu2kII0s5p34D-PwhA-mvmnlZJJKwl4MxyqDXYOd7gfpeJSfel8c_TmOH0_FfnnraS15b19x5-rnDjRvduIY6ehUsyUEeJYJIvGo2-XNMMrqGmDG_WYJvyvylJmg-SJdemtB1Pkryy48WOuDFQG1H5qTsvMtX8 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aaeedd5efeba49ccaa3d3b29debdcbc8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}] Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3075dc2d6032442685d84366a087e602 Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '091049f3-1734-43db-9ebd-42aa9af4835c'} Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.175650 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Returning 404 to user: Instance 091049f3-1734-43db-9ebd-42aa9af4835c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3519bc0-0979-44cc-9642-2233f176f71e tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c" status: 404 len: 111 microversion: 2.1 time: 0.045939 Nov 03 04:24:29.181304 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2967/5818] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:24:29 2022] GET /compute/v2.1/servers/091049f3-1734-43db-9ebd-42aa9af4835c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:29.185298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ebd2c41-1c38-4c77-a827-02ba72964522 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.191752 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-3ebd2c41-1c38-4c77-a827-02ba72964522 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] HTTP exception thrown: Instance group e1df72c9-1a93-4d51-ac64-97dc427eb3e2 could not be found. Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ebd2c41-1c38-4c77-a827-02ba72964522 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Request method failure captured: Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-server-groups/e1df72c9-1a93-4d51-ac64-97dc427eb3e2 HTTP/1.1 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0JhlLG_ZUWp0LkHZSu2kII0s5p34D-PwhA-mvmnlZJJKwl4MxyqDXYOd7gfpeJSfel8c_TmOH0_FfnnraS15b19x5-rnDjRvduIY6ehUsyUEeJYJIvGo2-XNMMrqGmDG_WYJvyvylJmg-SJdemtB1Pkryy48WOuDFQG1H5qTsvMtX8 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aaeedd5efeba49ccaa3d3b29debdcbc8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}] Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3075dc2d6032442685d84366a087e602 Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance group e1df72c9-1a93-4d51-ac64-97dc427eb3e2 could not be found. Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e1df72c9-1a93-4d51-ac64-97dc427eb3e2'} Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e1df72c9-1a93-4d51-ac64-97dc427eb3e2 could not be found. Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e1df72c9-1a93-4d51-ac64-97dc427eb3e2 could not be found. Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.218518 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e1df72c9-1a93-4d51-ac64-97dc427eb3e2 could not be found. Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ebd2c41-1c38-4c77-a827-02ba72964522 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Returning 404 to user: Instance group e1df72c9-1a93-4d51-ac64-97dc427eb3e2 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ebd2c41-1c38-4c77-a827-02ba72964522 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/e1df72c9-1a93-4d51-ac64-97dc427eb3e2" status: 404 len: 117 microversion: 2.1 time: 0.041063 Nov 03 04:24:29.227553 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2852/5819] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:29 2022] DELETE /compute/v2.1/os-server-groups/e1df72c9-1a93-4d51-ac64-97dc427eb3e2 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:29.236957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd700cbc-23e8-44c7-8094-93a9d8776f51 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.243949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-bd700cbc-23e8-44c7-8094-93a9d8776f51 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] HTTP exception thrown: Instance group 3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da could not be found. Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd700cbc-23e8-44c7-8094-93a9d8776f51 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Request method failure captured: Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-server-groups/3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da HTTP/1.1 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0JhlLG_ZUWp0LkHZSu2kII0s5p34D-PwhA-mvmnlZJJKwl4MxyqDXYOd7gfpeJSfel8c_TmOH0_FfnnraS15b19x5-rnDjRvduIY6ehUsyUEeJYJIvGo2-XNMMrqGmDG_WYJvyvylJmg-SJdemtB1Pkryy48WOuDFQG1H5qTsvMtX8 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aaeedd5efeba49ccaa3d3b29debdcbc8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}] Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3075dc2d6032442685d84366a087e602 Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance group 3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da could not be found. Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da'} Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da could not be found. Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da could not be found. Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.245685 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da could not be found. Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd700cbc-23e8-44c7-8094-93a9d8776f51 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Returning 404 to user: Instance group 3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd700cbc-23e8-44c7-8094-93a9d8776f51 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da" status: 404 len: 117 microversion: 2.1 time: 0.021020 Nov 03 04:24:29.258974 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2968/5820] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:29 2022] DELETE /compute/v2.1/os-server-groups/3a0c8dcb-27b9-4a1d-bc77-b02fa8dd45da => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:29.262137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a46ed5c-0e7e-4263-810b-b29c95bdb12d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.271602 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-2a46ed5c-0e7e-4263-810b-b29c95bdb12d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] HTTP exception thrown: Instance group 29a314ff-96a7-4555-8094-beda278f73aa could not be found. Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a46ed5c-0e7e-4263-810b-b29c95bdb12d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Request method failure captured: Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-server-groups/29a314ff-96a7-4555-8094-beda278f73aa HTTP/1.1 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0JhlLG_ZUWp0LkHZSu2kII0s5p34D-PwhA-mvmnlZJJKwl4MxyqDXYOd7gfpeJSfel8c_TmOH0_FfnnraS15b19x5-rnDjRvduIY6ehUsyUEeJYJIvGo2-XNMMrqGmDG_WYJvyvylJmg-SJdemtB1Pkryy48WOuDFQG1H5qTsvMtX8 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aaeedd5efeba49ccaa3d3b29debdcbc8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}] Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 3075dc2d6032442685d84366a087e602 Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance group 29a314ff-96a7-4555-8094-beda278f73aa could not be found. Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '29a314ff-96a7-4555-8094-beda278f73aa'} Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29a314ff-96a7-4555-8094-beda278f73aa could not be found. Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29a314ff-96a7-4555-8094-beda278f73aa could not be found. Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.273398 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29a314ff-96a7-4555-8094-beda278f73aa could not be found. Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a46ed5c-0e7e-4263-810b-b29c95bdb12d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Returning 404 to user: Instance group 29a314ff-96a7-4555-8094-beda278f73aa could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a46ed5c-0e7e-4263-810b-b29c95bdb12d tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/29a314ff-96a7-4555-8094-beda278f73aa" status: 404 len: 117 microversion: 2.1 time: 0.021172 Nov 03 04:24:29.282962 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2853/5821] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:29 2022] DELETE /compute/v2.1/os-server-groups/29a314ff-96a7-4555-8094-beda278f73aa => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:29.285045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0567980d-fbfd-48ed-a0f0-58e889c92732 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.293057 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-0567980d-fbfd-48ed-a0f0-58e889c92732 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] HTTP exception thrown: Instance group 4b2d3425-ca06-4247-8a06-59a1e220c98b could not be found. Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0567980d-fbfd-48ed-a0f0-58e889c92732 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Request method failure captured: Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/os-server-groups/4b2d3425-ca06-4247-8a06-59a1e220c98b HTTP/1.1 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0JhlLG_ZUWp0LkHZSu2kII0s5p34D-PwhA-mvmnlZJJKwl4MxyqDXYOd7gfpeJSfel8c_TmOH0_FfnnraS15b19x5-rnDjRvduIY6ehUsyUEeJYJIvGo2-XNMMrqGmDG_WYJvyvylJmg-SJdemtB1Pkryy48WOuDFQG1H5qTsvMtX8 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_aaeedd5efeba49ccaa3d3b29debdcbc8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/aaeedd5efeba49ccaa3d3b29debdcbc8"}]}] Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: aaeedd5efeba49ccaa3d3b29debdcbc8 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerGroupTestJSON-1895939583 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 3075dc2d6032442685d84366a087e602 Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerGroupTestJSON-1895939583-project Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance group 4b2d3425-ca06-4247-8a06-59a1e220c98b could not be found. Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4b2d3425-ca06-4247-8a06-59a1e220c98b'} Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4b2d3425-ca06-4247-8a06-59a1e220c98b could not be found. Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4b2d3425-ca06-4247-8a06-59a1e220c98b could not be found. Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.301479 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4b2d3425-ca06-4247-8a06-59a1e220c98b could not be found. Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0567980d-fbfd-48ed-a0f0-58e889c92732 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Returning 404 to user: Instance group 4b2d3425-ca06-4247-8a06-59a1e220c98b could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:24:29.307471 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0567980d-fbfd-48ed-a0f0-58e889c92732 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/4b2d3425-ca06-4247-8a06-59a1e220c98b" status: 404 len: 117 microversion: 2.1 time: 0.021913 Nov 03 04:24:29.311913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7205ecc8-8b81-47d5-90eb-abb1cc9769b4 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:29.314956 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2969/5822] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:29 2022] DELETE /compute/v2.1/os-server-groups/4b2d3425-ca06-4247-8a06-59a1e220c98b => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:24:29.422527 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7205ecc8-8b81-47d5-90eb-abb1cc9769b4 tempest-ServerGroupTestJSON-1895939583 tempest-ServerGroupTestJSON-1895939583-project] 10.222.0.30 "DELETE /compute/v2.1/os-server-groups/5debecff-c3b0-4774-a08c-873abc4a7548" status: 204 len: 0 microversion: 2.1 time: 0.113125 Nov 03 04:24:29.423857 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2854/5823] 10.222.0.30 () {58 vars in 1266 bytes} [Thu Nov 3 04:24:29 2022] DELETE /compute/v2.1/os-server-groups/5debecff-c3b0-4774-a08c-873abc4a7548 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:24:50.320540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:50.329712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:50.497980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1641961413", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "d34c199a-4af0-422a-bb2d-185232ef1a39"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:50.578817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] validate_networks() for [('d34c199a-4af0-422a-bb2d-185232ef1a39', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:24:51.196309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:24:51.197051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:24:51.197735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:24:51.199197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:24:51.199465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:24:51.218445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:51.219468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:51.220176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:51.221193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:51.221895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:51.222592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:51.244451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Getting quotas for project fcc6d922f2c64131b308d8d2affd1c5f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:24:51.253548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Getting quotas for user 8b9d07666a064db5b88c3607c74f530b and project fcc6d922f2c64131b308d8d2affd1c5f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:24:51.271795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:24:51.274697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:24:51.439322 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-663a3c61-0eaa-4f91-899b-a7ac6e0e709c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.123989 Nov 03 04:24:51.440766 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2970/5824] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Nov 3 04:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 03 04:24:51.450918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=61 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:51.452406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:24:51.457702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7db65d87-5f79-4f22-9d87-dd0972fb0241 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:51.458324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7db65d87-5f79-4f22-9d87-dd0972fb0241 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:51.572337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7db65d87-5f79-4f22-9d87-dd0972fb0241 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:51.596235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7db65d87-5f79-4f22-9d87-dd0972fb0241 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:51.600768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7db65d87-5f79-4f22-9d87-dd0972fb0241 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:51.602010 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7db65d87-5f79-4f22-9d87-dd0972fb0241 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1262 microversion: 2.26 time: 0.153362 Nov 03 04:24:51.604737 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2855/5825] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:51 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:52.632874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61fde6a5-e869-404c-a5ef-8950123af6d5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:52.634425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61fde6a5-e869-404c-a5ef-8950123af6d5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:52.786748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-61fde6a5-e869-404c-a5ef-8950123af6d5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:52.798164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-61fde6a5-e869-404c-a5ef-8950123af6d5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:52.803227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-61fde6a5-e869-404c-a5ef-8950123af6d5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:52.806943 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61fde6a5-e869-404c-a5ef-8950123af6d5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1262 microversion: 2.26 time: 0.179258 Nov 03 04:24:52.814764 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2971/5826] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:52 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:53.837470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:53.838099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:53.854937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:53.855439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:53.857639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:53.858823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:53.859466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:53.860357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:53.985387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:53.996308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:53.998510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:53.999880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f366594c-451d-4e6f-b8d1-0c5d5bcc1a13 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1314 microversion: 2.26 time: 0.168344 Nov 03 04:24:54.003322 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2856/5827] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:53 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:55.026876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:55.028263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:55.038594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:55.044381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:55.044381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:55.044381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:55.044381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:55.044381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:55.197099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:55.214161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:55.215868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:55.219387 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-733edca7-c76d-4269-93bd-2cb46ee0e37f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1320 microversion: 2.26 time: 0.195803 Nov 03 04:24:55.243447 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2972/5828] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:55 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:56.256493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:56.257474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:56.280702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:56.281902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:56.282678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:56.283642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:56.284223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:56.284919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:56.620420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:56.645588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:56.653240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:56.659048 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c77cb6fb-3f22-4df3-99e4-f86cebf241ee tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.406155 Nov 03 04:24:56.659048 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2857/5829] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:56 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:57.420468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-864c7169-3188-40fa-9242-b359879114d1 req-33e4390f-d5da-4e1d-9b55-5ba3bc1b95a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4141a51-2307-4e4f-bf0d-4eb61d59463b", "tag": "dfcb6463-7ddf-4e7f-a60f-813d993d8a55"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:24:57.434523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-864c7169-3188-40fa-9242-b359879114d1 req-33e4390f-d5da-4e1d-9b55-5ba3bc1b95a3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:57.435357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-864c7169-3188-40fa-9242-b359879114d1 req-33e4390f-d5da-4e1d-9b55-5ba3bc1b95a3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:57.435871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-864c7169-3188-40fa-9242-b359879114d1 req-33e4390f-d5da-4e1d-9b55-5ba3bc1b95a3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:57.451490 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-864c7169-3188-40fa-9242-b359879114d1 req-33e4390f-d5da-4e1d-9b55-5ba3bc1b95a3 service nova] Creating event network-changed:dfcb6463-7ddf-4e7f-a60f-813d993d8a55 for instance a4141a51-2307-4e4f-bf0d-4eb61d59463b on n-h2-854653-7 Nov 03 04:24:57.459358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-864c7169-3188-40fa-9242-b359879114d1 req-33e4390f-d5da-4e1d-9b55-5ba3bc1b95a3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044538 Nov 03 04:24:57.460374 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2973/5830] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:24:57.695102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:57.700594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:57.714828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:57.715589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:57.716327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:57.717291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:57.717919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:57.718558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:58.104627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:58.131325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:58.132933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:58.134336 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d631f3d9-c66d-4322-a7bd-9af039d91880 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.455421 Nov 03 04:24:58.135090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2858/5831] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:57 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:24:59.162299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:24:59.163036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:24:59.170405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:59.170927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:59.171381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:59.174999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:24:59.174999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:24:59.174999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:24:59.329721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:59.388759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:59.403612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:24:59.405343 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c5cba3c0-8c42-4808-a634-2a5de2b888e5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.248702 Nov 03 04:24:59.406776 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2974/5832] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:24:59 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:00.439737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:00.441901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:00.452841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:00.453776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:00.454436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:00.455560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:00.456299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:00.457226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:00.660358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:00.672016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:00.679215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:00.680974 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8778de67-8c2d-4e7a-8e2c-61e62319a452 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.251224 Nov 03 04:25:00.682900 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2859/5833] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:00 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:01.710070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:01.710702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:01.713706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:01.719220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:01.719725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:01.720384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:01.721160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:01.721624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:01.722056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:01.899872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:01.908871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:01.910646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:01.919312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc29362f-7017-4d6a-b9a4-d12a7e3eaf4c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.205902 Nov 03 04:25:01.919312 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2975/5834] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:01 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:02.942742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:02.943505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:02.948025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:02.955224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:02.955718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:02.964410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:02.965375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:02.965915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:02.966291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:03.253180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:03.271537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:03.273192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:03.278236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9663d77-6821-4382-8414-f1e5ca3ead5e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.339674 Nov 03 04:25:03.280340 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2860/5835] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:02 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:04.311649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:04.313525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:04.323021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:04.334747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:04.341723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:04.342885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:04.345378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:04.348247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:04.348925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:04.619773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:04.632025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:04.635644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:04.639558 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fa9992ae-a464-4eb7-b67a-db374d88c130 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.333028 Nov 03 04:25:04.643234 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2976/5836] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:04 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:04.718177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-2d635ee2-c1ad-4c54-ae54-42f7b84e2137 req-54e619ce-7352-43ba-ac6b-87ac6eb8e98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4141a51-2307-4e4f-bf0d-4eb61d59463b", "name": "network-vif-plugged", "status": "completed", "tag": "dfcb6463-7ddf-4e7f-a60f-813d993d8a55"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:04.730951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2d635ee2-c1ad-4c54-ae54-42f7b84e2137 req-54e619ce-7352-43ba-ac6b-87ac6eb8e98d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:04.731745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2d635ee2-c1ad-4c54-ae54-42f7b84e2137 req-54e619ce-7352-43ba-ac6b-87ac6eb8e98d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:04.732382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-2d635ee2-c1ad-4c54-ae54-42f7b84e2137 req-54e619ce-7352-43ba-ac6b-87ac6eb8e98d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:04.746154 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-2d635ee2-c1ad-4c54-ae54-42f7b84e2137 req-54e619ce-7352-43ba-ac6b-87ac6eb8e98d service nova] Creating event network-vif-plugged:dfcb6463-7ddf-4e7f-a60f-813d993d8a55 for instance a4141a51-2307-4e4f-bf0d-4eb61d59463b on n-h2-854653-7 Nov 03 04:25:04.751658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-2d635ee2-c1ad-4c54-ae54-42f7b84e2137 req-54e619ce-7352-43ba-ac6b-87ac6eb8e98d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037212 Nov 03 04:25:04.756513 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2861/5837] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:25:05.668539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:05.669215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:05.678955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:05.679717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:05.680714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:05.681734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:05.691375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:05.691375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:06.290327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:06.301906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:06.304390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:06.307168 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-909d80c4-82bf-4b9b-80bf-dbc0ef2f95b2 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1362 microversion: 2.26 time: 0.644037 Nov 03 04:25:06.326254 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2977/5838] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:05 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1362 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:07.336844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:07.338761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:07.345836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.346584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.347221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:07.347931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.348800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.349725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:07.640169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:07.653411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:07.667975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:07.667975 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6bdcf6a4-3ff9-423e-ab3f-3a755647822f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1546 microversion: 2.26 time: 0.337052 Nov 03 04:25:07.671089 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2862/5839] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:07 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1546 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:07.709665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f95bdb80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:07.739588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.740126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.740578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:07.741498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:07.766821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.769339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.769977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:07.771437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.771437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.772115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:07.804558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.805603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.806070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:07.828673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.829228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.829818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:07.935648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:07.957042 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96fa13f4-31c8-495d-ac70-2f300807507e tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-1604625972" status: 201 len: 0 microversion: 2.26 time: 0.260144 Nov 03 04:25:07.958187 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2978/5840] 10.222.0.30 () {62 vars in 1380 bytes} [Thu Nov 3 04:25:07 2022] PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-1604625972 => generated 0 bytes in 263 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 03 04:25:07.970457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2ad07c2-ae82-4147-bb4e-eb42a5c2fd80 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f9360dc0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:07.984860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2ad07c2-ae82-4147-bb4e-eb42a5c2fd80 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:07.985824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2ad07c2-ae82-4147-bb4e-eb42a5c2fd80 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:07.986496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2ad07c2-ae82-4147-bb4e-eb42a5c2fd80 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.019697 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2ad07c2-ae82-4147-bb4e-eb42a5c2fd80 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-1604625972" status: 204 len: 0 microversion: 2.26 time: 0.055065 Nov 03 04:25:08.021228 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2863/5841] 10.222.0.30 () {60 vars in 1361 bytes} [Thu Nov 3 04:25:07 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-1604625972 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 03 04:25:08.032358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7fd449940>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:08.044891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.055592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.056660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.068520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:08.081706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.082392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.083001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.084119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.084755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.086343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.123065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.124299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.124299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.223677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:08.242494 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98787dfb-26cd-4224-90d2-31747e917fc0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 204 len: 0 microversion: 2.26 time: 0.215686 Nov 03 04:25:08.244558 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2979/5842] 10.222.0.30 () {60 vars in 1295 bytes} [Thu Nov 3 04:25:08 2022] DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:25:08.255858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f434b927-876e-4710-a99b-7a647c93bee4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f8943d30>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:08.272650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f434b927-876e-4710-a99b-7a647c93bee4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.273271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f434b927-876e-4710-a99b-7a647c93bee4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.274448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f434b927-876e-4710-a99b-7a647c93bee4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.288458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f434b927-876e-4710-a99b-7a647c93bee4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 200 len: 12 microversion: 2.26 time: 0.036934 Nov 03 04:25:08.293330 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2864/5843] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 04:25:08 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:08.300820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f98ea280>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:08.312765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.313703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.314270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.314987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:08.323327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.324205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.324523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.326596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.327178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.327891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.363918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.364631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.365282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.375796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.376548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.377249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.468269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:08.487124 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b684dd84-fd9e-4819-87f2-64b2a3731b19 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-510271787" status: 201 len: 0 microversion: 2.26 time: 0.190407 Nov 03 04:25:08.487839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2980/5844] 10.222.0.30 () {62 vars in 1377 bytes} [Thu Nov 3 04:25:08 2022] PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-510271787 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 03 04:25:08.498910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-961fb6ef-efb4-45ce-969d-889a04abe551 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f9360c10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:08.512245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-961fb6ef-efb4-45ce-969d-889a04abe551 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.512519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-961fb6ef-efb4-45ce-969d-889a04abe551 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.513391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-961fb6ef-efb4-45ce-969d-889a04abe551 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.530827 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-961fb6ef-efb4-45ce-969d-889a04abe551 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 200 len: 35 microversion: 2.26 time: 0.034194 Nov 03 04:25:08.530827 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2865/5845] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 04:25:08 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 35 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:08.541606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f8f4b160>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:08.550460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.552328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.552328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.552328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:08.560028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.560580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.561282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.561990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.562462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.563026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.586605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.587026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.587500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.716025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:08.742954 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7f86c321-dd22-4b73-b49a-6665076f8bb0 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-510271787" status: 204 len: 0 microversion: 2.26 time: 0.205382 Nov 03 04:25:08.742954 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2981/5846] 10.222.0.30 () {60 vars in 1361 bytes} [Thu Nov 3 04:25:08 2022] DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-510271787 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:25:08.756439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee68d434-23fb-49a0-807f-9a53f15beff5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f99b4820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:08.774970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee68d434-23fb-49a0-807f-9a53f15beff5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.777625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee68d434-23fb-49a0-807f-9a53f15beff5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.779690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee68d434-23fb-49a0-807f-9a53f15beff5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.804157 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee68d434-23fb-49a0-807f-9a53f15beff5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 200 len: 12 microversion: 2.26 time: 0.057202 Nov 03 04:25:08.805938 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2866/5847] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 04:25:08 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:08.816382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7fd4495e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:08.829555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.830061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.830510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.831002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:08.851007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.851512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.851967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.852702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.853244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.865553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.924797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:08.932234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:08.932234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:08.936994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:08.975716 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68a24cff-5157-44c0-8140-0db899544786 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 204 len: 0 microversion: 2.26 time: 0.164120 Nov 03 04:25:08.976368 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2982/5848] 10.222.0.30 () {60 vars in 1295 bytes} [Thu Nov 3 04:25:08 2022] DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:25:08.991695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f9360ca0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:09.011324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.015352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.015352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.015352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:09.027574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.031474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.032185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.033815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.035925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.038807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.083517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.084405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.085136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.097124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.098149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.098838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.196804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:09.235224 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-243b6482-deff-49c9-b770-74076b982ce8 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-1031972579" status: 201 len: 0 microversion: 2.26 time: 0.247734 Nov 03 04:25:09.236507 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2867/5849] 10.222.0.30 () {62 vars in 1380 bytes} [Thu Nov 3 04:25:08 2022] PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-1031972579 => generated 0 bytes in 250 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Nov 03 04:25:09.247130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f95a3b80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:09.258106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.260269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.261131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.261802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:09.268085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.268604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.269121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.269934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.270442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.288572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.292910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:09.380537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.381203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.381667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.394637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.395126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.395990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.521717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:09.565926 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1646716-6978-4731-bb52-7cd2978b5a57 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-822968866" status: 201 len: 0 microversion: 2.26 time: 0.323833 Nov 03 04:25:09.567130 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2983/5850] 10.222.0.30 () {62 vars in 1377 bytes} [Thu Nov 3 04:25:09 2022] PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-822968866 => generated 0 bytes in 326 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Nov 03 04:25:09.581105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f8943ee0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:09.593394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.593888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.594361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.594847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:09.601333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.602089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.602702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.604287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.604922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.605553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.638076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.638562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.639198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.745080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:09.769318 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96a22556-8844-412d-bc70-c0d867f5886f tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 204 len: 0 microversion: 2.26 time: 0.196861 Nov 03 04:25:09.773426 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2868/5851] 10.222.0.30 () {60 vars in 1295 bytes} [Thu Nov 3 04:25:09 2022] DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:25:09.779362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20b70d6e-28b5-4af0-85db-4829d082fb54 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f80edd30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:09.794581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b70d6e-28b5-4af0-85db-4829d082fb54 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.795120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b70d6e-28b5-4af0-85db-4829d082fb54 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.795568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20b70d6e-28b5-4af0-85db-4829d082fb54 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.813555 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20b70d6e-28b5-4af0-85db-4829d082fb54 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 200 len: 12 microversion: 2.26 time: 0.038645 Nov 03 04:25:09.819647 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2984/5852] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 04:25:09 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:09.831260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f97aec10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:09.843781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.844352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.844792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.845367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:09.854468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.855718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.856207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.857383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.858567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.859023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.908524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:09.909224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:09.909775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:09.943004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:09.969071 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07caa178-a104-4fab-a4ea-6b2270190184 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 204 len: 0 microversion: 2.26 time: 0.142997 Nov 03 04:25:09.978339 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2869/5853] 10.222.0.30 () {60 vars in 1295 bytes} [Thu Nov 3 04:25:09 2022] DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:25:09.983615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f92cb8b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:10.002283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.004204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.004845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.007540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:10.028729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.034863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.035447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.036438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.037126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.037740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.097090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.097845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.098485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.128480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.129028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.137852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.293161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:10.323480 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50bd0070-419d-4bf9-ab00-0525027ead3c tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-24844636" status: 201 len: 0 microversion: 2.26 time: 0.344033 Nov 03 04:25:10.336036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f8943d30>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:10.345220 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2985/5854] 10.222.0.30 () {62 vars in 1374 bytes} [Thu Nov 3 04:25:09 2022] PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-24844636 => generated 0 bytes in 367 msecs (HTTP/1.1 201) 10 headers in 484 bytes (2 switches on core 0) Nov 03 04:25:10.363157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.364148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.364818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.366043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:10.382399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.386367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.387316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.388068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.388532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.391728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.460706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.461445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.464031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.488621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.489137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.489579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.638700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:10.638700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:10.667124 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57746b33-f242-4541-94bc-a7dd41804031 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-794324521" status: 201 len: 0 microversion: 2.26 time: 0.334158 Nov 03 04:25:10.667124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2870/5855] 10.222.0.30 () {62 vars in 1377 bytes} [Thu Nov 3 04:25:10 2022] PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags/tempest-tag-794324521 => generated 0 bytes in 336 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Nov 03 04:25:10.676395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Action: 'update_all', calling method: .version_select at 0x7ff7f8fb7550>, body: {"tags": ["tempest-tag-1671844677", "tempest-tag-765938211"]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:10.687983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.695835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.695835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.695835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:10.697789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.698469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.699101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.700736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.701416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.702691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.757480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.759269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.760765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.858372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:10.881501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b745d5c0-db36-42c5-9e34-9bd6adbd5703 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 200 len: 61 microversion: 2.26 time: 0.209594 Nov 03 04:25:10.882691 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2986/5856] 10.222.0.30 () {62 vars in 1312 bytes} [Thu Nov 3 04:25:10 2022] PUT /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 61 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:10.896168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e86658b8-19ab-4a73-9f76-a5ad76e55061 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f994a430>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:10.906451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e86658b8-19ab-4a73-9f76-a5ad76e55061 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.907333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e86658b8-19ab-4a73-9f76-a5ad76e55061 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.907834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e86658b8-19ab-4a73-9f76-a5ad76e55061 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.918520 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e86658b8-19ab-4a73-9f76-a5ad76e55061 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 200 len: 61 microversion: 2.26 time: 0.028346 Nov 03 04:25:10.919468 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2871/5857] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Nov 3 04:25:10 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 61 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:10.932058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '.version_select at 0x7ff7f9b65c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:10.940910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.941747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.942632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.943339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:10.950343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.951008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.951637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.953558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.953558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.953558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:10.992412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:10.993150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:10.994289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:11.077074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'flavor' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:11.100854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6192f5b1-dbad-459f-9163-96d993e2d819 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags" status: 204 len: 0 microversion: 2.26 time: 0.173320 Nov 03 04:25:11.100854 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2987/5858] 10.222.0.30 () {60 vars in 1295 bytes} [Thu Nov 3 04:25:10 2022] DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:25:11.110424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:11.110949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:11.117834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:11.118333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:11.119020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:11.120104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:11.120786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:11.121409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:11.171014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:25:11.488000 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7bd4d329-1531-4d16-89c8-a5e92bb59de5 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 204 len: 0 microversion: 2.26 time: 0.381181 Nov 03 04:25:11.492669 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2872/5859] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:25:11 2022] DELETE /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:25:11.498135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:11.498413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:11.506507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:11.508893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:11.509446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:11.510209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:11.510669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:11.511093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:11.697669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:11.706540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:11.708018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:11.709298 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-acaa02d9-c1e1-4642-823f-9b62523a38d4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1552 microversion: 2.26 time: 0.215513 Nov 03 04:25:11.717065 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2988/5860] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:11 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1552 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:25:12.429704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:12.430587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:12.445223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:12.445783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:12.446249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:12.447653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:12.448134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:12.448570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:12.513646 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb7accbb-ad3d-47f3-b8d7-db2d20190353 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/ips" status: 200 len: 151 microversion: 2.20 time: 0.090228 Nov 03 04:25:12.514688 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2873/5861] 10.222.0.30 () {60 vars in 1289 bytes} [Thu Nov 3 04:25:12 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:25:12.737674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:12.738301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:12.754314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:12.755107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:12.755914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:12.756522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:12.757191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:12.757636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:13.212246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:13.221051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:13.222806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:13.224268 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-996cbfa4-923d-4718-bf9c-4f19a3a12b84 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1552 microversion: 2.26 time: 0.491066 Nov 03 04:25:13.225075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2989/5862] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:12 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1552 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:13.881328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6c43b717-c1a4-4e77-b09b-54c0f946ead8 req-534cdb67-80d3-4241-a2a1-82970400c4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4141a51-2307-4e4f-bf0d-4eb61d59463b", "name": "network-vif-deleted", "tag": "dfcb6463-7ddf-4e7f-a60f-813d993d8a55"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:13.895359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6c43b717-c1a4-4e77-b09b-54c0f946ead8 req-534cdb67-80d3-4241-a2a1-82970400c4ab service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:13.896298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6c43b717-c1a4-4e77-b09b-54c0f946ead8 req-534cdb67-80d3-4241-a2a1-82970400c4ab service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:13.896991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6c43b717-c1a4-4e77-b09b-54c0f946ead8 req-534cdb67-80d3-4241-a2a1-82970400c4ab service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:13.928984 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6c43b717-c1a4-4e77-b09b-54c0f946ead8 req-534cdb67-80d3-4241-a2a1-82970400c4ab service nova] Creating event network-vif-deleted:dfcb6463-7ddf-4e7f-a60f-813d993d8a55 for instance a4141a51-2307-4e4f-bf0d-4eb61d59463b on n-h2-854653-7 Nov 03 04:25:13.942880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6c43b717-c1a4-4e77-b09b-54c0f946ead8 req-534cdb67-80d3-4241-a2a1-82970400c4ab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066005 Nov 03 04:25:13.945962 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2874/5863] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:25:14.257145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:14.259049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:14.281435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:14.282348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:14.292853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:14.298283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:14.298283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:14.298283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:14.359974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:14.360861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:14.361530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:14.362207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lazy-loading 'fault' on Instance uuid a4141a51-2307-4e4f-bf0d-4eb61d59463b {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:14.444452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:14.454573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:14.456564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b9d07666a064db5b88c3607c74f530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc6d922f2c64131b308d8d2affd1c5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:14.458306 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4430c057-dc1a-4f17-a624-c5c5a6e0d109 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 200 len: 1352 microversion: 2.26 time: 0.207116 Nov 03 04:25:14.459405 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2990/5864] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:14 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 1352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:15.506130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:15.511974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] [instance: a4141a51-2307-4e4f-bf0d-4eb61d59463b] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:15.528010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:15.528010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:15.528010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:15.529295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:15.529948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:15.530463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:15.552979 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] HTTP exception thrown: Instance a4141a51-2307-4e4f-bf0d-4eb61d59463b could not be found. Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Request method failure captured: Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b HTTP/1.1 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0KSXAhAkybT0gzj729jc3LsmdXgMmGuUvDWIyMBZXgRCDgszI6C5yyGukWroRW_JVegoDuSGm2kTOqmzNpp9X0ZPyv8a0exHoEDZ3DfrwCyptoRXgSUN4PavpTi1NmYaMD1Ux_zTiRTMYwwAo-tKRPIeVNPDujHHNQ_FM81cmW9Btw Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.26 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: fcc6d922f2c64131b308d8d2affd1c5f Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerTagsTestJSON-1547265807 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fcc6d922f2c64131b308d8d2affd1c5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fcc6d922f2c64131b308d8d2affd1c5f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fcc6d922f2c64131b308d8d2affd1c5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fcc6d922f2c64131b308d8d2affd1c5f"}]}] Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerTagsTestJSON-1547265807 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: fcc6d922f2c64131b308d8d2affd1c5f Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerTagsTestJSON-1547265807 Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerTagsTestJSON-1547265807-project Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 8b9d07666a064db5b88c3607c74f530b Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerTagsTestJSON-1547265807-project Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a4141a51-2307-4e4f-bf0d-4eb61d59463b could not be found. Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a4141a51-2307-4e4f-bf0d-4eb61d59463b'} Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4141a51-2307-4e4f-bf0d-4eb61d59463b could not be found. Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4141a51-2307-4e4f-bf0d-4eb61d59463b could not be found. Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:25:15.555018 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:25:15.562244 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:25:15.562244 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:25:15.562244 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:25:15.562244 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:25:15.562244 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:25:15.562244 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4141a51-2307-4e4f-bf0d-4eb61d59463b could not be found. Nov 03 04:25:15.562244 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:25:15.567694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] Returning 404 to user: Instance a4141a51-2307-4e4f-bf0d-4eb61d59463b could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:25:15.569102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-340f478e-c1f5-48a3-a21a-6a300653a0c4 tempest-ServerTagsTestJSON-1547265807 tempest-ServerTagsTestJSON-1547265807-project] 10.222.0.30 "GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b" status: 404 len: 111 microversion: 2.26 time: 0.077993 Nov 03 04:25:15.574258 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2875/5865] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:15 2022] GET /compute/v2.1/servers/a4141a51-2307-4e4f-bf0d-4eb61d59463b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:25:16.100446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:16.101744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:16.110212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:16.110707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:16.111151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:16.111861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:16.112593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:16.113118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:16.155144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lazy-loading 'flavor' on Instance uuid 6aaced6c-4fb6-4299-aab5-66cfac456794 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:25:16.989981 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-911eb27c-d859-449a-b1b6-fd4d5356be87 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/action" status: 202 len: 0 microversion: 2.20 time: 0.892637 Nov 03 04:25:16.991358 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2991/5866] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:25:16 2022] POST /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:25:17.015100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:17.017557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:17.044569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:17.045526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:17.046073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:17.047311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:17.048147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:17.049395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:17.298542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:17.307068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:17.308541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:17.309967 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed741d88-87bd-49c4-b8a4-fd2503b59174 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.313555 Nov 03 04:25:17.310527 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2876/5867] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:16 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:18.382513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:18.385460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:18.409150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:18.411507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:18.414386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:18.417509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:18.418574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:18.420660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:18.698189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:18.701939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:18.710382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:18.711864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:18.713783 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5da6cad2-eaf5-420c-a5e5-d559a0b84e0e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.377595 Nov 03 04:25:18.714366 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2992/5868] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:18 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:19.740736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:19.741435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:19.748740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:19.749457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:19.749910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:19.750625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:19.751090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:19.751635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:20.131294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:20.161848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:20.163478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:20.164980 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be3e9e7b-5153-44b0-b8f0-c862133f4ea3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.429030 Nov 03 04:25:20.169107 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2877/5869] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:19 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:21.194724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:21.195350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:21.198942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:21.204340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:21.204831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:21.205517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:21.206261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:21.206946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:21.207749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:21.510188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:21.521593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:21.527131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:21.528381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a6c08f63-3059-481f-a737-f70778201763 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.338034 Nov 03 04:25:21.528961 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2993/5870] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:21 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:22.555078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:22.556440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:22.563688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:22.564190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:22.564640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:22.565386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:22.565884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:22.566320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:22.755560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:22.764716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:22.766504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:22.768731 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.218163 Nov 03 04:25:22.769528 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2878/5871] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:22 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:23.797378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:23.799117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:23.809908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:23.810477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:23.811027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:23.812152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:23.812677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:23.813310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:23.960742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:23.970201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:23.971900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:23.973303 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69fcbf4a-6d20-42f0-8db2-e0e2d811d7b2 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.181668 Nov 03 04:25:23.973936 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2994/5872] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:23 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:24.951629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:24.952569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51008c28-b77a-4f0e-8e1a-ab3b90a74645 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001311 Nov 03 04:25:24.952797 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2879/5873] 10.222.0.30 () {56 vars in 886 bytes} [Thu Nov 3 04:25:24 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Nov 03 04:25:25.000724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:25.004202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:25.009455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:25.010182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:25.010618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:25.011324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:25.011778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:25.012390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:25.179524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:25.189608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:25.191536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:25.192949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.196521 Nov 03 04:25:25.193848 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2995/5874] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:24 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:26.224307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:26.225339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:26.235398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:26.235988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:26.236499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:26.237447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:26.237990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:26.238496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:26.901076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:26.912720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:26.920339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:26.922309 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.702908 Nov 03 04:25:26.933543 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2880/5875] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:26 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:27.880621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:27.881659 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001382 Nov 03 04:25:27.882005 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2996/5876] 10.222.0.30 () {56 vars in 886 bytes} [Thu Nov 3 04:25:27 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 03 04:25:27.890313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:27.891544 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001821 Nov 03 04:25:27.892043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2881/5877] 10.222.0.30 () {54 vars in 1035 bytes} [Thu Nov 3 04:25:27 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Nov 03 04:25:27.914017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:27.919872 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f22090a9-2518-4c96-8a42-ccb549e50798 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.007803 Nov 03 04:25:27.920318 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2997/5878] 10.222.0.30 () {54 vars in 1041 bytes} [Thu Nov 3 04:25:27 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:25:27.931102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:27.932016 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-108d6106-6ff9-417f-8853-0d0663f79359 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001923 Nov 03 04:25:27.932356 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2882/5879] 10.222.0.30 () {56 vars in 886 bytes} [Thu Nov 3 04:25:27 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 03 04:25:27.952485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:27.953235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:27.960765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:27.961378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:27.961943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:27.962825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:27.963361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:27.963860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:28.123751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:28.134637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:28.136263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:28.138523 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-22d7a499-9f4e-4cce-b4c6-2f9ae423360c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.190833 Nov 03 04:25:28.153740 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2998/5880] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:27 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:29.166864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:29.168037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:29.175859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:29.177776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:29.178540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:29.179212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:29.179999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:29.180746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:29.181431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:29.448688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:29.457884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:29.459810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:29.461093 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fed5c087-d9a2-4abd-8ea1-ca516574e044 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.301274 Nov 03 04:25:29.477717 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2883/5881] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:29 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:30.499504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:30.500171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:30.520077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:30.522750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:30.523223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:30.531462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:30.531972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:30.535974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:30.969476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:30.983802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:30.994790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:30.998322 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08d56db8-9c08-4ce7-ace6-79dfe8db4987 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.514643 Nov 03 04:25:30.999890 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 2999/5882] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:30 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:32.038235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:32.040091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:32.048926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:32.049755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:32.050434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:32.051400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:32.053336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:32.054031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:32.279843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:32.296294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:32.300252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:32.301931 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-84aefdb0-2443-4518-884e-a46b5a0a2398 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.273916 Nov 03 04:25:32.302502 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2884/5883] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:32 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:33.337762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:33.338563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:33.348329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:33.349119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:33.349731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:33.351317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:33.351990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:33.353159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:33.618043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:33.643213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:33.655188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:33.658010 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ba66d51f-6238-4800-80b9-0447f9bc9ff5 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1742 microversion: 2.20 time: 0.327965 Nov 03 04:25:33.659475 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3000/5884] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:33 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1742 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:34.687217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:34.687809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:34.704081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:34.704915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:34.705714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:34.706636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:34.709216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:34.709941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:35.507786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:35.538835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:35.542736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:35.556341 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-29465d59-5bda-41bb-8e29-b1ac6ef71b65 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1742 microversion: 2.20 time: 0.869528 Nov 03 04:25:35.558050 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2885/5885] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:34 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1742 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:36.586216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:36.586984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:36.596593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:36.598955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:36.602883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:36.602883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:36.602883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:36.602883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:36.977878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:36.998195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:37.000825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:37.009270 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c2f0f16-7f96-424f-9a20-adc476edcd2b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1742 microversion: 2.20 time: 0.425365 Nov 03 04:25:37.013313 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3001/5886] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:36 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1742 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:38.036931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:38.037543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:38.053598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:38.054292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:38.055952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:38.058697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:38.059251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:38.059735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:38.313859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:38.323582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:38.326527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:38.329777 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9805a2f1-7945-474f-8e25-61627bb7bb5b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1742 microversion: 2.20 time: 0.295851 Nov 03 04:25:38.329777 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2886/5887] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:38 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1742 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:25:38.591607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a4b6a81f-bd74-41a6-b065-0bbfb66249aa req-1ec8757f-f429-4621-9e41-07aeb38106ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaced6c-4fb6-4299-aab5-66cfac456794", "name": "network-vif-plugged", "status": "completed", "tag": "eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:38.601944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a4b6a81f-bd74-41a6-b065-0bbfb66249aa req-1ec8757f-f429-4621-9e41-07aeb38106ff service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:38.603002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a4b6a81f-bd74-41a6-b065-0bbfb66249aa req-1ec8757f-f429-4621-9e41-07aeb38106ff service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:38.603581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a4b6a81f-bd74-41a6-b065-0bbfb66249aa req-1ec8757f-f429-4621-9e41-07aeb38106ff service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:38.615297 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a4b6a81f-bd74-41a6-b065-0bbfb66249aa req-1ec8757f-f429-4621-9e41-07aeb38106ff service nova] Creating event network-vif-plugged:eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25 for instance 6aaced6c-4fb6-4299-aab5-66cfac456794 on n-h1-854653-7 Nov 03 04:25:38.620919 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a4b6a81f-bd74-41a6-b065-0bbfb66249aa req-1ec8757f-f429-4621-9e41-07aeb38106ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033610 Nov 03 04:25:38.621334 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3002/5888] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:25:39.357679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:39.359385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:39.368425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:39.372156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:39.372913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:39.381817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:39.386558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:39.390239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:39.603353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:39.614461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:39.616283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:39.617701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f5f6de8-614b-49a0-9322-dfd9720fa4c8 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.267890 Nov 03 04:25:39.618277 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2887/5889] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:39 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:40.646224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:40.648210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:40.670369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:40.670369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:40.679240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:40.682278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:40.682702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:40.683095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:41.508305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de8a4060-5ec7-42d4-bbe6-03a8019493dc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'create', calling method: .version_select at 0x7ff7f93f0af0>, body: {"keypair": {"name": "tempest-keypair-111786986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLt3+W1O8e7xf0Nxg548F1tT1QYjgWAHDLTpJqpILEXuN3KizAQqYDHlfRaps9HWuL4jGMhLbSZwpntT7L2sXpqGmy17iLtW+yaowxQ9RnfQmlKXb9Zu1NUxr4oyxDkcnQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:41.543965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-de8a4060-5ec7-42d4-bbe6-03a8019493dc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for project e1da15001cf94302ab8effa988b31db6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:25:41.559334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-de8a4060-5ec7-42d4-bbe6-03a8019493dc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for user a81a3d829ca245ae88387ed7e8839d1b and project e1da15001cf94302ab8effa988b31db6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:25:41.669614 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de8a4060-5ec7-42d4-bbe6-03a8019493dc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.393316 Nov 03 04:25:41.670924 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2888/5890] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:25:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:25:41.738299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:41.751061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:41.753046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:41.754512 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3194720f-c4c9-4723-92ce-b4027be6e3ca tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 1.113963 Nov 03 04:25:41.755827 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3003/5891] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:40 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:42.790677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:42.790677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:42.800649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:42.801697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:42.803672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:42.810235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:42.810235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:42.810235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:42.853379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:43.509169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:43.518733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:43.523615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:43.527591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96596d1d-19f2-4353-9caf-0b02023c70cc tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.747311 Nov 03 04:25:43.543346 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2889/5892] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:42 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:44.554772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:44.555437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:44.565315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:44.568115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:44.568633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:44.569413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:44.569890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:44.570332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:44.989946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:45.013458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:45.018470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:45.021058 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-381835aa-a83a-4adc-92da-81cba1243025 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.470481 Nov 03 04:25:45.042338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3004/5893] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:44 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:45.638314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-311843739", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "249e8b9e-956a-4ad7-b692-1fe379ef3734"}], "security_groups": [{"name": "tempest-securitygroup--1675824842"}], "key_name": "tempest-keypair-111786986", "user_data": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:45.865818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] validate_networks() for [('249e8b9e-956a-4ad7-b692-1fe379ef3734', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:25:46.064381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:46.065043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:46.097842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:46.098369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:46.098831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:46.099591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:46.100036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:46.100468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:46.572053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:46.582698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:46.584501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:46.585824 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15d50258-3410-4d16-9914-8303b0747785 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.527117 Nov 03 04:25:46.586617 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3005/5894] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:46 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:46.787834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:25:46.789578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:25:46.791107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:25:46.797621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:25:46.797621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:25:46.811040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:46.814599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:46.815057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:46.820604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:46.821438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:46.822086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:46.855030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for project e1da15001cf94302ab8effa988b31db6. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:25:46.864076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for user a81a3d829ca245ae88387ed7e8839d1b and project e1da15001cf94302ab8effa988b31db6. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:25:46.880552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:25:46.888281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:25:47.110319 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5f782a98-1d39-44d7-b97d-a346830627e1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.480033 Nov 03 04:25:47.127288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01473051-7bce-4a58-a0f2-20d3d1187cf5 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:47.129637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01473051-7bce-4a58-a0f2-20d3d1187cf5 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:47.132634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2890/5895] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:25:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:25:47.400162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01473051-7bce-4a58-a0f2-20d3d1187cf5 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:47.412854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01473051-7bce-4a58-a0f2-20d3d1187cf5 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1236 microversion: 2.1 time: 0.292591 Nov 03 04:25:47.424599 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3006/5896] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:47 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1236 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:47.617102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:47.617742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:47.668828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:47.670744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:47.671998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:47.673000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:47.673666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:47.674326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:48.070179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:48.088989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:48.094441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:48.097999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fde43495-e190-4e99-a573-a1600cd8f3df tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.486404 Nov 03 04:25:48.101963 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2891/5897] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:47 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:48.450562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-890692a7-85b0-4d8d-997c-0a6da45c1fd0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:48.451983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-890692a7-85b0-4d8d-997c-0a6da45c1fd0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:48.582450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-890692a7-85b0-4d8d-997c-0a6da45c1fd0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:48.595273 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-890692a7-85b0-4d8d-997c-0a6da45c1fd0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1236 microversion: 2.1 time: 0.148796 Nov 03 04:25:48.619911 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3007/5898] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:48 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1236 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:49.132118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:49.132984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:49.146956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:49.148003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:49.151126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:49.153278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:49.156078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:49.157197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:49.712822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:49.786375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:49.800305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:49.808214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:49.812196 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5827fd5e-300c-4df6-a8fe-ec58c1e4ca2c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.684669 Nov 03 04:25:49.814145 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2892/5899] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:49 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:49.822301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:49.844099 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-88abf894-8281-4d26-8676-e371110d5c31 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1232 microversion: 2.1 time: 0.223090 Nov 03 04:25:49.861398 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3008/5900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:49 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1232 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:50.844704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:50.849835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:50.889497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:50.890279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:50.898577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:50.900956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:50.901472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:50.904644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:50.905972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:50.906473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:50.906916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:50.908254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:50.908729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:50.911982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:50.912476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:50.912920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:51.342093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:51.356606 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b38fb7ad-f80a-467f-a9b0-1aaf2714bd76 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1296 microversion: 2.1 time: 0.469869 Nov 03 04:25:51.361201 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3009/5901] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:50 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1296 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:51.826751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:51.839259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:51.840804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:51.844971 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0dc1b31-edf9-4a60-a458-8923090292ce tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 1.004712 Nov 03 04:25:51.849803 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2893/5902] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:50 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:52.400185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:52.402060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:52.420741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:52.423662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:52.424311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:52.426384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:52.431293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:52.432075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:52.694175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:52.702712 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14ca82a6-e128-48e6-8617-f1564c697efd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1294 microversion: 2.1 time: 0.310007 Nov 03 04:25:52.703300 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3010/5903] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:52 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1294 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:52.878736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:52.881268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:52.889857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:52.890582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:52.891245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:52.892185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:52.892912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:52.893573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:53.396135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:53.413099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:53.414226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:53.416272 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5059862-7777-4396-a832-a333e28b5634 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.542424 Nov 03 04:25:53.421111 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2894/5904] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:52 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:53.728625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:53.729869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:53.739614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:53.740447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:53.741085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:53.743506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:53.745007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:53.745486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:53.892007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:53.906376 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cb40b69d-2db0-4720-9352-affc688a1609 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1294 microversion: 2.1 time: 0.182237 Nov 03 04:25:53.911312 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3011/5905] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:53 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1294 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:25:54.458693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:54.467717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:54.493868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:54.498513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:54.503391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:54.510415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:54.511271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:54.513342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:54.937122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:54.937770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:54.941463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=38 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:54.954916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:54.956325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:54.957216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:54.958530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:54.959407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:54.960766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:55.441797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:55.456607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:55.458807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:55.460048 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a89cc132-ce9c-403d-a6c6-37f466c18040 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 1.016215 Nov 03 04:25:55.460633 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2895/5906] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:54 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:55.740656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:55.752446 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80a0db7d-7b7e-45ba-a15a-3bd95b02bf40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.820228 Nov 03 04:25:55.753113 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3012/5907] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:54 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:25:56.494430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:56.496183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:56.512675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:56.516398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:56.517391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:56.518353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:56.520165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:56.522660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:56.782321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:56.782990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:56.802269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:56.806106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:56.806106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:56.809494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:56.810245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:56.811573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:56.835058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:56.872098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:58.144538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:58.156251 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d651823b-edf0-4b1d-9f05-a3cb5baa244b tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 1.379199 Nov 03 04:25:58.156857 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3013/5908] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:56 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:25:58.169451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:58.174052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:58.178617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:25:58.186126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38ea519d-8a2e-4da8-8812-d5624ea7127c tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 1.698083 Nov 03 04:25:58.187409 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2896/5909] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:56 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:25:58.820978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a79a1916-f150-4cff-98f4-0193cac1decc req-1b6388ce-f3d3-452f-a127-21484e0aa3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7590f73f-35cd-47d0-a748-8bf7280a0c7d", "tag": "0a99884e-1c93-44f2-8c01-90610ae02c19"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:25:58.834066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:58.837949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a79a1916-f150-4cff-98f4-0193cac1decc req-1b6388ce-f3d3-452f-a127-21484e0aa3d7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:58.838959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a79a1916-f150-4cff-98f4-0193cac1decc req-1b6388ce-f3d3-452f-a127-21484e0aa3d7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:58.839591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a79a1916-f150-4cff-98f4-0193cac1decc req-1b6388ce-f3d3-452f-a127-21484e0aa3d7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:58.846642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:25:58.855161 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a79a1916-f150-4cff-98f4-0193cac1decc req-1b6388ce-f3d3-452f-a127-21484e0aa3d7 service nova] Creating event network-changed:0a99884e-1c93-44f2-8c01-90610ae02c19 for instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d on n-h2-854653-7 Nov 03 04:25:58.862748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a79a1916-f150-4cff-98f4-0193cac1decc req-1b6388ce-f3d3-452f-a127-21484e0aa3d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048295 Nov 03 04:25:58.864023 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3014/5910] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:25:59.184956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:59.185953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:59.202749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:59.203534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:59.205579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:59.207763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:59.208978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:59.210740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:59.218029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:25:59.219135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:25:59.242441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:59.253288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:59.254275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:25:59.255260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:25:59.255945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:25:59.256587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:00.377309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:00.390871 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41d5cd7e-67fc-4d74-8aa4-3423fa2627e8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 1.209751 Nov 03 04:26:00.392140 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2897/5911] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:25:59 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:00.403685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:00.416144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:00.418041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:00.419790 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fd189bab-f7db-4c20-a15e-c31350316ad6 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 1.207600 Nov 03 04:26:00.420859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3015/5912] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:25:59 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:01.416157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:01.416731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:01.431685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:01.432312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:01.432856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:01.438764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:01.439650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:01.440111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:01.451502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:01.452297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:01.460447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:01.460977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:01.466858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:01.467766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:01.468450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:01.469100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:01.871674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:01.880078 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e251e6b-ffa1-4d4b-8fa4-54f948866331 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.468298 Nov 03 04:26:01.892394 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2898/5913] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:01 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:01.906347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:01.919814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:01.921534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:01.923458 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b1dd2ae-e17e-48d7-a69a-90edd7f8de56 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1737 microversion: 2.20 time: 0.478076 Nov 03 04:26:01.924397 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3016/5914] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:01 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1737 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:02.941550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:02.942190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:02.951622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:02.952955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:02.981138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:02.982872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:02.983972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:02.984432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:02.988128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:02.988128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:02.988128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:02.988345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:02.988429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:02.988691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:02.989033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:02.989514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:02.990103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:03.369324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:03.406500 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-86d0471f-822a-4c69-af85-0b83cfc91691 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.487644 Nov 03 04:26:03.407501 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2899/5915] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:02 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:03.616540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:03.630190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:03.633575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:03.635784 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-afb400bb-19fc-4933-8c4f-01d6bbb0c03a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1719 microversion: 2.20 time: 0.689095 Nov 03 04:26:03.636900 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3017/5916] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:02 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1719 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:04.440524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:04.444235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:04.454871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:04.456143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:04.456841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:04.457872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:04.458446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:04.458959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:04.655840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:04.667748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64ab52af-f876-42d9-b15c-183b49f08aaf tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.239248 Nov 03 04:26:04.667948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:04.668374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:04.670860 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2900/5917] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:04 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:04.683016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:04.683016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:04.683016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:04.683016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:04.683016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:04.683016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:05.225910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:05.239850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:05.241353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:05.242580 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a528edc-aa41-4f6a-8005-51be5a5ce3f3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1719 microversion: 2.20 time: 0.579497 Nov 03 04:26:05.243247 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3018/5918] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:04 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1719 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:26:05.699801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:05.700432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:05.721579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:05.723943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:05.728488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:05.729321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:05.732699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:05.732699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:06.099185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:06.111525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-780c6508-0d09-4e69-b916-52cfe1eba1de tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.417290 Nov 03 04:26:06.112937 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2901/5919] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:05 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:06.229733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8675166a-887c-41d7-ab98-bfdb8e2fe805 req-c180001f-7a10-4ed2-9544-e6227839a72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaced6c-4fb6-4299-aab5-66cfac456794", "name": "network-vif-unplugged", "status": "completed", "tag": "eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:26:06.254911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8675166a-887c-41d7-ab98-bfdb8e2fe805 req-c180001f-7a10-4ed2-9544-e6227839a72f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:06.255507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8675166a-887c-41d7-ab98-bfdb8e2fe805 req-c180001f-7a10-4ed2-9544-e6227839a72f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:06.267508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8675166a-887c-41d7-ab98-bfdb8e2fe805 req-c180001f-7a10-4ed2-9544-e6227839a72f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:06.272665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:06.273561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:06.286238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:06.287118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:06.287865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:06.294377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8675166a-887c-41d7-ab98-bfdb8e2fe805 req-c180001f-7a10-4ed2-9544-e6227839a72f service nova] Creating event network-vif-unplugged:eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25 for instance 6aaced6c-4fb6-4299-aab5-66cfac456794 on n-h1-854653-7 Nov 03 04:26:06.295473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:06.296373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:06.302623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:06.314115 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8675166a-887c-41d7-ab98-bfdb8e2fe805 req-c180001f-7a10-4ed2-9544-e6227839a72f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087103 Nov 03 04:26:06.314788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3019/5920] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:26:06.750210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:06.764039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:06.767274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:06.768524 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cdfe69ea-a38e-4ccc-a29b-9fdf1f48b53b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1722 microversion: 2.20 time: 0.501401 Nov 03 04:26:06.774017 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2902/5921] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:06 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:26:06.809929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e0e5c0b-84f9-4591-8adb-8a4895a9c593"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:26:06.814749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:06.846547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:06.848907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:06.850855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:06.856852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:06.858052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:06.858962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:07.138243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:07.139834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:07.155241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:07.156210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:07.157365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:07.158432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:07.159005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:07.159645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:07.498076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:07.506534 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-941755ec-5a4d-4ed9-8a33-8b9825ecd704 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.373877 Nov 03 04:26:07.507307 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2903/5922] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:07 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:26:07.898567 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03615b9f-f36e-40fc-819c-977c7064abdb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.093542 Nov 03 04:26:07.901160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3020/5923] 10.222.0.30 () {62 vars in 1364 bytes} [Thu Nov 3 04:26:06 2022] POST /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-volume_attachments => generated 188 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:26:08.062625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:08.063134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:08.073261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:08.075394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:08.075873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:08.076607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:08.077103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:08.077545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:08.532577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:08.533248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:08.548969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:08.551179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:08.551855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:08.552776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:08.555053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:08.555761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:08.744874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:08.815057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:08.824237 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7187df8-545d-46ee-843f-c5f4733351c9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.296548 Nov 03 04:26:08.824834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3021/5924] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:08 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:08.838527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7a10c543-ede5-486b-8e04-f2f78e8976c1 req-63209d8a-2659-4b0b-9798-731a1ba77782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7590f73f-35cd-47d0-a748-8bf7280a0c7d", "name": "network-vif-plugged", "status": "completed", "tag": "0a99884e-1c93-44f2-8c01-90610ae02c19"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:26:08.849045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a10c543-ede5-486b-8e04-f2f78e8976c1 req-63209d8a-2659-4b0b-9798-731a1ba77782 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:08.849569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a10c543-ede5-486b-8e04-f2f78e8976c1 req-63209d8a-2659-4b0b-9798-731a1ba77782 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:08.850686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7a10c543-ede5-486b-8e04-f2f78e8976c1 req-63209d8a-2659-4b0b-9798-731a1ba77782 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:08.864143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7a10c543-ede5-486b-8e04-f2f78e8976c1 req-63209d8a-2659-4b0b-9798-731a1ba77782 service nova] Creating event network-vif-plugged:0a99884e-1c93-44f2-8c01-90610ae02c19 for instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d on n-h2-854653-7 Nov 03 04:26:08.871034 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7a10c543-ede5-486b-8e04-f2f78e8976c1 req-63209d8a-2659-4b0b-9798-731a1ba77782 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044973 Nov 03 04:26:08.871651 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3022/5925] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:26:08.925463 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce681582-82af-49df-9960-9406271f33de tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-volume_attachments/8e0e5c0b-84f9-4591-8adb-8a4895a9c593" status: 202 len: 0 microversion: 2.20 time: 0.866988 Nov 03 04:26:08.926662 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2904/5926] 10.222.0.30 () {60 vars in 1457 bytes} [Thu Nov 3 04:26:08 2022] DELETE /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-volume_attachments/8e0e5c0b-84f9-4591-8adb-8a4895a9c593 => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:26:09.076436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:26:09.096733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:09.104626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:09.112986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:09.112986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:09.112986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:09.112986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:09.112986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:09.226037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127594) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 03 04:26:09.448968 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17ae50ef-e609-4932-b646-f7f371415c96 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "POST /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/action" status: 202 len: 0 microversion: 2.20 time: 0.376618 Nov 03 04:26:09.450340 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3023/5927] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Nov 3 04:26:09 2022] POST /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:26:09.458593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:09.461490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:09.478980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:09.480431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:09.481330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:09.483503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:09.483980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:09.484444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:09.702383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:09.720055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:09.722082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:09.723664 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-663b196c-41ad-40e6-883d-a97cd7ab1721 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1670 microversion: 2.20 time: 0.269080 Nov 03 04:26:09.724461 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2905/5928] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:09 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:09.852143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:09.853570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:09.859982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:09.861219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:09.861665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:09.862372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:09.862828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:09.863582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:10.022928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:10.032629 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4f48024-dc0f-46b8-82e1-a50a4226a146 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1362 microversion: 2.1 time: 0.184965 Nov 03 04:26:10.042048 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3024/5929] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:09 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:10.763923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:10.767829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:10.790811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:10.792046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:10.793372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:10.794892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:10.795952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:10.796597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:11.010339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:11.018906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:11.020740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:11.021996 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d189b64-d3e3-47b3-9b65-d0189089e8a3 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1670 microversion: 2.20 time: 0.272380 Nov 03 04:26:11.022573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2906/5930] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:10 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:11.055689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:11.060051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:11.065793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:11.066541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:11.070675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:11.072274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:11.073243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:11.073854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:11.272443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:11.279420 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b71f4dc9-3d5a-4811-a23a-cbd67a59c498 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1549 microversion: 2.1 time: 0.228327 Nov 03 04:26:11.280714 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3025/5931] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:26:11 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:26:11.304530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:11.305193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:11.311543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:11.312312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:11.313097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:11.314024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:11.314551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:11.315165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:11.432614 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89359bbd-248f-4618-846a-b9d2aabdad05 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132192 Nov 03 04:26:11.433242 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2907/5932] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:26:11 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:26:12.053298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:12.054968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:12.067718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:12.068389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:12.068637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:12.075758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:12.076293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:12.076760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:12.645278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:12.657391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:12.662067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:12.664462 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5a429663-c971-4d9e-8155-28837416849b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.620115 Nov 03 04:26:12.667252 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3026/5933] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:12 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:13.469639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-329209ce-e0f3-46c3-9c60-ddf551f31b41 req-ea263d17-0d01-4575-b99c-7bc710cddc5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7590f73f-35cd-47d0-a748-8bf7280a0c7d", "tag": "0a99884e-1c93-44f2-8c01-90610ae02c19"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:26:13.484035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-329209ce-e0f3-46c3-9c60-ddf551f31b41 req-ea263d17-0d01-4575-b99c-7bc710cddc5b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:13.485037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-329209ce-e0f3-46c3-9c60-ddf551f31b41 req-ea263d17-0d01-4575-b99c-7bc710cddc5b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:13.486021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-329209ce-e0f3-46c3-9c60-ddf551f31b41 req-ea263d17-0d01-4575-b99c-7bc710cddc5b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:13.499796 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-329209ce-e0f3-46c3-9c60-ddf551f31b41 req-ea263d17-0d01-4575-b99c-7bc710cddc5b service nova] Creating event network-changed:0a99884e-1c93-44f2-8c01-90610ae02c19 for instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d on n-h2-854653-7 Nov 03 04:26:13.506485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-329209ce-e0f3-46c3-9c60-ddf551f31b41 req-ea263d17-0d01-4575-b99c-7bc710cddc5b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042363 Nov 03 04:26:13.508315 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2908/5934] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:26:13.711418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:13.712582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:13.773715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:13.777727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:13.778438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:13.783218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:13.784350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:13.786066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:14.267370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:14.282775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:14.291406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:14.292957 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3dad824e-7249-46e1-9621-96593b2b0d34 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.602746 Nov 03 04:26:14.293807 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3027/5935] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:13 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:15.327608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:15.328511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:15.342308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:15.343719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:15.345110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:15.347240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:15.348542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:15.349882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:15.709619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:15.727166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:15.728800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:15.730252 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a0dfc74-0879-46b5-a003-3e994f38000a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.413511 Nov 03 04:26:15.730830 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2909/5936] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:15 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:16.759609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:16.760853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:16.771221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:16.773337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:16.780599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:16.781562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:16.782176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:16.783689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:17.062769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:17.079776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:17.083289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:17.085464 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c03d32a-1e0e-42d5-a15b-38ab625e7f12 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.330099 Nov 03 04:26:17.102985 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3028/5937] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:16 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:18.116222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:18.121635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:18.132229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:18.132830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:18.134083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:18.135091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:18.136077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:18.136844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:18.386664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:18.395194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:18.401187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:18.402537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-688c133a-c4b2-4b83-9827-7438a6d35988 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.290688 Nov 03 04:26:18.403811 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2910/5938] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:18 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:19.430743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:19.431929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:19.449390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:19.449883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:19.450325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:19.451034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:19.451492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:19.451913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:19.469283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:19.707210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:19.721047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:19.723329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:19.724792 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a9c7b9e-5d61-488e-92ab-0026cbd5ea2e tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.298069 Nov 03 04:26:19.725827 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3029/5939] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:19 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:20.754452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:20.757416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:20.762451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:20.762955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:20.763403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:20.764125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:20.764599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:20.765052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:21.102860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:21.116624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:21.121184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:21.124789 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7468fc4-0170-4363-9d40-edae3bf6b224 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.372216 Nov 03 04:26:21.126293 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2911/5940] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:20 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:22.159377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:22.163466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:22.168221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:22.168718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:22.169235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:22.169944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:22.170404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:22.170836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:22.459461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:22.467801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:22.469342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:22.470545 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71f01749-0daf-4da3-bcdf-ca43252092c9 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.317270 Nov 03 04:26:22.471127 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3030/5941] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:22 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:23.496777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:23.497547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:23.504558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:23.505079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:23.505565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:23.506271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:23.506736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:23.507479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:23.678074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:23.687316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:23.688863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:23.690236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec5b1f8e-25bc-4979-946d-67b7eb6ae615 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.197488 Nov 03 04:26:23.690861 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2912/5942] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:23 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:24.717780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:24.718535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:24.726198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:24.726787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:24.727304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:24.728691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:24.729466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:24.729978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:24.878572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:24.890067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:24.892392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:24.894233 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68995fe1-edc4-4b89-9ffe-994164edb131 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.181085 Nov 03 04:26:24.912683 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3031/5943] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:24 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:25.925699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:25.927254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:25.934820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:25.935473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:25.935915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:25.936665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:25.937424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:25.937880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:26.112840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:26.124747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:26.125042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:26.126389 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f63b528-d055-4a98-9399-49d056b5a8f1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.205154 Nov 03 04:26:26.127281 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2913/5944] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:25 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:27.154928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:27.155812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:27.161674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:27.163480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:27.163979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:27.164690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:27.165115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:27.165633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:27.166057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:27.323696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:27.332075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:27.333602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:27.334814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8448b74a-a026-4b5f-a447-6f6fb43ca562 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.185961 Nov 03 04:26:27.335422 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3032/5945] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:27 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:26:28.362371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:28.363000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:28.370204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:28.376388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:28.376388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:28.376388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:28.376388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:28.376388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:28.514638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:28.529106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:28.531437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:28.532735 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0c85d134-dcae-4995-8492-e681acb46c8a tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.174669 Nov 03 04:26:28.533677 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2914/5946] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:28 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:29.558826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:29.559451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:29.567242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:29.567730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:29.568804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:29.569549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:29.570157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:29.570594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:29.747643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:29.761631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:29.763586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:29.765008 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82812194-ce6f-45ad-8266-74a8b6084859 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.210367 Nov 03 04:26:29.766112 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3033/5947] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:29 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:30.792239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:30.793462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:30.800300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:30.803451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:30.803451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:30.803451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:30.803451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:30.803451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:30.941339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:30.950063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:30.951530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:30.952712 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9e4564b-e5ae-4499-88bc-a7f7a6f7abf1 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.165158 Nov 03 04:26:30.953330 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2915/5948] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:30 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:31.979067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:31.979822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:31.987103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:31.987653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:31.988094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:31.988794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:31.989282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:31.989707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:32.157443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:32.174666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:32.174666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:32.177668 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fbf790a9-d0e1-4aa2-92fa-1eac770c8892 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.203318 Nov 03 04:26:32.197990 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3034/5949] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:31 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:32.265794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9e4ff440-746c-4fd8-85c4-3da59493be4f req-590b90a2-c359-40a6-9d13-ff9665a183ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaced6c-4fb6-4299-aab5-66cfac456794", "name": "network-vif-plugged", "status": "completed", "tag": "eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:26:32.278283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e4ff440-746c-4fd8-85c4-3da59493be4f req-590b90a2-c359-40a6-9d13-ff9665a183ad service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:32.278943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e4ff440-746c-4fd8-85c4-3da59493be4f req-590b90a2-c359-40a6-9d13-ff9665a183ad service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:32.279626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e4ff440-746c-4fd8-85c4-3da59493be4f req-590b90a2-c359-40a6-9d13-ff9665a183ad service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:32.299769 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9e4ff440-746c-4fd8-85c4-3da59493be4f req-590b90a2-c359-40a6-9d13-ff9665a183ad service nova] Creating event network-vif-plugged:eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25 for instance 6aaced6c-4fb6-4299-aab5-66cfac456794 on n-h1-854653-7 Nov 03 04:26:32.305531 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9e4ff440-746c-4fd8-85c4-3da59493be4f req-590b90a2-c359-40a6-9d13-ff9665a183ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043798 Nov 03 04:26:32.307365 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2916/5950] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:26:33.203404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:33.204055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:33.212787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:33.213326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:33.213973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:33.214689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:33.215148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:33.215584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:33.356493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:33.365319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:33.366913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:33.368097 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2ce9b0b-9357-4c1e-a1f0-472fbdb95191 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.168517 Nov 03 04:26:33.368704 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3035/5951] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:33 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:34.394886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:34.395799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:34.403325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=36 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:34.405116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:34.405771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:34.406419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:34.407265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:34.407881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:34.408379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:34.633038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:34.645983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:34.647556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:34.648851 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48eaa307-32d9-48e9-a45b-4a5456513610 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1728 microversion: 2.20 time: 0.259458 Nov 03 04:26:34.657651 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2917/5952] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:34 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1728 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:35.676134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:35.677150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:35.685126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:35.686064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:35.686825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:35.687865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:35.688496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:35.689205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:35.921611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:35.929851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:35.931987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:26:35.933243 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c6be0eb-abb5-404b-9d4b-10c88a3fcc59 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1715 microversion: 2.20 time: 0.261301 Nov 03 04:26:35.933812 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3036/5953] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:26:35 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1715 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:26:49.993454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:26:49.994017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:49.997087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:49.997767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=71 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:50.005343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:50.006228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:50.006867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:50.010015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:50.010015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:50.010015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:50.052418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31447c90-a2ec-4180-b994-2c4fefdf8f07 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/ips" status: 200 len: 146 microversion: 2.1 time: 0.062630 Nov 03 04:26:50.053826 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2918/5954] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:26:49 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/ips => generated 146 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:26:54.181806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac251c4a-a2b4-47a1-b6b7-9bafdfaa0be1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:26:54.188820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:26:54.188820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:54.188820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=46 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:26:54.193223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:54.193715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:54.194154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:54.194855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:26:54.195314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:26:54.195743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:26:55.106254 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36af0f5c-7333-4541-931f-26cfee21c0d7 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927795 Nov 03 04:26:55.106254 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3037/5955] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:26:54 2022] POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-volume_attachments => generated 194 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:27:08.276852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79b39b69-6c73-4ee6-8a5b-4df30e846fd8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:27:08.283607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b39b69-6c73-4ee6-8a5b-4df30e846fd8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:08.284343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b39b69-6c73-4ee6-8a5b-4df30e846fd8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:08.284967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79b39b69-6c73-4ee6-8a5b-4df30e846fd8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:08.313716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79b39b69-6c73-4ee6-8a5b-4df30e846fd8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Going to try to stop instance {{(pid=127593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:27:08.571469 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79b39b69-6c73-4ee6-8a5b-4df30e846fd8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action" status: 202 len: 0 microversion: 2.1 time: 0.300107 Nov 03 04:27:08.572500 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2919/5956] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:27:08 2022] POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:27:08.579151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:08.580623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:08.585389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:08.586003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:08.598867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:08.599619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:08.600674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:08.601442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:08.602020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:08.602521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:08.925950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:08.936706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b894306-39c9-4b14-a20e-e4b569eb9d40 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.359408 Nov 03 04:27:08.937407 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3038/5957] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:08 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:09.970671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:09.971394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:09.986188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:09.986768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:09.991210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:09.994510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:09.996558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:09.997042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:10.230687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:10.246176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5c8e2839-6d03-46d2-9d01-0eba06ce95d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.281968 Nov 03 04:27:10.250908 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2920/5958] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:09 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:11.269680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:11.270304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:11.278005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:11.278497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:11.278942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:11.279765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:11.280286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:11.280664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:11.425863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:11.434446 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e592c1e-bd52-4613-abdf-ba5f304314d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.168735 Nov 03 04:27:11.435145 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3039/5959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:11 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:12.457952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:12.459231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:12.468991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:12.468991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:12.469745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:12.470752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:12.471650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:12.472288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:12.735263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:12.759949 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e27c817d-d496-47d4-8159-07d78fe16889 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.305644 Nov 03 04:27:12.765385 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2921/5960] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:12 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:13.789094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:13.790356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:13.799030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:13.799912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:13.800559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:13.803605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:13.804334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:13.804839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:14.071920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:14.081743 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-827c43f8-58a7-4474-8bcb-ce19829c5dea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.297920 Nov 03 04:27:14.082794 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3040/5961] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:13 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:15.112050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:15.113659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:15.125270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:15.126576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:15.127460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:15.130099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:15.130771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:15.131362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:15.317033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:15.330196 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4611bd9-e025-4ca5-9407-6e92474e69b2 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.227348 Nov 03 04:27:15.331068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2922/5962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:15 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:16.355023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:16.355742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:16.362948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:16.363446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:16.363908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:16.364873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:16.365395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:16.365855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:16.574369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:16.592149 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3abbb8c6-d0c6-4d48-b944-a72ac0011f77 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.241008 Nov 03 04:27:16.593737 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3041/5963] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:16 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:17.615977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:17.616602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:17.623538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:17.624025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:17.624469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:17.625196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:17.625663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:17.626094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:17.790929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:17.799625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-32bc5555-132f-46f4-8aa5-ec6d2cd2cc30 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.187826 Nov 03 04:27:17.800295 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2923/5964] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:17 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:18.824305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:18.824943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:18.832576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:18.833363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:18.834174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:18.834903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:18.835369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:18.835969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:19.006204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:19.020892 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee34616e-6cc6-443b-80b2-55e64649fb3e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1723 microversion: 2.1 time: 0.200659 Nov 03 04:27:19.021717 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3042/5965] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:18 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:19.385482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-119377322", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "f902784e-fd57-42eb-9d7c-3664975afafb"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:27:19.439121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] validate_networks() for [('f902784e-fd57-42eb-9d7c-3664975afafb', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:27:19.804140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:27:19.804573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:27:19.805072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:27:19.805488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:27:19.806114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:27:19.815435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:19.815925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:19.816365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:19.817128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:19.817617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:19.818048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:19.836030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Getting quotas for project c544123188d3481c97cbf022a90811e8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:27:19.841484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Getting quotas for user 57b4e7b7bd1e47bbbff940175aa46ea3 and project c544123188d3481c97cbf022a90811e8. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:27:19.853927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:27:19.856232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:27:20.005739 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b62a7478-0f03-4449-9748-71cffedf1373 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735758 Nov 03 04:27:20.006425 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2924/5966] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:27:20.018486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5985d322-31e6-41d7-8b02-db2d6651e19c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:20.019265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5985d322-31e6-41d7-8b02-db2d6651e19c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:20.046686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:20.047436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:20.055277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:20.055893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:20.056633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:20.057988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:20.059299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:20.060254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:20.108295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5985d322-31e6-41d7-8b02-db2d6651e19c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:20.116088 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5985d322-31e6-41d7-8b02-db2d6651e19c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1213 microversion: 2.1 time: 0.101723 Nov 03 04:27:20.117147 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3043/5967] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:20 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:27:20.222251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:20.231542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c757e4f-77f0-4cba-b6ff-ea8190d66109 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1700 microversion: 2.1 time: 0.188804 Nov 03 04:27:20.232108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2925/5968] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:20 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1700 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:20.256552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23c5b88f-7839-4ab1-9ff2-1e40080601bd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:27:20.265323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c5b88f-7839-4ab1-9ff2-1e40080601bd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:20.265818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c5b88f-7839-4ab1-9ff2-1e40080601bd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:20.266266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23c5b88f-7839-4ab1-9ff2-1e40080601bd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:20.289598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23c5b88f-7839-4ab1-9ff2-1e40080601bd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Going to try to start instance {{(pid=127594) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 03 04:27:20.486137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23c5b88f-7839-4ab1-9ff2-1e40080601bd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action" status: 202 len: 0 microversion: 2.1 time: 0.235087 Nov 03 04:27:20.486757 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3044/5969] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:27:20 2022] POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:27:20.503137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:20.504991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:20.512727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:20.513281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:20.513728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:20.514483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:20.514943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:20.515374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:20.659807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:20.668233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f903d81-17eb-4f37-bba0-612120a18fde tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1709 microversion: 2.1 time: 0.176912 Nov 03 04:27:20.668814 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2926/5970] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:20 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1709 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:21.140509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:21.141249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:21.147399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:21.147888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:21.148420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:21.149143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:21.149609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:21.150041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:21.243818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:21.253839 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7862fbc3-0bb5-4eaf-9fd3-a98070a8a678 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1217 microversion: 2.1 time: 0.119028 Nov 03 04:27:21.254531 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3045/5971] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:21 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:27:21.692391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:21.693916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:21.704418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:21.713674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:21.713674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:21.713674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:21.713674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:21.713674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:21.863715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:21.873628 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71332532-68d6-4fa8-8800-744d08f4dc98 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1709 microversion: 2.1 time: 0.185609 Nov 03 04:27:21.874242 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2927/5972] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:21 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1709 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:22.280028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:22.282006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:22.292597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:22.295722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:22.295722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:22.295722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:22.295722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:22.295722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:22.378231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:22.386965 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-699c0eba-b463-4113-b546-4a5c1ebd3c67 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1265 microversion: 2.1 time: 0.113267 Nov 03 04:27:22.399664 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3046/5973] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:22 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:22.897609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:22.898841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:22.905942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:22.906683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:22.907300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:22.908163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:22.908773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:22.909373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:23.157758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:23.169407 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe0fcb6e-1784-4082-982c-b12b835c66cb tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1713 microversion: 2.1 time: 0.275562 Nov 03 04:27:23.187509 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2928/5974] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:22 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1713 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:23.410798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:23.411529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:23.418421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:23.418901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:23.419339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:23.420033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:23.420488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:23.420918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:23.670824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:23.682482 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d1039341-ce71-41cb-9cae-b47f16fdcdda tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.273394 Nov 03 04:27:23.682482 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3047/5975] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:23 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:24.707781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:24.708466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:24.723523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:24.723523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:24.723523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:24.723523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:24.723523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:24.723523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:24.880546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a9fe0d8b-549e-45fe-ae1f-cef9fe471543 req-e7b2a6c6-63cf-4df4-9556-ab9758db797a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243291ef-d622-4c90-98e6-e328b9720dd9", "tag": "41c8e375-6d21-40ba-a0d9-a10028133dcd"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:27:24.906708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a9fe0d8b-549e-45fe-ae1f-cef9fe471543 req-e7b2a6c6-63cf-4df4-9556-ab9758db797a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:24.907085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a9fe0d8b-549e-45fe-ae1f-cef9fe471543 req-e7b2a6c6-63cf-4df4-9556-ab9758db797a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:24.916764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a9fe0d8b-549e-45fe-ae1f-cef9fe471543 req-e7b2a6c6-63cf-4df4-9556-ab9758db797a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:24.930642 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a9fe0d8b-549e-45fe-ae1f-cef9fe471543 req-e7b2a6c6-63cf-4df4-9556-ab9758db797a service nova] Creating event network-changed:41c8e375-6d21-40ba-a0d9-a10028133dcd for instance 243291ef-d622-4c90-98e6-e328b9720dd9 on n-h2-854653-7 Nov 03 04:27:24.936707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a9fe0d8b-549e-45fe-ae1f-cef9fe471543 req-e7b2a6c6-63cf-4df4-9556-ab9758db797a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320542 Nov 03 04:27:24.937854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2929/5976] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:27:25.048056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:25.061747 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1aec4a20-8554-497e-9ef9-85f2c205499c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.357168 Nov 03 04:27:25.071246 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3048/5977] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:24 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:27:26.084832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:26.085733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:26.093957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:26.094531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:26.095042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:26.095823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:26.096286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:26.096716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:26.397041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:26.405767 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50d32952-657a-4398-ab4d-a12309637a32 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.325403 Nov 03 04:27:26.406337 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2930/5978] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:26 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:27.429070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:27.429748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:27.437147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:27.437640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:27.438089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:27.438773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:27.439519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:27.439962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:27.996841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:28.004704 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e7c9ab2-33dc-4833-8e4f-bc37d89efea6 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.579530 Nov 03 04:27:28.005516 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3049/5979] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:27 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:27:29.029172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:29.029798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:29.037051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:29.039007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:29.039007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:29.039431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:29.039894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:29.040338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:29.206023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:29.214605 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f37a3e90-f4bf-481f-b4d4-443954956db1 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.189551 Nov 03 04:27:29.215198 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2931/5980] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:29 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:30.237687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:30.238345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:30.241501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:30.246859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:30.247467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:30.247776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:30.248477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:30.248937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:30.249584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:30.387781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:30.395492 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-098afb13-5454-422d-943d-86dff74bc792 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.161827 Nov 03 04:27:30.396063 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3050/5981] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:30 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:31.179885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:31.180680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:31.187374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:31.189674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:31.195976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.196475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.196924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.198219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.198682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.199117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.231734 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad64ac46-f162-422d-b839-02be8103b5bb tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052772 Nov 03 04:27:31.232348 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2932/5982] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Nov 3 04:27:31 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:31.299668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:31.300388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:31.313421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.313421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.313421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.313421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.313421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.313421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.336402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:27:31.419541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:31.420199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:31.426301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.426909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.427275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.427973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.428433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.428859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.567990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:31.580274 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44c0d0ad-e0f4-4e15-b5b0-025627568e58 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.164607 Nov 03 04:27:31.593907 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2933/5983] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:31 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:27:31.602553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-93b05514-9d8e-4307-8dae-e49c89120531 req-52e474d9-d75d-43ff-aadf-2589572abfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243291ef-d622-4c90-98e6-e328b9720dd9", "name": "network-vif-plugged", "status": "completed", "tag": "41c8e375-6d21-40ba-a0d9-a10028133dcd"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:27:31.613360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93b05514-9d8e-4307-8dae-e49c89120531 req-52e474d9-d75d-43ff-aadf-2589572abfc4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.613849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93b05514-9d8e-4307-8dae-e49c89120531 req-52e474d9-d75d-43ff-aadf-2589572abfc4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.614327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93b05514-9d8e-4307-8dae-e49c89120531 req-52e474d9-d75d-43ff-aadf-2589572abfc4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.626720 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-93b05514-9d8e-4307-8dae-e49c89120531 req-52e474d9-d75d-43ff-aadf-2589572abfc4 service nova] Creating event network-vif-plugged:41c8e375-6d21-40ba-a0d9-a10028133dcd for instance 243291ef-d622-4c90-98e6-e328b9720dd9 on n-h2-854653-7 Nov 03 04:27:31.635723 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-93b05514-9d8e-4307-8dae-e49c89120531 req-52e474d9-d75d-43ff-aadf-2589572abfc4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Nov 03 04:27:31.635723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2934/5984] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:27:31.676499 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-78ae1e33-5e7d-405d-b387-ebf407842659 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 204 len: 0 microversion: 2.20 time: 0.380984 Nov 03 04:27:31.677364 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3051/5985] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:27:31 2022] DELETE /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:27:31.687521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:31.688491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:31.695424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.696095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.696587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:31.698195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:31.698669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:31.699103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:32.016868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:32.020909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:32.026020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:32.027703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:32.028930 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b156b63-9ec9-4c26-b0ea-c2a259e7ab0b tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.346110 Nov 03 04:27:32.029842 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2935/5986] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:27:31 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 03 04:27:32.605870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:32.606590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:32.614020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:32.614552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:32.615521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:32.616238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:32.616702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:32.617198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:32.754794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:32.758570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:32.763995 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d776b89-ed6c-4a52-8bd7-a1ec73ed9b7c tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1313 microversion: 2.1 time: 0.163133 Nov 03 04:27:32.764582 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3052/5987] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:32 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:33.057261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:33.057881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:33.065829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:33.066324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:33.066760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:33.067463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:33.067919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:33.068356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:33.322246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:33.330876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:33.332401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:33.333608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-40eaa91b-5c84-4161-899a-c4c4f130fd84 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1721 microversion: 2.20 time: 0.281008 Nov 03 04:27:33.334182 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2936/5988] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:27:33 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:27:33.789366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:33.789981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:33.798629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:33.799372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:33.799976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:33.801009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:33.801694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:33.802272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:33.979846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:33.990449 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-188b8fc8-a1b7-4d7e-a473-2c15f0b28b97 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1496 microversion: 2.1 time: 0.205696 Nov 03 04:27:33.992992 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3053/5989] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:33 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1496 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:34.346103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e7e8df32-c836-4c80-8fe8-66068a8dcc90 req-77010056-e669-433f-be29-8f3d8a0dfc64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aaced6c-4fb6-4299-aab5-66cfac456794", "name": "network-vif-deleted", "tag": "eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:27:34.360680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:34.361301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:34.379712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:34.381714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:34.381983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:34.384184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:34.388109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:34.390845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:34.393826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e7e8df32-c836-4c80-8fe8-66068a8dcc90 req-77010056-e669-433f-be29-8f3d8a0dfc64 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:34.394317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e7e8df32-c836-4c80-8fe8-66068a8dcc90 req-77010056-e669-433f-be29-8f3d8a0dfc64 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:34.397927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e7e8df32-c836-4c80-8fe8-66068a8dcc90 req-77010056-e669-433f-be29-8f3d8a0dfc64 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:34.437513 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e7e8df32-c836-4c80-8fe8-66068a8dcc90 req-77010056-e669-433f-be29-8f3d8a0dfc64 service nova] Creating event network-vif-deleted:eeb8c814-d3e4-4e21-95a3-e9d4ec3a8b25 for instance 6aaced6c-4fb6-4299-aab5-66cfac456794 on n-h1-854653-7 Nov 03 04:27:34.451438 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e7e8df32-c836-4c80-8fe8-66068a8dcc90 req-77010056-e669-433f-be29-8f3d8a0dfc64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113727 Nov 03 04:27:34.477197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2937/5990] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:27:34.545936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:34.558756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:34.560243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e6a65ca09f54e1eb3e3ee5cc9c7e64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2e39fc670a24c958ef2e52d6dedb2fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:34.565372 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b687006-51aa-49d8-8908-00a5797c08c0 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 200 len: 1653 microversion: 2.20 time: 0.208943 Nov 03 04:27:34.566134 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3054/5991] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:27:34 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 1653 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 03 04:27:35.597308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:35.599469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:35.608839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:35.609971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:35.611313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:35.612562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:35.613488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:35.614691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:35.634419 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] HTTP exception thrown: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Request method failure captured: Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 HTTP/1.1 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0El5ZXBgerY91p46f_bYYCXXRqPFoPy8F8cPP630-UpfdI7uwhjiy7iM1psv1PikzbVL_biMSz-YH0aq4MCjHPGLoSrtxKTncQ_D4wcvhmUfLbkptAwNgiRU-vbrMegfUot8RtjvWDWuNaM5o0VpFNm4v7mTzGaBJlbp0-sJ6Fqd64 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.20 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a2e39fc670a24c958ef2e52d6dedb2fc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a2e39fc670a24c958ef2e52d6dedb2fc"}]}] Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0e6a65ca09f54e1eb3e3ee5cc9c7e64f Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '6aaced6c-4fb6-4299-aab5-66cfac456794'} Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:35.636577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:35.642361 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:35.647868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Returning 404 to user: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:27:35.649118 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7a3877d-a638-49bb-ac8a-359c9abf4a43 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 404 len: 111 microversion: 2.20 time: 0.060093 Nov 03 04:27:35.650306 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2938/5992] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:27:35 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:27:35.661243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7aea5135-a4dc-438e-9b91-aee57ac84a8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '.version_select at 0x7ff7f887ab80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:35.772008 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7aea5135-a4dc-438e-9b91-aee57ac84a8d tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88452943" status: 204 len: 0 microversion: 2.20 time: 0.116649 Nov 03 04:27:35.776728 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3055/5993] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 04:27:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88452943 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 03 04:27:39.371646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:39.372182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:39.378621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:39.380040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:39.380541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:39.380983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:39.381740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:39.382203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:39.382638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:39.413809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:27:39.729802 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0193d0de-ee15-41f6-a53a-e4d8d35b9471 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "DELETE /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 204 len: 0 microversion: 2.1 time: 0.362249 Nov 03 04:27:39.730550 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2939/5994] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:27:39 2022] DELETE /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:27:39.738992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:39.739625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:39.751462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:39.762772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:39.763274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:39.763719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:39.764428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:39.764890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:39.766073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:39.909638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:39.920936 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-43c71145-04a9-433b-ac35-8055421fc5c0 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1502 microversion: 2.1 time: 0.185914 Nov 03 04:27:39.921561 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3056/5995] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:39 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:40.944512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:40.945514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:40.952004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:40.952493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:40.952929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:40.953662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:40.954115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:40.954538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:41.166274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:41.179869 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d5757d58-55d7-46b5-a3fe-36d7fae6d70d tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1502 microversion: 2.1 time: 0.239478 Nov 03 04:27:41.193547 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2940/5996] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:40 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:41.421700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:41.423094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:41.432623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:41.433355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:41.433947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:41.435386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:41.435993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:41.436574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] HTTP exception thrown: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Request method failure captured: Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 HTTP/1.1 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0El5ZXBgerY91p46f_bYYCXXRqPFoPy8F8cPP630-UpfdI7uwhjiy7iM1psv1PikzbVL_biMSz-YH0aq4MCjHPGLoSrtxKTncQ_D4wcvhmUfLbkptAwNgiRU-vbrMegfUot8RtjvWDWuNaM5o0VpFNm4v7mTzGaBJlbp0-sJ6Fqd64 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.20 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a2e39fc670a24c958ef2e52d6dedb2fc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a2e39fc670a24c958ef2e52d6dedb2fc"}]}] Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 0e6a65ca09f54e1eb3e3ee5cc9c7e64f Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '6aaced6c-4fb6-4299-aab5-66cfac456794'} Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:27:41.458583 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.462663 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.465253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Returning 404 to user: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:27:41.466576 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f2ed4dc-4494-4765-b7f5-bf0b5e3a5491 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 404 len: 111 microversion: 2.20 time: 0.048937 Nov 03 04:27:41.467480 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3057/5997] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:27:41 2022] DELETE /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:27:41.475703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:41.476579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: 6aaced6c-4fb6-4299-aab5-66cfac456794] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:41.483093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:41.483804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:41.485029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:41.485452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:41.486075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:41.486663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:41.503681 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] HTTP exception thrown: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Request method failure captured: Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 HTTP/1.1 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0El5ZXBgerY91p46f_bYYCXXRqPFoPy8F8cPP630-UpfdI7uwhjiy7iM1psv1PikzbVL_biMSz-YH0aq4MCjHPGLoSrtxKTncQ_D4wcvhmUfLbkptAwNgiRU-vbrMegfUot8RtjvWDWuNaM5o0VpFNm4v7mTzGaBJlbp0-sJ6Fqd64 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.20 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a2e39fc670a24c958ef2e52d6dedb2fc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a2e39fc670a24c958ef2e52d6dedb2fc"}]}] Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0e6a65ca09f54e1eb3e3ee5cc9c7e64f Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '6aaced6c-4fb6-4299-aab5-66cfac456794'} Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.505798 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Returning 404 to user: Instance 6aaced6c-4fb6-4299-aab5-66cfac456794 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:27:41.515525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-29d5a9e5-7594-4786-b225-8fc3600c5f25 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794" status: 404 len: 111 microversion: 2.20 time: 0.035655 Nov 03 04:27:41.521440 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2941/5998] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:27:41 2022] GET /compute/v2.1/servers/6aaced6c-4fb6-4299-aab5-66cfac456794 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:27:41.825535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-9c317537-8dd5-4264-bb3e-97d3007fa322 req-d03ca7b6-b8e9-4a87-8896-bca5c62c47c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243291ef-d622-4c90-98e6-e328b9720dd9", "name": "network-vif-deleted", "tag": "41c8e375-6d21-40ba-a0d9-a10028133dcd"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:27:41.837605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9c317537-8dd5-4264-bb3e-97d3007fa322 req-d03ca7b6-b8e9-4a87-8896-bca5c62c47c0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:41.838840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9c317537-8dd5-4264-bb3e-97d3007fa322 req-d03ca7b6-b8e9-4a87-8896-bca5c62c47c0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:41.839278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-9c317537-8dd5-4264-bb3e-97d3007fa322 req-d03ca7b6-b8e9-4a87-8896-bca5c62c47c0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:41.862289 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-9c317537-8dd5-4264-bb3e-97d3007fa322 req-d03ca7b6-b8e9-4a87-8896-bca5c62c47c0 service nova] Creating event network-vif-deleted:41c8e375-6d21-40ba-a0d9-a10028133dcd for instance 243291ef-d622-4c90-98e6-e328b9720dd9 on n-h2-854653-7 Nov 03 04:27:41.868173 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-9c317537-8dd5-4264-bb3e-97d3007fa322 req-d03ca7b6-b8e9-4a87-8896-bca5c62c47c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047438 Nov 03 04:27:41.870120 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3058/5999] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:27:42.217826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:42.221192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:42.237366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:42.239912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:42.241121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:42.242108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:42.242887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:42.244807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:42.309120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:42.309853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:42.310492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:42.312144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lazy-loading 'fault' on Instance uuid 243291ef-d622-4c90-98e6-e328b9720dd9 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:27:42.359197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b4e7b7bd1e47bbbff940175aa46ea3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c544123188d3481c97cbf022a90811e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:27:42.370213 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9d85130e-45d0-4aa8-84ad-680d94c5c5d3 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 200 len: 1303 microversion: 2.1 time: 0.168707 Nov 03 04:27:42.371933 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2942/6000] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:42 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:27:43.396928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:43.398278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] [instance: 243291ef-d622-4c90-98e6-e328b9720dd9] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:43.406077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:43.406698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:43.407247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:43.408074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:43.408630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:43.409225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:43.424852 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] HTTP exception thrown: Instance 243291ef-d622-4c90-98e6-e328b9720dd9 could not be found. Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Request method failure captured: Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 HTTP/1.1 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Mkhfujv78CMRNhuRBfApwONcu0-JnQth4uf6kGba6NWGTItffrZVBXoADOpD_DNerpyCLveW9ze5wpA-f-bj2yb_C9wzZ0KfxvBwXCgBP6qXTTI32kYn6gl7FQqQxd_v_vHcY5QgWfMITjFq58xi9j-UWhyAuCUHEK9OgJJe_UyEQ Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: c544123188d3481c97cbf022a90811e8 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesActionsTest-1648242878 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c544123188d3481c97cbf022a90811e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c544123188d3481c97cbf022a90811e8", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c544123188d3481c97cbf022a90811e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c544123188d3481c97cbf022a90811e8"}]}] Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesActionsTest-1648242878 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: c544123188d3481c97cbf022a90811e8 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesActionsTest-1648242878 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesActionsTest-1648242878-project Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 57b4e7b7bd1e47bbbff940175aa46ea3 Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesActionsTest-1648242878-project Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 243291ef-d622-4c90-98e6-e328b9720dd9 could not be found. Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '243291ef-d622-4c90-98e6-e328b9720dd9'} Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243291ef-d622-4c90-98e6-e328b9720dd9 could not be found. Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243291ef-d622-4c90-98e6-e328b9720dd9 could not be found. Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:43.426681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243291ef-d622-4c90-98e6-e328b9720dd9 could not be found. Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] Returning 404 to user: Instance 243291ef-d622-4c90-98e6-e328b9720dd9 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:27:43.433525 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc93f45e-198f-4522-8ade-7729ca195b71 tempest-VolumesActionsTest-1648242878 tempest-VolumesActionsTest-1648242878-project] 10.222.0.30 "GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9" status: 404 len: 111 microversion: 2.1 time: 0.039044 Nov 03 04:27:43.441110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3059/6001] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:27:43 2022] GET /compute/v2.1/servers/243291ef-d622-4c90-98e6-e328b9720dd9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:27:45.001156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:45.001680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:45.008920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:45.009476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:45.009930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:45.010653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:45.011120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:45.011554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:45.027053 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] HTTP exception thrown: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Request method failure captured: Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 HTTP/1.1 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0El5ZXBgerY91p46f_bYYCXXRqPFoPy8F8cPP630-UpfdI7uwhjiy7iM1psv1PikzbVL_biMSz-YH0aq4MCjHPGLoSrtxKTncQ_D4wcvhmUfLbkptAwNgiRU-vbrMegfUot8RtjvWDWuNaM5o0VpFNm4v7mTzGaBJlbp0-sJ6Fqd64 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Openstack-Nova-Api-Version: 2.20 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a2e39fc670a24c958ef2e52d6dedb2fc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a2e39fc670a24c958ef2e52d6dedb2fc"}]}] Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 0e6a65ca09f54e1eb3e3ee5cc9c7e64f Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ca3ffb7c-7bf8-4a22-923a-055c3a5eae15'} Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:27:45.028678 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Returning 404 to user: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f731342e-16f4-4a08-942f-de349f4a5b9f tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 404 len: 111 microversion: 2.20 time: 0.033391 Nov 03 04:27:45.036365 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2943/6002] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Nov 3 04:27:44 2022] DELETE /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:27:45.039268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:45.039800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] [instance: ca3ffb7c-7bf8-4a22-923a-055c3a5eae15] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:45.047037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:45.047530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:45.050429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:45.050429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:45.050429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:45.050429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:45.079713 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] HTTP exception thrown: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Request method failure captured: Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 HTTP/1.1 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0El5ZXBgerY91p46f_bYYCXXRqPFoPy8F8cPP630-UpfdI7uwhjiy7iM1psv1PikzbVL_biMSz-YH0aq4MCjHPGLoSrtxKTncQ_D4wcvhmUfLbkptAwNgiRU-vbrMegfUot8RtjvWDWuNaM5o0VpFNm4v7mTzGaBJlbp0-sJ6Fqd64 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Openstack-Nova-Api-Version: 2.20 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a2e39fc670a24c958ef2e52d6dedb2fc", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a2e39fc670a24c958ef2e52d6dedb2fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a2e39fc670a24c958ef2e52d6dedb2fc"}]}] Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a2e39fc670a24c958ef2e52d6dedb2fc Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-451498403 Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 0e6a65ca09f54e1eb3e3ee5cc9c7e64f Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-451498403-project Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ca3ffb7c-7bf8-4a22-923a-055c3a5eae15'} Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.082959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] Returning 404 to user: Instance ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9516d742-9cad-4b25-86f9-b236bfff1824 tempest-AttachVolumeShelveTestJSON-451498403 tempest-AttachVolumeShelveTestJSON-451498403-project] 10.222.0.30 "GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15" status: 404 len: 111 microversion: 2.20 time: 0.047672 Nov 03 04:27:45.087589 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3060/6003] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Nov 3 04:27:45 2022] GET /compute/v2.1/servers/ca3ffb7c-7bf8-4a22-923a-055c3a5eae15 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:27:58.751105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:27:58.751707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:27:58.754771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:58.804319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:27:58.804319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:58.804319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:58.804319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:58.804319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:27:58.804319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:27:58.804319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:27:58.843890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lazy-loading 'services' on Instance uuid 7590f73f-35cd-47d0-a748-8bf7280a0c7d {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:27:59.214998 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c0ba82f1-caaa-4b35-a4b1-f4a8bdf35805 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-volume_attachments/ac251c4a-a2b4-47a1-b6b7-9bafdfaa0be1" status: 202 len: 0 microversion: 2.1 time: 0.467963 Nov 03 04:27:59.215602 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2944/6004] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:27:58 2022] DELETE /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-volume_attachments/ac251c4a-a2b4-47a1-b6b7-9bafdfaa0be1 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:28:06.113849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eeacfab4-4f75-495f-a98c-38ecc3a3a235 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:28:06.117520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:06.121203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=26 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:06.123614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeacfab4-4f75-495f-a98c-38ecc3a3a235 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:06.124112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeacfab4-4f75-495f-a98c-38ecc3a3a235 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:06.124561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeacfab4-4f75-495f-a98c-38ecc3a3a235 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:06.148882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eeacfab4-4f75-495f-a98c-38ecc3a3a235 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Going to try to stop instance {{(pid=127594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 04:28:06.328277 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eeacfab4-4f75-495f-a98c-38ecc3a3a235 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action" status: 202 len: 0 microversion: 2.1 time: 0.219612 Nov 03 04:28:06.328886 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3061/6005] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:28:06 2022] POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:28:06.345832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:06.346608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:06.356523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:06.357241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:06.357862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:06.358719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:06.359330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:06.359912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:06.520648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:06.529636 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd24fca2-b0c4-4529-aebd-a8c5658b8569 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.193536 Nov 03 04:28:06.530618 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2945/6006] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:06 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:07.557740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:07.558378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:07.566409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:07.566895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:07.567513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:07.568234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:07.568692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:07.569149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:07.905703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:07.915726 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2830196e-10ec-456c-8ac8-bdfb8ec6c2f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.363943 Nov 03 04:28:07.917043 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3062/6007] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:07 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:08.941444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:08.942150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:08.950321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:08.950832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:08.951354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:08.952230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:08.952723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:08.953288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:09.196673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:09.205695 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-08b25750-fb12-4d6c-bf86-ca55c9629d69 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.269761 Nov 03 04:28:09.206281 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2946/6008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:08 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:10.229054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:10.230330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:10.237762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:10.238184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:10.238636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:10.239351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:10.239816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:10.240296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:10.436889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:10.448166 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-744e1dce-ef86-4b46-bc74-4f9fdefc7813 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.223123 Nov 03 04:28:10.449316 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3063/6009] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:10 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:11.475429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:11.476657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:11.490739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:11.495334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:11.496063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:11.499090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:11.499639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:11.500121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:11.895802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:11.905309 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06c929f3-39b4-4d74-93c3-ecc35771658c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.434017 Nov 03 04:28:11.906069 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2947/6010] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:11 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:12.936374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:12.936374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:12.957421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:12.958321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:12.958844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:12.959609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:12.960224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:12.960944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:13.145204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:13.176086 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec3691b9-0334-4ec7-973f-0abc8f955ec4 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.242812 Nov 03 04:28:13.183309 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3064/6011] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:12 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:14.206701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:14.210123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:14.226359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:14.231060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:14.232507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:14.240123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:14.240826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:14.241868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:14.533809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:14.547431 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f92ea820-94ac-496c-a75a-88ea85ea19ee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.346036 Nov 03 04:28:14.548349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2948/6012] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:14 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:15.571838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:15.575154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:15.590962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:15.596485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:15.596485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:15.596485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:15.596485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:15.596485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:15.841937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:15.850358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7c3a5d6-a025-448d-a23b-0c96027972f1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1677 microversion: 2.1 time: 0.283122 Nov 03 04:28:15.869108 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3065/6013] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:15 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1677 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:16.884078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:16.884078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:16.888233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:16.888934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:16.889618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:16.891168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:16.891627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:16.892251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:17.543631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:17.551110 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36e99762-30d6-4368-a220-0d38aef68a14 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1654 microversion: 2.1 time: 0.678833 Nov 03 04:28:17.565490 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2949/6014] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:16 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1654 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:17.577460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd73ebf7-eac2-4b96-9037-c5f15aa31d04 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:28:17.590403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd73ebf7-eac2-4b96-9037-c5f15aa31d04 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:17.590910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd73ebf7-eac2-4b96-9037-c5f15aa31d04 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:17.591351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd73ebf7-eac2-4b96-9037-c5f15aa31d04 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:17.627553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd73ebf7-eac2-4b96-9037-c5f15aa31d04 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Going to try to start instance {{(pid=127594) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 03 04:28:17.836333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd73ebf7-eac2-4b96-9037-c5f15aa31d04 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action" status: 202 len: 0 microversion: 2.1 time: 0.263747 Nov 03 04:28:17.837566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3066/6015] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:28:17 2022] POST /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:28:17.846053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:17.846688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:17.859800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:17.860317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:17.861356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:17.862392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:17.863010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:17.863594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:18.234572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:18.246625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-683a5b02-58bf-4d30-a528-7123b1031cc0 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1663 microversion: 2.1 time: 0.404409 Nov 03 04:28:18.247387 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2950/6016] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:17 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1663 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:19.272643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:19.273390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:19.292584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:19.293122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:19.293581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:19.294309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:19.294779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:19.295216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:19.501308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:19.511270 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-edb311d1-4a16-48a4-8291-ec0f89bbef1f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1663 microversion: 2.1 time: 0.243716 Nov 03 04:28:19.512174 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3067/6017] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:19 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1663 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:20.539696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:20.540315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:20.547870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:20.548519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:20.549863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:20.550882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:20.551502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:20.552098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:20.713503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:20.723466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44fc96b4-f9a0-4309-8e92-3b523e305742 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1667 microversion: 2.1 time: 0.187794 Nov 03 04:28:20.724075 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2951/6018] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:20 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1667 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:24.438308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Calling method '.version_select at 0x7ff7f882faf0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:24.440091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:24.440605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:24.441072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:24.455668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:24.456150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:24.456591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:24.467268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:24.467754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:24.468197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:24.476354 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-733b2d7a-6365-4d99-b58b-226c10508e41 tempest-PortsAdminExtendedAttrsTestJSON-327370353 tempest-PortsAdminExtendedAttrsTestJSON-327370353-project-admin] 10.222.0.30 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.226485 Nov 03 04:28:24.478769 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3068/6019] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 04:28:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:28:29.556356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1223836694", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:28:29.612771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:28:30.048021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:28:30.048445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:28:30.049129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:28:30.049706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:28:30.050158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:28:30.060283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:30.063630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:30.063630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:30.063630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:30.063630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:30.063630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:30.081152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Getting quotas for project 0cb262fe52614964bc5459c71f5f7c02. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:28:30.087802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Getting quotas for user 7c7d672530544542b957a28035939525 and project 0cb262fe52614964bc5459c71f5f7c02. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:28:30.101142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:28:30.104464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:28:30.459905 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a688f4bc-ee54-455a-a053-98e7f9383e57 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907592 Nov 03 04:28:30.461333 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2952/6020] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:28:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:28:30.473160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d234e3e-7b87-4442-8a8e-7bcf96011e7b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:30.473777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d234e3e-7b87-4442-8a8e-7bcf96011e7b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:30.559106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3d234e3e-7b87-4442-8a8e-7bcf96011e7b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:30.571663 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d234e3e-7b87-4442-8a8e-7bcf96011e7b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1214 microversion: 2.1 time: 0.102576 Nov 03 04:28:30.573045 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3069/6021] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:30 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:31.596341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e3cda52a-5dce-401b-8f2f-905f8ce6cf22 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:31.596966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e3cda52a-5dce-401b-8f2f-905f8ce6cf22 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:31.682974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3cda52a-5dce-401b-8f2f-905f8ce6cf22 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:31.692077 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e3cda52a-5dce-401b-8f2f-905f8ce6cf22 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1214 microversion: 2.1 time: 0.100466 Nov 03 04:28:31.693129 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2953/6022] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:31 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:32.715186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:32.716354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:32.728750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:32.730177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:32.730624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:32.731612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:32.732244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:32.732833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:32.826017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:32.834815 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0aaf7693-cd5f-4391-a6b2-32622dc20b09 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1266 microversion: 2.1 time: 0.124218 Nov 03 04:28:32.837401 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3070/6023] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:32 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:33.865430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:33.866062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:33.874451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:33.875309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:33.875812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:33.884049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:33.884049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:33.884049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:33.969561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:33.979304 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac2bf090-b573-44e4-a290-e410d2b94c0c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1272 microversion: 2.1 time: 0.117235 Nov 03 04:28:33.979903 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2954/6024] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:33 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:35.002424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:35.003192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:35.018694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:35.019200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:35.019650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:35.020373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:35.020836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:35.021299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:35.425493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:35.439037 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71457f77-72b9-4d4b-a74d-01db5d113bd5 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.440133 Nov 03 04:28:35.445683 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3071/6025] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:34 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:36.433889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c26ab6a9-c537-43be-9272-0e54fbfeef41 req-d27895ab-4fe7-4e5f-bd7b-511793a8811a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd604c0e-6859-477d-94d4-54faa7bd4f8e", "tag": "cda3b015-da5a-4b5b-affc-8cb382c45de8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:28:36.448846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:36.455572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c26ab6a9-c537-43be-9272-0e54fbfeef41 req-d27895ab-4fe7-4e5f-bd7b-511793a8811a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:36.456551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c26ab6a9-c537-43be-9272-0e54fbfeef41 req-d27895ab-4fe7-4e5f-bd7b-511793a8811a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:36.457002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c26ab6a9-c537-43be-9272-0e54fbfeef41 req-d27895ab-4fe7-4e5f-bd7b-511793a8811a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:36.465320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:36.472671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:36.474082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:36.475669 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c26ab6a9-c537-43be-9272-0e54fbfeef41 req-d27895ab-4fe7-4e5f-bd7b-511793a8811a service nova] Creating event network-changed:cda3b015-da5a-4b5b-affc-8cb382c45de8 for instance dd604c0e-6859-477d-94d4-54faa7bd4f8e on n-h1-854653-7 Nov 03 04:28:36.481570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:36.482065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:36.482836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:36.483313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:36.483749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:36.485725 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c26ab6a9-c537-43be-9272-0e54fbfeef41 req-d27895ab-4fe7-4e5f-bd7b-511793a8811a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056295 Nov 03 04:28:36.486817 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2955/6026] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:28:36.820276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:36.830580 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-76036d39-dfb3-427c-b177-57c9cb769cb6 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.369073 Nov 03 04:28:36.832609 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3072/6027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:36 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:28:37.863285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:37.863285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:37.869887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:37.870562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:37.871097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:37.871970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:37.872608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:37.873063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:38.087635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:38.100879 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e2e9df3-fbad-49fc-b8d7-85aedcae006d tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.248852 Nov 03 04:28:38.103596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2956/6028] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:37 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:39.129357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:39.129998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:39.132884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=29 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:39.138344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:39.138935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:39.139452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:39.140347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:39.140974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:39.141593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:39.145675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:39.289222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:39.297885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f4693b3-483a-4454-b601-ed059630873c tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.172545 Nov 03 04:28:39.299038 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3073/6029] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:39 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:40.322737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:40.325226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:40.327794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:40.333901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:40.334640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:40.335324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:40.336245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:40.336888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:40.337341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:40.345921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:40.546383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:40.556026 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e0f73a5-84e8-4646-a503-3ff3594d5760 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.237814 Nov 03 04:28:40.556706 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2957/6030] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:40 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:41.579563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:41.585866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:41.585866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:41.589227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:41.589715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:41.590152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:41.590898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:41.591359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:41.591783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:41.744649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:41.752412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec930928-5761-4599-b19f-a18842d13108 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.177115 Nov 03 04:28:41.752983 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3074/6031] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:41 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:42.778531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:42.779936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:42.788887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:28:42.790022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:42.790710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:42.791208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:42.791920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:42.792538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:42.793161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:42.998665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:43.009271 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7796d9dc-20f7-4d6a-ba7b-de098c5baa8e tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.236797 Nov 03 04:28:43.010526 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2958/6032] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:42 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:43.071868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-17d1462d-d1e7-494e-bd5f-80860d23a298 req-f7ee74b3-2556-4903-9d7f-21c313a0b076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd604c0e-6859-477d-94d4-54faa7bd4f8e", "name": "network-vif-plugged", "status": "completed", "tag": "cda3b015-da5a-4b5b-affc-8cb382c45de8"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:28:43.082400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-17d1462d-d1e7-494e-bd5f-80860d23a298 req-f7ee74b3-2556-4903-9d7f-21c313a0b076 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:43.082879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-17d1462d-d1e7-494e-bd5f-80860d23a298 req-f7ee74b3-2556-4903-9d7f-21c313a0b076 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:43.083318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-17d1462d-d1e7-494e-bd5f-80860d23a298 req-f7ee74b3-2556-4903-9d7f-21c313a0b076 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:43.094502 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-17d1462d-d1e7-494e-bd5f-80860d23a298 req-f7ee74b3-2556-4903-9d7f-21c313a0b076 service nova] Creating event network-vif-plugged:cda3b015-da5a-4b5b-affc-8cb382c45de8 for instance dd604c0e-6859-477d-94d4-54faa7bd4f8e on n-h1-854653-7 Nov 03 04:28:43.099532 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-17d1462d-d1e7-494e-bd5f-80860d23a298 req-f7ee74b3-2556-4903-9d7f-21c313a0b076 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220814 Nov 03 04:28:43.100116 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3075/6033] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:28:44.033345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:44.041977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:44.045158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:44.045683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:44.046135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:44.046885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:44.047471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:44.048004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:44.188615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:44.196465 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-495a1098-b48a-495b-b387-e9b05703303b tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1314 microversion: 2.1 time: 0.167452 Nov 03 04:28:44.197652 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2959/6034] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:44 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:45.221820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:45.222541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:45.232281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:45.232506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:45.233156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:45.233871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:45.234377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:45.234762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:45.496964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:45.505310 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69a8fc22-b813-440d-810e-332e92da6916 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1463 microversion: 2.1 time: 0.288795 Nov 03 04:28:45.505906 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3076/6035] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:45 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1463 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:45.528987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c34451bc-0f73-40b2-ad09-f4be2b01a19b", "device": "/dev/sdb"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:28:45.531470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:45.538317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:45.538821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:45.539239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:45.539929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:45.546928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:45.546928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:46.228164 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-47fee866-3ed1-4dfc-b570-93595ad7e203 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "POST /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703514 Nov 03 04:28:46.235607 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2960/6036] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:28:45 2022] POST /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e/os-volume_attachments => generated 194 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:28:53.473280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:53.475619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:53.482303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:53.482799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:53.483249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:53.483957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:53.484420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:53.484851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:53.519095 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc69d8d1-2aa7-467b-9555-657ed4c19edd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049834 Nov 03 04:28:53.519879 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3077/6037] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:28:53 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:28:53.588769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:53.589402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:53.596059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:53.596562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:53.597006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:53.597769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:53.598233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:53.598671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:53.626970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:28:53.935092 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-138c7718-1a18-4694-a293-bbd94635e33f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 204 len: 0 microversion: 2.1 time: 0.352046 Nov 03 04:28:53.937316 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2961/6038] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:28:53 2022] DELETE /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:28:53.944341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:53.945205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:53.952329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:53.953150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:53.953769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:53.954491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:53.954957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:53.955412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:54.111796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:54.120600 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9edaf564-8945-488b-95f9-82daa8b80b62 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1673 microversion: 2.1 time: 0.180156 Nov 03 04:28:54.133250 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3078/6039] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:53 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:55.152458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:55.154176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:55.162168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:55.163198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:55.163963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:55.165131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:55.165957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:55.166585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:55.385925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:55.396036 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d253b9e5-c26a-4e2c-8fa0-df8e6ff461d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1673 microversion: 2.1 time: 0.253278 Nov 03 04:28:55.397622 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2962/6040] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:55 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:56.426494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:56.427305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:56.443635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:56.444151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:56.444640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:56.449670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:56.450186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:56.450634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:56.759704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:56.771024 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-830ce5c7-ff9b-45b2-87fa-bc7283b68f6c tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1673 microversion: 2.1 time: 0.350685 Nov 03 04:28:56.772217 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3079/6041] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:56 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1673 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:28:57.468646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4f966494-37c2-48bc-8388-6e5d8f8ca7d8 req-fd526cc7-5a69-441a-8609-4fc825b304b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7590f73f-35cd-47d0-a748-8bf7280a0c7d", "name": "network-vif-deleted", "tag": "0a99884e-1c93-44f2-8c01-90610ae02c19"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:28:57.479848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f966494-37c2-48bc-8388-6e5d8f8ca7d8 req-fd526cc7-5a69-441a-8609-4fc825b304b7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:57.483524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f966494-37c2-48bc-8388-6e5d8f8ca7d8 req-fd526cc7-5a69-441a-8609-4fc825b304b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:57.483524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f966494-37c2-48bc-8388-6e5d8f8ca7d8 req-fd526cc7-5a69-441a-8609-4fc825b304b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:57.506174 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4f966494-37c2-48bc-8388-6e5d8f8ca7d8 req-fd526cc7-5a69-441a-8609-4fc825b304b7 service nova] Creating event network-vif-deleted:0a99884e-1c93-44f2-8c01-90610ae02c19 for instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d on n-h2-854653-7 Nov 03 04:28:57.523659 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4f966494-37c2-48bc-8388-6e5d8f8ca7d8 req-fd526cc7-5a69-441a-8609-4fc825b304b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058727 Nov 03 04:28:57.526175 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2963/6042] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:28:57.798168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:57.798858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:57.806211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:57.806703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:57.807384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:57.808236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:57.808861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:57.809766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:57.845652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:57.846138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:57.846831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:57.847485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lazy-loading 'fault' on Instance uuid 7590f73f-35cd-47d0-a748-8bf7280a0c7d {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:28:57.892870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:28:57.926100 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-399050ad-4074-4bef-aa09-a3d2d94716fd tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 200 len: 1326 microversion: 2.1 time: 0.133251 Nov 03 04:28:57.927580 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3080/6043] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:57 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:28:58.957657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:58.958568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:28:58.973872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:58.977161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:58.979438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:58.982962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:28:58.983552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:28:58.992060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:28:59.041448 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] HTTP exception thrown: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Request method failure captured: Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d HTTP/1.1 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0LFJM2UwUkOxLUgEMfGwMUIC-3Iy-3WmUnf_OrpKp5fSXpWWYIyKaJ0ns-85Gy1UaBIyCw8XIOtlMkDFZ0CnSQlFYCTQQmJCxqDx7mQ56oXcBCGhqK51_NxB3KVkkjbHvXuXn8RqKsh9mOLg3PY2iDS8we1ihs5VwwwdfGpyd98_2U Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e1da15001cf94302ab8effa988b31db6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e1da15001cf94302ab8effa988b31db6"}]}] Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a81a3d829ca245ae88387ed7e8839d1b Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7590f73f-35cd-47d0-a748-8bf7280a0c7d'} Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:28:59.047323 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:28:59.052228 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:28:59.052228 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:28:59.052228 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:28:59.052228 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:28:59.052228 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:28:59.052228 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:28:59.052228 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:28:59.053102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Returning 404 to user: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:28:59.055103 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2bc5e5f1-7d79-4e15-9eb2-1762c08a80ca tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 404 len: 111 microversion: 2.1 time: 0.101489 Nov 03 04:28:59.057653 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2964/6044] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:28:58 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:28:59.065985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8ab3da2-b0af-4cfa-85a0-7fcf5b15f9cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '.version_select at 0x7ff7fd673c10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:28:59.218340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8ab3da2-b0af-4cfa-85a0-7fcf5b15f9cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-111786986" status: 202 len: 0 microversion: 2.1 time: 0.156596 Nov 03 04:28:59.222745 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3081/6045] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 04:28:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-111786986 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:29:00.573547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac450c3a-5311-42c2-acbc-83c5cac8db46 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'create', calling method: .version_select at 0x7ff7fd658550>, body: {"keypair": {"name": "tempest-keypair-143993083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGy4T4hSerVHEo5Tem2rN/zegxF7a9sBi8hjUh203QNvcMNRdXBeYI5l7G3Fben8yRdUX1Ki6z398t9SqexIZ9hPHZb7FMKeYnpLQTeT/rU9r8lHODTAe4V9YIIRI1gEA=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:29:00.614120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ac450c3a-5311-42c2-acbc-83c5cac8db46 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for project e1da15001cf94302ab8effa988b31db6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:29:00.632667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-ac450c3a-5311-42c2-acbc-83c5cac8db46 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for user a81a3d829ca245ae88387ed7e8839d1b and project e1da15001cf94302ab8effa988b31db6. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:29:00.733904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac450c3a-5311-42c2-acbc-83c5cac8db46 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165178 Nov 03 04:29:00.735480 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2965/6046] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:29:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:29:05.471452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-183169914", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "249e8b9e-956a-4ad7-b692-1fe379ef3734"}], "security_groups": [{"name": "tempest-securitygroup--1750584945"}], "key_name": "tempest-keypair-143993083", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:29:05.797927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] validate_networks() for [('249e8b9e-956a-4ad7-b692-1fe379ef3734', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:29:06.597092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:29:06.597896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:29:06.598034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:29:06.598680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:29:06.599103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:29:06.613370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:06.613868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:06.614483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:06.615221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:06.615686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:06.616123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:06.639268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for project e1da15001cf94302ab8effa988b31db6. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:29:06.644562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Getting quotas for user a81a3d829ca245ae88387ed7e8839d1b and project e1da15001cf94302ab8effa988b31db6. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:29:06.657872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:29:06.660233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:29:06.836560 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [9d7458c6-7cc0-4617-8d65-c61ff10c0f25] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:29:07.851468 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [9d7458c6-7cc0-4617-8d65-c61ff10c0f25] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 42840. Nov 03 04:29:07.879570 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a709b42-aa69-49d5-93ec-a77892336e60 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.413383 Nov 03 04:29:07.881071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3082/6047] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:29:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:29:07.903795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-575ed566-e439-4d62-b703-b8f83a737124 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:07.904875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-575ed566-e439-4d62-b703-b8f83a737124 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:08.112578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-575ed566-e439-4d62-b703-b8f83a737124 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:08.133291 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-575ed566-e439-4d62-b703-b8f83a737124 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1236 microversion: 2.1 time: 0.244821 Nov 03 04:29:08.136064 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2966/6048] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:07 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1236 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:09.159305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8c78c17-41d0-4a21-a901-83558dce2172 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:09.160599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8c78c17-41d0-4a21-a901-83558dce2172 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:09.238178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f8c78c17-41d0-4a21-a901-83558dce2172 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:09.247382 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8c78c17-41d0-4a21-a901-83558dce2172 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1236 microversion: 2.1 time: 0.092684 Nov 03 04:29:09.255031 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3083/6049] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:09 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:29:10.272782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:10.273620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:10.277348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:29:10.288435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:10.289640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:10.290683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:10.291600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:10.292428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:10.293571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:10.429461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:10.445075 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-773db287-34e0-4b48-a425-135ce55e6f8f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1288 microversion: 2.1 time: 0.175505 Nov 03 04:29:10.446639 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2967/6050] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:10 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1288 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:11.470021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:11.474351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:11.481990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:11.482730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:11.483354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:11.484331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:11.484548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:11.485041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:11.552904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:11.566680 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8249fe5-e063-41dc-9c10-d6913b4f4fed tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1306 microversion: 2.1 time: 0.095760 Nov 03 04:29:11.566680 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3084/6051] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:11 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:12.587706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:12.589627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:12.597793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:29:12.616501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:12.621081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:12.621657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:12.623110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:12.625196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:12.626530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:12.942055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:12.963006 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9eb5850-e355-4399-aeeb-483234ebf0af tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.381383 Nov 03 04:29:12.978978 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2968/6052] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:12 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:13.995133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:13.997470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:14.005704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:29:14.008684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:14.009245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:14.009699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:14.010472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:14.010941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:14.011378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:14.269362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:14.290105 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c97b391a-859a-4c8c-b070-9b621af26809 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.299826 Nov 03 04:29:14.292190 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3085/6053] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:13 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:14.440853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-75e050d7-63fa-46c9-a2d0-147b5bbf2e84 req-81a6f9f0-1ed5-443c-9873-d87557c082a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a", "tag": "3ecc1ed2-5268-4219-ab7d-56fdea373259"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:29:14.453629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-75e050d7-63fa-46c9-a2d0-147b5bbf2e84 req-81a6f9f0-1ed5-443c-9873-d87557c082a6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:14.456382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-75e050d7-63fa-46c9-a2d0-147b5bbf2e84 req-81a6f9f0-1ed5-443c-9873-d87557c082a6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:14.456382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-75e050d7-63fa-46c9-a2d0-147b5bbf2e84 req-81a6f9f0-1ed5-443c-9873-d87557c082a6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:14.474195 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-75e050d7-63fa-46c9-a2d0-147b5bbf2e84 req-81a6f9f0-1ed5-443c-9873-d87557c082a6 service nova] Creating event network-changed:3ecc1ed2-5268-4219-ab7d-56fdea373259 for instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a on n-h2-854653-7 Nov 03 04:29:14.500806 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-75e050d7-63fa-46c9-a2d0-147b5bbf2e84 req-81a6f9f0-1ed5-443c-9873-d87557c082a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050760 Nov 03 04:29:14.502568 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2969/6054] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:29:15.313955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:15.315575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:15.328028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:15.338163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:15.338650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:15.339513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:15.340143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:15.340573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:15.347858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=60 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:29:15.696063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:15.708620 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-da33651c-2783-403f-87da-764f5de5df94 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.398345 Nov 03 04:29:15.712782 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3086/6055] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:15 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:16.738791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:16.740081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:16.752121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:16.752617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:16.753086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:16.753801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:16.754258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:16.754859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:16.930030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:16.939102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73c20333-fc07-412b-bf97-67050aa21e51 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.205503 Nov 03 04:29:16.939690 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2970/6056] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:16 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:17.963516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:17.964272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:17.967103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:29:17.990581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:17.991092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:17.991550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:17.992282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:17.992753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:17.995498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:18.266892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:18.285273 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f59a7199-13fc-4409-8a51-c00174bb4706 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.326155 Nov 03 04:29:18.286097 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3087/6057] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:17 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:19.309646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:19.310267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:19.314904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:29:19.318772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:19.319322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:19.319775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:19.320481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:19.320943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:19.321405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:19.475504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:19.493322 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5413e8e4-470a-494d-8712-9665ad6936bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.188163 Nov 03 04:29:19.494256 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2971/6058] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:19 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:20.518173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:20.519500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:20.524162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:29:20.530412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:20.531769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:20.532371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:20.533396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:20.534096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:20.535099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:20.751539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:20.766023 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd3ad622-f19e-4468-b46a-9f0426cde08e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.252103 Nov 03 04:29:20.787352 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3088/6059] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:20 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:29:21.801351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:21.803382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:21.816447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:21.818411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:21.819288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:21.835597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:21.836281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:21.836903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:22.001906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-496565c9-d80f-47be-b6de-29293be42c69 req-7ce94688-1d09-4033-88b8-5353cf106b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a", "name": "network-vif-plugged", "status": "completed", "tag": "3ecc1ed2-5268-4219-ab7d-56fdea373259"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:29:22.016112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-496565c9-d80f-47be-b6de-29293be42c69 req-7ce94688-1d09-4033-88b8-5353cf106b6a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:22.016965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-496565c9-d80f-47be-b6de-29293be42c69 req-7ce94688-1d09-4033-88b8-5353cf106b6a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:22.017649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-496565c9-d80f-47be-b6de-29293be42c69 req-7ce94688-1d09-4033-88b8-5353cf106b6a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:22.033260 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-496565c9-d80f-47be-b6de-29293be42c69 req-7ce94688-1d09-4033-88b8-5353cf106b6a service nova] Creating event network-vif-plugged:3ecc1ed2-5268-4219-ab7d-56fdea373259 for instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a on n-h2-854653-7 Nov 03 04:29:22.038973 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-496565c9-d80f-47be-b6de-29293be42c69 req-7ce94688-1d09-4033-88b8-5353cf106b6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045198 Nov 03 04:29:22.040164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3089/6060] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:29:22.096359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:22.105779 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1fac71d2-f798-4af9-9343-84cc246fbcea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.318083 Nov 03 04:29:22.121557 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2972/6061] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:21 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:23.130580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:23.131936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:23.139533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:23.140093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:23.140716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:23.141629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:23.142097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:23.142530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:23.485484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:23.492781 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4608035a-f83b-458f-bbbd-e22a072d95b6 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1362 microversion: 2.1 time: 0.366033 Nov 03 04:29:23.493425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3090/6062] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:23 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:24.517002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:24.518360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:24.526948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:24.527889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:24.528564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:24.529531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:24.530215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:24.530841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:24.722558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:29:24.732525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8567bacb-1d06-44a3-8050-235eae6736d1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1549 microversion: 2.1 time: 0.219374 Nov 03 04:29:24.737338 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2973/6063] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:29:24 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1549 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:29:24.762182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:29:24.762683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:29:24.771882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:24.772372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:24.772816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:24.773553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:24.774013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:24.774431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:24.914435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee57da4c-edf5-4890-9eaf-8517348e3da8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156142 Nov 03 04:29:24.921363 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3091/6064] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:29:24 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:29:27.447385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c3c99887-fcf2-413b-a75f-bca28252d836 req-bb495297-763f-4fc0-a70b-3b50648c4e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a", "tag": "3ecc1ed2-5268-4219-ab7d-56fdea373259"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:29:27.467168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c3c99887-fcf2-413b-a75f-bca28252d836 req-bb495297-763f-4fc0-a70b-3b50648c4e6b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:29:27.468233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c3c99887-fcf2-413b-a75f-bca28252d836 req-bb495297-763f-4fc0-a70b-3b50648c4e6b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:29:27.468676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c3c99887-fcf2-413b-a75f-bca28252d836 req-bb495297-763f-4fc0-a70b-3b50648c4e6b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:29:27.491930 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c3c99887-fcf2-413b-a75f-bca28252d836 req-bb495297-763f-4fc0-a70b-3b50648c4e6b service nova] Creating event network-changed:3ecc1ed2-5268-4219-ab7d-56fdea373259 for instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a on n-h2-854653-7 Nov 03 04:29:27.501211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c3c99887-fcf2-413b-a75f-bca28252d836 req-bb495297-763f-4fc0-a70b-3b50648c4e6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057523 Nov 03 04:29:27.502151 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2974/6065] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:04.477479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=13 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:04.478437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=29 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:04.482874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:04.487892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:04.489563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:04.491164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:04.491612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:04.492325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:04.492798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:04.493299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:04.520730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0388e285-2ccf-4ec6-8cda-55fef0ff9de3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/ips" status: 200 len: 146 microversion: 2.1 time: 0.045145 Nov 03 04:30:04.523350 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3092/6066] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:30:04 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:07.483521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=13 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:07.484326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=40 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:07.489031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "562135db-4571-4a62-a3ce-c50d8e9ef912"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:30:07.491619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:07.500739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:07.500739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:07.500739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:07.501315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:07.501896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:07.502196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:08.585374 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a635f7f-7586-4bef-8bce-16a5afce8bee tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.102262 Nov 03 04:30:08.588774 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2975/6067] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:30:07 2022] POST /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments => generated 194 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:21.958399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:21.960852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:21.965337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:21.972320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:21.973002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:21.977712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:21.977712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:21.977712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:21.977712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:22.012474 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a0cb3120-568a-4c5b-9959-c500a0b49fd9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058125 Nov 03 04:30:22.013074 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3093/6068] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:30:21 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:22.022041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:22.022843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:22.027790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:22.028387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:22.034918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:22.035012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:22.035418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:22.036120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:22.036756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:22.037235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:22.067186 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c14f3b1a-6545-46e0-8255-bba2cb258a72 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/562135db-4571-4a62-a3ce-c50d8e9ef912" status: 200 len: 194 microversion: 2.1 time: 0.046866 Nov 03 04:30:22.067655 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2976/6069] 10.222.0.30 () {58 vars in 1413 bytes} [Thu Nov 3 04:30:22 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/562135db-4571-4a62-a3ce-c50d8e9ef912 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:24.890775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26f0c3ce-1986-46cd-aa5a-5e9798b277ac"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:30:24.893402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:24.908038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:24.908755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:24.909457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:24.910431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:24.911042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:24.911621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:25.747526 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c724b0b-aa96-4bf4-b655-0a85702e9fba tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "POST /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.869025 Nov 03 04:30:25.748449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3094/6070] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:30:24 2022] POST /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:37.939218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:37.942031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:37.951476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:37.954459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:37.954459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:37.954459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:37.954459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:37.954459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:37.995911 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61e8a639-2cd4-40e7-bb82-77de59bcc7ea tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061881 Nov 03 04:30:38.002272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2977/6071] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:30:37 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:38.151785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:38.153685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:30:38.157372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:38.157967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:38.163988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:38.164482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:38.164934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:38.165670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:38.166134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:38.166571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:38.196084 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-930cd1a0-824a-43e7-a86e-3ab9defb51d9 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/562135db-4571-4a62-a3ce-c50d8e9ef912" status: 200 len: 194 microversion: 2.1 time: 0.046120 Nov 03 04:30:38.196666 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3095/6072] 10.222.0.30 () {58 vars in 1413 bytes} [Thu Nov 3 04:30:38 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/562135db-4571-4a62-a3ce-c50d8e9ef912 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:38.209109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:38.209460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:38.219417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:38.220046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:38.220145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:38.221006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:38.221587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:38.222004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:38.312099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lazy-loading 'services' on Instance uuid e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:30:38.525871 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f8cfac10-0b04-4915-a012-0d6361a4acdc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/562135db-4571-4a62-a3ce-c50d8e9ef912" status: 202 len: 0 microversion: 2.1 time: 0.322509 Nov 03 04:30:38.530097 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2978/6073] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:30:38 2022] DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/562135db-4571-4a62-a3ce-c50d8e9ef912 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:30:38.765119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:38.765627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:38.772783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:38.773301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:38.773750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:38.774471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:38.774936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:38.775386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:38.859360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lazy-loading 'services' on Instance uuid dd604c0e-6859-477d-94d4-54faa7bd4f8e {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:30:39.118363 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45853793-ad8d-4577-a242-de82301a4065 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e/os-volume_attachments/c34451bc-0f73-40b2-ad09-f4be2b01a19b" status: 202 len: 0 microversion: 2.1 time: 0.356998 Nov 03 04:30:39.119105 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3096/6074] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:30:38 2022] DELETE /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e/os-volume_attachments/c34451bc-0f73-40b2-ad09-f4be2b01a19b => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:30:43.604211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:43.604794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:43.612655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:43.613459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:43.614360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:43.615066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:43.615519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:43.615937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:43.649234 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8202dc9c-e4c9-47d5-8032-73a83f8a1a24 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/26f0c3ce-1986-46cd-aa5a-5e9798b277ac" status: 200 len: 194 microversion: 2.1 time: 0.049441 Nov 03 04:30:43.658747 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2979/6075] 10.222.0.30 () {58 vars in 1413 bytes} [Thu Nov 3 04:30:43 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/26f0c3ce-1986-46cd-aa5a-5e9798b277ac => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:43.662942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:43.663532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:43.669867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:43.670361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:43.670802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:43.671507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:43.671962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:43.672396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:45.039154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lazy-loading 'services' on Instance uuid e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:30:45.480129 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8ad8228-aae8-4978-84c0-fabb53d01ca3 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/26f0c3ce-1986-46cd-aa5a-5e9798b277ac" status: 202 len: 0 microversion: 2.1 time: 1.822422 Nov 03 04:30:45.480729 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3097/6076] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:30:43 2022] DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments/26f0c3ce-1986-46cd-aa5a-5e9798b277ac => generated 0 bytes in 1824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:30:47.572215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:47.572738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:47.580362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:47.580846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:47.581347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:47.582220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:47.582834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:47.583442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:47.610996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:30:47.897417 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d79a64a-d45f-461d-b673-472a34655588 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "DELETE /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 204 len: 0 microversion: 2.1 time: 0.328733 Nov 03 04:30:47.898674 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2980/6077] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:30:47 2022] DELETE /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:30:47.922218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:47.922884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:47.931601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:47.932321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:47.933145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:47.934936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:47.935326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:47.935771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:48.079861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:30:48.088142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-64a2b9a4-410e-4683-9bd2-113c197f7aab tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1469 microversion: 2.1 time: 0.182939 Nov 03 04:30:48.088723 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3098/6078] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:47 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:30:49.114573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:49.115979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:49.127413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:49.128223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:49.128908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:49.130142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:49.131046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:49.131696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:49.337290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:30:49.347026 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f502571e-41cc-442b-a574-4d224bf7f0c7 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1469 microversion: 2.1 time: 0.237529 Nov 03 04:30:49.352174 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2981/6079] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:49 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1469 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:30:50.349956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-e98cccb8-7e3c-41bf-8198-7bffa77c90b8 req-2c71f83a-4d00-47d0-887d-0658722713fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd604c0e-6859-477d-94d4-54faa7bd4f8e", "name": "network-vif-deleted", "tag": "cda3b015-da5a-4b5b-affc-8cb382c45de8"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:30:50.361768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e98cccb8-7e3c-41bf-8198-7bffa77c90b8 req-2c71f83a-4d00-47d0-887d-0658722713fe service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:50.362966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e98cccb8-7e3c-41bf-8198-7bffa77c90b8 req-2c71f83a-4d00-47d0-887d-0658722713fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:50.371452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-e98cccb8-7e3c-41bf-8198-7bffa77c90b8 req-2c71f83a-4d00-47d0-887d-0658722713fe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:50.385922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:50.387686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:50.428731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:50.472708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:50.473669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:50.491981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:50.492754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:50.497204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:50.553206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-e98cccb8-7e3c-41bf-8198-7bffa77c90b8 req-2c71f83a-4d00-47d0-887d-0658722713fe service nova] Creating event network-vif-deleted:cda3b015-da5a-4b5b-affc-8cb382c45de8 for instance dd604c0e-6859-477d-94d4-54faa7bd4f8e on n-h1-854653-7 Nov 03 04:30:50.569175 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-e98cccb8-7e3c-41bf-8198-7bffa77c90b8 req-2c71f83a-4d00-47d0-887d-0658722713fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222029 Nov 03 04:30:50.576586 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3099/6080] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:50.644810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c7d672530544542b957a28035939525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cb262fe52614964bc5459c71f5f7c02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:30:50.655637 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68370acb-357b-4478-af7e-5b6628bcb0e2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 200 len: 1299 microversion: 2.1 time: 0.274345 Nov 03 04:30:50.656814 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2982/6081] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:50 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 1299 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:30:51.680882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:51.681930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] [instance: dd604c0e-6859-477d-94d4-54faa7bd4f8e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:51.692971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:51.701056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:51.702878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:51.705301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:51.705770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:51.706203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:51.726241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] HTTP exception thrown: Instance dd604c0e-6859-477d-94d4-54faa7bd4f8e could not be found. Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Request method failure captured: Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e HTTP/1.1 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0NqOIraIuDYd4C13Ge5xZOrPNocLzm-96SQ2AgONykyf7q3HXsaSs526rzInHStg-qsWa52IBiSD-nrOU8QQXWl_W4KASxDjZlWtbrBAD10LnTJAHk8TnzPqHZNLMpgStb8_mhT7V_Z-7ZR2aktf_18-nbbbVwDCVRO5fkdu8eKb3o Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 0cb262fe52614964bc5459c71f5f7c02 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesBackupsTest-1618963375 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0cb262fe52614964bc5459c71f5f7c02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0cb262fe52614964bc5459c71f5f7c02", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0cb262fe52614964bc5459c71f5f7c02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0cb262fe52614964bc5459c71f5f7c02"}]}] Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesBackupsTest-1618963375 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 0cb262fe52614964bc5459c71f5f7c02 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesBackupsTest-1618963375 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesBackupsTest-1618963375-project Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7c7d672530544542b957a28035939525 Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesBackupsTest-1618963375-project Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance dd604c0e-6859-477d-94d4-54faa7bd4f8e could not be found. Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'dd604c0e-6859-477d-94d4-54faa7bd4f8e'} Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd604c0e-6859-477d-94d4-54faa7bd4f8e could not be found. Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd604c0e-6859-477d-94d4-54faa7bd4f8e could not be found. Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:30:51.734087 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:30:51.738782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:30:51.738782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:30:51.738782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:30:51.738782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:30:51.738782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:30:51.738782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd604c0e-6859-477d-94d4-54faa7bd4f8e could not be found. Nov 03 04:30:51.738782 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:30:51.741309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] Returning 404 to user: Instance dd604c0e-6859-477d-94d4-54faa7bd4f8e could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:30:51.745452 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e60d3135-3653-41d4-bf13-0ce8017042d2 tempest-VolumesBackupsTest-1618963375 tempest-VolumesBackupsTest-1618963375-project] 10.222.0.30 "GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e" status: 404 len: 111 microversion: 2.1 time: 0.066728 Nov 03 04:30:51.746058 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3100/6082] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:51 2022] GET /compute/v2.1/servers/dd604c0e-6859-477d-94d4-54faa7bd4f8e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:30:53.356639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:53.358962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:53.365740 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:30:53.366079 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:30:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments (ip 10.222.0.30) !!! Nov 03 04:30:53.368445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:53.369145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:53.369788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:53.370781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:53.371414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:53.372617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:53.410907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30386239-ad36-410a-95ef-ed885204da83 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058760 Nov 03 04:30:53.412108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2983/6083] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:30:53 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:30:53.558246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:53.561879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:53.572379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:53.573804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:53.574947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:53.576612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:53.577492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:53.578139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:53.614507 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5922e6be-cfad-4581-a0cf-baf5cf12c2bc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061373 Nov 03 04:30:53.615189 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3101/6084] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:30:53 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:30:53.680490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:53.681424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:53.694303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:53.695161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:53.695870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:53.696873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:53.697633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:53.698222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:53.730400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:30:54.115029 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8889928-959e-4ec5-80db-6d1b9b7aff47 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 204 len: 0 microversion: 2.1 time: 0.437869 Nov 03 04:30:54.116285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2984/6085] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:30:53 2022] DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:30:54.125947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:54.125947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:54.144996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:54.145610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:54.146063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:54.154587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:54.154587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:54.154587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:54.311686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:30:54.322864 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f5028cc-15f2-415c-a05e-097e78f25d80 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1673 microversion: 2.1 time: 0.201981 Nov 03 04:30:54.323766 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3102/6086] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:54 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:30:55.348319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:55.349663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:55.357684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:55.358178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:55.358615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:55.359319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:55.359776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:55.360203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:55.504562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:30:55.513396 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6870dfb-2353-4290-8ae4-41204085d1a8 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1673 microversion: 2.1 time: 0.169140 Nov 03 04:30:55.514000 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2985/6087] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:55 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:30:56.537780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:56.538441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:56.549713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:56.550447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:56.551066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:56.554243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:56.555082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:56.556786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:57.147997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:30:57.163047 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cff95862-2b4c-4bb1-93b8-9277e6b6a036 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1673 microversion: 2.1 time: 0.629578 Nov 03 04:30:57.163665 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3103/6088] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:56 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1673 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:30:57.684324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-55f2c57b-59a5-40cc-980a-3c33a62db224 req-05c168e0-146b-4190-bcff-ce542e3e8e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a", "name": "network-vif-deleted", "tag": "3ecc1ed2-5268-4219-ab7d-56fdea373259"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:30:57.725598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-55f2c57b-59a5-40cc-980a-3c33a62db224 req-05c168e0-146b-4190-bcff-ce542e3e8e2e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:57.725598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-55f2c57b-59a5-40cc-980a-3c33a62db224 req-05c168e0-146b-4190-bcff-ce542e3e8e2e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:57.725598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-55f2c57b-59a5-40cc-980a-3c33a62db224 req-05c168e0-146b-4190-bcff-ce542e3e8e2e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:57.745432 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-55f2c57b-59a5-40cc-980a-3c33a62db224 req-05c168e0-146b-4190-bcff-ce542e3e8e2e service nova] Creating event network-vif-deleted:3ecc1ed2-5268-4219-ab7d-56fdea373259 for instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a on n-h2-854653-7 Nov 03 04:30:57.756007 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-55f2c57b-59a5-40cc-980a-3c33a62db224 req-05c168e0-146b-4190-bcff-ce542e3e8e2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090420 Nov 03 04:30:57.757971 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2986/6089] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:30:58.193529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:58.199494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:58.220365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:58.221057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:58.223043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:58.224074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:58.226241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:58.226893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:58.304573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:58.314292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:58.314292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:58.322026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lazy-loading 'fault' on Instance uuid e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:30:58.416457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81a3d829ca245ae88387ed7e8839d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1da15001cf94302ab8effa988b31db6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:30:58.437196 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c796ef90-d968-4e19-9d23-36c3b56f3a7f tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 200 len: 1326 microversion: 2.1 time: 0.240536 Nov 03 04:30:58.438022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3104/6090] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:58 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 1326 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:30:59.471930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:59.478187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:30:59.499542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:59.500457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:59.501602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:59.503006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:30:59.503737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:30:59.504548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:30:59.523352 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] HTTP exception thrown: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Request method failure captured: Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a HTTP/1.1 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0LFJM2UwUkOxLUgEMfGwMUIC-3Iy-3WmUnf_OrpKp5fSXpWWYIyKaJ0ns-85Gy1UaBIyCw8XIOtlMkDFZ0CnSQlFYCTQQmJCxqDx7mQ56oXcBCGhqK51_NxB3KVkkjbHvXuXn8RqKsh9mOLg3PY2iDS8we1ihs5VwwwdfGpyd98_2U Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e1da15001cf94302ab8effa988b31db6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e1da15001cf94302ab8effa988b31db6"}]}] Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a81a3d829ca245ae88387ed7e8839d1b Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a'} Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:30:59.525081 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Returning 404 to user: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-55e149d9-8509-4f98-b95a-4d496233c06e tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 404 len: 111 microversion: 2.1 time: 0.065749 Nov 03 04:30:59.531154 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2987/6091] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:30:59 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:30:59.536808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f4154c8-e707-4b0d-bdfe-e66f14c425c1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '.version_select at 0x7ff7f84c60d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:30:59.728884 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f4154c8-e707-4b0d-bdfe-e66f14c425c1 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143993083" status: 202 len: 0 microversion: 2.1 time: 0.196651 Nov 03 04:30:59.730673 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3105/6092] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 04:30:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143993083 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:31:10.255458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:10.255931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:10.270612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:31:10.271344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:31:10.272765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:10.281510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:10.281904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:10.282968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:10.283244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:10.283510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:10.302348 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] HTTP exception thrown: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Request method failure captured: Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a HTTP/1.1 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0LFJM2UwUkOxLUgEMfGwMUIC-3Iy-3WmUnf_OrpKp5fSXpWWYIyKaJ0ns-85Gy1UaBIyCw8XIOtlMkDFZ0CnSQlFYCTQQmJCxqDx7mQ56oXcBCGhqK51_NxB3KVkkjbHvXuXn8RqKsh9mOLg3PY2iDS8we1ihs5VwwwdfGpyd98_2U Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e1da15001cf94302ab8effa988b31db6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e1da15001cf94302ab8effa988b31db6"}]}] Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a81a3d829ca245ae88387ed7e8839d1b Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a'} Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:31:10.304150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Returning 404 to user: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-46630fa8-0330-4bef-b0f6-b2f85d328859 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 404 len: 111 microversion: 2.1 time: 0.054817 Nov 03 04:31:10.308751 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2988/6093] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:31:10 2022] DELETE /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:31:10.316238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:10.316877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:10.332883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:31:10.332883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:31:10.349770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:10.350766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:10.351594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:10.352854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:10.353579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:10.354231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:10.369723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] HTTP exception thrown: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Request method failure captured: Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a HTTP/1.1 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0LFJM2UwUkOxLUgEMfGwMUIC-3Iy-3WmUnf_OrpKp5fSXpWWYIyKaJ0ns-85Gy1UaBIyCw8XIOtlMkDFZ0CnSQlFYCTQQmJCxqDx7mQ56oXcBCGhqK51_NxB3KVkkjbHvXuXn8RqKsh9mOLg3PY2iDS8we1ihs5VwwwdfGpyd98_2U Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e1da15001cf94302ab8effa988b31db6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e1da15001cf94302ab8effa988b31db6"}]}] Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: a81a3d829ca245ae88387ed7e8839d1b Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a'} Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:10.372443 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.376488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:10.376488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:10.376488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:10.376488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:31:10.376488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:31:10.376488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. Nov 03 04:31:10.376488 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:10.378224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Returning 404 to user: Instance e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:31:10.384766 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce8f1edb-b841-4f00-bd84-c5286f661308 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a" status: 404 len: 111 microversion: 2.1 time: 0.068063 Nov 03 04:31:10.384766 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3106/6094] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:10 2022] GET /compute/v2.1/servers/e7524d6b-6b32-4fa0-b0c0-5fbc98d8022a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:31:15.109004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:15.109942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:15.125511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:15.129947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:15.131579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:15.132437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:15.135650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:15.136248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:15.161569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] HTTP exception thrown: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Request method failure captured: Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d HTTP/1.1 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0LFJM2UwUkOxLUgEMfGwMUIC-3Iy-3WmUnf_OrpKp5fSXpWWYIyKaJ0ns-85Gy1UaBIyCw8XIOtlMkDFZ0CnSQlFYCTQQmJCxqDx7mQ56oXcBCGhqK51_NxB3KVkkjbHvXuXn8RqKsh9mOLg3PY2iDS8we1ihs5VwwwdfGpyd98_2U Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e1da15001cf94302ab8effa988b31db6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e1da15001cf94302ab8effa988b31db6"}]}] Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a81a3d829ca245ae88387ed7e8839d1b Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7590f73f-35cd-47d0-a748-8bf7280a0c7d'} Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:31:15.166888 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.171869 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.174110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Returning 404 to user: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:31:15.176311 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d49036e4-dcd2-4109-bb6e-d13e682218cc tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 404 len: 111 microversion: 2.1 time: 0.071347 Nov 03 04:31:15.176311 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2989/6095] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:31:15 2022] DELETE /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:31:15.185134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:15.185827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] [instance: 7590f73f-35cd-47d0-a748-8bf7280a0c7d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:15.194206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:15.201878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:15.203509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:15.211269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:15.211269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:15.211269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] HTTP exception thrown: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Request method failure captured: Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d HTTP/1.1 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0LFJM2UwUkOxLUgEMfGwMUIC-3Iy-3WmUnf_OrpKp5fSXpWWYIyKaJ0ns-85Gy1UaBIyCw8XIOtlMkDFZ0CnSQlFYCTQQmJCxqDx7mQ56oXcBCGhqK51_NxB3KVkkjbHvXuXn8RqKsh9mOLg3PY2iDS8we1ihs5VwwwdfGpyd98_2U Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e1da15001cf94302ab8effa988b31db6", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e1da15001cf94302ab8effa988b31db6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e1da15001cf94302ab8effa988b31db6"}]}] Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: e1da15001cf94302ab8effa988b31db6 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2056313917 Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: a81a3d829ca245ae88387ed7e8839d1b Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeTestJSON-2056313917-project Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '7590f73f-35cd-47d0-a748-8bf7280a0c7d'} Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:31:15.245705 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] Returning 404 to user: Instance 7590f73f-35cd-47d0-a748-8bf7280a0c7d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a622918-57ca-4f4f-bf7f-7b43ada75d32 tempest-AttachVolumeTestJSON-2056313917 tempest-AttachVolumeTestJSON-2056313917-project] 10.222.0.30 "GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d" status: 404 len: 111 microversion: 2.1 time: 0.060486 Nov 03 04:31:15.252741 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3107/6096] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:15 2022] GET /compute/v2.1/servers/7590f73f-35cd-47d0-a748-8bf7280a0c7d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:31:30.862512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34871481-9c38-4820-a24f-99e49193ac1e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: .version_select at 0x7ff7f9183700>, body: {"keypair": {"name": "tempest-keypair-1157772696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXnFgHw3SF2gsESwv6LywWhkiuS+DmMy/a+8IW6Yk9n2Wqrm2BaW4PGdUxWj3Wv7nHJVWby8o5d78RpPd0EmLIAMKN30+yveSO8AcvZJcelOpTMHh5bZc9yHPnc387npA=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:31:30.882582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-34871481-9c38-4820-a24f-99e49193ac1e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:31:30.891576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-34871481-9c38-4820-a24f-99e49193ac1e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:31:31.101233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-34871481-9c38-4820-a24f-99e49193ac1e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.380668 Nov 03 04:31:31.103956 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2990/6097] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:31:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:31:34.346955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-205462169", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90a5130a-d918-44b0-bf8d-6477ad7d46bd"}], "security_groups": [{"name": "tempest-securitygroup--1119101195"}], "key_name": "tempest-keypair-1157772696", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:31:34.550458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] validate_networks() for [('90a5130a-d918-44b0-bf8d-6477ad7d46bd', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:31:35.672174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:31:35.673466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:31:35.674388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:31:35.675491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:31:35.676318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:31:35.688933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:35.689752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:35.695360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:35.695360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:35.695360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:35.695360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:35.730575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:31:35.743804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:31:35.767656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:31:35.770933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:31:35.977212 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0ec34a07-d482-4b35-93ac-6939e97434e8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.629302 Nov 03 04:31:35.978491 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3108/6098] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:31:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:31:35.992339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c290237a-dc82-4aee-b976-95aaced0be09 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:35.994621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c290237a-dc82-4aee-b976-95aaced0be09 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:36.489453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c290237a-dc82-4aee-b976-95aaced0be09 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:36.498227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c290237a-dc82-4aee-b976-95aaced0be09 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1241 microversion: 2.1 time: 0.511921 Nov 03 04:31:36.519565 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2991/6099] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:35 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1241 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:37.526268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-13458be9-ae6c-45a5-a11f-3adeceb3cf5e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:37.526867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-13458be9-ae6c-45a5-a11f-3adeceb3cf5e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:37.595441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-13458be9-ae6c-45a5-a11f-3adeceb3cf5e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:37.604308 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-13458be9-ae6c-45a5-a11f-3adeceb3cf5e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1241 microversion: 2.1 time: 0.081790 Nov 03 04:31:37.604971 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3109/6100] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:37 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:38.646368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:38.646996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:38.665984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:38.666571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:38.667085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:38.667865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:38.668416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:38.669528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:38.766992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:38.778536 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb773106-c787-4892-8abf-2ed90e5ebc3c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1293 microversion: 2.1 time: 0.142540 Nov 03 04:31:38.780040 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2992/6101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:38 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:39.808808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:39.809846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:39.817319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:39.818040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:39.818476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:39.819563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:39.820177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:39.820762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:39.897804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:39.910505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ad5c4f4-2a11-4318-829a-3d770d72600c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1299 microversion: 2.1 time: 0.105222 Nov 03 04:31:39.912865 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3110/6102] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:39 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:40.937055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:40.937730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:40.946276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:40.947028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:40.947738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:40.960649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:40.960649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:40.960889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:41.172439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:41.180943 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-001eb4e2-8835-4d38-8032-d661a5eec76f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1367 microversion: 2.1 time: 0.249469 Nov 03 04:31:41.181544 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2993/6103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:40 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:41.230355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8fb78674-3bc5-46d8-8acc-7272af6af33b req-d9ad68c0-e0b2-4589-8c45-0d5bbe56b722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8bec4d-235f-455c-ab36-9f26eb7bac34", "tag": "a33c81ff-df74-401c-b096-f8bb17f8428b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:31:41.270665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8fb78674-3bc5-46d8-8acc-7272af6af33b req-d9ad68c0-e0b2-4589-8c45-0d5bbe56b722 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:41.272259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8fb78674-3bc5-46d8-8acc-7272af6af33b req-d9ad68c0-e0b2-4589-8c45-0d5bbe56b722 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:41.272768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8fb78674-3bc5-46d8-8acc-7272af6af33b req-d9ad68c0-e0b2-4589-8c45-0d5bbe56b722 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:41.284609 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8fb78674-3bc5-46d8-8acc-7272af6af33b req-d9ad68c0-e0b2-4589-8c45-0d5bbe56b722 service nova] Creating event network-changed:a33c81ff-df74-401c-b096-f8bb17f8428b for instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 on n-h2-854653-7 Nov 03 04:31:41.289723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8fb78674-3bc5-46d8-8acc-7272af6af33b req-d9ad68c0-e0b2-4589-8c45-0d5bbe56b722 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066405 Nov 03 04:31:41.290520 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3111/6104] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:31:42.210761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:42.211945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:42.228414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:42.229111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:42.246021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:42.247046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:42.255025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:42.256481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:42.507832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:42.518444 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-669d1b50-0e53-4c2f-9ae8-8d846f2b066a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1367 microversion: 2.1 time: 0.318039 Nov 03 04:31:42.520949 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2994/6105] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:42 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:43.545505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:43.546227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:43.553352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:43.553848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:43.554315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:43.555158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:43.555802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:43.556242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:43.708919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:43.717445 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3055fb04-a2cb-4961-9616-990b7e52ab75 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1367 microversion: 2.1 time: 0.176592 Nov 03 04:31:43.718136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3112/6106] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:43 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:44.751568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:44.757358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:44.766369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:44.766932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:44.767587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:44.768384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:44.768913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:44.769534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:45.012508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:45.025780 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2dcb1bd5-b71b-4a85-9638-3156e426c3ca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1367 microversion: 2.1 time: 0.284027 Nov 03 04:31:45.026485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2995/6107] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:44 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:46.053200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:46.054089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:46.056827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:31:46.062476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:46.068754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:46.068754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:46.068754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:46.068754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:46.068754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:46.234979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:46.244237 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd6e9f7e-859f-4570-8049-4c21cce705ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1367 microversion: 2.1 time: 0.194944 Nov 03 04:31:46.245160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3113/6108] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:46 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:46.602262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-95a5d266-1339-4ede-bdfb-5e811aed531f req-3a6b3a6a-72ed-44c8-b19c-6f69f604e96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8bec4d-235f-455c-ab36-9f26eb7bac34", "name": "network-vif-plugged", "status": "completed", "tag": "a33c81ff-df74-401c-b096-f8bb17f8428b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:31:46.608386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:31:46.614050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-95a5d266-1339-4ede-bdfb-5e811aed531f req-3a6b3a6a-72ed-44c8-b19c-6f69f604e96f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:46.614538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-95a5d266-1339-4ede-bdfb-5e811aed531f req-3a6b3a6a-72ed-44c8-b19c-6f69f604e96f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:46.614981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-95a5d266-1339-4ede-bdfb-5e811aed531f req-3a6b3a6a-72ed-44c8-b19c-6f69f604e96f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:46.629349 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-95a5d266-1339-4ede-bdfb-5e811aed531f req-3a6b3a6a-72ed-44c8-b19c-6f69f604e96f service nova] Creating event network-vif-plugged:a33c81ff-df74-401c-b096-f8bb17f8428b for instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 on n-h2-854653-7 Nov 03 04:31:46.634605 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-95a5d266-1339-4ede-bdfb-5e811aed531f req-3a6b3a6a-72ed-44c8-b19c-6f69f604e96f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037370 Nov 03 04:31:46.635248 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2996/6109] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:31:47.268055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:47.268667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:47.275344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:47.275826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:47.276359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:47.276959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:47.277530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:47.279366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:47.437604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:47.452364 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c360cd0-612e-4182-89fc-e97d79ac717a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1367 microversion: 2.1 time: 0.186016 Nov 03 04:31:47.453607 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3114/6110] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:47 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:48.482541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:48.483321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:48.491531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:48.492306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:48.496840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:48.496840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:48.496840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:48.496840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:48.650515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:31:48.658815 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a80a6455-5f5e-4afd-b7d1-84bdb602a438 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1557 microversion: 2.1 time: 0.181188 Nov 03 04:31:48.660977 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2997/6111] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:31:48 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:31:48.682819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:31:48.686419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:31:48.689120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:31:48.692030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:48.692668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:48.693296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:48.694022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:48.694477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:48.694902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:48.789603 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b44ee18-bed4-44e5-984a-d954cd5a63d2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110279 Nov 03 04:31:48.789603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3115/6112] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:31:48 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:31:50.414248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-94d5d3ce-5250-4e1d-9867-cf17867775e3 req-9a830a33-2fab-4003-97e5-ebf272274bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8bec4d-235f-455c-ab36-9f26eb7bac34", "tag": "a33c81ff-df74-401c-b096-f8bb17f8428b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:31:50.429192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-94d5d3ce-5250-4e1d-9867-cf17867775e3 req-9a830a33-2fab-4003-97e5-ebf272274bfa service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:31:50.430148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-94d5d3ce-5250-4e1d-9867-cf17867775e3 req-9a830a33-2fab-4003-97e5-ebf272274bfa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:31:50.430659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-94d5d3ce-5250-4e1d-9867-cf17867775e3 req-9a830a33-2fab-4003-97e5-ebf272274bfa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:31:50.443781 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-94d5d3ce-5250-4e1d-9867-cf17867775e3 req-9a830a33-2fab-4003-97e5-ebf272274bfa service nova] Creating event network-changed:a33c81ff-df74-401c-b096-f8bb17f8428b for instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 on n-h2-854653-7 Nov 03 04:31:50.448912 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-94d5d3ce-5250-4e1d-9867-cf17867775e3 req-9a830a33-2fab-4003-97e5-ebf272274bfa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194042 Nov 03 04:31:50.449775 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2998/6113] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:32:26.042274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:26.043109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=36 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:26.048127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:26.048691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:26.054678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:26.059073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:26.059073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:26.059073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:26.059073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:26.059073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:26.081915 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60d6f7a4-4cfa-4965-9d74-343a2b969fc8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/ips" status: 200 len: 150 microversion: 2.1 time: 0.041397 Nov 03 04:32:26.082511 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3116/6114] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:32:26 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:32:29.119552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:29.120927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=38 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:29.125896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6895c76a-3fba-4b20-8b35-2b0318342433"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:32:29.129159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:29.143948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:29.147003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:29.147640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:29.150443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:29.151101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:29.151839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:30.020609 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8729b4be-a9c5-40d7-af9e-869ce3caea98 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.910350 Nov 03 04:32:30.021966 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 2999/6115] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:32:29 2022] POST /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:32:42.411319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e0950e5-34c7-44f4-adb6-50cd0cac3fdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: .version_select at 0x7ff7f9129790>, body: {"keypair": {"name": "tempest-keypair-2085078079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxnVuRVfRaJIreX0KmhkRyfWc+EVxLWP7isK/0V57JzG5EsO8gM4SuyVbyurFbg23rfD6ubrNPiewkEYa0k3pAYLfYCy7c/12dCNh+nSo0ODh0lIZrA0DCsq0Mg6TsajA=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:32:42.411319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1e0950e5-34c7-44f4-adb6-50cd0cac3fdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:32:42.411319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1e0950e5-34c7-44f4-adb6-50cd0cac3fdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:32:42.768053 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e0950e5-34c7-44f4-adb6-50cd0cac3fdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.484230 Nov 03 04:32:42.768672 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3117/6116] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:32:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:32:45.336724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:45.337695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:45.343387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1358837281", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90a5130a-d918-44b0-bf8d-6477ad7d46bd"}], "security_groups": [{"name": "tempest-securitygroup--1194277493"}], "key_name": "tempest-keypair-2085078079", "user_data": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:32:45.487798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] validate_networks() for [('90a5130a-d918-44b0-bf8d-6477ad7d46bd', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:32:46.099843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:32:46.100480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:32:46.101339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:32:46.101943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:32:46.102533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:32:46.112315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:46.112806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:46.113299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:46.114260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:46.114720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:46.115320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:46.142506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:32:46.149860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:32:46.164203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:32:46.169965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:32:46.322882 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3e2c1161-7f47-423c-a415-6a07f8969d1c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.988395 Nov 03 04:32:46.323873 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3000/6117] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:32:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:32:46.335657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7f8c4a99-1ebe-48ff-923e-34f305d88038 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:46.336274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7f8c4a99-1ebe-48ff-923e-34f305d88038 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:46.427460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7f8c4a99-1ebe-48ff-923e-34f305d88038 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:46.437048 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7f8c4a99-1ebe-48ff-923e-34f305d88038 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1242 microversion: 2.1 time: 0.105287 Nov 03 04:32:46.438000 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3118/6118] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:46 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:47.463379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:47.464934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:47.474646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:47.475404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:47.476464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:47.477498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:47.478134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:47.478776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:47.557076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:47.565725 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a347f91c-4a80-4042-aea7-3969bbe48d28 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1246 microversion: 2.1 time: 0.108109 Nov 03 04:32:47.566311 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3001/6119] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:47 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:48.589072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:48.590773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:48.635631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:48.636849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:48.637432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:48.639132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:48.640357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:48.640828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:48.707190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:48.715944 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9a7cf57-b496-49e1-849e-d886d8893f6c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1294 microversion: 2.1 time: 0.131177 Nov 03 04:32:48.716526 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3119/6120] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:48 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1294 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:49.739943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:49.740548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:49.749632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:49.750131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:49.750580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:49.751468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:49.751926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:49.752352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:50.035694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:50.045800 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2530573f-51db-4c8a-9f36-a7aed3db2d16 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.309395 Nov 03 04:32:50.046864 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3002/6121] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:49 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:51.076757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:51.078301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:51.090500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:51.091316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:51.091917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:51.092910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:51.094026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:51.094613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:51.385519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:51.395114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f19d0de-c06a-4905-bda7-a4c4445674ac tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.322649 Nov 03 04:32:51.407261 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3120/6122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:51 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:51.528826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-30d23b8a-6908-45b7-9e9d-578ad80ea210 req-58397d10-7808-4225-8bfc-3b86f70e267f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33da54b-d47c-4a3f-a349-b9e6ae8268ff", "tag": "5de6cef9-ec5f-407f-bc92-80ee4915438e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:32:51.550107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-30d23b8a-6908-45b7-9e9d-578ad80ea210 req-58397d10-7808-4225-8bfc-3b86f70e267f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:51.551049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-30d23b8a-6908-45b7-9e9d-578ad80ea210 req-58397d10-7808-4225-8bfc-3b86f70e267f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:51.551739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-30d23b8a-6908-45b7-9e9d-578ad80ea210 req-58397d10-7808-4225-8bfc-3b86f70e267f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:51.596860 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-30d23b8a-6908-45b7-9e9d-578ad80ea210 req-58397d10-7808-4225-8bfc-3b86f70e267f service nova] Creating event network-changed:5de6cef9-ec5f-407f-bc92-80ee4915438e for instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff on n-h1-854653-7 Nov 03 04:32:51.604379 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-30d23b8a-6908-45b7-9e9d-578ad80ea210 req-58397d10-7808-4225-8bfc-3b86f70e267f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394576 Nov 03 04:32:51.607197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3003/6123] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:32:52.424602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:52.425451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:52.433310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:52.434171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:52.435345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:52.436403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:52.436982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:52.437495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:52.701050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:52.701050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a93c19fe-8407-471f-85c4-8c0c56a421fc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.212385 Nov 03 04:32:52.701050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3121/6124] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:52 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:53.656529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:53.657265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:53.664793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:53.665562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:53.666363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:53.667265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:53.667759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:53.668493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:53.829287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:53.839616 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5a530886-2adc-4c76-8d63-4bd34cd1ac69 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.188967 Nov 03 04:32:53.840922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3004/6125] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:53 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:54.871142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:54.872647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:54.880768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:54.881568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:54.882421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:54.883879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:54.884730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:54.885685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:55.172628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:55.172628 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-806d3548-b40f-4043-b1a5-fa9fae296c43 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.204151 Nov 03 04:32:55.172628 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3122/6126] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:54 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:56.104571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:56.105363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:56.113481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:56.113984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:56.114429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:56.115165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:56.115625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:56.116067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:56.133482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:56.159396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:56.271734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:56.280301 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d7c49535-2629-48ce-975c-145aea79c85c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.184255 Nov 03 04:32:56.284854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3005/6127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:56 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:57.309247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:57.310626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:57.313420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:32:57.318643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:57.324053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:57.324053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:57.324053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:57.324053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:57.324053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:57.479247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:57.488241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a651034-b105-4e1a-8696-e4c051333737 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.183872 Nov 03 04:32:57.494283 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3123/6128] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:57 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:58.024581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8807376c-ce6a-495c-8538-6390d11699f4 req-a53fd646-414f-4b2b-bef5-0c6446d8b6f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33da54b-d47c-4a3f-a349-b9e6ae8268ff", "name": "network-vif-plugged", "status": "completed", "tag": "5de6cef9-ec5f-407f-bc92-80ee4915438e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:32:58.040090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8807376c-ce6a-495c-8538-6390d11699f4 req-a53fd646-414f-4b2b-bef5-0c6446d8b6f2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:58.040572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8807376c-ce6a-495c-8538-6390d11699f4 req-a53fd646-414f-4b2b-bef5-0c6446d8b6f2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:58.044825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8807376c-ce6a-495c-8538-6390d11699f4 req-a53fd646-414f-4b2b-bef5-0c6446d8b6f2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:58.062632 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8807376c-ce6a-495c-8538-6390d11699f4 req-a53fd646-414f-4b2b-bef5-0c6446d8b6f2 service nova] Creating event network-vif-plugged:5de6cef9-ec5f-407f-bc92-80ee4915438e for instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff on n-h1-854653-7 Nov 03 04:32:58.068302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8807376c-ce6a-495c-8538-6390d11699f4 req-a53fd646-414f-4b2b-bef5-0c6446d8b6f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047328 Nov 03 04:32:58.072222 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3006/6129] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:32:58.521290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:58.522139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:58.529991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:58.530522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:58.530963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:58.531679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:58.532300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:58.532746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:58.692807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:58.701957 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-24081bfb-d8ea-4b86-9416-cac6f3ba9a71 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.184710 Nov 03 04:32:58.713570 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3124/6130] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:58 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:32:59.726905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:32:59.727606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:32:59.734605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:59.735107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:59.735566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:59.736298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:32:59.736752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:32:59.737303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:32:59.959461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:32:59.969098 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-28b6cc17-4559-4943-be9c-2f3c79edbcf9 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1368 microversion: 2.1 time: 0.247141 Nov 03 04:32:59.970005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3007/6131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:32:59 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:00.992966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:00.993749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:01.001569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:01.002151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:01.002679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:01.003780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:01.004284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:01.004716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:01.144483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:01.152611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8910e8f-e846-463d-bfe4-91cdf9aa9c26 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1558 microversion: 2.1 time: 0.163553 Nov 03 04:33:01.153593 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3125/6132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:00 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:01.177244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:01.178036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:01.186511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:01.187093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:01.187607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:01.188451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:01.189002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:01.189878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:01.279476 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d83c80e7-e07b-4c50-ac95-c9aea9238772 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106368 Nov 03 04:33:01.280075 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3008/6133] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:33:01 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:02.441200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3053db82-eb2a-4651-a874-364faa8418d8 req-cd03c256-597b-4567-821d-1dbea7d3dd6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33da54b-d47c-4a3f-a349-b9e6ae8268ff", "tag": "5de6cef9-ec5f-407f-bc92-80ee4915438e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:02.452176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3053db82-eb2a-4651-a874-364faa8418d8 req-cd03c256-597b-4567-821d-1dbea7d3dd6d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:02.452681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3053db82-eb2a-4651-a874-364faa8418d8 req-cd03c256-597b-4567-821d-1dbea7d3dd6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:02.453158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3053db82-eb2a-4651-a874-364faa8418d8 req-cd03c256-597b-4567-821d-1dbea7d3dd6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:02.464564 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3053db82-eb2a-4651-a874-364faa8418d8 req-cd03c256-597b-4567-821d-1dbea7d3dd6d service nova] Creating event network-changed:5de6cef9-ec5f-407f-bc92-80ee4915438e for instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff on n-h1-854653-7 Nov 03 04:33:02.470756 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3053db82-eb2a-4651-a874-364faa8418d8 req-cd03c256-597b-4567-821d-1dbea7d3dd6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033254 Nov 03 04:33:02.471541 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3126/6134] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:08.373181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1180332413", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:08.429324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] validate_networks() for None {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:33:08.622223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:33:08.622725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:33:08.623210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:33:08.623626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:33:08.624038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:33:08.644011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:08.644506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:08.645128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:08.645874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:08.646340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:08.646916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:08.665945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Getting quotas for project bf778b44e7e741c685d711d5ccb2a10c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:33:08.671693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Getting quotas for user e4f3117b2fdf4c9fa2135562d0054001 and project bf778b44e7e741c685d711d5ccb2a10c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:33:08.685746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:33:08.688537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:33:08.816660 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d8442cff-0471-447c-ab7f-40fe265b633e tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449352 Nov 03 04:33:08.817372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3009/6135] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:33:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:33:08.841859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c7bb839-286c-4da5-a851-2ab5c7c5f5c2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:08.841859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c7bb839-286c-4da5-a851-2ab5c7c5f5c2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:08.887187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c7bb839-286c-4da5-a851-2ab5c7c5f5c2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:08.897368 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c7bb839-286c-4da5-a851-2ab5c7c5f5c2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1215 microversion: 2.1 time: 0.071697 Nov 03 04:33:08.898119 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3127/6136] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:08 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df91a809-fe28-438f-8c24-38c350972589 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1219 microversion: 2.1 time: 0.098739 Nov 03 04:33:10.028773 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3010/6137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:09 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:11.039719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:11.040348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:11.048260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:11.048753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:11.049230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:11.049986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:11.050448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:11.050884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:11.122208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:11.130772 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-80525555-cd0c-43f4-9088-df3ac2713b55 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1267 microversion: 2.1 time: 0.094929 Nov 03 04:33:11.144171 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3128/6138] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:11 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1267 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:12.156375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:12.157120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:12.164130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:12.164620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:12.165084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:12.165776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:12.166233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:12.166662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:12.247170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:12.255447 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-239017d5-c63a-45a9-9ccd-8f198fcf2884 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1273 microversion: 2.1 time: 0.103201 Nov 03 04:33:12.256033 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3011/6139] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:12 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:13.282997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:13.284328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:13.288034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:13.311819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:13.312334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:13.312795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:13.313559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:13.316347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:13.316347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:13.322496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=55 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:13.545873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:13.553880 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b64eb1a5-44ca-4153-a36a-ec555f25b308 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.275737 Nov 03 04:33:13.554927 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3129/6140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:13 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:13.852869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3df57997-0c16-4c67-8688-31b81a3230a0 req-01ae1159-bd1f-4465-9f4b-bb6f1a78593e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542a1529-e492-434c-8604-ea510caab531", "tag": "be8fafca-3762-4cf3-8191-9c5a8ae69714"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:13.865575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3df57997-0c16-4c67-8688-31b81a3230a0 req-01ae1159-bd1f-4465-9f4b-bb6f1a78593e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:13.866258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3df57997-0c16-4c67-8688-31b81a3230a0 req-01ae1159-bd1f-4465-9f4b-bb6f1a78593e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:13.866757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3df57997-0c16-4c67-8688-31b81a3230a0 req-01ae1159-bd1f-4465-9f4b-bb6f1a78593e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:13.879572 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3df57997-0c16-4c67-8688-31b81a3230a0 req-01ae1159-bd1f-4465-9f4b-bb6f1a78593e service nova] Creating event network-changed:be8fafca-3762-4cf3-8191-9c5a8ae69714 for instance 542a1529-e492-434c-8604-ea510caab531 on n-h2-854653-7 Nov 03 04:33:13.885051 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3df57997-0c16-4c67-8688-31b81a3230a0 req-01ae1159-bd1f-4465-9f4b-bb6f1a78593e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038427 Nov 03 04:33:13.890157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3012/6141] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:14.578846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:14.579462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:14.585735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:14.587612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:14.587612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:14.587612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:14.587908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:14.588247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:14.737676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:14.745481 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9bc1b861-f4e8-4428-8827-d93008693ce5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.171913 Nov 03 04:33:14.746581 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3130/6142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:14 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:15.772332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:15.773174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:15.775305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:15.781565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:15.782067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:15.782694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:15.783405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:15.784008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:15.784433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:15.800704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=57 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:16.041531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:16.055973 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc0a031e-671b-406a-b765-a14099d912c5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.289835 Nov 03 04:33:16.056818 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3013/6143] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:15 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:17.079688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:17.080315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:17.087425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:17.087912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:17.088362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:17.089115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:17.090149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:17.093123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:17.242824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:17.251244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77edf4d4-3598-4cf7-8a31-70246826d771 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.175501 Nov 03 04:33:17.252069 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3131/6144] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:17 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:18.275540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:18.276114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:18.318396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:18.318893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:18.319363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:18.320096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:18.320556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:18.321000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:18.455624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:18.463877 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f75c38d-bd80-466c-a315-8d8ddb9308bf tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.192288 Nov 03 04:33:18.472038 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3014/6145] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:18 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:19.493589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:19.499343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:19.499972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:19.513474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:19.515492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:19.516165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:19.517311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:19.518757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:19.532228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:19.687020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:19.696451 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4da97316-2839-4d80-915b-a6ee9f72aab5 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.204349 Nov 03 04:33:19.697859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3132/6146] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:19 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:20.720506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:20.723295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:20.723426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:20.724085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:20.736242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:20.736978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:20.737834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:20.738736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:20.739379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:20.739973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:20.890346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:20.909819 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b7fea65-5e88-432d-a184-2f67387d4700 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.183177 Nov 03 04:33:20.909819 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3015/6147] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:20 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:21.021826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1acaf13a-8a79-4cb3-bc55-32d3d06e79af req-b04ecd5c-9975-4402-bfd0-7d8218237dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542a1529-e492-434c-8604-ea510caab531", "name": "network-vif-plugged", "status": "completed", "tag": "be8fafca-3762-4cf3-8191-9c5a8ae69714"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:21.036318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1acaf13a-8a79-4cb3-bc55-32d3d06e79af req-b04ecd5c-9975-4402-bfd0-7d8218237dfe service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:21.037174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1acaf13a-8a79-4cb3-bc55-32d3d06e79af req-b04ecd5c-9975-4402-bfd0-7d8218237dfe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:21.038001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1acaf13a-8a79-4cb3-bc55-32d3d06e79af req-b04ecd5c-9975-4402-bfd0-7d8218237dfe service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:21.052123 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1acaf13a-8a79-4cb3-bc55-32d3d06e79af req-b04ecd5c-9975-4402-bfd0-7d8218237dfe service nova] Creating event network-vif-plugged:be8fafca-3762-4cf3-8191-9c5a8ae69714 for instance 542a1529-e492-434c-8604-ea510caab531 on n-h2-854653-7 Nov 03 04:33:21.059083 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1acaf13a-8a79-4cb3-bc55-32d3d06e79af req-b04ecd5c-9975-4402-bfd0-7d8218237dfe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042000 Nov 03 04:33:21.060074 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3133/6148] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:21.926171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:21.926804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:21.934158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:21.934650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:21.935093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:21.935796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:21.936543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:21.936978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:22.078177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:22.086563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-432207ef-2686-4351-bb90-c46d350089c8 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1315 microversion: 2.1 time: 0.165705 Nov 03 04:33:22.087153 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3016/6149] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:21 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:23.113419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:23.121230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:23.124140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:23.124645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:23.125157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:23.125880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:23.126341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:23.126771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:23.327584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:23.337297 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-194a7603-b49a-49ac-b89d-2b3adde7ee56 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1465 microversion: 2.1 time: 0.230681 Nov 03 04:33:23.338094 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3134/6150] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:23 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1465 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:23.386441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:23.387803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:23.397457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:23.397968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:23.398417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:23.399137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:23.399630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:23.400064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:23.427871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:33:23.780969 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-348cc72b-2c16-41e5-9aa2-a33313dda854 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "DELETE /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 204 len: 0 microversion: 2.1 time: 0.398137 Nov 03 04:33:23.781615 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3017/6151] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:33:23 2022] DELETE /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:33:23.789930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:23.790695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:23.797548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:23.798040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:23.798491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:23.799211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:23.799675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:23.800106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:23.945714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:23.956124 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a82d9eef-5d3e-48ce-99f8-274ed04a2de2 tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1471 microversion: 2.1 time: 0.170007 Nov 03 04:33:23.956802 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3135/6152] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:23 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:24.980858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:24.981728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:24.988879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:24.989492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:24.990008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:24.990786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:24.991320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:24.991820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:25.132579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:25.140534 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4040340b-5a85-4fd8-ae35-d9cf7b7b122d tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1471 microversion: 2.1 time: 0.164574 Nov 03 04:33:25.141141 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3018/6153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:24 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:25.888896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cd86932c-81d8-4071-8f8b-0acf021c1782 req-f0787ca7-5c91-400e-938a-2681d6393b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542a1529-e492-434c-8604-ea510caab531", "name": "network-vif-deleted", "tag": "be8fafca-3762-4cf3-8191-9c5a8ae69714"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:25.900803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cd86932c-81d8-4071-8f8b-0acf021c1782 req-f0787ca7-5c91-400e-938a-2681d6393b0f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:25.902468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cd86932c-81d8-4071-8f8b-0acf021c1782 req-f0787ca7-5c91-400e-938a-2681d6393b0f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:25.902939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cd86932c-81d8-4071-8f8b-0acf021c1782 req-f0787ca7-5c91-400e-938a-2681d6393b0f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:25.916243 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cd86932c-81d8-4071-8f8b-0acf021c1782 req-f0787ca7-5c91-400e-938a-2681d6393b0f service nova] Creating event network-vif-deleted:be8fafca-3762-4cf3-8191-9c5a8ae69714 for instance 542a1529-e492-434c-8604-ea510caab531 on n-h2-854653-7 Nov 03 04:33:25.926463 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cd86932c-81d8-4071-8f8b-0acf021c1782 req-f0787ca7-5c91-400e-938a-2681d6393b0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041806 Nov 03 04:33:25.927090 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3136/6154] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:26.164587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:26.165245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:26.172064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:26.172780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:26.173435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:26.174151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:26.174615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:26.175044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:26.242816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4f3117b2fdf4c9fa2135562d0054001', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf778b44e7e741c685d711d5ccb2a10c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:26.255744 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f6866ec-47ef-4467-961c-51b3dc01cfcc tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 200 len: 1300 microversion: 2.1 time: 0.095418 Nov 03 04:33:26.257119 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3019/6155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:26 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:26.608624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc8230b6-f251-41b6-b970-affb669c10a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Action: 'create', calling method: .version_select at 0x7ff7fd62c4c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1050022468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlRbUeu8RX/aGWCOU9lW8i5Vagqe3Ve5gjP3B5LAVLx7Fedlqa8k7S+ZT3dVmsD6Bmx7yXkUntuRK6j/jXiwbXu8gJSekVO7FHB1W38IoXs/3OxXZJMPPS8MFSKUP5vmw=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:26.624587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-bc8230b6-f251-41b6-b970-affb669c10a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Getting quotas for project ef44251e47054e4aaf388ce8004511fd. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:33:26.630181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-bc8230b6-f251-41b6-b970-affb669c10a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Getting quotas for user ab4c3736e94d4db0835b776af2e6588c and project ef44251e47054e4aaf388ce8004511fd. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:33:26.749004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc8230b6-f251-41b6-b970-affb669c10a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.315586 Nov 03 04:33:26.749004 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3137/6156] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:33:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:27.283514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:27.284690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] [instance: 542a1529-e492-434c-8604-ea510caab531] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:27.291323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:27.291816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:27.292258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:27.292961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:27.293478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:27.293914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:27.308119 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] HTTP exception thrown: Instance 542a1529-e492-434c-8604-ea510caab531 could not be found. Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Request method failure captured: Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 HTTP/1.1 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0SB3byQyqb1yAn_3WNtKKCHk6qxxZ1_v6Ei7wOwnWmVsO47VXOuD4vqX90_YULSPod3nh2OigMwB8Cyqw5yNkUbyYUrLqVbk3C0OXg5IjWJQf4VllXVCNMvDLeaDvCx4DeTr1oOott4PNRq1vT9x3n7A5fycIp3qKKvt_iuccwpgRc Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: bf778b44e7e741c685d711d5ccb2a10c Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesNegativeTest-667653380 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bf778b44e7e741c685d711d5ccb2a10c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bf778b44e7e741c685d711d5ccb2a10c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bf778b44e7e741c685d711d5ccb2a10c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bf778b44e7e741c685d711d5ccb2a10c"}]}] Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesNegativeTest-667653380 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: bf778b44e7e741c685d711d5ccb2a10c Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesNegativeTest-667653380 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesNegativeTest-667653380-project Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: e4f3117b2fdf4c9fa2135562d0054001 Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesNegativeTest-667653380-project Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 542a1529-e492-434c-8604-ea510caab531 could not be found. Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '542a1529-e492-434c-8604-ea510caab531'} Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542a1529-e492-434c-8604-ea510caab531 could not be found. Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542a1529-e492-434c-8604-ea510caab531 could not be found. Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:33:27.309910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542a1529-e492-434c-8604-ea510caab531 could not be found. Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] Returning 404 to user: Instance 542a1529-e492-434c-8604-ea510caab531 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-17413c1b-151f-4fc3-a40b-cbb64641454b tempest-VolumesNegativeTest-667653380 tempest-VolumesNegativeTest-667653380-project] 10.222.0.30 "GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531" status: 404 len: 111 microversion: 2.1 time: 0.031740 Nov 03 04:33:27.315024 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3020/6157] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:27 2022] GET /compute/v2.1/servers/542a1529-e492-434c-8604-ea510caab531 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:33:36.366805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1732675692-access_point-1363141878", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "da57db1a-bc37-435e-8a89-9cb4e7d75352"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1050022468", "security_groups": [{"name": "tempest-secgroup_access--1648580390"}, {"name": "tempest-secgroup_general--936274141"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:36.379802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=39 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:36.638799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:36.917892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] validate_networks() for [('da57db1a-bc37-435e-8a89-9cb4e7d75352', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:33:37.461935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:33:37.462503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:33:37.462854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:33:37.463264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:33:37.463668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:33:37.475102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:37.475593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:37.476214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:37.476960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:37.477440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:37.477970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:37.499840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Getting quotas for project ef44251e47054e4aaf388ce8004511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:33:37.506325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Getting quotas for user ab4c3736e94d4db0835b776af2e6588c and project ef44251e47054e4aaf388ce8004511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:33:37.527681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:33:37.530415 n-d-854653-7 devstack@n-api.service[127594]: WARNING nova.utils [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1732675692-access_point-1363141878 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1732675692-ac Nov 03 04:33:37.531289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:33:37.661297 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c39a852-312c-40ac-a77e-c9aae1e04337 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.299028 Nov 03 04:33:37.662694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3138/6158] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:33:36 2022] POST /compute/v2.1/servers => generated 457 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:33:37.676337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b310dc6-b007-443b-a0ed-ba61efca112f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:37.677577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b310dc6-b007-443b-a0ed-ba61efca112f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:37.705272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:37.720173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:37.855599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b310dc6-b007-443b-a0ed-ba61efca112f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:37.881384 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b310dc6-b007-443b-a0ed-ba61efca112f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1295 microversion: 2.1 time: 0.206739 Nov 03 04:33:37.881384 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3021/6159] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:37 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1295 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:38.899698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7bfd132-7c85-4392-9a1f-a449a4ec24db tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:38.900957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7bfd132-7c85-4392-9a1f-a449a4ec24db tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:38.997308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f7bfd132-7c85-4392-9a1f-a449a4ec24db tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:39.006144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7bfd132-7c85-4392-9a1f-a449a4ec24db tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1295 microversion: 2.1 time: 0.110349 Nov 03 04:33:39.007353 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3139/6160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:38 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:40.033366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:40.044413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:40.059900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:40.060822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:40.062184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:40.063346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:40.063981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:40.064748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:40.146921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:40.155591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26e9165b-7137-421e-a503-fc7f9eae205a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1347 microversion: 2.1 time: 0.127145 Nov 03 04:33:40.156707 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3022/6161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:40 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1347 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:41.178766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:41.179388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:41.200966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:41.205163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:41.205814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:41.206740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:41.207373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:41.208089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:41.324719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:41.333105 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35fedbe3-a380-459d-ac93-a42126ad0d3e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1353 microversion: 2.1 time: 0.158315 Nov 03 04:33:41.333730 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3140/6162] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:41 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1353 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:42.357524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:42.358762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:42.370932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:42.371424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:42.371971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:42.372698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:42.373223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:42.373932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:42.598899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:42.607816 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aadef377-bb19-4f30-a430-6694ceac97f5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.254957 Nov 03 04:33:42.608397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3023/6163] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:42 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:33:42.686716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cebc9465-174b-44d8-a8a3-d308853d2f39 req-dea3732a-1f59-4936-a927-4428e93ec52c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed70470a-8acf-4092-99d9-055b7665d1d1", "tag": "aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:42.700336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cebc9465-174b-44d8-a8a3-d308853d2f39 req-dea3732a-1f59-4936-a927-4428e93ec52c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:42.701371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cebc9465-174b-44d8-a8a3-d308853d2f39 req-dea3732a-1f59-4936-a927-4428e93ec52c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:42.702047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cebc9465-174b-44d8-a8a3-d308853d2f39 req-dea3732a-1f59-4936-a927-4428e93ec52c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:42.714740 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cebc9465-174b-44d8-a8a3-d308853d2f39 req-dea3732a-1f59-4936-a927-4428e93ec52c service nova] Creating event network-changed:aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2 for instance ed70470a-8acf-4092-99d9-055b7665d1d1 on n-h2-854653-7 Nov 03 04:33:42.720524 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cebc9465-174b-44d8-a8a3-d308853d2f39 req-dea3732a-1f59-4936-a927-4428e93ec52c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038743 Nov 03 04:33:42.721478 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3141/6164] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:43.632618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:43.633813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:43.641349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:43.641842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:43.642319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:43.643028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:43.643487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:43.643917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:43.797274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:43.805320 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf9e0ef9-0430-4a79-bb3b-46a2ce7c7a94 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.178439 Nov 03 04:33:43.806002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3024/6165] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:43 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:44.830097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:44.830701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:44.832656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:44.838257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:44.839262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:44.839720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:44.840427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:44.840888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:44.841422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:45.019417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:45.027814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-22871248-4407-4cac-ac44-90af7462659e tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.203036 Nov 03 04:33:45.028391 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3142/6166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:44 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:46.051678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:46.052297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:46.059796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:46.060404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:46.060930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:46.061753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:46.062321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:46.062864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:46.213678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:46.221802 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-46574841-8c0d-4215-9722-68f76354d7d9 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.173936 Nov 03 04:33:46.222379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3025/6167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:46 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:47.243631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:47.244307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:47.252572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:47.253102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:47.253549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:47.254256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:47.255039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:47.255473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:47.405780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:47.413588 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-380d30ef-f2e3-4c1a-9b76-43e8a5ec6683 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.173820 Nov 03 04:33:47.414169 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3143/6168] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:47 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:48.439017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:48.439565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:48.442370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:48.448325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:48.448813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:48.449273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:48.449965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:48.450421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:48.450889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:48.614036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:48.622148 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70a4c11e-9d84-4722-a08d-f5342b4cc9ad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.187323 Nov 03 04:33:48.622726 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3026/6169] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:48 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:49.124227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:49.126306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:33:49.286456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8cae0480-9786-45ca-8732-ec8e0dac05b1 req-66abc478-f748-47a4-a5f7-513729d9d2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed70470a-8acf-4092-99d9-055b7665d1d1", "name": "network-vif-plugged", "status": "completed", "tag": "aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:49.299141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8cae0480-9786-45ca-8732-ec8e0dac05b1 req-66abc478-f748-47a4-a5f7-513729d9d2b8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:49.299633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8cae0480-9786-45ca-8732-ec8e0dac05b1 req-66abc478-f748-47a4-a5f7-513729d9d2b8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:49.300070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8cae0480-9786-45ca-8732-ec8e0dac05b1 req-66abc478-f748-47a4-a5f7-513729d9d2b8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:49.312143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8cae0480-9786-45ca-8732-ec8e0dac05b1 req-66abc478-f748-47a4-a5f7-513729d9d2b8 service nova] Creating event network-vif-plugged:aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2 for instance ed70470a-8acf-4092-99d9-055b7665d1d1 on n-h2-854653-7 Nov 03 04:33:49.317402 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8cae0480-9786-45ca-8732-ec8e0dac05b1 req-66abc478-f748-47a4-a5f7-513729d9d2b8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197834 Nov 03 04:33:49.317922 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3144/6170] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:33:49.645739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:49.646288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:49.653302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:49.653789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:49.655110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:49.655110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:49.655483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:49.655909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:49.818227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:49.821467 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6f1d4c19-a6aa-497f-9b57-b717cfce0206 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.180311 Nov 03 04:33:49.822162 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3027/6171] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:49 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:50.845405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:50.846229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:50.853039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:50.853522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:50.853974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:50.854648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:50.855101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:50.855524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:51.030262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:51.038017 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5c4709f-1f9d-4d2a-ae9b-4e5f5d5a4032 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1472 microversion: 2.1 time: 0.197987 Nov 03 04:33:51.043266 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3145/6172] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:50 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:33:52.061431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:52.062373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:52.069982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:52.070478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:52.070915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:52.071640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:52.072127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:52.072555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:52.238157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:52.247206 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ebfc1be0-c3bd-4921-819f-3fdf86651e33 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1644 microversion: 2.1 time: 0.189882 Nov 03 04:33:52.247821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3028/6173] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:52 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1644 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:52.270834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:52.271481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:52.279345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:52.279842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:52.280285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:52.281008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:52.281490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:52.281933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:52.436290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:33:52.444730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a9b3db2b-c9a3-40d3-a9f5-0682efd62a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1644 microversion: 2.1 time: 0.177750 Nov 03 04:33:52.445450 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3146/6174] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:52 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1644 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:52.467389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:33:52.468037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:33:52.474071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:52.474708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:52.475007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:52.475699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:52.476203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:52.476624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:52.797143 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bcd52c15-3821-4e3e-b18b-8ff6236e5d0f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1795 microversion: 2.1 time: 0.334056 Nov 03 04:33:52.797724 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3029/6175] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:33:52 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1795 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:33:54.884397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2758693f-76ae-45cd-b031-213f3a3df5a8 req-8dad0ada-2602-4c3b-9eb3-afe570d8d6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed70470a-8acf-4092-99d9-055b7665d1d1", "tag": "aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:33:54.906635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2758693f-76ae-45cd-b031-213f3a3df5a8 req-8dad0ada-2602-4c3b-9eb3-afe570d8d6c2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:33:54.907380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2758693f-76ae-45cd-b031-213f3a3df5a8 req-8dad0ada-2602-4c3b-9eb3-afe570d8d6c2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:33:54.908177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2758693f-76ae-45cd-b031-213f3a3df5a8 req-8dad0ada-2602-4c3b-9eb3-afe570d8d6c2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:33:54.925099 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2758693f-76ae-45cd-b031-213f3a3df5a8 req-8dad0ada-2602-4c3b-9eb3-afe570d8d6c2 service nova] Creating event network-changed:aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2 for instance ed70470a-8acf-4092-99d9-055b7665d1d1 on n-h2-854653-7 Nov 03 04:33:54.930574 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2758693f-76ae-45cd-b031-213f3a3df5a8 req-8dad0ada-2602-4c3b-9eb3-afe570d8d6c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062455 Nov 03 04:33:54.931411 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3147/6176] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:07.299958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:07.300518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:07.303282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=20 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:07.303808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=48 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:07.308716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.309241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.309703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.310463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.310919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.311364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.335104 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce57f434-990e-4835-a14e-42988b7987fd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff/ips" status: 200 len: 149 microversion: 2.1 time: 0.039035 Nov 03 04:34:07.335674 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3030/6177] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:34:07 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:07.347124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=11 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:07.347865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=38 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:07.352242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6895c76a-3fba-4b20-8b35-2b0318342433"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:07.355491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:07.361603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.362188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.362628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.363318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.363770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.364194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.446091 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Invalid volume: volume 6895c76a-3fba-4b20-8b35-2b0318342433 is already attached to instances: 3d8bec4d-235f-455c-ab36-9f26eb7bac34 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff/os-volume_attachments HTTP/1.1 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 74 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: {"volumeAttachment": {"volumeId": "6895c76a-3fba-4b20-8b35-2b0318342433"}} Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: exception: Invalid volume: volume 6895c76a-3fba-4b20-8b35-2b0318342433 is already attached to instances: 3d8bec4d-235f-455c-ab36-9f26eb7bac34 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': 'a33da54b-d47c-4a3f-a349-b9e6ae8268ff', 'body': {'volumeAttachment': {'volumeId': '6895c76a-3fba-4b20-8b35-2b0318342433'}}} Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6895c76a-3fba-4b20-8b35-2b0318342433 is already attached to instances: 3d8bec4d-235f-455c-ab36-9f26eb7bac34 Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:34:07.447882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6895c76a-3fba-4b20-8b35-2b0318342433 is already attached to instances: 3d8bec4d-235f-455c-ab36-9f26eb7bac34 Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6895c76a-3fba-4b20-8b35-2b0318342433 is already attached to instances: 3d8bec4d-235f-455c-ab36-9f26eb7bac34 Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 400 to user: Invalid volume: volume 6895c76a-3fba-4b20-8b35-2b0318342433 is already attached to instances: 3d8bec4d-235f-455c-ab36-9f26eb7bac34 {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-231dcef3-9834-4581-9144-e31788927177 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104198 Nov 03 04:34:07.453156 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3148/6178] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:34:07 2022] POST /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:34:07.460080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:07.460585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:07.467139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.467611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.468051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.468743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.469270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.469709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.500824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:34:07.842150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5def751b-afa9-4d3d-99ba-526188c00fa7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 204 len: 0 microversion: 2.1 time: 0.385866 Nov 03 04:34:07.843465 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3031/6179] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:34:07 2022] DELETE /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:34:07.852407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:07.853164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:07.860077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.860681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.861242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.861958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:07.862417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:07.862845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:07.996317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:08.004823 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc9b305b-720a-4e03-8eb3-25aef51efc9e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1682 microversion: 2.1 time: 0.156530 Nov 03 04:34:08.005985 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3149/6180] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:07 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:09.030389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:09.031313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:09.038776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:09.039281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:09.039733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:09.040448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:09.040947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:09.041430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:09.173947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:09.181793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f4a5e29-bb6c-4a57-83b6-65a8c4fab957 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1682 microversion: 2.1 time: 0.156674 Nov 03 04:34:09.182376 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3032/6181] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:09 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:10.206015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:10.207491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:10.217280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:10.218081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:10.218736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:10.219405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:10.219860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:10.221367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:10.237886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c4bd7efb-f30a-4f7c-99c1-54115166e715 req-46d02eee-e30d-4e61-bbbb-3e9e19001c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33da54b-d47c-4a3f-a349-b9e6ae8268ff", "name": "network-vif-deleted", "tag": "5de6cef9-ec5f-407f-bc92-80ee4915438e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:10.248817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c4bd7efb-f30a-4f7c-99c1-54115166e715 req-46d02eee-e30d-4e61-bbbb-3e9e19001c3d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:10.249606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c4bd7efb-f30a-4f7c-99c1-54115166e715 req-46d02eee-e30d-4e61-bbbb-3e9e19001c3d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:10.250225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c4bd7efb-f30a-4f7c-99c1-54115166e715 req-46d02eee-e30d-4e61-bbbb-3e9e19001c3d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:10.263223 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c4bd7efb-f30a-4f7c-99c1-54115166e715 req-46d02eee-e30d-4e61-bbbb-3e9e19001c3d service nova] Creating event network-vif-deleted:5de6cef9-ec5f-407f-bc92-80ee4915438e for instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff on n-h1-854653-7 Nov 03 04:34:10.269549 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c4bd7efb-f30a-4f7c-99c1-54115166e715 req-46d02eee-e30d-4e61-bbbb-3e9e19001c3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035104 Nov 03 04:34:10.270397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3033/6182] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:34:10.340757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:10.352738 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e81d8e1d-02d2-422f-9443-376ba780555e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 200 len: 1614 microversion: 2.1 time: 0.151240 Nov 03 04:34:10.353631 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3150/6183] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:10 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 1614 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:11.378780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:11.379489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:11.386814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:11.387261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:11.387705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:11.388407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:11.388864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:11.389802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:11.404809 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff HTTP/1.1 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a33da54b-d47c-4a3f-a349-b9e6ae8268ff'} Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:11.406544 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f66b9ee6-2f85-4a64-a074-1813d6acf455 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 404 len: 111 microversion: 2.1 time: 0.034489 Nov 03 04:34:11.414485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3034/6184] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:11 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:34:11.418514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e6ce92c-2395-47b1-bdd8-3e4819cdef24 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '.version_select at 0x7ff7f84a09d0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:11.488072 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e6ce92c-2395-47b1-bdd8-3e4819cdef24 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085078079" status: 202 len: 0 microversion: 2.1 time: 0.074577 Nov 03 04:34:11.488815 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3151/6185] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:34:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085078079 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:34:12.321345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:12.321854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:12.329908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:12.330650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:12.331433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:12.332251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:12.332720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:12.333185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:12.416365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lazy-loading 'services' on Instance uuid 3d8bec4d-235f-455c-ab36-9f26eb7bac34 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:34:12.606218 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-03124cd3-2149-4a25-a112-f307c6cc662b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments/6895c76a-3fba-4b20-8b35-2b0318342433" status: 202 len: 0 microversion: 2.1 time: 0.288538 Nov 03 04:34:12.606824 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3035/6186] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:34:12 2022] DELETE /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments/6895c76a-3fba-4b20-8b35-2b0318342433 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:34:12.616298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:12.619278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:12.625887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:12.626380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:12.626826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:12.627520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:12.627977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:12.628404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:12.658650 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b6156095-40ae-4895-96d8-b230b9be5a23 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047274 Nov 03 04:34:12.659427 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3152/6187] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:34:12 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:13.676095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:13.678863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:13.689889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:13.690385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:13.690861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:13.691590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:13.692045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:13.692468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:13.726923 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f97548d9-a995-4d24-a6de-365480f62609 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057212 Nov 03 04:34:13.727486 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3036/6188] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:34:13 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:14.740141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:14.742623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:14.749125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:14.749685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:14.750194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:14.750965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:14.751513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:14.752028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:14.783609 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c0ea9612-6f36-4118-9dab-8cfb4d00fe3b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047479 Nov 03 04:34:14.784364 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3153/6189] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:34:14 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:15.796587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:15.799020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:15.806025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:15.806595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:15.807109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:15.807881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:15.808451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:15.808893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:15.852643 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-518fee27-1311-46a1-95ad-a8959c2aaa49 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060061 Nov 03 04:34:15.853241 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3037/6190] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:34:15 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:16.865508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:16.867684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:16.875901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:16.878153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:16.878153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:16.878153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:16.878153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:16.878589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:16.932520 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a675384-3ede-4b6c-a882-a79f6681416b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070454 Nov 03 04:34:16.933435 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3154/6191] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:34:16 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:17.945607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:17.948390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:17.955528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:17.956022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:17.956495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:17.957219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:17.957676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:17.958105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:17.988211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1679a7fe-4f04-4d4e-b4c4-9e810477fdd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046794 Nov 03 04:34:17.988787 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3038/6192] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:34:17 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:19.001869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:19.004058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:19.011346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:19.015891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:19.015891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:19.015891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:19.015891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:19.015891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:19.046478 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-de814215-4f62-4100-be13-05d8bbcc5fce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048644 Nov 03 04:34:19.050259 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3155/6193] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:34:18 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:34:19.115679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:19.115679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:19.118625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:19.119113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:19.119551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:19.120244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:19.120703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:19.121220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:19.146677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:34:19.412094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6857340-fdb0-46b2-b064-3c7ea68117b1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 204 len: 0 microversion: 2.1 time: 0.304311 Nov 03 04:34:19.412701 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3039/6194] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:34:19 2022] DELETE /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:34:19.421438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:19.422062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:19.428300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:19.428788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:19.429270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:19.429970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:19.430432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:19.430868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:19.563577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:19.571418 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0e71aa63-cdac-4e65-b711-c30345e1387f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1682 microversion: 2.1 time: 0.153793 Nov 03 04:34:19.571996 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3156/6195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:19 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:20.598443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:20.598443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:20.604836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:20.605365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:20.605801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:20.606518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:20.606972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:20.607398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:20.744598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:20.752729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-297f4422-a9ba-4041-9f5b-de23d9f19f04 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1682 microversion: 2.1 time: 0.160877 Nov 03 04:34:20.753329 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3040/6196] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:20 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:34:21.777703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:21.778566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:21.786083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:21.786575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:21.787258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:21.787968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:21.788443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:21.788871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:21.878370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:21.887838 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-67f9001f-5b7e-4fe8-b1f9-106a6b88092a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1614 microversion: 2.1 time: 0.115896 Nov 03 04:34:21.888841 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3157/6197] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:21 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:22.118937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c534654d-f8d6-4017-8094-492dda54d430 req-85b4dc25-938e-40fb-b53d-b57e8c470f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8bec4d-235f-455c-ab36-9f26eb7bac34", "name": "network-vif-deleted", "tag": "a33c81ff-df74-401c-b096-f8bb17f8428b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:22.143799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c534654d-f8d6-4017-8094-492dda54d430 req-85b4dc25-938e-40fb-b53d-b57e8c470f89 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:22.144573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c534654d-f8d6-4017-8094-492dda54d430 req-85b4dc25-938e-40fb-b53d-b57e8c470f89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:22.145229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c534654d-f8d6-4017-8094-492dda54d430 req-85b4dc25-938e-40fb-b53d-b57e8c470f89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:22.164082 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c534654d-f8d6-4017-8094-492dda54d430 req-85b4dc25-938e-40fb-b53d-b57e8c470f89 service nova] Creating event network-vif-deleted:a33c81ff-df74-401c-b096-f8bb17f8428b for instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 on n-h2-854653-7 Nov 03 04:34:22.174884 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c534654d-f8d6-4017-8094-492dda54d430 req-85b4dc25-938e-40fb-b53d-b57e8c470f89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059553 Nov 03 04:34:22.175444 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3041/6198] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:22.912004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:22.913183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:22.925959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:22.926747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:22.927373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:22.928278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:22.928742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:22.929216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:22.971349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:22.972120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:22.972560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:22.973032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lazy-loading 'fault' on Instance uuid 3d8bec4d-235f-455c-ab36-9f26eb7bac34 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:34:23.020314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:23.029530 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6849d70c-1cc2-4a9c-8847-e92c4d59ddfe tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 200 len: 1331 microversion: 2.1 time: 0.121451 Nov 03 04:34:23.040457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3158/6199] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:22 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:24.057166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:24.057887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:24.064098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:24.064586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:24.065052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:24.065755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:24.066217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:24.066681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:24.080525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 HTTP/1.1 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '3d8bec4d-235f-455c-ab36-9f26eb7bac34'} Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:24.082172 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12124144-26e9-4b1f-a12a-4de9f804da87 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 404 len: 111 microversion: 2.1 time: 0.031677 Nov 03 04:34:24.087441 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3042/6200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:24 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:34:24.093660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f92ab20a-28d5-4335-b687-63dd558d69e1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '.version_select at 0x7ff7f84a0ca0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:24.186495 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f92ab20a-28d5-4335-b687-63dd558d69e1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157772696" status: 202 len: 0 microversion: 2.1 time: 0.096629 Nov 03 04:34:24.187156 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3159/6201] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1157772696 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:34:24.980569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b584b8e-8946-4b5d-a863-d41c846e4ea8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: .version_select at 0x7ff7f3f9d5e0>, body: {"keypair": {"name": "tempest-keypair-1260145969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJJSvBFhjVYc3Z5gmURgEC9qNj/DVRFOCMK+yoku4Kvs9VaaI99LVA9PEKt2W2M/Om3z3KxPdzDLZPlbDB5ebe/EJL1hTAJcM3LYpbD9Co6sKdx+MHVvwilhZ9ODSg1cg=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:24.996346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3b584b8e-8946-4b5d-a863-d41c846e4ea8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:34:25.001430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3b584b8e-8946-4b5d-a863-d41c846e4ea8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:34:25.014633 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b584b8e-8946-4b5d-a863-d41c846e4ea8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:34:26.033553 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b584b8e-8946-4b5d-a863-d41c846e4ea8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 49988. Nov 03 04:34:26.119780 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b584b8e-8946-4b5d-a863-d41c846e4ea8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.143788 Nov 03 04:34:26.120475 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3043/6202] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:34:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:28.688304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-593463798", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90a5130a-d918-44b0-bf8d-6477ad7d46bd"}], "security_groups": [{"name": "tempest-securitygroup--325201949"}], "key_name": "tempest-keypair-1260145969", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:28.793506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] validate_networks() for [('90a5130a-d918-44b0-bf8d-6477ad7d46bd', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:34:29.170857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:34:29.171367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:34:29.171805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:34:29.172221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:34:29.172666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:34:29.182138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:29.182672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:29.183080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:29.183710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:29.184173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:29.184607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:29.202328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:34:29.207523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:34:29.220651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:34:29.223041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:34:29.320132 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-692833c6-e18f-4c85-9a83-9047b92c9fb8 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.636217 Nov 03 04:34:29.320799 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3160/6203] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:34:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:34:29.334044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9237110-6c58-4932-8069-d54996507ceb tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:29.338835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9237110-6c58-4932-8069-d54996507ceb tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:29.394797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9237110-6c58-4932-8069-d54996507ceb tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:29.402877 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9237110-6c58-4932-8069-d54996507ceb tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1241 microversion: 2.1 time: 0.074045 Nov 03 04:34:29.403450 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3044/6204] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:29 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:30.426729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:30.427663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:30.433350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:30.433842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:30.434285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:30.434980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:30.435436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:30.435867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:30.499059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:30.507381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9dca7422-2f1e-4cf2-963c-174a58b12f03 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1245 microversion: 2.1 time: 0.085576 Nov 03 04:34:30.513994 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3161/6205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:30 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:31.530180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:31.531414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:31.542032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:31.543252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:31.543816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:31.544623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:31.545196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:31.545706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:31.614995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:31.626811 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96c45fdd-93f8-41fe-8f81-3dc37606d5cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1311 microversion: 2.1 time: 0.098267 Nov 03 04:34:31.641204 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3045/6206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:31 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:32.652233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:32.653849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:32.661507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:32.662417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:32.663079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:32.664049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:32.664714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:32.665379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:33.230492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:33.244155 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14738f5f-ad08-45f1-bd23-dd126db1b233 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1366 microversion: 2.1 time: 0.596648 Nov 03 04:34:33.246331 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3162/6207] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:32 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1366 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:34:33.545185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0d881a53-9239-4539-9ac2-021b87e03066 req-58c8024b-6014-4a64-88e5-c7b5b4af6de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37536020-8fbd-4608-8068-1bc25ccf1757", "tag": "6a5822e5-18a2-40b4-aad6-391376f7dd7e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:33.565480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0d881a53-9239-4539-9ac2-021b87e03066 req-58c8024b-6014-4a64-88e5-c7b5b4af6de0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:33.566318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0d881a53-9239-4539-9ac2-021b87e03066 req-58c8024b-6014-4a64-88e5-c7b5b4af6de0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:33.566752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0d881a53-9239-4539-9ac2-021b87e03066 req-58c8024b-6014-4a64-88e5-c7b5b4af6de0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:33.578302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0d881a53-9239-4539-9ac2-021b87e03066 req-58c8024b-6014-4a64-88e5-c7b5b4af6de0 service nova] Creating event network-changed:6a5822e5-18a2-40b4-aad6-391376f7dd7e for instance 37536020-8fbd-4608-8068-1bc25ccf1757 on n-h1-854653-7 Nov 03 04:34:33.583668 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0d881a53-9239-4539-9ac2-021b87e03066 req-58c8024b-6014-4a64-88e5-c7b5b4af6de0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042778 Nov 03 04:34:33.589328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3046/6208] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:34.273162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:34.273780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:34.280639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:34.281466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:34.288983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:34.290164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:34.290878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:34.291751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:34.559692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:34.587760 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97c5b501-2282-4555-b3af-252eed0739e6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1366 microversion: 2.1 time: 0.318583 Nov 03 04:34:34.589204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3163/6209] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:34 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:35.615971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:35.616884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:35.628263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:35.629289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:35.630268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:35.632507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:35.632507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:35.632991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:35.826265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:35.835651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30c3470b-9462-40ea-b083-c16e32338aaa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1366 microversion: 2.1 time: 0.224871 Nov 03 04:34:35.836263 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3047/6210] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:35 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:36.864744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:36.869977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:36.876564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:36.877093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:36.877546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:36.881536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:36.882025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:36.883034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:37.158886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:37.178382 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1a2dab52-b40d-4664-9914-5ee94299d12c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1366 microversion: 2.1 time: 0.312731 Nov 03 04:34:37.179463 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3164/6211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:36 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:38.202036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:38.202665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:38.205591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:38.211009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:38.215642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:38.215642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:38.215642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:38.215642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:38.215642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:38.218049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:38.418994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:38.428891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9cb97a4e-4b0d-44c4-bcf9-a364a0023528 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1366 microversion: 2.1 time: 0.231451 Nov 03 04:34:38.429823 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3048/6212] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:38 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:38.919999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-72fa2fe1-3b75-4974-931e-42bbebb0bc54 req-a0780c71-efc9-432e-9574-f32926c3e057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37536020-8fbd-4608-8068-1bc25ccf1757", "name": "network-vif-plugged", "status": "completed", "tag": "6a5822e5-18a2-40b4-aad6-391376f7dd7e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:38.926890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:38.937878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1200581431", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "20e1f6ec-6ec4-4f7e-86a7-a57cde909921"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1050022468", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ed70470a-8acf-4092-99d9-055b7665d1d1"]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:38.948124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72fa2fe1-3b75-4974-931e-42bbebb0bc54 req-a0780c71-efc9-432e-9574-f32926c3e057 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:38.948608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72fa2fe1-3b75-4974-931e-42bbebb0bc54 req-a0780c71-efc9-432e-9574-f32926c3e057 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:38.949068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72fa2fe1-3b75-4974-931e-42bbebb0bc54 req-a0780c71-efc9-432e-9574-f32926c3e057 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:38.951876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=89 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:38.987078 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-72fa2fe1-3b75-4974-931e-42bbebb0bc54 req-a0780c71-efc9-432e-9574-f32926c3e057 service nova] Creating event network-vif-plugged:6a5822e5-18a2-40b4-aad6-391376f7dd7e for instance 37536020-8fbd-4608-8068-1bc25ccf1757 on n-h1-854653-7 Nov 03 04:34:38.998989 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-72fa2fe1-3b75-4974-931e-42bbebb0bc54 req-a0780c71-efc9-432e-9574-f32926c3e057 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083085 Nov 03 04:34:38.999599 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3165/6213] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:39.059745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] validate_networks() for [('20e1f6ec-6ec4-4f7e-86a7-a57cde909921', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:34:39.404324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:39.452132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:39.454099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:39.460067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:39.460955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:39.470297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:39.470912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:39.471633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:39.472716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:39.473434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:39.474098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:39.737920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:34:39.738869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:34:39.739818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:34:39.740454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:34:39.741148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:34:39.770682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:39.772417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:39.775558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:39.777164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:39.778195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:39.778826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:39.779432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:39.789238 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c6ba37d-f75f-4684-ac5e-7ab982b6ccdf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1366 microversion: 2.1 time: 0.338165 Nov 03 04:34:39.789839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3166/6214] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:39 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:34:39.806280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Getting quotas for project ef44251e47054e4aaf388ce8004511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:34:39.817803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Getting quotas for user ab4c3736e94d4db0835b776af2e6588c and project ef44251e47054e4aaf388ce8004511fd. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:34:39.832896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:34:39.835904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:34:39.958636 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b1f8a4a1-a0de-45f9-9bd2-a2b78c53e614 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.025450 Nov 03 04:34:39.960170 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3049/6215] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:34:38 2022] POST /compute/v2.1/servers => generated 361 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:34:39.972286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-129312d3-257a-443c-b24a-0a313a321a15 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:39.973684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-129312d3-257a-443c-b24a-0a313a321a15 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:40.047198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-129312d3-257a-443c-b24a-0a313a321a15 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:40.056357 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-129312d3-257a-443c-b24a-0a313a321a15 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1242 microversion: 2.1 time: 0.087459 Nov 03 04:34:40.057821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3167/6216] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:39 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:40.818651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:40.819338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:40.828187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:40.828679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:40.829173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:40.829887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:40.830343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:40.830774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:41.000933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:41.010577 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c235f0c-f0ce-4842-989d-fc49db785a6a tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1555 microversion: 2.1 time: 0.195866 Nov 03 04:34:41.011342 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3050/6217] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:40 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:34:41.041955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:41.042826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:41.053375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:41.054111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:41.054832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:41.057191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:41.057191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:41.057914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:41.080123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:41.083148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:41.087149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:41.087638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:41.088833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:41.089887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:41.090527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:41.091162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:41.182715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:41.192963 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7d75115-7c2b-4cb0-a84e-96bee099c871 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156229 Nov 03 04:34:41.193911 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3168/6218] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:34:41 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:41.202171 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-46e1666b-338e-45f2-a4cc-114214856cdf tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1246 microversion: 2.1 time: 0.125883 Nov 03 04:34:41.203517 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3051/6219] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:41 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:34:42.235162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:42.235923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:42.247383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:42.247953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:42.248451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:42.249573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:42.250353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:42.251093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:42.348032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:42.357999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69424270-2775-4149-be6b-ac4ca7413081 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1294 microversion: 2.1 time: 0.127929 Nov 03 04:34:42.359288 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3169/6220] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:42 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:42.473881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9e2405cb-b87f-4a4b-af6e-1f72fd68a90f req-a2cb882e-d429-4f46-8a85-f1d8f180e7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37536020-8fbd-4608-8068-1bc25ccf1757", "tag": "6a5822e5-18a2-40b4-aad6-391376f7dd7e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:42.485839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e2405cb-b87f-4a4b-af6e-1f72fd68a90f req-a2cb882e-d429-4f46-8a85-f1d8f180e7a2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:42.486584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e2405cb-b87f-4a4b-af6e-1f72fd68a90f req-a2cb882e-d429-4f46-8a85-f1d8f180e7a2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:42.487363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9e2405cb-b87f-4a4b-af6e-1f72fd68a90f req-a2cb882e-d429-4f46-8a85-f1d8f180e7a2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:42.500086 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9e2405cb-b87f-4a4b-af6e-1f72fd68a90f req-a2cb882e-d429-4f46-8a85-f1d8f180e7a2 service nova] Creating event network-changed:6a5822e5-18a2-40b4-aad6-391376f7dd7e for instance 37536020-8fbd-4608-8068-1bc25ccf1757 on n-h1-854653-7 Nov 03 04:34:42.507647 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9e2405cb-b87f-4a4b-af6e-1f72fd68a90f req-a2cb882e-d429-4f46-8a85-f1d8f180e7a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044487 Nov 03 04:34:42.507897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3052/6221] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:43.389529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:43.390906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:43.400025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:43.401295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:43.401919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:43.403185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:43.403805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:43.404488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:43.489683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:43.502367 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-31c7e23c-5e1d-4d5d-a77b-a1b394e27bad tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.118411 Nov 03 04:34:43.514953 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3170/6222] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:43 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:44.534005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:44.535205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:44.541324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:44.541817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:44.542259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:44.543021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:44.543534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:44.543965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:44.605515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c51e915b-1fe6-4119-88fb-4c4a9a5d1b00 req-e5331ae1-b889-4d53-b736-c995c344c378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f37990-6aa8-4b45-8d20-73ebb27b332c", "tag": "2a7326d3-b401-4684-bd5f-62fe29e5295e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:44.615719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c51e915b-1fe6-4119-88fb-4c4a9a5d1b00 req-e5331ae1-b889-4d53-b736-c995c344c378 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:44.616269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c51e915b-1fe6-4119-88fb-4c4a9a5d1b00 req-e5331ae1-b889-4d53-b736-c995c344c378 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:44.616712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c51e915b-1fe6-4119-88fb-4c4a9a5d1b00 req-e5331ae1-b889-4d53-b736-c995c344c378 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:44.630320 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c51e915b-1fe6-4119-88fb-4c4a9a5d1b00 req-e5331ae1-b889-4d53-b736-c995c344c378 service nova] Creating event network-changed:2a7326d3-b401-4684-bd5f-62fe29e5295e for instance 73f37990-6aa8-4b45-8d20-73ebb27b332c on n-h1-854653-7 Nov 03 04:34:44.637696 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c51e915b-1fe6-4119-88fb-4c4a9a5d1b00 req-e5331ae1-b889-4d53-b736-c995c344c378 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035299 Nov 03 04:34:44.638132 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3171/6223] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:34:44.674380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:44.684749 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1afa34d1-ac4f-4d55-ad02-8505a6128b52 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.155885 Nov 03 04:34:44.685940 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3053/6224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:44 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:45.710127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:45.710828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:45.717626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:45.718082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:45.720565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:45.720565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:45.720565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:45.720565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:45.813167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:45.821882 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a8b9569-852f-4355-889f-8ee49145b646 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.116762 Nov 03 04:34:45.823163 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3172/6225] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:45 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:46.846656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:46.847336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:46.854239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:46.854729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:46.855172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:46.855873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:46.856354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:46.856769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:46.944159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:46.952655 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-429f4078-f4ba-42e1-afc7-c8f86fd90d0d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.109911 Nov 03 04:34:46.953275 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3054/6226] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:46 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:47.975343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:47.975963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:47.983474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:47.983983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:47.984421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:47.985134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:47.985592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:47.986016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:48.067685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:48.076146 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-898d68df-df04-4bc4-b426-d604d922f527 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.104722 Nov 03 04:34:48.076726 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3173/6227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:47 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:49.099774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:49.100519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:49.108362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:49.108881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:49.109348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:49.110069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:49.110555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:49.110978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:49.193361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:49.201302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38f4058a-b59f-4925-84d5-a5b91f15f817 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.105653 Nov 03 04:34:49.202237 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3055/6228] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:49 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:50.225723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:50.226260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:50.229066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:50.234240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:50.234728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:50.235268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:50.235976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:50.236424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:50.236884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:50.335381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:50.343414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2964986c-83b7-4934-952d-1022566ade3f tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.121927 Nov 03 04:34:50.344243 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3174/6229] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:50 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:51.367133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:51.367864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:51.369886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:51.370574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:34:51.376372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:51.376792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:51.377270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:51.377978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:51.378443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:51.378881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:51.461740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:51.470246 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dba84d23-7814-4a15-9489-3e4280160bcd tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.107060 Nov 03 04:34:51.477356 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3056/6230] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:51 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:52.498420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:52.499065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:52.507908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:52.512195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:52.512195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:52.512195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:52.512195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:52.512195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:52.516399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9568d072-00b2-4d2e-b0c6-1ad25ceb7ce0 req-32bb0651-23f9-461b-85be-4c886a17888e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f37990-6aa8-4b45-8d20-73ebb27b332c", "name": "network-vif-plugged", "status": "completed", "tag": "2a7326d3-b401-4684-bd5f-62fe29e5295e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:52.532082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9568d072-00b2-4d2e-b0c6-1ad25ceb7ce0 req-32bb0651-23f9-461b-85be-4c886a17888e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:52.532665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9568d072-00b2-4d2e-b0c6-1ad25ceb7ce0 req-32bb0651-23f9-461b-85be-4c886a17888e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:52.533209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9568d072-00b2-4d2e-b0c6-1ad25ceb7ce0 req-32bb0651-23f9-461b-85be-4c886a17888e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:52.549669 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9568d072-00b2-4d2e-b0c6-1ad25ceb7ce0 req-32bb0651-23f9-461b-85be-4c886a17888e service nova] Creating event network-vif-plugged:2a7326d3-b401-4684-bd5f-62fe29e5295e for instance 73f37990-6aa8-4b45-8d20-73ebb27b332c on n-h1-854653-7 Nov 03 04:34:52.554965 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9568d072-00b2-4d2e-b0c6-1ad25ceb7ce0 req-32bb0651-23f9-461b-85be-4c886a17888e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042491 Nov 03 04:34:52.557146 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3057/6231] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:52.616564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:52.627388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e98a7b5-6138-468d-9ceb-55a20c25630d tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.132758 Nov 03 04:34:52.629227 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3175/6232] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:52 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:34:53.652921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:53.653675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:53.660587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:53.661117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:53.661556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:53.662237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:53.662686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:53.663112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:53.749250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:53.757214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c0978e7f-4860-43a8-b164-9b60b74320d1 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1300 microversion: 2.1 time: 0.109188 Nov 03 04:34:53.770055 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3058/6233] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:53 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:54.780288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:54.780909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:54.787963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:54.788455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:54.788895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:54.789623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:54.790084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:54.790534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:54.879002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:54.887764 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3ec6cd80-ab3b-4f70-81c1-f3f254670698 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1473 microversion: 2.1 time: 0.111364 Nov 03 04:34:54.888347 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3176/6234] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:54 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1473 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:54.914724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:54.916357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:54.923886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:54.924387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:54.924832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:54.925589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:54.926092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:54.926532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.021896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:55.032041 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cefef8d1-cbed-44b7-a5a1-7ca4e0b17500 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1473 microversion: 2.1 time: 0.121253 Nov 03 04:34:55.032573 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3059/6235] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:54 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1473 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:34:55.054319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:55.054946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:55.061915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.062402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.062839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.063548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.064006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.064434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.154086 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7a619d0-36ea-4419-a110-6ce3a5284d9f tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1624 microversion: 2.1 time: 0.103526 Nov 03 04:34:55.154687 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3177/6236] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:55 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1624 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:55.176274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:55.176908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:55.184026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.184559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.185001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.185739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.186221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.186652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.334944 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-697f73eb-e452-4fcb-86ef-0936730ee6b9 tempest-TestSecurityGroupsBasicOps-1341413461 tempest-TestSecurityGroupsBasicOps-1341413461-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1914 microversion: 2.1 time: 0.162841 Nov 03 04:34:55.335530 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3060/6237] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:55 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1914 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:55.403428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:55.403935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:55.410156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.410650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.411091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.411784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.412244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.412672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.439148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:34:55.730419 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9310d7c4-af08-4fea-8f6b-56ac5c622570 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "DELETE /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 204 len: 0 microversion: 2.1 time: 0.330802 Nov 03 04:34:55.731227 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3178/6238] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:34:55 2022] DELETE /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:34:55.739933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:55.740553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:55.747804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.748296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.748734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.749477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:55.750029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:55.750494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:55.836977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:55.844820 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5d7bc1b1-0e59-4d8e-b8c6-2562dd813e95 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1479 microversion: 2.1 time: 0.109012 Nov 03 04:34:55.845434 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3061/6239] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:55 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1479 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:56.870477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:56.871094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:56.877928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:56.878414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:56.878856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:56.879546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:56.880005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:56.880432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:56.971817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:56.979900 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-514c7ac3-85bb-465c-9208-63cfc2ef3a83 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1479 microversion: 2.1 time: 0.114259 Nov 03 04:34:56.980676 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3179/6240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:56 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1479 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:57.777725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1f417e30-e389-4c69-99db-a0349049f66a req-1eb10f8e-1f44-4e43-a624-9e97e06b1f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f37990-6aa8-4b45-8d20-73ebb27b332c", "name": "network-vif-deleted", "tag": "2a7326d3-b401-4684-bd5f-62fe29e5295e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:34:57.797778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1f417e30-e389-4c69-99db-a0349049f66a req-1eb10f8e-1f44-4e43-a624-9e97e06b1f95 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:57.798564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1f417e30-e389-4c69-99db-a0349049f66a req-1eb10f8e-1f44-4e43-a624-9e97e06b1f95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:57.799176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1f417e30-e389-4c69-99db-a0349049f66a req-1eb10f8e-1f44-4e43-a624-9e97e06b1f95 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:57.811425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1f417e30-e389-4c69-99db-a0349049f66a req-1eb10f8e-1f44-4e43-a624-9e97e06b1f95 service nova] Creating event network-vif-deleted:2a7326d3-b401-4684-bd5f-62fe29e5295e for instance 73f37990-6aa8-4b45-8d20-73ebb27b332c on n-h1-854653-7 Nov 03 04:34:57.817386 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1f417e30-e389-4c69-99db-a0349049f66a req-1eb10f8e-1f44-4e43-a624-9e97e06b1f95 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043284 Nov 03 04:34:57.818258 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3062/6241] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:34:58.007470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:58.007470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:58.011957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:58.012450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:58.012894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:58.013620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:58.014103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:58.014534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:58.084934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:34:58.093943 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b6cfc328-307a-4d5f-915c-3f333a4d507a tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 200 len: 1327 microversion: 2.1 time: 0.094267 Nov 03 04:34:58.094530 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3180/6242] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:57 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:34:59.118095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:34:59.118808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: 73f37990-6aa8-4b45-8d20-73ebb27b332c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:34:59.125284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:59.125802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:59.126207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:59.126919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:34:59.127380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:34:59.127806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:34:59.143887 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] HTTP exception thrown: Instance 73f37990-6aa8-4b45-8d20-73ebb27b332c could not be found. Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Request method failure captured: Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c HTTP/1.1 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0SU4T1w6RPi8_RvO8BofoTI3QAeYyQ7cEw0trA8mo-kNvCLfQWGkFSa472qH7jbbTmijZjhUNgvKw_oS_xCH12OElYk29IClpf3WPWpSNBeq5tDRdFpYAnngTPNIiXjDtqAl0YA0mLK6g5XIpVDn8ErJwXbBLPtxZ39NhvKP1gxkg4 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: ef44251e47054e4aaf388ce8004511fd Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1732675692 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef44251e47054e4aaf388ce8004511fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef44251e47054e4aaf388ce8004511fd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef44251e47054e4aaf388ce8004511fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef44251e47054e4aaf388ce8004511fd"}]}] Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1732675692 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: ef44251e47054e4aaf388ce8004511fd Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1732675692 Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestSecurityGroupsBasicOps-1732675692-project Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ab4c3736e94d4db0835b776af2e6588c Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1732675692-project Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 73f37990-6aa8-4b45-8d20-73ebb27b332c could not be found. Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '73f37990-6aa8-4b45-8d20-73ebb27b332c'} Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f37990-6aa8-4b45-8d20-73ebb27b332c could not be found. Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f37990-6aa8-4b45-8d20-73ebb27b332c could not be found. Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:59.144100 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f37990-6aa8-4b45-8d20-73ebb27b332c could not be found. Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Returning 404 to user: Instance 73f37990-6aa8-4b45-8d20-73ebb27b332c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a681f775-62f3-4830-aa9b-5f09cde4e1ee tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c" status: 404 len: 111 microversion: 2.1 time: 0.032699 Nov 03 04:34:59.149638 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3063/6243] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:34:59 2022] GET /compute/v2.1/servers/73f37990-6aa8-4b45-8d20-73ebb27b332c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:35:04.063329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:04.063868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:04.063979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4509ecdc-df7a-4d32-bdc9-8650651c0b58 req-8a1f3d77-85a9-4785-b80b-3e921e74649c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed70470a-8acf-4092-99d9-055b7665d1d1", "tag": "aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:04.070743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:04.071463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:04.072450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:04.073221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:04.073684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:04.074116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:04.076390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4509ecdc-df7a-4d32-bdc9-8650651c0b58 req-8a1f3d77-85a9-4785-b80b-3e921e74649c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:04.077246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4509ecdc-df7a-4d32-bdc9-8650651c0b58 req-8a1f3d77-85a9-4785-b80b-3e921e74649c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:04.077921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4509ecdc-df7a-4d32-bdc9-8650651c0b58 req-8a1f3d77-85a9-4785-b80b-3e921e74649c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:04.093054 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4509ecdc-df7a-4d32-bdc9-8650651c0b58 req-8a1f3d77-85a9-4785-b80b-3e921e74649c service nova] Creating event network-changed:aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2 for instance ed70470a-8acf-4092-99d9-055b7665d1d1 on n-h2-854653-7 Nov 03 04:35:04.099456 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4509ecdc-df7a-4d32-bdc9-8650651c0b58 req-8a1f3d77-85a9-4785-b80b-3e921e74649c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039346 Nov 03 04:35:04.100465 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3064/6244] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:04.106157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:35:04.140521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:04.465093 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-55ff02bf-d170-474f-911d-f23be98b4b91 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 204 len: 0 microversion: 2.1 time: 0.407473 Nov 03 04:35:04.476031 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3181/6245] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:35:04 2022] DELETE /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:35:04.477740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:04.478621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:04.486650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:04.487255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:04.487980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:04.488966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:04.489643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:04.490357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:04.666764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:04.674733 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c08ab27b-a2ae-40f7-9c0e-29013d5a32fa tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1769 microversion: 2.1 time: 0.203248 Nov 03 04:35:04.675296 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3065/6246] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:04 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1769 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:05.703451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:05.705453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:05.711067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:05.711555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:05.711992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:05.712916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:05.713395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:05.714065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:05.892329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:05.907989 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0356f161-70d6-4edc-98b9-c15b3ba47758 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1769 microversion: 2.1 time: 0.208787 Nov 03 04:35:05.909160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3182/6247] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:05 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1769 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:06.592983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-52475518-5807-4824-bf13-65c634ed1088 req-629747e4-4547-4801-ae21-05ef3e9aa72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed70470a-8acf-4092-99d9-055b7665d1d1", "name": "network-vif-deleted", "tag": "aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:06.603700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52475518-5807-4824-bf13-65c634ed1088 req-629747e4-4547-4801-ae21-05ef3e9aa72e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:06.604181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52475518-5807-4824-bf13-65c634ed1088 req-629747e4-4547-4801-ae21-05ef3e9aa72e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:06.604613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-52475518-5807-4824-bf13-65c634ed1088 req-629747e4-4547-4801-ae21-05ef3e9aa72e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:06.617937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-52475518-5807-4824-bf13-65c634ed1088 req-629747e4-4547-4801-ae21-05ef3e9aa72e service nova] Creating event network-vif-deleted:aa1ab114-b6ea-43c4-88b6-6d3e82f9cae2 for instance ed70470a-8acf-4092-99d9-055b7665d1d1 on n-h2-854653-7 Nov 03 04:35:06.623031 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-52475518-5807-4824-bf13-65c634ed1088 req-629747e4-4547-4801-ae21-05ef3e9aa72e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033742 Nov 03 04:35:06.623727 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3066/6248] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:06.932250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:06.933729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:06.944508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:06.945201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:06.945649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:06.946390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:06.947401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:06.947842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:06.991482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:06.991974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:06.992423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:06.992941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lazy-loading 'fault' on Instance uuid ed70470a-8acf-4092-99d9-055b7665d1d1 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:35:07.063270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab4c3736e94d4db0835b776af2e6588c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef44251e47054e4aaf388ce8004511fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:07.072935 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fec8c6c0-932b-4c87-beb3-520e83b4c6a6 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 200 len: 1385 microversion: 2.1 time: 0.144817 Nov 03 04:35:07.073701 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3183/6249] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:06 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 1385 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:08.100408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:08.101193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] [instance: ed70470a-8acf-4092-99d9-055b7665d1d1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:08.109147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:08.109657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:08.110080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:08.110803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:08.111262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:08.111695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:08.128130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] HTTP exception thrown: Instance ed70470a-8acf-4092-99d9-055b7665d1d1 could not be found. Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Request method failure captured: Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 HTTP/1.1 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0SU4T1w6RPi8_RvO8BofoTI3QAeYyQ7cEw0trA8mo-kNvCLfQWGkFSa472qH7jbbTmijZjhUNgvKw_oS_xCH12OElYk29IClpf3WPWpSNBeq5tDRdFpYAnngTPNIiXjDtqAl0YA0mLK6g5XIpVDn8ErJwXbBLPtxZ39NhvKP1gxkg4 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: ef44251e47054e4aaf388ce8004511fd Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1732675692 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef44251e47054e4aaf388ce8004511fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ef44251e47054e4aaf388ce8004511fd", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ef44251e47054e4aaf388ce8004511fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ef44251e47054e4aaf388ce8004511fd"}]}] Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1732675692 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: ef44251e47054e4aaf388ce8004511fd Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1732675692 Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestSecurityGroupsBasicOps-1732675692-project Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: ab4c3736e94d4db0835b776af2e6588c Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1732675692-project Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance ed70470a-8acf-4092-99d9-055b7665d1d1 could not be found. Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ed70470a-8acf-4092-99d9-055b7665d1d1'} Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed70470a-8acf-4092-99d9-055b7665d1d1 could not be found. Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed70470a-8acf-4092-99d9-055b7665d1d1 could not be found. Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:35:08.129835 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed70470a-8acf-4092-99d9-055b7665d1d1 could not be found. Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Returning 404 to user: Instance ed70470a-8acf-4092-99d9-055b7665d1d1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-156d5966-2761-4e9a-85fd-8ce2ee981af5 tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1" status: 404 len: 111 microversion: 2.1 time: 0.036275 Nov 03 04:35:08.135484 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3067/6250] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:08 2022] GET /compute/v2.1/servers/ed70470a-8acf-4092-99d9-055b7665d1d1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:35:12.568440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-536dbcf7-a163-46c6-b961-7b86187b6bea tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] Calling method '.version_select at 0x7ff7f9861e50>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:12.587705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:12.659054 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-536dbcf7-a163-46c6-b961-7b86187b6bea tempest-TestSecurityGroupsBasicOps-1732675692 tempest-TestSecurityGroupsBasicOps-1732675692-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1050022468" status: 202 len: 0 microversion: 2.1 time: 0.094823 Nov 03 04:35:12.659656 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3184/6251] 10.222.0.30 () {58 vars in 1278 bytes} [Thu Nov 3 04:35:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1050022468 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:35:20.353764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:20.354606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=87 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:20.471701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-9285454", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "0a2bfe51-0dc6-4dc0-ae7b-61c50a760ef8"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:20.526099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] validate_networks() for [('0a2bfe51-0dc6-4dc0-ae7b-61c50a760ef8', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:35:20.891727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:35:20.892128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:35:20.892644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:35:20.893088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:35:20.893546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:35:20.903303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:20.904597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:20.904597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:20.905112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:20.905578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:20.906014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:20.923104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Getting quotas for project 4d77c8cc06cd4024b73f16da8d2c9116. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:35:20.928816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Getting quotas for user f6e2280f1fd9444f84a618da4e23cbac and project 4d77c8cc06cd4024b73f16da8d2c9116. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:35:20.941830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:35:20.944120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:35:21.104008 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-77fb6842-c4a4-489c-b04d-64b4d5d901e8 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755998 Nov 03 04:35:21.104649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3068/6252] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:35:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:35:21.113978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:21.119311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ba30263d-d2e4-4923-bc3f-f178f0f93b1f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:21.120156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ba30263d-d2e4-4923-bc3f-f178f0f93b1f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:21.183228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ba30263d-d2e4-4923-bc3f-f178f0f93b1f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:21.189931 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ba30263d-d2e4-4923-bc3f-f178f0f93b1f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1212 microversion: 2.1 time: 0.077758 Nov 03 04:35:21.190600 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3185/6253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:21 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1212 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:22.218265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:22.218836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:22.226489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:22.226984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:22.227431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:22.228136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:22.228597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:22.229051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:22.292861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:22.300980 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87bb090a-1715-4d71-be99-c115273f0e4a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1216 microversion: 2.1 time: 0.086864 Nov 03 04:35:22.306224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3069/6254] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:22 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:23.326806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:23.328001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:23.336535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:23.338227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:23.338678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:23.339377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:23.339834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:23.340258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:23.462941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:23.473739 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a6d0b3c-1527-4409-b6ec-013303e5c869 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1272 microversion: 2.1 time: 0.151344 Nov 03 04:35:23.477093 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3186/6255] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:23 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:24.497251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:24.497830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:24.504911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:24.505450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:24.505995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:24.506590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:24.507052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:24.507749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:24.730170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:24.738971 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2541d409-12d7-43c0-b77f-ffcf7aaafa05 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.245840 Nov 03 04:35:24.739575 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3070/6256] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:24 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:25.252669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f3148a97-cae3-4e28-a0fe-5036cce5747b req-1eaac982-2902-4612-b09f-58d17c7a9ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff59eb2-e71f-4135-8805-2f4b30e244c4", "tag": "d3f9c89b-21be-4876-a9d6-ed143284d707"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:25.267821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f3148a97-cae3-4e28-a0fe-5036cce5747b req-1eaac982-2902-4612-b09f-58d17c7a9ea6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:25.268399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f3148a97-cae3-4e28-a0fe-5036cce5747b req-1eaac982-2902-4612-b09f-58d17c7a9ea6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:25.271846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f3148a97-cae3-4e28-a0fe-5036cce5747b req-1eaac982-2902-4612-b09f-58d17c7a9ea6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:25.280644 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f3148a97-cae3-4e28-a0fe-5036cce5747b req-1eaac982-2902-4612-b09f-58d17c7a9ea6 service nova] Creating event network-changed:d3f9c89b-21be-4876-a9d6-ed143284d707 for instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 on n-h2-854653-7 Nov 03 04:35:25.286345 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f3148a97-cae3-4e28-a0fe-5036cce5747b req-1eaac982-2902-4612-b09f-58d17c7a9ea6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038223 Nov 03 04:35:25.287066 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3187/6257] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:25.763701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:25.764406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:25.770925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:25.771413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:25.771851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:25.772590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:25.773184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:25.773670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:25.983259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:25.991512 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b406a599-2b5b-4f81-ba57-c1df447398e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.232253 Nov 03 04:35:25.992158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3071/6258] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:25 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:27.019221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:27.019221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:27.024488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:27.024975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:27.025460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:27.026189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:27.026646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:27.027079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:27.157452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:27.165772 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a5d69293-fb15-4659-913f-f758fb11c46a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.153071 Nov 03 04:35:27.166227 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3188/6259] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:27 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:28.189213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:28.189886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:28.196983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:28.197503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:28.197995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:28.198692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:28.199144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:28.199569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:28.331294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:28.339775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7b723e7-4379-4f0c-8038-36b92dcaace7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.154714 Nov 03 04:35:28.340342 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3072/6260] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:28 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:29.362719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:29.363469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:29.371075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:29.371565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:29.372011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:29.372718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:29.373200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:29.373753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:29.514186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:29.522477 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72e0a735-dc4a-4fbd-a468-ea7e12070f11 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.163393 Nov 03 04:35:29.523138 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3189/6261] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:29 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:30.546378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:30.547404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:30.554576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:30.555074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:30.555523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:30.556230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:30.556695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:30.557188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:30.710622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:30.719038 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-09da7021-fa92-40e1-b661-52c79a1ff875 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.176625 Nov 03 04:35:30.719636 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3073/6262] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:30 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:31.534759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f47c48ef-d806-40e2-a27f-123ec72a9734 req-6bd87052-83ff-4b91-afe6-c056b97429f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff59eb2-e71f-4135-8805-2f4b30e244c4", "name": "network-vif-plugged", "status": "completed", "tag": "d3f9c89b-21be-4876-a9d6-ed143284d707"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:31.542121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:31.546557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f47c48ef-d806-40e2-a27f-123ec72a9734 req-6bd87052-83ff-4b91-afe6-c056b97429f3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:31.547043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f47c48ef-d806-40e2-a27f-123ec72a9734 req-6bd87052-83ff-4b91-afe6-c056b97429f3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:31.547470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f47c48ef-d806-40e2-a27f-123ec72a9734 req-6bd87052-83ff-4b91-afe6-c056b97429f3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:31.559220 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f47c48ef-d806-40e2-a27f-123ec72a9734 req-6bd87052-83ff-4b91-afe6-c056b97429f3 service nova] Creating event network-vif-plugged:d3f9c89b-21be-4876-a9d6-ed143284d707 for instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 on n-h2-854653-7 Nov 03 04:35:31.564281 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f47c48ef-d806-40e2-a27f-123ec72a9734 req-6bd87052-83ff-4b91-afe6-c056b97429f3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033358 Nov 03 04:35:31.564897 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3190/6263] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:31.743095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:31.743715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:31.745644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:31.746315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:31.752140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:31.752628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:31.753108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:31.753807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:31.754263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:31.754683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:31.888010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:31.895951 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c019dea7-ae4a-453b-abb6-d4541119f386 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.156790 Nov 03 04:35:31.896766 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3074/6264] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:31 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:32.921792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:32.922505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:32.929086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:32.934667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:32.934667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:32.934667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:32.934667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:32.934667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:33.074810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:33.082553 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc377064-6d4f-4ab2-a302-adae8525f698 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1312 microversion: 2.1 time: 0.166959 Nov 03 04:35:33.083146 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3191/6265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:32 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:34.106477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:34.107097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:34.113949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.114444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.114886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.115638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.116101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.116529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.248014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:34.256194 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2b10c62d-84b5-4b1f-bd00-9f5f29bc7ef7 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1497 microversion: 2.1 time: 0.154198 Nov 03 04:35:34.256777 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3075/6266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:34 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:34.278908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:34.279518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:34.286302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.286783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.287218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.288293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.288759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.289215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.425286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:34.433809 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2fe75c61-c4ea-43aa-9fda-7fe7b7a5f927 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1497 microversion: 2.1 time: 0.159356 Nov 03 04:35:34.434395 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3192/6267] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:34 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:34.462619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:34.462619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:34.466335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.466903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.467342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.468046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.468547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.468998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.494309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lazy-loading 'flavor' on Instance uuid 5ff59eb2-e71f-4135-8805-2f4b30e244c4 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:35:34.747492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2220f3d1-98cc-4274-a412-dd93ad0b9032 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action" status: 202 len: 0 microversion: 2.1 time: 0.294181 Nov 03 04:35:34.753198 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3076/6268] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:35:34 2022] POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:35:34.757315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:34.758249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:34.765443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.765923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.766672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.767641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:34.768277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:34.768940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:34.929593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:34.939010 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8f403c6-c52d-4265-9bdd-efc77ac4faa9 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1505 microversion: 2.1 time: 0.185890 Nov 03 04:35:34.939664 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3193/6269] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:34 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:35.964935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:35.965679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:35.972327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:35.972814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:35.973274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:35.973995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:35.974482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:35.974911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:36.107776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:36.115819 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ef15a9e4-f753-4859-85c2-63383834ae0f tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1488 microversion: 2.1 time: 0.156481 Nov 03 04:35:36.116491 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3077/6270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:35 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1488 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:36.139074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:36.139579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:36.146483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:36.146924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:36.147511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:36.148090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:36.148553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:36.148983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:36.362170 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-46f4a62e-7db8-41ba-8c9f-6903dd4c3f83 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action" status: 202 len: 0 microversion: 2.1 time: 0.227456 Nov 03 04:35:36.362829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3194/6271] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:35:36 2022] POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:35:36.376663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:36.377340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:36.383499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:36.383988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:36.384432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:36.385158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:36.385616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:36.386048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:36.562344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:36.573065 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d80eef28-19d9-4211-b7e1-89b26262e8e3 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1494 microversion: 2.1 time: 0.199922 Nov 03 04:35:36.574051 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3078/6272] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:36 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1494 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:37.596981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:37.597632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:37.603889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:37.604372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:37.604817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:37.606128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:37.606597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:37.607214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:37.755933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:37.764190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e643384a-cef9-4da0-9f67-07c75b3229cb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1494 microversion: 2.1 time: 0.172389 Nov 03 04:35:37.764773 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3195/6273] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:37 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1494 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:38.787652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:38.788261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:38.795285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:38.795786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:38.796230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:38.796943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:38.797439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:38.798257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:38.936551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:38.944896 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-291030f6-c1e2-43d9-aa50-2160009f3b4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1497 microversion: 2.1 time: 0.161101 Nov 03 04:35:38.945187 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3079/6274] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:38 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:38.968068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:38.968712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:38.975843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:38.976403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:38.976907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:38.977799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:38.978260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:38.978682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:39.004253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lazy-loading 'flavor' on Instance uuid 5ff59eb2-e71f-4135-8805-2f4b30e244c4 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:35:39.296853 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-853958e4-c414-411d-b7cf-957865a8d82e tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action" status: 202 len: 0 microversion: 2.1 time: 0.332444 Nov 03 04:35:39.300840 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3196/6275] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:35:38 2022] POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:35:39.311593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:39.312236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:39.320406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:39.320907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:39.321496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:39.322145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:39.322607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:39.323035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:39.459688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:39.468188 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-68321d28-fc14-44d7-9dc7-6387817c4385 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1505 microversion: 2.1 time: 0.165868 Nov 03 04:35:39.468763 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3080/6276] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:39 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:40.492250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:40.492973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:40.505045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:40.505045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:40.505045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:40.505045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:40.505045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:40.505045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:40.641742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:40.649624 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96c6b6d3-a917-4226-a882-777b3da5c301 tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1488 microversion: 2.1 time: 0.161542 Nov 03 04:35:40.650214 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3197/6277] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:40 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1488 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:40.672416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:40.672985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:40.679756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:40.680250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:40.682943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:40.682943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:40.682943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:40.682943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:40.919903 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-354cec9c-7657-4a8c-aaf7-58c0820a48dd tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action" status: 202 len: 0 microversion: 2.1 time: 0.251205 Nov 03 04:35:40.920739 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3081/6278] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:35:40 2022] POST /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:35:40.928945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:40.929610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:40.936090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:40.936583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:40.937109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:40.937748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:40.938207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:40.938635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:41.079921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:41.094255 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d1e02bd-119c-4c88-bf33-3a32a0f319bb tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1494 microversion: 2.1 time: 0.169261 Nov 03 04:35:41.094939 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3198/6279] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:40 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1494 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:42.128904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:42.129648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:42.136196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:42.136689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:42.137194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:42.137898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:42.138364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:42.138799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:42.159027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:42.276549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:42.284799 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27b457c5-74ed-43e9-b5ef-2713ef6a9adc tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1494 microversion: 2.1 time: 0.161529 Nov 03 04:35:42.285399 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3082/6280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:42 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1494 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:35:43.308523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:43.309209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:43.315823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:43.316310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:43.316764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:43.317495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:43.317955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:43.318383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:43.455982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:43.464110 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2b8835f0-862d-403e-8136-d50d9a66964d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1497 microversion: 2.1 time: 0.160166 Nov 03 04:35:43.464795 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3199/6281] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:43 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:35:43.487639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:43.488804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:43.503751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:43.503751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:43.503751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:43.503751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:43.503751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:43.503751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:43.524583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:35:43.788070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-218bd406-453e-476e-8606-115c8600ef4d tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 204 len: 0 microversion: 2.1 time: 0.303933 Nov 03 04:35:43.790672 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3083/6282] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:35:43 2022] DELETE /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:35:43.797493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:43.798111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:43.804354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:43.804843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:43.805312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:43.806002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:43.806461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:43.806893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:43.946588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:43.954658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2470db9-1abe-46c9-8bb7-7410dda2075a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1503 microversion: 2.1 time: 0.161052 Nov 03 04:35:43.955227 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3200/6283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:43 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:44.980970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:44.981709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:44.988692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:44.989217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:44.990358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:44.991287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:44.991745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:44.992172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:45.237283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:45.246493 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c87c8368-7b56-46b4-a1bc-c813c6850d6a tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1503 microversion: 2.1 time: 0.270981 Nov 03 04:35:45.247351 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3084/6284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:44 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:46.270217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:46.271446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:46.278276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:46.278769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:46.279217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:46.279928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:46.280391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:46.280822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:46.304465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:46.565248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:46.574337 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b16f6476-1ce1-474f-aa0d-e62cb8e1d46b tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1503 microversion: 2.1 time: 0.308188 Nov 03 04:35:46.575063 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3201/6285] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:46 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:46.884887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1a6b6dc2-96a8-408c-97dd-8913ca7db7e8 req-3c2edd7b-6425-46bd-b160-3d33b87f4fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff59eb2-e71f-4135-8805-2f4b30e244c4", "name": "network-vif-deleted", "tag": "d3f9c89b-21be-4876-a9d6-ed143284d707"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:46.896735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1a6b6dc2-96a8-408c-97dd-8913ca7db7e8 req-3c2edd7b-6425-46bd-b160-3d33b87f4fa7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:46.897275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1a6b6dc2-96a8-408c-97dd-8913ca7db7e8 req-3c2edd7b-6425-46bd-b160-3d33b87f4fa7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:46.897723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1a6b6dc2-96a8-408c-97dd-8913ca7db7e8 req-3c2edd7b-6425-46bd-b160-3d33b87f4fa7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:46.913548 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1a6b6dc2-96a8-408c-97dd-8913ca7db7e8 req-3c2edd7b-6425-46bd-b160-3d33b87f4fa7 service nova] Creating event network-vif-deleted:d3f9c89b-21be-4876-a9d6-ed143284d707 for instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 on n-h2-854653-7 Nov 03 04:35:46.921974 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1a6b6dc2-96a8-408c-97dd-8913ca7db7e8 req-3c2edd7b-6425-46bd-b160-3d33b87f4fa7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041009 Nov 03 04:35:46.922675 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3085/6286] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:47.376864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:47.378430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:47.389425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:47.391576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:47.392259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:47.403614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:47.406113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:47.408288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:47.440513 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c0af5dd-af10-47f5-8ca3-8870036d047f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/ips" status: 200 len: 148 microversion: 2.1 time: 0.070971 Nov 03 04:35:47.448395 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3202/6287] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:35:47 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/ips => generated 148 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:35:47.599416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:47.600132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:47.606417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:47.606916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:47.607364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:47.608085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:47.608535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:47.608970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:47.648130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:47.648637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:47.649110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:47.649772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lazy-loading 'fault' on Instance uuid 5ff59eb2-e71f-4135-8805-2f4b30e244c4 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:35:47.699635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e2280f1fd9444f84a618da4e23cbac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d77c8cc06cd4024b73f16da8d2c9116', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:35:47.711656 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-350cd1dd-c72e-4490-874f-efed3c4b19da tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 200 len: 1302 microversion: 2.1 time: 0.116162 Nov 03 04:35:47.712414 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3086/6288] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:47 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:35:48.736418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:48.737078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] [instance: 5ff59eb2-e71f-4135-8805-2f4b30e244c4] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:48.744510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:48.745309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:48.745976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:48.746979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:48.747671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:48.748329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:48.767338 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] HTTP exception thrown: Instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 could not be found. Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Request method failure captured: Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 HTTP/1.1 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0UGD-hsJb6geKwAJZdu9Z99qq-5dO4S5a7a_MfU5A5qp5WzEput0qE0GxF7v7xBz88pv3ENyvKjxJB5aBdScaC2uc8jHcF2fEkRqzmSuOMk7T4i9ctJQRJ9U7sqFrMaN0xCSF4U5FsY8PpdfvO16KZTAjCmt25aN80xbinikwV8P8w Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4d77c8cc06cd4024b73f16da8d2c9116 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestServerAdvancedOps-1941017668 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4d77c8cc06cd4024b73f16da8d2c9116"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4d77c8cc06cd4024b73f16da8d2c9116", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4d77c8cc06cd4024b73f16da8d2c9116"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4d77c8cc06cd4024b73f16da8d2c9116"}]}] Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestServerAdvancedOps-1941017668 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4d77c8cc06cd4024b73f16da8d2c9116 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestServerAdvancedOps-1941017668 Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestServerAdvancedOps-1941017668-project Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f6e2280f1fd9444f84a618da4e23cbac Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestServerAdvancedOps-1941017668-project Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 could not be found. Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '5ff59eb2-e71f-4135-8805-2f4b30e244c4'} Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 could not be found. Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 could not be found. Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:35:48.772391 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 could not be found. Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] Returning 404 to user: Instance 5ff59eb2-e71f-4135-8805-2f4b30e244c4 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d8563af-22c8-4ef4-9a98-f1c8ba73358c tempest-TestServerAdvancedOps-1941017668 tempest-TestServerAdvancedOps-1941017668-project] 10.222.0.30 "GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4" status: 404 len: 111 microversion: 2.1 time: 0.041543 Nov 03 04:35:48.779681 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3203/6289] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:35:48 2022] GET /compute/v2.1/servers/5ff59eb2-e71f-4135-8805-2f4b30e244c4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:35:50.310397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e68cbb9-b5b2-409b-9c7d-8298fc1989b9"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:50.316927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:35:50.330618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:50.330618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:50.330618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:50.330618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:50.330618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:50.330618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:51.199989 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c248f70-3bdc-4f0c-b48b-0db46eddf47d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895213 Nov 03 04:35:51.201322 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3087/6290] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:35:50 2022] POST /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:58.624267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef87caaf-1273-4051-8c5d-62575c365782 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1075708588", "availability_zone": "foo_zone"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:58.628268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.aggregate [None req-ef87caaf-1273-4051-8c5d-62575c365782 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Generated uuid 2adec6c4-1852-464c-bc61-6a97415368de for aggregate {{(pid=127594) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 03 04:35:58.633958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:58.708266 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef87caaf-1273-4051-8c5d-62575c365782 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.253609 Nov 03 04:35:58.709462 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3204/6291] 10.222.0.30 () {60 vars in 1164 bytes} [Thu Nov 3 04:35:58 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:58.722694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c97cf6c-c2be-4593-8086-0bf9956482b9 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:58.727467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:58.818055 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c97cf6c-c2be-4593-8086-0bf9956482b9 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.100564 Nov 03 04:35:58.826324 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3088/6292] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 04:35:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:58.827862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:35:58.831959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:58.835499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:58.836293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:58.836763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:58.837542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:58.839671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:58.843432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:58.867290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9b8516e6-b2eb-4e80-b430-96ead3c1df22 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040029 Nov 03 04:35:58.868238 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3205/6293] 10.222.0.30 () {58 vars in 1176 bytes} [Thu Nov 3 04:35:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:58.879745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d176e76-69a2-4016-b665-6c7cab3c5d8c tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:58.889334 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d176e76-69a2-4016-b665-6c7cab3c5d8c tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013256 Nov 03 04:35:58.889913 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3089/6294] 10.222.0.30 () {58 vars in 1143 bytes} [Thu Nov 3 04:35:58 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:58.903328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-453f3885-9ec7-4aed-90f8-a450063fb63d tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854653-7"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:58.921281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453f3885-9ec7-4aed-90f8-a450063fb63d tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:58.921927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453f3885-9ec7-4aed-90f8-a450063fb63d tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:58.922371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-453f3885-9ec7-4aed-90f8-a450063fb63d tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:35:59.470669 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-453f3885-9ec7-4aed-90f8-a450063fb63d tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.572028 Nov 03 04:35:59.471296 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3206/6295] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 04:35:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:59.482721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7bb7a47-7436-485b-8b07-e80256da3cb1 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:59.492728 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7bb7a47-7436-485b-8b07-e80256da3cb1 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.013674 Nov 03 04:35:59.505213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-08e221c2-8bdd-485f-8a82-a4f95fe39ec6 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-825440491", "availability_zone": "foo_zone"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:59.510410 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3090/6296] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:35:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:59.630721 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-08e221c2-8bdd-485f-8a82-a4f95fe39ec6 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.128633 Nov 03 04:35:59.632696 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3207/6297] 10.222.0.30 () {60 vars in 1173 bytes} [Thu Nov 3 04:35:59 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:35:59.645237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44af09a7-af15-42b7-aa8d-21ce2b2d1582 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:59.743610 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44af09a7-af15-42b7-aa8d-21ce2b2d1582 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.102550 Nov 03 04:35:59.746342 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3091/6298] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 04:35:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:35:59.759176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-74d90f19-ab25-4ac7-81ea-b1e6a85a8351 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:35:59.769782 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-74d90f19-ab25-4ac7-81ea-b1e6a85a8351 tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.015751 Nov 03 04:35:59.770717 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3208/6299] 10.222.0.30 () {58 vars in 1152 bytes} [Thu Nov 3 04:35:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:35:59.784391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-930bb290-c79e-4f18-83d3-b9593337c3fd tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854653-7"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:35:59.798085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-930bb290-c79e-4f18-83d3-b9593337c3fd tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:35:59.798838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-930bb290-c79e-4f18-83d3-b9593337c3fd tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:35:59.799637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-930bb290-c79e-4f18-83d3-b9593337c3fd tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:00.231182 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-930bb290-c79e-4f18-83d3-b9593337c3fd tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.452518 Nov 03 04:36:00.232123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3092/6300] 10.222.0.30 () {60 vars in 1194 bytes} [Thu Nov 3 04:35:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:00.247483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35cc6b06-ae00-4667-83b9-79ced62d2bdc tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:00.346251 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35cc6b06-ae00-4667-83b9-79ced62d2bdc tempest-TestAggregatesBasicOps-908805266 tempest-TestAggregatesBasicOps-908805266-project-admin] 10.222.0.30 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.106548 Nov 03 04:36:00.354106 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3209/6301] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 04:36:00 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 03 04:36:04.638443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e68cbb9-b5b2-409b-9c7d-8298fc1989b9"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:04.638443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:04.643696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:04.644277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:04.644791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:04.645610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:04.646141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:04.646659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:04.766875 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Invalid volume: volume 2e68cbb9-b5b2-409b-9c7d-8298fc1989b9 is already attached to instances: 37536020-8fbd-4608-8068-1bc25ccf1757 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments HTTP/1.1 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 74 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: {"volumeAttachment": {"volumeId": "2e68cbb9-b5b2-409b-9c7d-8298fc1989b9"}} Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid volume: volume 2e68cbb9-b5b2-409b-9c7d-8298fc1989b9 is already attached to instances: 37536020-8fbd-4608-8068-1bc25ccf1757 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '37536020-8fbd-4608-8068-1bc25ccf1757', 'body': {'volumeAttachment': {'volumeId': '2e68cbb9-b5b2-409b-9c7d-8298fc1989b9'}}} Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2e68cbb9-b5b2-409b-9c7d-8298fc1989b9 is already attached to instances: 37536020-8fbd-4608-8068-1bc25ccf1757 Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:36:04.769181 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2e68cbb9-b5b2-409b-9c7d-8298fc1989b9 is already attached to instances: 37536020-8fbd-4608-8068-1bc25ccf1757 Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2e68cbb9-b5b2-409b-9c7d-8298fc1989b9 is already attached to instances: 37536020-8fbd-4608-8068-1bc25ccf1757 Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 400 to user: Invalid volume: volume 2e68cbb9-b5b2-409b-9c7d-8298fc1989b9 is already attached to instances: 37536020-8fbd-4608-8068-1bc25ccf1757 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-44b89009-81a8-4665-b4fa-c8b4caa33aca tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147442 Nov 03 04:36:04.783707 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3093/6302] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:36:04 2022] POST /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 174 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 04:36:04.882440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:04.883038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:04.893830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:04.894841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:04.895540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:04.896429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:04.897117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:04.897717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:05.458479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lazy-loading 'services' on Instance uuid 37536020-8fbd-4608-8068-1bc25ccf1757 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:36:05.764304 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-441363f3-004f-45cb-bf0a-22ce21b3b97f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments/2e68cbb9-b5b2-409b-9c7d-8298fc1989b9" status: 202 len: 0 microversion: 2.1 time: 0.886619 Nov 03 04:36:05.765359 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3210/6303] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:36:04 2022] DELETE /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments/2e68cbb9-b5b2-409b-9c7d-8298fc1989b9 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:36:05.775450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:05.779110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:05.802091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:05.802883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:05.803584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:05.805955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:05.806702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:05.807858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:05.847240 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a2cd51e-7787-4fcf-a82b-a742d7a4c37e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076824 Nov 03 04:36:05.848328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3094/6304] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:05 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:06.861488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:06.864961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:06.885183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:06.886127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:06.886912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:06.887880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:06.888567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:06.889319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:06.970260 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c745c5d9-9cdb-49a0-8893-341e47c99443 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113499 Nov 03 04:36:06.972528 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3211/6305] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:06 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:07.984967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:07.988173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:08.009596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:08.010483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:08.011645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:08.012401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:08.012912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:08.013970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:08.070794 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-01274921-0f90-4664-ab3d-599b62848396 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090539 Nov 03 04:36:08.077550 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3095/6306] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:07 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:09.085375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:09.091537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:09.099409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:09.110141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:09.111114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:09.111732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:09.112972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:09.114772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:09.115403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:09.196243 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7fa995ce-4495-4338-90e3-b0550a0fe15e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115538 Nov 03 04:36:09.197753 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3212/6307] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:09 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:10.217701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:10.222830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:10.240240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:10.240743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:10.251905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:10.253334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:10.255113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:10.255756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:10.300046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57aa3c16-c32e-4b6f-aef9-11fdbbb00bfd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094074 Nov 03 04:36:10.301481 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3096/6308] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:10 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:11.315569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:11.317930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:11.344135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:11.344722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:11.346350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:11.348712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:11.349476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:11.351248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:11.411202 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a0ee4f49-abf1-4bf1-a339-0b846c484b35 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099915 Nov 03 04:36:11.412898 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3213/6309] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:11 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:12.262823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:12.264677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:12.265369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:12.265890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:12.266963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:12.267501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:12.268004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:12.296133 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3ffec7e-8a7d-41e4-a38c-c2e44748de86 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.134541 Nov 03 04:36:12.301077 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3097/6310] 10.222.0.30 () {58 vars in 1185 bytes} [Thu Nov 3 04:36:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:12.428950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:12.433137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:12.454827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:12.455710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:12.459385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:12.461418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:12.463702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:12.466456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:12.476124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-387462770", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "availability_zone": "nova:n-h2-854653-7", "networks": [{"uuid": "d87a433c-6775-4ea8-94d8-a0ec87091a39"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:12.531619 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ebd1b963-1497-4c3f-b8cb-28ce0dabe2ae tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111547 Nov 03 04:36:12.533215 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3214/6311] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:12 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:12.601699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] validate_networks() for [('d87a433c-6775-4ea8-94d8-a0ec87091a39', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:36:13.171130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:36:13.171550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:36:13.172122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:36:13.172542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:36:13.173132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:36:13.184597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:13.185662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:13.186317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:13.187327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:13.188001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:13.188660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:13.216007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Getting quotas for project d2f707c15d264302b9d885ee7e44a328. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:36:13.222858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Getting quotas for user a8e71308034b4241a8a5a99d155e260e and project d2f707c15d264302b9d885ee7e44a328. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:36:13.239076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:36:13.241488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:36:13.369750 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aaefbc06-6000-46ab-92cd-08a32a798943 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897731 Nov 03 04:36:13.370718 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3098/6312] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:36:13.386760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3917301e-8818-49ec-a336-bfb3f08c8d95 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:13.387416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3917301e-8818-49ec-a336-bfb3f08c8d95 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:13.465357 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3917301e-8818-49ec-a336-bfb3f08c8d95 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1328 microversion: 2.1 time: 0.087750 Nov 03 04:36:13.477617 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3215/6313] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:13 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:13.544455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:13.546865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:13.554358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:13.555183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:13.555649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:13.556854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:13.557602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:13.558265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:13.573995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:13.592430 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1562d19b-9f7b-4e8f-9cb6-314f77471c7d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050996 Nov 03 04:36:13.592430 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3099/6314] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:36:13 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:36:13.668544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:13.669162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:13.676656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:13.677186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:13.677811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:13.678536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:13.679002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:13.679432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:13.707567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:36:14.424444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0043384-f3c0-4c2d-8b4b-0c40d1af81cf tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 204 len: 0 microversion: 2.1 time: 0.760105 Nov 03 04:36:14.425063 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3216/6315] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:36:13 2022] DELETE /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:36:14.434634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:14.435285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:14.442536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:14.443027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:14.443644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:14.444247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:14.444710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:14.445168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:14.490493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a13d226-c3e9-4bef-9893-f71166c7f84a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:14.491903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a13d226-c3e9-4bef-9893-f71166c7f84a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:14.563242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a13d226-c3e9-4bef-9893-f71166c7f84a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1328 microversion: 2.1 time: 0.077163 Nov 03 04:36:14.563830 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3217/6316] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:14 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1328 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:14.609120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:14.617723 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee2f93a2-ad9b-46dd-b906-01f02cbd741d tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1679 microversion: 2.1 time: 0.187989 Nov 03 04:36:14.618300 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3100/6317] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:14 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1679 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:15.586986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:15.587613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:15.595790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:15.596322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:15.596902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:15.597661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:15.598119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:15.598548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:15.641771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:15.642545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:15.653048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:15.653546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:15.653982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:15.659769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:15.660643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:15.663166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:16.042396 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-588e6a62-30c0-4e6e-90ef-ed58734f2646 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1337 microversion: 2.1 time: 0.458385 Nov 03 04:36:16.047062 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3218/6318] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:15 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1337 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:16.263769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:16.271824 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de1c7096-9f63-40e8-99eb-cdedf92e9156 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1679 microversion: 2.1 time: 0.634264 Nov 03 04:36:16.274212 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3101/6319] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:15 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1679 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:17.068376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:17.069691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:17.077553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:17.078403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:17.079030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:17.079944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:17.080642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:17.081275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:17.204394 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2ee8fc64-8fa6-4784-8733-0c6575dd15ae tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1421 microversion: 2.1 time: 0.140249 Nov 03 04:36:17.205694 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3219/6320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:17 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1421 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:17.300214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:17.306599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:17.347689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:17.348188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:17.348624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:17.349594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:17.350204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:17.350782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:17.404901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71bf71d5-f579-4a7c-9d83-2a6381bc982b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: .version_select at 0x7ff7f3f503a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-707244016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAXCBvwJOgsDaUgo4zJ6q+GPLuZIky/IR1WHQES0ypS3HfgE7bWzke67C7Bq9duEPjaU7nqD7BFu0+vGY+4XOK+SQf5PxMqeJApPecTg6pHpzxtrnL9axlOxcewWmPgpA=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:17.431760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-71bf71d5-f579-4a7c-9d83-2a6381bc982b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:36:17.440999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-71bf71d5-f579-4a7c-9d83-2a6381bc982b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:36:17.527893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:17.544539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f271e29-c0d2-4e16-9230-5e9e0512fa88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1612 microversion: 2.1 time: 0.244974 Nov 03 04:36:17.544539 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3220/6321] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:17 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1612 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:17.568160 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71bf71d5-f579-4a7c-9d83-2a6381bc982b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.430733 Nov 03 04:36:17.585492 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3102/6322] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:36:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:36:17.718869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d64e163e-31f3-41a3-84de-901199270c19 req-5de194b1-f37b-4048-8667-fd557981f711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37536020-8fbd-4608-8068-1bc25ccf1757", "name": "network-vif-deleted", "tag": "6a5822e5-18a2-40b4-aad6-391376f7dd7e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:17.748804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d64e163e-31f3-41a3-84de-901199270c19 req-5de194b1-f37b-4048-8667-fd557981f711 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:17.749415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d64e163e-31f3-41a3-84de-901199270c19 req-5de194b1-f37b-4048-8667-fd557981f711 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:17.753790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d64e163e-31f3-41a3-84de-901199270c19 req-5de194b1-f37b-4048-8667-fd557981f711 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:17.794112 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d64e163e-31f3-41a3-84de-901199270c19 req-5de194b1-f37b-4048-8667-fd557981f711 service nova] Creating event network-vif-deleted:6a5822e5-18a2-40b4-aad6-391376f7dd7e for instance 37536020-8fbd-4608-8068-1bc25ccf1757 on n-h1-854653-7 Nov 03 04:36:17.809150 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d64e163e-31f3-41a3-84de-901199270c19 req-5de194b1-f37b-4048-8667-fd557981f711 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094129 Nov 03 04:36:17.813755 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3221/6323] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:18.239046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:18.239731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:18.252282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:18.252804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:18.253308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:18.257567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:18.259503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:18.261392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:18.552885 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bd0d7654-a240-4709-8831-1f57303f2f37 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1463 microversion: 2.1 time: 0.317400 Nov 03 04:36:18.552885 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3103/6324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:18 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1463 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:18.581597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:18.581597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:18.584460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:18.585222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:18.586027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:18.586975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:18.587600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:18.588206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:18.646109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:18.646599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:18.647234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:18.647691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lazy-loading 'fault' on Instance uuid 37536020-8fbd-4608-8068-1bc25ccf1757 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:36:18.698717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:18.708975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3e172d04-8603-4a57-8951-40bb976ecbd1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 200 len: 1331 microversion: 2.1 time: 0.139421 Nov 03 04:36:18.724287 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3222/6325] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:18 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:19.575486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:19.576120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:19.583579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:19.584458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:19.584943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:19.591992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:19.595466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:19.595466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:19.735536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:19.736784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:19.745717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:19.746741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:19.748339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:19.749610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:19.750305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:19.752915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 HTTP/1.1 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '37536020-8fbd-4608-8068-1bc25ccf1757'} Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:36:19.783208 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:36:19.788353 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c0a080d9-80b8-425d-b109-e2dca0b17b51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 404 len: 111 microversion: 2.1 time: 0.053883 Nov 03 04:36:19.790431 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3223/6326] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:19 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:36:19.795528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa4b7fb8-33ff-4267-9023-369875b11a80 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '.version_select at 0x7ff7f3fc54c0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:19.816273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c285959-d51f-4a3c-a4fa-5db6f3f966d7 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1463 microversion: 2.1 time: 0.245086 Nov 03 04:36:19.817197 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3104/6327] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:19 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:19.829333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1ab4512c-0282-4dbb-a299-64872e4178ee req-a147ae1d-4b5d-4288-a671-ca6929644e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dadb656-045b-4d20-9517-1731f28a57cf", "tag": "567c3375-6d87-4465-a418-4dff6bd11ce7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:19.839422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ab4512c-0282-4dbb-a299-64872e4178ee req-a147ae1d-4b5d-4288-a671-ca6929644e8b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:19.840030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ab4512c-0282-4dbb-a299-64872e4178ee req-a147ae1d-4b5d-4288-a671-ca6929644e8b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:19.840472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1ab4512c-0282-4dbb-a299-64872e4178ee req-a147ae1d-4b5d-4288-a671-ca6929644e8b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:19.852625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1ab4512c-0282-4dbb-a299-64872e4178ee req-a147ae1d-4b5d-4288-a671-ca6929644e8b service nova] Creating event network-changed:567c3375-6d87-4465-a418-4dff6bd11ce7 for instance 4dadb656-045b-4d20-9517-1731f28a57cf on n-h2-854653-7 Nov 03 04:36:19.857836 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1ab4512c-0282-4dbb-a299-64872e4178ee req-a147ae1d-4b5d-4288-a671-ca6929644e8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032058 Nov 03 04:36:19.858450 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3105/6328] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:36:19.874576 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa4b7fb8-33ff-4267-9023-369875b11a80 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260145969" status: 202 len: 0 microversion: 2.1 time: 0.082850 Nov 03 04:36:19.875535 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3224/6329] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:36:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260145969 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:36:20.692864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c5d3ef64-ac02-47f4-910c-82e42d0eb2fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: .version_select at 0x7ff7f3fa5dc0>, body: {"keypair": {"name": "tempest-keypair-1369269384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhpbaTMqdm1zKlNyjwt5JfymxHuypxy1OxJOQ8f03Hs3zZ/mo4XZybOkbh2BdU3555cT8Y3WORY/FP/yteyn3d/on/bGN8q/6IVmTpoaj0yosgnyaGML+eRFb2tjkJXGw=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:20.708515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c5d3ef64-ac02-47f4-910c-82e42d0eb2fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:36:20.714649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-c5d3ef64-ac02-47f4-910c-82e42d0eb2fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:36:20.819102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c5d3ef64-ac02-47f4-910c-82e42d0eb2fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131361 Nov 03 04:36:20.819991 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3106/6330] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:36:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:36:20.842113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:20.843705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:20.850912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:20.851497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:20.851946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:20.852660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:20.853164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:20.853603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:21.051883 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3b8c7d73-033a-4cab-bb6d-aeb177141c28 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1463 microversion: 2.1 time: 0.216018 Nov 03 04:36:21.052468 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3225/6331] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:20 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1463 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:22.075728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:22.076483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:22.089663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:22.090167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:22.091047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:22.091771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:22.092232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:22.092662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:22.266852 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-02237688-5be8-48fe-a8dc-42911f02c784 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1463 microversion: 2.1 time: 0.195027 Nov 03 04:36:22.267433 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3107/6332] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:22 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1463 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:23.289835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:23.292100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:23.300509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:23.301665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:23.302375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:23.303551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:23.304988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:23.305661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:23.524761 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d95b35ce-72f4-4e6c-97fb-3f27c18f00d8 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1463 microversion: 2.1 time: 0.238818 Nov 03 04:36:23.525691 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3226/6333] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:23 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1463 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:23.866418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a0ef1e42-0dd4-4832-9053-0505e97b7d1c req-448b1782-8c49-4711-963c-7d793b1a1a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dadb656-045b-4d20-9517-1731f28a57cf", "name": "network-vif-plugged", "status": "completed", "tag": "567c3375-6d87-4465-a418-4dff6bd11ce7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:23.876402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:23.880874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a0ef1e42-0dd4-4832-9053-0505e97b7d1c req-448b1782-8c49-4711-963c-7d793b1a1a65 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:23.881418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a0ef1e42-0dd4-4832-9053-0505e97b7d1c req-448b1782-8c49-4711-963c-7d793b1a1a65 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:23.881902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a0ef1e42-0dd4-4832-9053-0505e97b7d1c req-448b1782-8c49-4711-963c-7d793b1a1a65 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:23.898050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a0ef1e42-0dd4-4832-9053-0505e97b7d1c req-448b1782-8c49-4711-963c-7d793b1a1a65 service nova] Creating event network-vif-plugged:567c3375-6d87-4465-a418-4dff6bd11ce7 for instance 4dadb656-045b-4d20-9517-1731f28a57cf on n-h2-854653-7 Nov 03 04:36:23.901617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-556456306", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90a5130a-d918-44b0-bf8d-6477ad7d46bd"}], "security_groups": [{"name": "tempest-securitygroup--140606776"}], "key_name": "tempest-keypair-1369269384", "user_data": "}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:23.904612 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a0ef1e42-0dd4-4832-9053-0505e97b7d1c req-448b1782-8c49-4711-963c-7d793b1a1a65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047299 Nov 03 04:36:23.905699 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3108/6334] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:24.087503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] validate_networks() for [('90a5130a-d918-44b0-bf8d-6477ad7d46bd', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:36:24.519105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:36:24.519732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:36:24.520192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:36:24.520675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:36:24.521247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:36:24.530369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:24.536860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:24.536860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:24.536860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:24.536860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:24.536860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:24.543144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:24.553509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:24.555145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:24.555680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:36:24.561837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Getting quotas for user 6213b618d72f4fb6aca0a98959544421 and project cb028fd3127e48ce9e0df8f7f2f54432. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:36:24.563657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:24.565172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:24.566026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:24.566970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:24.567777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:24.568440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:24.589139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:24.590774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:36:24.593253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:36:24.756763 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4d8b182-28cc-4d6f-9d06-667b0364ed6f tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1463 microversion: 2.1 time: 0.210902 Nov 03 04:36:24.757395 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3109/6335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:24 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:24.799703 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5b0cac98-7911-4913-9e4e-20197a340c51 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.904050 Nov 03 04:36:24.808258 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3227/6336] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:36:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:36:24.814945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ecbb6838-7e0d-4532-bb91-deba1093cdcc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:24.815607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ecbb6838-7e0d-4532-bb91-deba1093cdcc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:24.904191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ecbb6838-7e0d-4532-bb91-deba1093cdcc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:24.917485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ecbb6838-7e0d-4532-bb91-deba1093cdcc tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1241 microversion: 2.1 time: 0.105299 Nov 03 04:36:24.917485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3110/6337] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:24 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:25.783632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:25.784463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:25.792334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:25.798120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:25.798120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:25.798120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:25.798120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:25.798120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:25.939227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:25.943617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:25.974979 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-404babc1-faee-4514-ab6b-8c28b6ab557b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1648 microversion: 2.1 time: 0.198888 Nov 03 04:36:25.975572 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3228/6338] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:25 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1648 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:25.999071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:25.999071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:25.999071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:25.999071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:25.999071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:25.999071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:25.999071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:26.006739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:26.007376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:26.024841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:26.029098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:26.032143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:26.033465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:26.035545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:26.036212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:26.112793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:26.122713 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a27259a9-9c8d-4577-bdf4-e7b8020b62e2 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1245 microversion: 2.1 time: 0.186656 Nov 03 04:36:26.137985 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3111/6339] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:25 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1245 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:26.234315 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e96ebca1-3507-4532-8459-b39cb67aa9d4 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1648 microversion: 2.1 time: 0.232376 Nov 03 04:36:26.234892 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3229/6340] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:26 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1648 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:26.256652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:26.257324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:26.263652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:26.264155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:26.264584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:26.265315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:26.265779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:26.266225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:26.422187 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-208eef79-f53e-44e7-8359-6223d62120eb tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1648 microversion: 2.1 time: 0.169403 Nov 03 04:36:26.422763 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3112/6341] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:26 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1648 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:26.549643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1615436914", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "availability_zone": "nova:n-h1-854653-7", "networks": [{"uuid": "d87a433c-6775-4ea8-94d8-a0ec87091a39"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:26.632484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] validate_networks() for [('d87a433c-6775-4ea8-94d8-a0ec87091a39', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:36:27.079539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:36:27.080150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:36:27.080440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:36:27.081550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:36:27.082232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:36:27.099131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:27.103869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:27.103869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:27.103869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:27.103869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:27.107201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:27.136633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Getting quotas for project d2f707c15d264302b9d885ee7e44a328. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:36:27.143742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Getting quotas for user a8e71308034b4241a8a5a99d155e260e and project d2f707c15d264302b9d885ee7e44a328. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:36:27.150286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:27.151716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:27.172878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:36:27.179119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:36:27.179388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:27.179936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:27.180404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:27.181169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:27.181625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:27.187635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:27.354356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:27.367920 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d53fa6bd-5cbb-49b7-8a8f-af6e6c02c955 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1301 microversion: 2.1 time: 0.224001 Nov 03 04:36:27.372532 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3113/6342] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:27 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1301 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:27.428948 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-011e153a-77d7-4704-9fe7-47abd67f856b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884815 Nov 03 04:36:27.434651 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3230/6343] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:36:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:36:27.446383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0492f634-e2c1-4c78-890d-1ab18ab77633 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:27.447024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0492f634-e2c1-4c78-890d-1ab18ab77633 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:27.580860 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0492f634-e2c1-4c78-890d-1ab18ab77633 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1329 microversion: 2.1 time: 0.138989 Nov 03 04:36:27.582763 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3114/6344] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:27 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1329 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:27.681060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-117520888", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "07668c95-8fdc-4523-be81-2c38c2f63080"}], "key_name": "tempest-TestNetworkAdvancedServerOps-707244016", "security_groups": [{"name": "tempest-secgroup-smoke-110998051"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:27.887020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] validate_networks() for [('07668c95-8fdc-4523-be81-2c38c2f63080', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:36:28.392893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:28.393765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:28.401971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:28.402893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:28.404003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:28.404818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:28.405301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:28.405726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:28.528813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:28.540496 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d78f1b4d-ed2e-449a-a528-764210647c88 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1299 microversion: 2.1 time: 0.152250 Nov 03 04:36:28.541316 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3115/6345] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:28 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:28.598350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:36:28.598868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:36:28.599280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:36:28.600635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:36:28.600635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:36:28.609937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:28.612364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:28.612514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:28.612631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:28.612725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:28.612725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:28.613242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:28.613916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:28.619046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:28.619659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:28.621101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:28.621989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:28.622602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:28.623232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:28.637447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:36:28.649786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:36:28.673949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:36:28.676695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:36:28.750011 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5decdfb-65e9-42f9-88bc-051d2c0369da tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1346 microversion: 2.1 time: 0.144238 Nov 03 04:36:28.751215 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3116/6346] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:28 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:28.814861 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-141320d2-70b7-430f-9777-4b6bf9ecafd1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.139684 Nov 03 04:36:28.815518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3231/6347] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:36:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:36:28.827495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2dfe47aa-038c-41a3-a571-0d484e2a2b9a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:28.828442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2dfe47aa-038c-41a3-a571-0d484e2a2b9a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:28.908332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2dfe47aa-038c-41a3-a571-0d484e2a2b9a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:28.917926 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2dfe47aa-038c-41a3-a571-0d484e2a2b9a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1265 microversion: 2.1 time: 0.093640 Nov 03 04:36:28.929445 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3117/6348] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:28 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:29.566866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:29.567528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:29.574506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:29.576298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:29.576298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:29.576298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:29.576610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:29.577037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:29.774079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:29.774903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:29.793805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:29.797039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:29.797039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:29.797039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:29.797039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:29.797840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:29.825812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:29.835971 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7365042a-44c2-4773-a422-ef180e2e4f73 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.274179 Nov 03 04:36:29.837192 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3232/6349] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:29 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:29.924975 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4033835f-7653-45d4-9adc-5883a089794c tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1416 microversion: 2.1 time: 0.154741 Nov 03 04:36:29.926157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3118/6350] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:29 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1416 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:29.940583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8de0a440-66aa-49fb-aff4-3527a16774fd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:29.941237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8de0a440-66aa-49fb-aff4-3527a16774fd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:30.003270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9af1c009-97ee-4198-8964-ba64019c4b40 req-9c66a917-a8b0-400d-93c0-7dce79e4b8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c3890c-6b70-42be-9c81-2316ef887aa5", "tag": "8e942043-aca7-473c-916b-0ac910122bf8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:30.014324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9af1c009-97ee-4198-8964-ba64019c4b40 req-9c66a917-a8b0-400d-93c0-7dce79e4b8d0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:30.015112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9af1c009-97ee-4198-8964-ba64019c4b40 req-9c66a917-a8b0-400d-93c0-7dce79e4b8d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:30.015712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9af1c009-97ee-4198-8964-ba64019c4b40 req-9c66a917-a8b0-400d-93c0-7dce79e4b8d0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:30.033652 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9af1c009-97ee-4198-8964-ba64019c4b40 req-9c66a917-a8b0-400d-93c0-7dce79e4b8d0 service nova] Creating event network-changed:8e942043-aca7-473c-916b-0ac910122bf8 for instance 26c3890c-6b70-42be-9c81-2316ef887aa5 on n-h1-854653-7 Nov 03 04:36:30.033652 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9af1c009-97ee-4198-8964-ba64019c4b40 req-9c66a917-a8b0-400d-93c0-7dce79e4b8d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033624 Nov 03 04:36:30.034639 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3119/6351] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:36:30.044740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8de0a440-66aa-49fb-aff4-3527a16774fd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:30.052377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8de0a440-66aa-49fb-aff4-3527a16774fd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1265 microversion: 2.1 time: 0.115733 Nov 03 04:36:30.052974 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3233/6352] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:29 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:30.947768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:30.948330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:30.948698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:30.948920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:30.956281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:30.957488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:30.957674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:30.958251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:30.958750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:30.959129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:30.959534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:30.959872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:30.960418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:30.960941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:30.961625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:30.962287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:31.193088 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cee9b825-1fec-4306-b9cf-cff8045afd52 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1422 microversion: 2.1 time: 0.249210 Nov 03 04:36:31.193685 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3234/6353] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:30 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1422 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:31.198511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:31.199117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:31.205963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:31.206775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:31.207217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:31.208117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:31.208612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:31.209137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:31.343613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:31.359631 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-397e73f2-4c9b-4da4-838e-7d0b8bd0ee99 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1317 microversion: 2.1 time: 0.162533 Nov 03 04:36:31.360788 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3235/6354] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:31 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:31.402460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:31.412603 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23d17c2b-07c6-4043-a136-aca6f71aab42 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.555753 Nov 03 04:36:31.413486 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3120/6355] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:30 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:32.222142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:32.222759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:32.230164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:32.230651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:32.231095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:32.231848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:32.232304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:32.232729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:32.383319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:32.384231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:32.391029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:32.391524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:32.391964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:32.392891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:32.393394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:32.393828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:32.409274 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-349df819-f20c-4f2c-a32a-e4094ae5ef01 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.190801 Nov 03 04:36:32.409854 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3236/6356] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:32 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:32.436215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:32.436840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:32.443834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:32.444340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:32.444788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:32.445558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:32.446052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:32.448108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:32.704405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:32.712881 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1888a87-5273-4da9-a212-9d2c5f27b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.333509 Nov 03 04:36:32.714040 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3121/6357] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:32 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:32.722525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:32.732939 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b6c6c4d-b126-4a6c-885a-9e146708af93 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.299909 Nov 03 04:36:32.740103 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3237/6358] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:32 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:33.431751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:33.432388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:33.439656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:33.440239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:33.440761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:33.441585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:33.442283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:33.442784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:33.594059 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0af085fa-a760-4123-b569-85b4edf38789 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.165987 Nov 03 04:36:33.609039 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3122/6359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:33 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:33.646138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6813e30b-1037-4ba5-82a0-a01bbe24b30b req-34c8a2e7-e80b-4346-b9f0-7daa162f84c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:33.659275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6813e30b-1037-4ba5-82a0-a01bbe24b30b req-34c8a2e7-e80b-4346-b9f0-7daa162f84c1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:33.660025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6813e30b-1037-4ba5-82a0-a01bbe24b30b req-34c8a2e7-e80b-4346-b9f0-7daa162f84c1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:33.660604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6813e30b-1037-4ba5-82a0-a01bbe24b30b req-34c8a2e7-e80b-4346-b9f0-7daa162f84c1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:33.674790 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6813e30b-1037-4ba5-82a0-a01bbe24b30b req-34c8a2e7-e80b-4346-b9f0-7daa162f84c1 service nova] Creating event network-changed:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h2-854653-7 Nov 03 04:36:33.680692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6813e30b-1037-4ba5-82a0-a01bbe24b30b req-34c8a2e7-e80b-4346-b9f0-7daa162f84c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038576 Nov 03 04:36:33.682494 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3238/6360] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:33.740519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:33.741160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:33.753694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:33.754191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:33.755835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:33.756568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:33.757042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:33.759495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:33.761547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:33.765296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:33.770833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:33.775434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:33.776776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:33.777520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:33.778573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:33.779410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:33.780938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:34.181321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:34.190296 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dac6fcb3-fb1f-4145-a309-1719d93a338e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.453576 Nov 03 04:36:34.191215 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3123/6361] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:33 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:34.223577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:34.231462 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4cbcf52e-f3c1-49b9-8a92-7b3abb226de4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.480502 Nov 03 04:36:34.232109 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3239/6362] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:33 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:34.618260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:34.618879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:34.626716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:34.627208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:34.627646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:34.628345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:34.628797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:34.629246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:34.904869 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a2279781-f498-4de0-8434-5d62ff0dc7de tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.290114 Nov 03 04:36:34.905385 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3124/6363] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:34 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:35.216628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:35.217932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:35.225387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:35.228132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:35.228132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:35.228132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:35.228470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:35.229321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:35.256342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:35.257439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:35.268945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:35.269564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:35.270200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:35.271170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:35.271733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:35.272313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:35.535989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:35.550617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e2cfc97b-db99-431f-a2e7-2066622ee35d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.332685 Nov 03 04:36:35.550617 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3240/6364] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:35 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:35.571739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:35.580243 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e3fc70f-c572-4ed3-ab68-dc2545294f32 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.329003 Nov 03 04:36:35.581093 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3125/6365] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:35 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:35.698616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dbc4d4c1-e5b9-402a-bda3-9faf6e5df10f req-e29004b5-ec5c-4914-97e6-4fcc15796135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbeaf566-baef-4c75-b0ec-1b1012d5a38a", "tag": "395d69ad-b41d-4e1c-b190-eb9f94299615"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:35.707927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbc4d4c1-e5b9-402a-bda3-9faf6e5df10f req-e29004b5-ec5c-4914-97e6-4fcc15796135 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:35.708414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbc4d4c1-e5b9-402a-bda3-9faf6e5df10f req-e29004b5-ec5c-4914-97e6-4fcc15796135 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:35.708856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbc4d4c1-e5b9-402a-bda3-9faf6e5df10f req-e29004b5-ec5c-4914-97e6-4fcc15796135 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:35.719549 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dbc4d4c1-e5b9-402a-bda3-9faf6e5df10f req-e29004b5-ec5c-4914-97e6-4fcc15796135 service nova] Creating event network-changed:395d69ad-b41d-4e1c-b190-eb9f94299615 for instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a on n-h1-854653-7 Nov 03 04:36:35.724392 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dbc4d4c1-e5b9-402a-bda3-9faf6e5df10f req-e29004b5-ec5c-4914-97e6-4fcc15796135 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030172 Nov 03 04:36:35.724989 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3241/6366] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:35.927604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:35.928223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:35.935610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:35.936234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:35.936678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:35.937406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:35.937870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:35.938302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:36.128821 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72e8640d-8b7c-4fba-946c-22db84a0a3e1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.204924 Nov 03 04:36:36.129429 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3126/6367] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:35 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:36.568513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:36.569249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:36.575533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:36.576016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:36.576458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:36.577190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:36.577652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:36.578109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:36.604484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:36.605118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:36.611095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:36.611582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:36.612023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:36.612726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:36.613202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:36.613631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:36.767689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:36.780032 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bd2521bc-f746-488e-a495-7059360831b6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.216020 Nov 03 04:36:36.781338 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3242/6368] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:36 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:36.800072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:36.811266 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a09d3a25-1097-4538-8d52-18258485dcde tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.211324 Nov 03 04:36:36.811846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3127/6369] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:36 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:37.151291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:37.151909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:37.157924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:37.158402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:37.158836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:37.159521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:37.159972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:37.160397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:37.288982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-69e0c797-2232-4c2d-a02d-187a827f6ff2 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.141529 Nov 03 04:36:37.289567 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3243/6370] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:37 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:37.813893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:37.814516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:37.821140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:37.821633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:37.822082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:37.823052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:37.823374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:37.823671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:37.839355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:37.839972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:37.855081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:37.855694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:37.856194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:37.859146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:37.859146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:37.859146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:38.432609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:38.440429 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d02c04bf-4201-4318-8244-334069041ab7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.631271 Nov 03 04:36:38.441005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3128/6371] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:37 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:38.460406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:38.461057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:38.464699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:38.467878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:38.468041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:38.468409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:38.469143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:38.469612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:38.470043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:38.473200 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-652bd73a-95a4-4d46-9955-ca658456e1ab tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.638231 Nov 03 04:36:38.474019 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3244/6372] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:37 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:38.673671 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4707266-4853-407c-a9e6-993bba1f1977 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.219429 Nov 03 04:36:38.674466 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3129/6373] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:38 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:38.934567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c1641474-ebd9-4d23-addb-d9a680d067c6 req-e58ab51b-e76d-49e9-98cb-0cdbfff7d12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c3890c-6b70-42be-9c81-2316ef887aa5", "name": "network-vif-plugged", "status": "completed", "tag": "8e942043-aca7-473c-916b-0ac910122bf8"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:38.939592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:38.945618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1641474-ebd9-4d23-addb-d9a680d067c6 req-e58ab51b-e76d-49e9-98cb-0cdbfff7d12f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:38.946096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1641474-ebd9-4d23-addb-d9a680d067c6 req-e58ab51b-e76d-49e9-98cb-0cdbfff7d12f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:38.946529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c1641474-ebd9-4d23-addb-d9a680d067c6 req-e58ab51b-e76d-49e9-98cb-0cdbfff7d12f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:38.957228 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c1641474-ebd9-4d23-addb-d9a680d067c6 req-e58ab51b-e76d-49e9-98cb-0cdbfff7d12f service nova] Creating event network-vif-plugged:8e942043-aca7-473c-916b-0ac910122bf8 for instance 26c3890c-6b70-42be-9c81-2316ef887aa5 on n-h1-854653-7 Nov 03 04:36:38.962407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c1641474-ebd9-4d23-addb-d9a680d067c6 req-e58ab51b-e76d-49e9-98cb-0cdbfff7d12f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031775 Nov 03 04:36:38.963707 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3245/6374] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:39.467281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:39.467901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:39.470630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=20 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:39.475569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:39.476062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:39.476504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:39.477233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:39.477694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:39.478122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:39.496891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:39.497620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:39.504443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:39.504980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:39.505403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:39.506249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:39.506713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:39.507140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:39.684613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:39.687669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:39.692773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b28ce36-3157-4254-9f36-332740f9f186 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.229301 Nov 03 04:36:39.706354 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3130/6375] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:39 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:39.706519 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5657fb59-1d02-4f75-93de-2be895582cce tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1366 microversion: 2.1 time: 0.204075 Nov 03 04:36:39.706519 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3246/6376] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:39 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:39.706724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:39.706724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:39.706724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:39.706724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:39.706724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:39.706724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:39.707350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:39.707581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:39.833165 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8cf694e7-dc1c-4bff-ac30-61bad515c966 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.138603 Nov 03 04:36:39.833745 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3131/6377] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:39 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:40.719102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:40.719679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:40.720272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:40.720505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:40.723281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=24 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:40.727221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.727721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.728162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:40.728304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.728888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.729248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.729370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:40.729701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.730072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.730474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:40.730621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.730955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:40.933612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:40.938364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:40.941511 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3703cf88-c2ee-47b6-a66c-0a0b1db57dd6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1556 microversion: 2.1 time: 0.225683 Nov 03 04:36:40.942102 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3132/6378] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:40 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1556 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:40.946454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:40.946664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0f7a1705-f6a0-4255-8b91-d39e051b2090 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.231503 Nov 03 04:36:40.947069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:40.948138 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3247/6379] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:40 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:40.953703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.954200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.954651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:40.955357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.955822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.956261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:40.964845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:40.965395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:40.974806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.974806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.974806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:40.974806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:40.974806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:40.974806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:41.092414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3ab82abc-4c55-4939-ab6f-8785caeb5ae6 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131556 Nov 03 04:36:41.093875 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3248/6380] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 04:36:40 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:36:41.098965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c50d454a-864e-4f04-a2c2-297f2c8ea478 req-2e8b5819-b9eb-455b-9897-b8ac08e7a0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "name": "network-vif-plugged", "status": "completed", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:41.109051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c50d454a-864e-4f04-a2c2-297f2c8ea478 req-2e8b5819-b9eb-455b-9897-b8ac08e7a0f6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:41.109695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c50d454a-864e-4f04-a2c2-297f2c8ea478 req-2e8b5819-b9eb-455b-9897-b8ac08e7a0f6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:41.111141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c50d454a-864e-4f04-a2c2-297f2c8ea478 req-2e8b5819-b9eb-455b-9897-b8ac08e7a0f6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:41.115017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:41.123934 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c50d454a-864e-4f04-a2c2-297f2c8ea478 req-2e8b5819-b9eb-455b-9897-b8ac08e7a0f6 service nova] Creating event network-vif-plugged:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h2-854653-7 Nov 03 04:36:41.128959 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c50d454a-864e-4f04-a2c2-297f2c8ea478 req-2e8b5819-b9eb-455b-9897-b8ac08e7a0f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033718 Nov 03 04:36:41.129771 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3249/6381] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:41.135774 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bf957fdb-d12f-4ee5-8a1e-50cc37ac2b2a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.186895 Nov 03 04:36:41.135774 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3133/6382] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:40 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:41.972499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:41.973237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:41.980527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:41.981034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:41.981526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:41.982248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:41.982700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:41.983338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:42.129065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:42.137145 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42bc5d68-f6f2-49a7-bedc-4925210dd571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1390 microversion: 2.1 time: 0.170158 Nov 03 04:36:42.137720 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3250/6383] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:41 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:42.154847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:42.155471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:42.162272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:42.162765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:42.163208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:42.163914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:42.164441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:42.164877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:42.291688 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a73cbb9e-894c-429f-aa61-234680cab3c5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.139953 Nov 03 04:36:42.292271 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3134/6384] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:42 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:42.406258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-79d09bb6-49a1-45da-908e-2aadebf9478b req-14a65de9-4ba1-4408-8598-407793a65132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c3890c-6b70-42be-9c81-2316ef887aa5", "tag": "8e942043-aca7-473c-916b-0ac910122bf8"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:42.416458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-79d09bb6-49a1-45da-908e-2aadebf9478b req-14a65de9-4ba1-4408-8598-407793a65132 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:42.416959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-79d09bb6-49a1-45da-908e-2aadebf9478b req-14a65de9-4ba1-4408-8598-407793a65132 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:42.417429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-79d09bb6-49a1-45da-908e-2aadebf9478b req-14a65de9-4ba1-4408-8598-407793a65132 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:42.432059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-79d09bb6-49a1-45da-908e-2aadebf9478b req-14a65de9-4ba1-4408-8598-407793a65132 service nova] Creating event network-changed:8e942043-aca7-473c-916b-0ac910122bf8 for instance 26c3890c-6b70-42be-9c81-2316ef887aa5 on n-h1-854653-7 Nov 03 04:36:42.438212 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-79d09bb6-49a1-45da-908e-2aadebf9478b req-14a65de9-4ba1-4408-8598-407793a65132 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035336 Nov 03 04:36:42.438842 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3251/6385] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:43.143774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b7d32b79-823c-45ee-b772-9e0907179ef1 req-ba044ddd-7ce1-4687-baf3-79d672a11b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeaf566-baef-4c75-b0ec-1b1012d5a38a", "name": "network-vif-plugged", "status": "completed", "tag": "395d69ad-b41d-4e1c-b190-eb9f94299615"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:43.154063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b7d32b79-823c-45ee-b772-9e0907179ef1 req-ba044ddd-7ce1-4687-baf3-79d672a11b44 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:43.154561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b7d32b79-823c-45ee-b772-9e0907179ef1 req-ba044ddd-7ce1-4687-baf3-79d672a11b44 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:43.155010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b7d32b79-823c-45ee-b772-9e0907179ef1 req-ba044ddd-7ce1-4687-baf3-79d672a11b44 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:43.160606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:43.161421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:43.166696 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b7d32b79-823c-45ee-b772-9e0907179ef1 req-ba044ddd-7ce1-4687-baf3-79d672a11b44 service nova] Creating event network-vif-plugged:395d69ad-b41d-4e1c-b190-eb9f94299615 for instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a on n-h1-854653-7 Nov 03 04:36:43.168634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:43.169146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:43.170389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:43.171155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:43.171618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:43.171760 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b7d32b79-823c-45ee-b772-9e0907179ef1 req-ba044ddd-7ce1-4687-baf3-79d672a11b44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031648 Nov 03 04:36:43.172048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:43.172420 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3135/6386] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:43.315462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:43.316186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:43.323755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:43.324629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:43.325401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:43.326457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:43.327130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:43.327681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:43.416140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:43.424706 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bc87e507-9915-483a-b6e2-363ceca8e0de tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1562 microversion: 2.1 time: 0.268482 Nov 03 04:36:43.428547 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3252/6387] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:43 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:43.448433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:43.449336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:43.455265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:43.455749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:43.456192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:43.456931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:43.458127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:43.458127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:43.485457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7721e943-5c0e-405f-b6e9-7d385b3b21c1 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.173992 Nov 03 04:36:43.486062 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3136/6388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:43 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:43.597179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:43.605459 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5078bdb5-5c41-4a7e-9210-5816a00c2c9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1562 microversion: 2.1 time: 0.161901 Nov 03 04:36:43.606034 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3253/6389] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:43 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:36:44.509417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:44.510060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:44.517111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:44.517604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:44.518043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:44.518743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:44.519198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:44.519624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:44.703826 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43dcec16-3b41-4d45-b701-9056857f2543 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1464 microversion: 2.1 time: 0.198477 Nov 03 04:36:44.704518 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3137/6390] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:44 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1464 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:45.727569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:45.728777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:45.735596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:45.736101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:45.736553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:45.737304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:45.737945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:45.738414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:45.895261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:45.895883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:45.905581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:45.906080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:45.906524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:45.907230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:45.907696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:45.908129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:45.912733 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1981217b-ae90-444b-bad6-8e7a2636bac9 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1649 microversion: 2.1 time: 0.189015 Nov 03 04:36:45.913356 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3254/6391] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:45 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1649 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:45.922943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6582843b-3fd9-48d4-9fbd-46b1c25118b8 req-ae14d9c3-bc0f-424b-bdf4-6b5515e45259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:45.940804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6582843b-3fd9-48d4-9fbd-46b1c25118b8 req-ae14d9c3-bc0f-424b-bdf4-6b5515e45259 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:45.941327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6582843b-3fd9-48d4-9fbd-46b1c25118b8 req-ae14d9c3-bc0f-424b-bdf4-6b5515e45259 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:45.941766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6582843b-3fd9-48d4-9fbd-46b1c25118b8 req-ae14d9c3-bc0f-424b-bdf4-6b5515e45259 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:45.952786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6582843b-3fd9-48d4-9fbd-46b1c25118b8 req-ae14d9c3-bc0f-424b-bdf4-6b5515e45259 service nova] Creating event network-changed:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h2-854653-7 Nov 03 04:36:45.958165 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6582843b-3fd9-48d4-9fbd-46b1c25118b8 req-ae14d9c3-bc0f-424b-bdf4-6b5515e45259 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043488 Nov 03 04:36:45.959144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3255/6392] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:36:45.964225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:45.965176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:45.971710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:45.972420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:45.973118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:45.974026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:45.974656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:45.975254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:46.219364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:36:46.227808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b41bc15c-efb4-4c45-a465-7c8fad20d4bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1562 microversion: 2.1 time: 0.336543 Nov 03 04:36:46.229297 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3138/6393] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:45 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1562 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:46.259402 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a0a50aff-7038-4966-b459-d960ee79305d tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1649 microversion: 2.1 time: 0.298593 Nov 03 04:36:46.260085 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3256/6394] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:45 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1649 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:46.281881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:46.282907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:46.289748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:46.290591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:46.291851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:46.292789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:46.293524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:46.294165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:46.501487 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-500618f5-f5fe-4cac-b1a2-76fb7863d84b tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1649 microversion: 2.1 time: 0.223074 Nov 03 04:36:46.502086 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3139/6395] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:46 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1649 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:46.524204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:46.524714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:46.531279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:46.531774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:46.532210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:46.532904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:46.533392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:46.533823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:46.561280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:36:46.793118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:46.886298 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20a819aa-d3ca-4967-932a-4bd30f55ef19 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 204 len: 0 microversion: 2.1 time: 0.363954 Nov 03 04:36:46.887455 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3257/6396] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:36:46 2022] DELETE /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:36:46.896452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:46.897102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:46.904410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:46.904908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:46.905396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:46.906112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:46.906712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:46.907143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:46.924364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=100 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:36:47.100610 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e869bbc7-12d2-43cc-b596-99feda6b62e5 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1655 microversion: 2.1 time: 0.207784 Nov 03 04:36:47.101380 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3140/6397] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:46 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1655 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:48.125281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:48.125922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:48.134492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:48.134984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:48.135432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:48.136134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:48.136598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:48.137054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:48.260623 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-509a15b4-4ee6-4336-ace0-ff22f306a115 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1655 microversion: 2.1 time: 0.139492 Nov 03 04:36:48.261227 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3258/6398] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:48 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:48.769411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-58b0ddc0-9c05-4c71-8cda-0f22671445bd req-2af888cc-c229-4c7c-a091-ef37ee6c395a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbeaf566-baef-4c75-b0ec-1b1012d5a38a", "name": "network-vif-deleted", "tag": "395d69ad-b41d-4e1c-b190-eb9f94299615"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:48.786121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-58b0ddc0-9c05-4c71-8cda-0f22671445bd req-2af888cc-c229-4c7c-a091-ef37ee6c395a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:48.786121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-58b0ddc0-9c05-4c71-8cda-0f22671445bd req-2af888cc-c229-4c7c-a091-ef37ee6c395a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:48.786121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-58b0ddc0-9c05-4c71-8cda-0f22671445bd req-2af888cc-c229-4c7c-a091-ef37ee6c395a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:48.794608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-58b0ddc0-9c05-4c71-8cda-0f22671445bd req-2af888cc-c229-4c7c-a091-ef37ee6c395a service nova] Creating event network-vif-deleted:395d69ad-b41d-4e1c-b190-eb9f94299615 for instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a on n-h1-854653-7 Nov 03 04:36:48.799805 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-58b0ddc0-9c05-4c71-8cda-0f22671445bd req-2af888cc-c229-4c7c-a091-ef37ee6c395a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035159 Nov 03 04:36:48.800556 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3141/6399] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:36:49.283801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:49.284421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:49.291398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:49.291890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:49.292331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:49.293044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:49.293497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:49.293925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:49.326617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:49.327101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:49.327538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:49.327991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lazy-loading 'fault' on Instance uuid bbeaf566-baef-4c75-b0ec-1b1012d5a38a {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:36:49.376811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c27c692-15b2-4b17-b3b3-1e9740511b6a tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 200 len: 1454 microversion: 2.1 time: 0.096815 Nov 03 04:36:49.377407 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3259/6400] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:49 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:50.402854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:50.403577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: bbeaf566-baef-4c75-b0ec-1b1012d5a38a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:50.409976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:50.410217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:50.410651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:50.411337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:50.411791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:50.412217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:50.425136 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] HTTP exception thrown: Instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a could not be found. Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Request method failure captured: Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a HTTP/1.1 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0U8GcV7iKe1SdNsphXjsSEQK0PqV-ZkSh-uUEsauDSa7i0SEOtPSsXWvCk6zJiQvze983P0zZF61_w0l0ohv_zVLn_hUrt52NRou_WaLBQfIprPr7k2tTvS0HbZbbTKR-bngjUjTVsJ_29UNzeQcUI4b27OTnuFncdHvk7phfsY9no Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: d2f707c15d264302b9d885ee7e44a328 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestServerMultinode-684990586 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2f707c15d264302b9d885ee7e44a328"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2f707c15d264302b9d885ee7e44a328", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2f707c15d264302b9d885ee7e44a328"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2f707c15d264302b9d885ee7e44a328"}]}] Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestServerMultinode-684990586 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: d2f707c15d264302b9d885ee7e44a328 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestServerMultinode-684990586 Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestServerMultinode-684990586-project-admin Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a8e71308034b4241a8a5a99d155e260e Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestServerMultinode-684990586-project-admin Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a could not be found. Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'bbeaf566-baef-4c75-b0ec-1b1012d5a38a'} Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a could not be found. Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a could not be found. Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:50.426757 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a could not be found. Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Returning 404 to user: Instance bbeaf566-baef-4c75-b0ec-1b1012d5a38a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-14126a06-eac7-416b-923b-68e2258ed778 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a" status: 404 len: 111 microversion: 2.1 time: 0.031064 Nov 03 04:36:50.432436 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3142/6401] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:50 2022] GET /compute/v2.1/servers/bbeaf566-baef-4c75-b0ec-1b1012d5a38a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:36:50.437094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:50.437631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:50.444115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:50.444597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:50.445056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:50.445745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:50.446200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:50.446627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:50.471494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:36:50.763654 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf266aae-6127-4094-9e20-a933774d0640 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "DELETE /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 204 len: 0 microversion: 2.1 time: 0.330216 Nov 03 04:36:50.764259 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3260/6402] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:36:50 2022] DELETE /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:36:50.772452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:50.773165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:50.779897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:50.780382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:50.780820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:50.781537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:50.781991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:50.782461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:50.914170 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b972fdf5-ecc3-4d88-8969-2ec71b4bdbef tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1654 microversion: 2.1 time: 0.145358 Nov 03 04:36:50.915683 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3143/6403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:50 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:51.938254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:51.938971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:51.945934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:51.946460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:51.946904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:51.948148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:51.948606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:51.949089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:52.075507 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb6aa362-12a2-4459-b403-cd8a1c1d012e tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1654 microversion: 2.1 time: 0.141529 Nov 03 04:36:52.077665 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3261/6404] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:51 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:52.614904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-69408b5f-39d7-4943-a496-590f5e6553cd req-094dbbb2-334f-4b9b-9275-852ad13222a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dadb656-045b-4d20-9517-1731f28a57cf", "name": "network-vif-deleted", "tag": "567c3375-6d87-4465-a418-4dff6bd11ce7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:36:52.625856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-69408b5f-39d7-4943-a496-590f5e6553cd req-094dbbb2-334f-4b9b-9275-852ad13222a2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:52.631909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-69408b5f-39d7-4943-a496-590f5e6553cd req-094dbbb2-334f-4b9b-9275-852ad13222a2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:52.631909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-69408b5f-39d7-4943-a496-590f5e6553cd req-094dbbb2-334f-4b9b-9275-852ad13222a2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:52.637813 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-69408b5f-39d7-4943-a496-590f5e6553cd req-094dbbb2-334f-4b9b-9275-852ad13222a2 service nova] Creating event network-vif-deleted:567c3375-6d87-4465-a418-4dff6bd11ce7 for instance 4dadb656-045b-4d20-9517-1731f28a57cf on n-h2-854653-7 Nov 03 04:36:52.642708 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-69408b5f-39d7-4943-a496-590f5e6553cd req-094dbbb2-334f-4b9b-9275-852ad13222a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Nov 03 04:36:52.643293 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3144/6405] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:36:53.098854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:53.099477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:53.106860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:53.107339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:53.107776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:53.108462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:53.108915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:53.109366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:53.139299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:53.139686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:53.140138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:53.140566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lazy-loading 'fault' on Instance uuid 4dadb656-045b-4d20-9517-1731f28a57cf {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:36:53.188074 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9027afaf-4d88-41a1-b0e1-6b5e7297f597 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 200 len: 1453 microversion: 2.1 time: 0.092879 Nov 03 04:36:53.188638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3262/6406] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:53 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:36:54.212772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:36:54.213448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] [instance: 4dadb656-045b-4d20-9517-1731f28a57cf] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:36:54.219637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:54.220123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:54.220561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:54.221275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:36:54.221742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:36:54.222170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:36:54.235570 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] HTTP exception thrown: Instance 4dadb656-045b-4d20-9517-1731f28a57cf could not be found. Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Request method failure captured: Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf HTTP/1.1 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0U8GcV7iKe1SdNsphXjsSEQK0PqV-ZkSh-uUEsauDSa7i0SEOtPSsXWvCk6zJiQvze983P0zZF61_w0l0ohv_zVLn_hUrt52NRou_WaLBQfIprPr7k2tTvS0HbZbbTKR-bngjUjTVsJ_29UNzeQcUI4b27OTnuFncdHvk7phfsY9no Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: d2f707c15d264302b9d885ee7e44a328 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestServerMultinode-684990586 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2f707c15d264302b9d885ee7e44a328"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d2f707c15d264302b9d885ee7e44a328", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d2f707c15d264302b9d885ee7e44a328"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d2f707c15d264302b9d885ee7e44a328"}]}] Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestServerMultinode-684990586 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: d2f707c15d264302b9d885ee7e44a328 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestServerMultinode-684990586 Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestServerMultinode-684990586-project-admin Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: a8e71308034b4241a8a5a99d155e260e Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestServerMultinode-684990586-project-admin Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 4dadb656-045b-4d20-9517-1731f28a57cf could not be found. Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '4dadb656-045b-4d20-9517-1731f28a57cf'} Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dadb656-045b-4d20-9517-1731f28a57cf could not be found. Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dadb656-045b-4d20-9517-1731f28a57cf could not be found. Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:36:54.237256 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dadb656-045b-4d20-9517-1731f28a57cf could not be found. Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] Returning 404 to user: Instance 4dadb656-045b-4d20-9517-1731f28a57cf could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-508ca00a-ee18-40a7-b9e6-a99f90d8e616 tempest-TestServerMultinode-684990586 tempest-TestServerMultinode-684990586-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf" status: 404 len: 111 microversion: 2.1 time: 0.030957 Nov 03 04:36:54.242546 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3145/6407] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:36:54 2022] GET /compute/v2.1/servers/4dadb656-045b-4d20-9517-1731f28a57cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:37:09.510633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:09.512845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:09.516119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:09.516785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:09.521501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:09.521936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:09.522373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:09.523061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:09.523513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:09.523938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:09.578235 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad3de18d-f52e-46da-ad10-4567c0e346d5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action" status: 200 len: 24571 microversion: 2.1 time: 0.071562 Nov 03 04:37:09.579144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3263/6408] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:37:09 2022] POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:37:20.510566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:20.511189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:20.513845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=72 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:20.517772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=17 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:20.519249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:20.519737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:20.520178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:20.520887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:20.521446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:20.521878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:20.846125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fab1d222-24bc-4604-b26f-97e68f761942 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1831 microversion: 2.1 time: 0.340112 Nov 03 04:37:20.846719 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3146/6409] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:20 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1831 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:20.871074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:20.871826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:20.880347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:20.880839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:20.881321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:20.882024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:20.882495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:20.882928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:21.020085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:21.028603 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5133e47f-a5c7-4410-bf29-ec401ea1e3be tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1680 microversion: 2.1 time: 0.161234 Nov 03 04:37:21.029201 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3264/6410] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:20 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:21.123730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:21.127374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:21.131897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:21.132381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:21.132887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:21.133678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:21.134132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:21.134619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:21.197569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d5d9a86a-7db3-4315-b9e7-600e6c69a88c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action" status: 200 len: 32647 microversion: 2.1 time: 0.077663 Nov 03 04:37:21.198214 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3147/6411] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:37:21 2022] POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action => generated 32647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:37:21.407731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:21.408245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:21.414776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:21.415259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:21.415699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:21.416429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:21.416888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:21.417367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:21.582655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a83ba1d7d1db4e1cbc68e028d8b2d3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5e86561d5544b9a8755c7857ce0f97', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:21.583274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] flavor_id is None. Assuming migration. {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 03 04:37:21.583720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 04:37:21.861150 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f8d12043-b3e0-4100-89b5-e1bbf67142d2 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action" status: 202 len: 0 microversion: 2.1 time: 0.457552 Nov 03 04:37:21.861853 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3265/6412] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:37:21 2022] POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:37:21.870965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:21.872373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:21.880515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:21.884139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:21.884139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:21.884139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:21.884139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:21.884139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:22.022524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:22.030945 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-971df327-db18-4193-b2a2-4cd416645f8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1689 microversion: 2.1 time: 0.164545 Nov 03 04:37:22.031511 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3148/6413] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:21 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:23.056450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:23.057101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:23.064387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:23.064877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:23.065358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:23.066065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:23.066527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:23.066963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:23.198000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:23.205847 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4914baa6-83fa-42e6-898f-b310c10d6135 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1689 microversion: 2.1 time: 0.154121 Nov 03 04:37:23.206417 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3266/6414] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:23 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:24.229400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:24.230016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:24.237103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:24.237591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:24.238029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:24.238723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:24.239176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:24.239599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:24.373717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:24.381401 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8207b7c-4afb-4ce0-9a2b-8b7f24adfa62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1689 microversion: 2.1 time: 0.155929 Nov 03 04:37:24.381981 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3149/6415] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:24 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:25.406680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:25.407300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:25.414111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:25.414596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:25.415039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:25.415732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:25.416192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:25.416631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:25.549753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:25.557424 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03edf134-f279-46b3-8fb9-2c49f64a633f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.155292 Nov 03 04:37:25.558000 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3267/6416] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:25 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:26.581489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:26.582105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:26.588655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:26.589174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:26.589610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:26.590292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:26.590752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:26.591176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:26.721378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:26.729136 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-132a4331-fde6-4fff-afd8-d82c56768711 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.151453 Nov 03 04:37:26.729690 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3150/6417] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:26 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:27.753297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:27.753916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:27.760871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:27.761386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:27.761827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:27.762519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:27.762972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:27.763902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:27.901420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:27.910407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ab58c1f6-4b9d-4f40-a1cf-6b5a5af22982 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.160969 Nov 03 04:37:27.910987 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3268/6418] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:27 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:28.933860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:28.934546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:28.941957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:28.942452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:28.942899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:28.943603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:28.944067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:28.944500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:29.076906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:29.084705 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-08f371bb-978c-4881-a562-80b30b56b09f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.154769 Nov 03 04:37:29.085306 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3151/6419] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:28 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:30.108444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:30.109091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:30.115934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:30.116416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:30.116851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:30.117558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:30.118009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:30.118437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:30.250351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:30.258043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c3b1927-2446-46ca-92f4-8862075f173f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.153557 Nov 03 04:37:30.258611 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3269/6420] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:30 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:31.282709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:31.283329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:31.290328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:31.290812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:31.291245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:31.291938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:31.292391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:31.292814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:31.424383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:31.432079 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8590b44-2e4a-4de7-9bc1-b0b0d23d5142 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.153271 Nov 03 04:37:31.432644 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3152/6421] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:31 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:32.456686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:32.457253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:32.464032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:32.464523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:32.464961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:32.465685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:32.466141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:32.467154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:32.678399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:32.687627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cd629f29-c17e-4c7a-bc61-4260ff79f608 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.234891 Nov 03 04:37:32.688218 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3270/6422] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:32 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:33.711462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:33.712014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:33.719427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:33.719908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:33.720502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:33.721223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:33.721683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:33.722113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:33.857344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:33.865045 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e2481d3f-c6f6-41f8-a005-a2989eb15510 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.157497 Nov 03 04:37:33.865626 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3153/6423] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:33 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:34.888388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:34.889061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:34.901836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:34.902334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:34.902901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:34.911719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:34.911719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:34.911719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:35.051623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:35.059586 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b6a024a0-1417-41cb-a29e-ee07e09d2b65 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.175276 Nov 03 04:37:35.060533 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3271/6424] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:34 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:36.082463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:36.083094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:36.090075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:36.090569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:36.091018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:36.092330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:36.092797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:36.093258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:36.222519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:36.230196 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-45f53a26-77fb-4c86-93eb-74eb32d2f455 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.151675 Nov 03 04:37:36.230770 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3154/6425] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:36 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:37.253615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:37.254234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:37.261312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:37.261800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:37.262244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:37.262934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:37.263392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:37.263823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:37.396796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:37.405277 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c967e90c-8b8d-4fb5-836b-2c9f58ae2bc5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.155511 Nov 03 04:37:37.405921 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3272/6426] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:37 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:38.428845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:38.429494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:38.437110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:38.437627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:38.438073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:38.438763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:38.439226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:38.439654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:38.570841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:38.578572 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee6dab9a-5357-4731-88ae-c7ef67324374 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.153592 Nov 03 04:37:38.579149 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3155/6427] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:38 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:39.602720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:39.603267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:39.610706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:39.611191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:39.611627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:39.612320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:39.612772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:39.613228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:39.741836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:39.749723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-de3b31b2-ccbf-4d38-b97a-1ef2cdb0c79b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.150919 Nov 03 04:37:39.750293 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3273/6428] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:39 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:40.774012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:40.774629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:40.781929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:40.782411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:40.782848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:40.783533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:40.783987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:40.784411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:40.917587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:40.926018 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-734bec4c-9aff-4c6a-9b0c-7b8219829e92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.155906 Nov 03 04:37:40.926592 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3156/6429] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:40 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:41.949615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:41.950267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:41.957107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:41.957590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:41.958029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:41.958719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:41.959177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:41.959608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:42.091800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:42.099611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b6156655-f5ce-452d-b4ca-801dd8330c1c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1694 microversion: 2.1 time: 0.153932 Nov 03 04:37:42.100199 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3274/6430] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:41 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:43.122623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:43.123507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:43.130618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:43.131192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:43.131647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:43.132349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:43.132817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:43.133283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:43.339152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5d94b72c-61dc-4631-9900-50728b7d60a4 req-7feb7dd8-a600-4514-8e40-36c8ef334d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "name": "network-vif-unplugged", "status": "completed", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:43.345340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:43.350212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5d94b72c-61dc-4631-9900-50728b7d60a4 req-7feb7dd8-a600-4514-8e40-36c8ef334d8b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:43.350697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5d94b72c-61dc-4631-9900-50728b7d60a4 req-7feb7dd8-a600-4514-8e40-36c8ef334d8b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:43.351137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5d94b72c-61dc-4631-9900-50728b7d60a4 req-7feb7dd8-a600-4514-8e40-36c8ef334d8b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:43.353662 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-90f9106a-4ab1-4ae3-8bf0-dcdf72d5b2f8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1693 microversion: 2.1 time: 0.234986 Nov 03 04:37:43.354250 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3157/6431] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:43 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:43.362920 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5d94b72c-61dc-4631-9900-50728b7d60a4 req-7feb7dd8-a600-4514-8e40-36c8ef334d8b service nova] Creating event network-vif-unplugged:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h1-854653-7 Nov 03 04:37:43.368462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-5d94b72c-61dc-4631-9900-50728b7d60a4 req-7feb7dd8-a600-4514-8e40-36c8ef334d8b service nova] Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 04:37:43.379163 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5d94b72c-61dc-4631-9900-50728b7d60a4 req-7feb7dd8-a600-4514-8e40-36c8ef334d8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043698 Nov 03 04:37:43.382682 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3275/6432] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:37:44.377980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:44.378517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:44.385065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:44.385823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:44.386274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:44.386981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:44.387440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:44.387902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:44.608875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:44.616808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-21f087d6-14e7-4745-bfcb-8668da09817a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1693 microversion: 2.1 time: 0.243237 Nov 03 04:37:44.617547 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3158/6433] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:44 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1693 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:45.395740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-71c38767-b434-444e-86cf-27e63582775a req-f5d2b213-bf93-44db-8d04-20b131e2f996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:45.405832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-71c38767-b434-444e-86cf-27e63582775a req-f5d2b213-bf93-44db-8d04-20b131e2f996 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:45.406312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-71c38767-b434-444e-86cf-27e63582775a req-f5d2b213-bf93-44db-8d04-20b131e2f996 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:45.406751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-71c38767-b434-444e-86cf-27e63582775a req-f5d2b213-bf93-44db-8d04-20b131e2f996 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:45.418131 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-71c38767-b434-444e-86cf-27e63582775a req-f5d2b213-bf93-44db-8d04-20b131e2f996 service nova] Creating event network-changed:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h1-854653-7 Nov 03 04:37:45.423975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-71c38767-b434-444e-86cf-27e63582775a req-f5d2b213-bf93-44db-8d04-20b131e2f996 service nova] Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 04:37:45.434824 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-71c38767-b434-444e-86cf-27e63582775a req-f5d2b213-bf93-44db-8d04-20b131e2f996 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044065 Nov 03 04:37:45.435425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3276/6434] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:37:45.641645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:45.642265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:45.649154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:45.649644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:45.650087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:45.651019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:45.651485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:45.651915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:45.874399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:45.882183 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-75df947d-77f7-4742-b739-c00a62cbaba5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1691 microversion: 2.1 time: 0.244942 Nov 03 04:37:45.882770 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3159/6435] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:45 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1691 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:46.907832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:46.908548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:46.915061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:46.915563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:46.916009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:46.916711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:46.917216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:46.917648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:47.054795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:47.062538 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c6f1597a-bf3c-4089-b399-b84889575364 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1691 microversion: 2.1 time: 0.160341 Nov 03 04:37:47.063103 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3277/6436] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:46 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:47.083945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:47.084494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:47.091349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:47.091824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:47.092268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:47.093639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:47.094104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:47.094543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:47.118115 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-518a1bf6-aed5-440f-a0df-a7dfb40b4769 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/ips" status: 200 len: 150 microversion: 2.1 time: 0.038041 Nov 03 04:37:47.118683 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3160/6437] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:37:47 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:37:48.088854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:48.090137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:48.098214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:48.098966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:48.099612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:48.100734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:48.101441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:48.102050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:48.320397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:48.324754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:48.331840 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7c4da1ae-8730-4d38-8bcd-4b11ee8932a7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1691 microversion: 2.1 time: 0.247125 Nov 03 04:37:48.332446 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3278/6438] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:48 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:49.355662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:49.356369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:49.363727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.364215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.364654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.365383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.365841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.366268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.503973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:49.512102 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fc1b7890-9aad-4a44-9f62-665309881ce1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1688 microversion: 2.1 time: 0.160444 Nov 03 04:37:49.512675 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3161/6439] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:49 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:49.534779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:49.535339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:49.543027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.543513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.543949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.544634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.545158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.552531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.712765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86bc17a7-faf8-469a-ada1-72f4abc227c3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action" status: 204 len: 0 microversion: 2.1 time: 0.181473 Nov 03 04:37:49.713417 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3279/6440] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:37:49 2022] POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:37:49.722538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:49.723228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:49.729883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.730428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.730879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.731717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.732185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.732685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.801569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "019f76ed-f0c3-4723-a381-8e3ae682a0fd"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:49.804913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:49.811627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.812428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.812885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.813632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:49.814267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:49.814698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:49.963958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:49.972448 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-16e31b58-f08a-43cf-bf9a-afe7d19478c0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1688 microversion: 2.1 time: 0.254015 Nov 03 04:37:49.973925 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3162/6441] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:49 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1688 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:50.653825 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d185324-512a-46d4-9757-6a9f1f1bb0ff tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "POST /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858003 Nov 03 04:37:50.654557 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3280/6442] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:37:49 2022] POST /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:37:50.996932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:50.997591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:51.000979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=35 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:51.005880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:51.006319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:51.006767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:51.007478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:51.007943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:51.008378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:51.011351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=99 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:51.148706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:51.159249 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f24f0ef6-7981-4c20-b73f-b7b3ec9aa704 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1688 microversion: 2.1 time: 0.165755 Nov 03 04:37:51.176401 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3163/6443] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:50 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:37:51.276118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-cee9627f-9c0e-4a35-9917-ec01b773867b req-28794470-f9a7-4ea1-b562-8b03b34da618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "name": "network-vif-plugged", "status": "completed", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:37:51.282391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=39 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:37:51.291386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cee9627f-9c0e-4a35-9917-ec01b773867b req-28794470-f9a7-4ea1-b562-8b03b34da618 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:51.292082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cee9627f-9c0e-4a35-9917-ec01b773867b req-28794470-f9a7-4ea1-b562-8b03b34da618 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:51.293054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-cee9627f-9c0e-4a35-9917-ec01b773867b req-28794470-f9a7-4ea1-b562-8b03b34da618 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:51.306043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-cee9627f-9c0e-4a35-9917-ec01b773867b req-28794470-f9a7-4ea1-b562-8b03b34da618 service nova] Creating event network-vif-plugged:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h1-854653-7 Nov 03 04:37:51.311199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-cee9627f-9c0e-4a35-9917-ec01b773867b req-28794470-f9a7-4ea1-b562-8b03b34da618 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041533 Nov 03 04:37:51.311813 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3281/6444] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:37:52.183968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:37:52.184618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:37:52.192021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:52.192514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:52.194579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:52.194579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:37:52.194579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:37:52.195003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:37:52.336062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:37:52.343872 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd0a2790-8bb1-4c24-b284-84503867d51b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1680 microversion: 2.1 time: 0.163939 Nov 03 04:37:52.344428 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3164/6445] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:37:52 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:38:02.526920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:38:02.531773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:02.532379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:02.539090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:02.539578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:02.540023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:02.540726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:02.541219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:02.541652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:02.621084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lazy-loading 'services' on Instance uuid 26c3890c-6b70-42be-9c81-2316ef887aa5 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:38:02.831224 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-93692c21-6f92-4728-8e24-f78ebc78a457 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments/019f76ed-f0c3-4723-a381-8e3ae682a0fd" status: 202 len: 0 microversion: 2.1 time: 0.306397 Nov 03 04:38:02.831765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3282/6446] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:38:02 2022] DELETE /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments/019f76ed-f0c3-4723-a381-8e3ae682a0fd => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:38:02.841565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:02.844476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:02.847271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:38:02.847941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=11 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:38:02.852606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:02.853651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:02.854103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:02.854818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:02.855310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:02.855744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:02.886497 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f39343f5-112b-4a9f-8836-7f6dcc0da3f1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050100 Nov 03 04:38:02.887121 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3165/6447] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:38:02 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:03.901655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:03.903874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:03.910332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:03.910825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:03.911320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:03.912323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:03.912775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:03.913244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:03.945857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-60729f3b-0301-4cf1-8526-02da0a260a10 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049600 Nov 03 04:38:03.946434 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3283/6448] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:38:03 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:38:04.958554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:04.960768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:04.968873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:04.971545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:04.971545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:04.971545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:04.971545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:04.971545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:05.003042 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5b889a61-3b5d-4639-9841-90a93f8745f7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048509 Nov 03 04:38:05.003914 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3166/6449] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:38:04 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:06.024700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:06.024700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:06.024700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:06.025602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:06.025602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:06.026172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:06.026624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:06.027048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:06.056635 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83599a85-34e1-4f86-9392-54103d557ea1 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Nov 03 04:38:06.057218 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3284/6450] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:38:06 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:07.068455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:07.070895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:07.077801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:07.078282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:07.082475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:07.082475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:07.082475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:07.082475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:07.113059 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a218e90-ade0-4454-aa63-dbafa33ba6d4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048561 Nov 03 04:38:07.113641 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3167/6451] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:38:07 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:08.126340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:08.128506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:08.135184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:08.135920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:08.136382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:08.137086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:08.137565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:08.137989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:08.166084 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6cb83664-78ff-4edf-8ce2-c942b6adfb7e tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044414 Nov 03 04:38:08.166562 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3285/6452] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 04:38:08 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 04:38:08.228548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:08.229102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:08.235974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:08.236460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:08.236905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:08.237627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:08.238088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:08.238529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:08.264064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:38:08.559838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-072d6229-a079-48d2-a7c0-7654d29019dd tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 204 len: 0 microversion: 2.1 time: 0.335069 Nov 03 04:38:08.560481 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3168/6453] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:38:08 2022] DELETE /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:38:08.568759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:08.569479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:08.575462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:08.575950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:08.576383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:08.577096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:08.577568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:08.577975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:08.709759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:38:08.717869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f4ca555f-5ea1-4619-a339-210b04cb1278 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1681 microversion: 2.1 time: 0.152957 Nov 03 04:38:08.718437 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3286/6454] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:08 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:38:09.742763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:09.743467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:09.750351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:09.750836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:09.751275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:09.751970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:09.752427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:09.752853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:09.880437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:38:09.888375 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae9c8967-a6b5-4e36-b55b-c2168b144cf0 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1681 microversion: 2.1 time: 0.149918 Nov 03 04:38:09.889477 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3169/6455] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:09 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:38:10.912854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:10.914251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:10.922825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:10.922825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:10.922825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:10.924255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:10.924255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:10.924464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:10.995665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:38:11.003708 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b38d8678-25f7-4e6f-ab96-8a7141281342 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1614 microversion: 2.1 time: 0.095114 Nov 03 04:38:11.004534 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3287/6456] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:10 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:38:11.300292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e357536d-3b97-47be-82e3-046d37e73eb2 req-afb131c0-a198-46e5-9978-91d11fea8efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c3890c-6b70-42be-9c81-2316ef887aa5", "name": "network-vif-deleted", "tag": "8e942043-aca7-473c-916b-0ac910122bf8"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:38:11.316590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e357536d-3b97-47be-82e3-046d37e73eb2 req-afb131c0-a198-46e5-9978-91d11fea8efa service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:11.317175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e357536d-3b97-47be-82e3-046d37e73eb2 req-afb131c0-a198-46e5-9978-91d11fea8efa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:11.320265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e357536d-3b97-47be-82e3-046d37e73eb2 req-afb131c0-a198-46e5-9978-91d11fea8efa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:11.330841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e357536d-3b97-47be-82e3-046d37e73eb2 req-afb131c0-a198-46e5-9978-91d11fea8efa service nova] Creating event network-vif-deleted:8e942043-aca7-473c-916b-0ac910122bf8 for instance 26c3890c-6b70-42be-9c81-2316ef887aa5 on n-h1-854653-7 Nov 03 04:38:11.336168 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e357536d-3b97-47be-82e3-046d37e73eb2 req-afb131c0-a198-46e5-9978-91d11fea8efa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119162 Nov 03 04:38:11.337536 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3170/6457] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:12.028047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:12.028659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:12.036081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:12.036574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:12.037066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:12.037866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:12.039132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:12.039770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:12.077421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:12.077921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:12.078369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:12.078826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lazy-loading 'fault' on Instance uuid 26c3890c-6b70-42be-9c81-2316ef887aa5 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:38:12.123500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6213b618d72f4fb6aca0a98959544421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb028fd3127e48ce9e0df8f7f2f54432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:38:12.131680 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a0f509d6-0a77-412b-82db-bce83f580e9c tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 200 len: 1331 microversion: 2.1 time: 0.107695 Nov 03 04:38:12.132476 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3288/6458] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:12 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:38:13.159788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:13.160500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:13.168506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:13.168940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:13.169415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:13.170122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:13.170585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:13.171019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:13.184148 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 HTTP/1.1 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '26c3890c-6b70-42be-9c81-2316ef887aa5'} Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:13.185801 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-12402eff-df6f-4e36-ac06-804afbf2837f tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 404 len: 111 microversion: 2.1 time: 0.031686 Nov 03 04:38:13.192103 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3171/6459] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:13 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:13.196637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-efe5cecc-a548-4145-9e47-2370f65b7637 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '.version_select at 0x7ff7f3edb040>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:13.290294 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-efe5cecc-a548-4145-9e47-2370f65b7637 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369269384" status: 202 len: 0 microversion: 2.1 time: 0.097519 Nov 03 04:38:13.290865 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3289/6460] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 04:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369269384 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:38:17.729723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:17.730269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:17.737727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:17.738221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:17.738667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:17.739405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:17.739870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:17.740303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:17.755358 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 HTTP/1.1 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '26c3890c-6b70-42be-9c81-2316ef887aa5'} Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:17.756956 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a2ee83e-3b62-4e95-ae6a-3eb06a3ef977 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 404 len: 111 microversion: 2.1 time: 0.032629 Nov 03 04:38:17.761910 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3172/6461] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:38:17 2022] DELETE /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:17.768791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:17.769462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 26c3890c-6b70-42be-9c81-2316ef887aa5] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:17.776627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:17.777143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:17.777594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:17.778300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:17.778769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:17.779650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:17.792907 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 HTTP/1.1 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '26c3890c-6b70-42be-9c81-2316ef887aa5'} Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:17.794882 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 26c3890c-6b70-42be-9c81-2316ef887aa5 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e00020c-ac7c-44d0-bd3e-29b2978f44b5 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5" status: 404 len: 111 microversion: 2.1 time: 0.032244 Nov 03 04:38:17.801148 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3290/6462] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:17 2022] GET /compute/v2.1/servers/26c3890c-6b70-42be-9c81-2316ef887aa5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:21.259197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:21.259739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:21.267795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.268282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.268729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.269456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.269916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.270345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.285485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 HTTP/1.1 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '37536020-8fbd-4608-8068-1bc25ccf1757'} Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:21.287057 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1a77516-ef03-4153-8e5b-c2c4257a60c7 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 404 len: 111 microversion: 2.1 time: 0.033244 Nov 03 04:38:21.292302 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3173/6463] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:38:21 2022] DELETE /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:21.303075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:21.303710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 37536020-8fbd-4608-8068-1bc25ccf1757] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:21.312973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.314037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.314496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.315180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.315638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.316064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.330306 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 HTTP/1.1 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '37536020-8fbd-4608-8068-1bc25ccf1757'} Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.331842 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 37536020-8fbd-4608-8068-1bc25ccf1757 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b488494d-276b-4055-b528-5e1f610dc504 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757" status: 404 len: 111 microversion: 2.1 time: 0.034416 Nov 03 04:38:21.338636 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3291/6464] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:21 2022] GET /compute/v2.1/servers/37536020-8fbd-4608-8068-1bc25ccf1757 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:21.341946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:21.342510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:21.349154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.349639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.350081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.350770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.351230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.351657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.365005 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff HTTP/1.1 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a33da54b-d47c-4a3f-a349-b9e6ae8268ff'} Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:21.366614 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-967d3a68-7e12-4386-b741-73b78853cd57 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 404 len: 111 microversion: 2.1 time: 0.030005 Nov 03 04:38:21.372777 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3174/6465] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:38:21 2022] DELETE /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:21.376659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:21.377438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: a33da54b-d47c-4a3f-a349-b9e6ae8268ff] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:21.383407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.383898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.384336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.385130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:21.385602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:21.386300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:21.400307 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff HTTP/1.1 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a33da54b-d47c-4a3f-a349-b9e6ae8268ff'} Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:21.401815 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance a33da54b-d47c-4a3f-a349-b9e6ae8268ff could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b059f7bb-72f8-4dd0-b5af-88e2d73a9d6b tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff" status: 404 len: 111 microversion: 2.1 time: 0.030775 Nov 03 04:38:21.406561 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3292/6466] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:21 2022] GET /compute/v2.1/servers/a33da54b-d47c-4a3f-a349-b9e6ae8268ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:38:22.564708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:38:22.566922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:22.574694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:22.575187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:22.575629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:22.576329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:22.576794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:22.577326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:22.633599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c0c3dd7-42a1-4eba-8923-6418df452f91 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action" status: 200 len: 24578 microversion: 2.1 time: 0.072447 Nov 03 04:38:22.640578 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3175/6467] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:38:22 2022] POST /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a/action => generated 24578 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:38:24.796378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:24.796956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:24.804184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:24.804669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:24.805138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:24.805832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:24.806287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:24.806711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:24.820240 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 HTTP/1.1 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '3d8bec4d-235f-455c-ab36-9f26eb7bac34'} Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:24.821979 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2844bd48-25dd-4236-8e86-7ffefed01df4 tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 404 len: 111 microversion: 2.1 time: 0.030875 Nov 03 04:38:24.826420 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3293/6468] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:38:24 2022] DELETE /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:24.832823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:24.833555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] [instance: 3d8bec4d-235f-455c-ab36-9f26eb7bac34] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:24.841317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:24.841802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:24.842237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:24.842926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:24.843380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:24.843805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:24.858239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] HTTP exception thrown: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Request method failure captured: Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 HTTP/1.1 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0Qil9aYzXwOIUTno8GLhBM-vF690npYTIDAdAqPj7xCS6bD0Sbn0PCxmy_daP2XekYVseC8I4MQpm2J9pTeDwFAig-Pki9lDw1PABwjDu-J3vK5G6m-e1KN0OjSFh_AC76cQUMGzKKa7Q8wIeE9j8ujBF8zEV5HdQqV2NXre0-FEWA Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cb028fd3127e48ce9e0df8f7f2f54432", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cb028fd3127e48ce9e0df8f7f2f54432"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cb028fd3127e48ce9e0df8f7f2f54432"}]}] Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cb028fd3127e48ce9e0df8f7f2f54432 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1774189355 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 6213b618d72f4fb6aca0a98959544421 Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-AttachVolumeNegativeTest-1774189355-project Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '3d8bec4d-235f-455c-ab36-9f26eb7bac34'} Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:24.859853 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] Returning 404 to user: Instance 3d8bec4d-235f-455c-ab36-9f26eb7bac34 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d10ed9aa-d933-4403-868f-68152481e8fa tempest-AttachVolumeNegativeTest-1774189355 tempest-AttachVolumeNegativeTest-1774189355-project] 10.222.0.30 "GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34" status: 404 len: 111 microversion: 2.1 time: 0.033130 Nov 03 04:38:24.865138 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3176/6469] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:24 2022] GET /compute/v2.1/servers/3d8bec4d-235f-455c-ab36-9f26eb7bac34 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:30.386451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0665d94f-c819-4dc7-9544-81ac01330c0f tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Action: 'create', calling method: .version_select at 0x7ff7f3ffe790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-156120742"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:38:30.931120 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0665d94f-c819-4dc7-9544-81ac01330c0f tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.659761 Nov 03 04:38:30.931743 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3294/6470] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Nov 3 04:38:30 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 661 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 03 04:38:30.944463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-348339df-4134-4ece-8500-e4a0182cdedc tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7fd531310>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:30.994591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-348339df-4134-4ece-8500-e4a0182cdedc tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 200 len: 344 microversion: 2.1 time: 0.053870 Nov 03 04:38:31.001284 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3177/6471] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:30 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:32.013814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa482678-6a28-4dd3-900b-b49f5a8e61ea tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3ee6550>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:32.066794 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa482678-6a28-4dd3-900b-b49f5a8e61ea tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 200 len: 344 microversion: 2.1 time: 0.058006 Nov 03 04:38:32.067414 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3295/6472] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:32 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:33.082565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ae917cd-382d-4e66-a1a4-9411f92d7f42 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f92d1550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:33.128911 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ae917cd-382d-4e66-a1a4-9411f92d7f42 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 200 len: 345 microversion: 2.1 time: 0.052582 Nov 03 04:38:33.129507 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3178/6473] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:33 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:33.143913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a2cc7b22-a60d-433b-9660-bb4580832cc2 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Action: 'create', calling method: .version_select at 0x7ff7f3f3cb80>, body: {"snapshot": {"volume_id": "639f2bfb-9764-4a9e-8963-1715d96c5883", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1179303179"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:38:33.492981 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a2cc7b22-a60d-433b-9660-bb4580832cc2 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.354189 Nov 03 04:38:33.493602 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3296/6474] 10.222.0.30 () {60 vars in 1162 bytes} [Thu Nov 3 04:38:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:33.508552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74ff2977-2c23-45cb-a18e-c037c239b883 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3e43820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:33.538444 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74ff2977-2c23-45cb-a18e-c037c239b883 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 200 len: 287 microversion: 2.1 time: 0.034131 Nov 03 04:38:33.538444 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3179/6475] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:38:33 2022] GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:33.546191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e64e51fe-95ac-4bcc-9bf7-74f0abf58b29 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3f3ca60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:33.576763 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e64e51fe-95ac-4bcc-9bf7-74f0abf58b29 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034282 Nov 03 04:38:33.577363 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3297/6476] 10.222.0.30 () {58 vars in 1140 bytes} [Thu Nov 3 04:38:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:33.589275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f0af2b40-e011-4634-a88f-a6260561ac59 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3e71af0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:33.620133 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f0af2b40-e011-4634-a88f-a6260561ac59 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 200 len: 287 microversion: 2.1 time: 0.035220 Nov 03 04:38:33.621206 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3180/6477] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:38:33 2022] GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:34.635002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-19182b7e-98cc-4c48-bcf7-1c81236a5179 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3f98670>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:34.666922 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-19182b7e-98cc-4c48-bcf7-1c81236a5179 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 200 len: 287 microversion: 2.1 time: 0.036610 Nov 03 04:38:34.672425 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3298/6478] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:38:34 2022] GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:35.678354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:38:35.679419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:38:35.684323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74845a2e-ee79-427d-8812-30372d8f182b tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3e54550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:35.715135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74845a2e-ee79-427d-8812-30372d8f182b tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 200 len: 288 microversion: 2.1 time: 0.039249 Nov 03 04:38:35.715705 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3181/6479] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:38:35 2022] GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:35.724838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:38:35.725655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:38:35.730456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f83dac92-4cdd-4e32-8664-4b12725b1f33 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3f3c280>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:35.856999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f83dac92-4cdd-4e32-8664-4b12725b1f33 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 202 len: 0 microversion: 2.1 time: 0.132990 Nov 03 04:38:35.860830 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3299/6480] 10.222.0.30 () {58 vars in 1254 bytes} [Thu Nov 3 04:38:35 2022] DELETE /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:38:35.866534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9e06c6d0-bba8-4425-8e25-141d48550103 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3e71550>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:35.904825 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9e06c6d0-bba8-4425-8e25-141d48550103 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 200 len: 287 microversion: 2.1 time: 0.042184 Nov 03 04:38:35.906034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3182/6481] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:38:35 2022] GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:36.920171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f874fb7-c902-497c-8c0d-c6bf6a0413b4 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3ee4790>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:36.951490 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f874fb7-c902-497c-8c0d-c6bf6a0413b4 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 200 len: 287 microversion: 2.1 time: 0.036397 Nov 03 04:38:36.952059 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3300/6482] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:38:36 2022] GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:37.964939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6c427b0-f72c-4f0a-8b94-7b2338f47b37 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7fd4889d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:37.990438 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d6c427b0-f72c-4f0a-8b94-7b2338f47b37 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] HTTP exception thrown: Snapshot a03d88f4-2efa-44e7-8284-20c922d156f3 could not be found. Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6c427b0-f72c-4f0a-8b94-7b2338f47b37 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Request method failure captured: Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 HTTP/1.1 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0XGSOF6Kfc-qGU4sFXc_us3jjARfrbtJ_YoYk4lGGC-lDpNR0REx8r3ZsI6rbVD8I07UtH3y3fDTBRx8BhftNGQnW1gcJCezuCKujDP6ttyL1jLfYxMH4n_HDaVqsRZLys7KECex4eFsnlotvGoSr6xZe4XHVnifG4g1AvikDNxWWU Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10087635597044ef9f077123745ddeb9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10087635597044ef9f077123745ddeb9"}]}] Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 65bd95e55ccd4e43bf6afbec87feca73 Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: exception: Snapshot a03d88f4-2efa-44e7-8284-20c922d156f3 could not be found. Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'a03d88f4-2efa-44e7-8284-20c922d156f3'} Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a03d88f4-2efa-44e7-8284-20c922d156f3 could not be found. (HTTP 404) (Request-ID: req-be242cfa-90fe-42f9-8308-01f93cfc32b4) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:38:38.007713 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a03d88f4-2efa-44e7-8284-20c922d156f3 could not be found. Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a03d88f4-2efa-44e7-8284-20c922d156f3 could not be found. Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a03d88f4-2efa-44e7-8284-20c922d156f3 could not be found. Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6c427b0-f72c-4f0a-8b94-7b2338f47b37 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Returning 404 to user: Snapshot a03d88f4-2efa-44e7-8284-20c922d156f3 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6c427b0-f72c-4f0a-8b94-7b2338f47b37 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3" status: 404 len: 111 microversion: 2.1 time: 0.049542 Nov 03 04:38:38.016569 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3183/6483] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 04:38:37 2022] GET /compute/v2.1/os-snapshots/a03d88f4-2efa-44e7-8284-20c922d156f3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:38.023651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-db1cae31-b4e5-4a93-8f9e-9433f1955668 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3ee6820>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:38.248788 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-db1cae31-b4e5-4a93-8f9e-9433f1955668 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 202 len: 0 microversion: 2.1 time: 0.229906 Nov 03 04:38:38.249561 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3301/6484] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:38:38 2022] DELETE /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:38:38.259933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b3e14750-d6ad-4410-badb-dfc093590956 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7fd4889d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:38.306657 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b3e14750-d6ad-4410-badb-dfc093590956 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 200 len: 344 microversion: 2.1 time: 0.052058 Nov 03 04:38:38.307301 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3184/6485] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:38 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:39.323264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1a68a143-258e-4404-adc4-1c20695a364b tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3ef78b0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:39.370230 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1a68a143-258e-4404-adc4-1c20695a364b tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 200 len: 344 microversion: 2.1 time: 0.051655 Nov 03 04:38:39.370934 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3302/6486] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:39 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:40.385492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c7b80d1-1b18-4e29-bb17-61714bcb69f9 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3e8f040>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:40.432996 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c7b80d1-1b18-4e29-bb17-61714bcb69f9 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 200 len: 344 microversion: 2.1 time: 0.052206 Nov 03 04:38:40.433597 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3185/6487] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:40 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:41.448264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a7325d9-fdde-4df6-b85a-6c02cb0ed796 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3f3cd30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:41.476359 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6a7325d9-fdde-4df6-b85a-6c02cb0ed796 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] HTTP exception thrown: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a7325d9-fdde-4df6-b85a-6c02cb0ed796 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Request method failure captured: Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 HTTP/1.1 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0XGSOF6Kfc-qGU4sFXc_us3jjARfrbtJ_YoYk4lGGC-lDpNR0REx8r3ZsI6rbVD8I07UtH3y3fDTBRx8BhftNGQnW1gcJCezuCKujDP6ttyL1jLfYxMH4n_HDaVqsRZLys7KECex4eFsnlotvGoSr6xZe4XHVnifG4g1AvikDNxWWU Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10087635597044ef9f077123745ddeb9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10087635597044ef9f077123745ddeb9"}]}] Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 65bd95e55ccd4e43bf6afbec87feca73 Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: exception: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '639f2bfb-9764-4a9e-8963-1715d96c5883'} Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. (HTTP 404) (Request-ID: req-0779f948-a8f4-4900-8b1a-a932da10b0ee) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:38:41.478380 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6a7325d9-fdde-4df6-b85a-6c02cb0ed796 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Returning 404 to user: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6a7325d9-fdde-4df6-b85a-6c02cb0ed796 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 404 len: 109 microversion: 2.1 time: 0.037735 Nov 03 04:38:41.483624 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3303/6488] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:41 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:41.495759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b2b6a67-f34a-4cf4-9147-c03e34fc0008 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3f38a60>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:41.524702 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7b2b6a67-f34a-4cf4-9147-c03e34fc0008 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] HTTP exception thrown: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b2b6a67-f34a-4cf4-9147-c03e34fc0008 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Request method failure captured: Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 HTTP/1.1 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0XGSOF6Kfc-qGU4sFXc_us3jjARfrbtJ_YoYk4lGGC-lDpNR0REx8r3ZsI6rbVD8I07UtH3y3fDTBRx8BhftNGQnW1gcJCezuCKujDP6ttyL1jLfYxMH4n_HDaVqsRZLys7KECex4eFsnlotvGoSr6xZe4XHVnifG4g1AvikDNxWWU Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10087635597044ef9f077123745ddeb9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10087635597044ef9f077123745ddeb9"}]}] Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 65bd95e55ccd4e43bf6afbec87feca73 Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: method: Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: exception: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '639f2bfb-9764-4a9e-8963-1715d96c5883'} Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. (HTTP 404) (Request-ID: req-29bbfdfd-93d2-43e2-bc19-2aba07a53328) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:38:41.526695 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7b2b6a67-f34a-4cf4-9147-c03e34fc0008 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Returning 404 to user: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7b2b6a67-f34a-4cf4-9147-c03e34fc0008 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 404 len: 109 microversion: 2.1 time: 0.037085 Nov 03 04:38:41.535441 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3186/6489] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Nov 3 04:38:41 2022] DELETE /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:38:41.539686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b96dfa3-0217-44f5-aec6-6c0c4d38e1c8 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Calling method '.version_select at 0x7ff7f3ee4e50>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:41.567980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-7b96dfa3-0217-44f5-aec6-6c0c4d38e1c8 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] HTTP exception thrown: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b96dfa3-0217-44f5-aec6-6c0c4d38e1c8 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Request method failure captured: Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 HTTP/1.1 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0XGSOF6Kfc-qGU4sFXc_us3jjARfrbtJ_YoYk4lGGC-lDpNR0REx8r3ZsI6rbVD8I07UtH3y3fDTBRx8BhftNGQnW1gcJCezuCKujDP6ttyL1jLfYxMH4n_HDaVqsRZLys7KECex4eFsnlotvGoSr6xZe4XHVnifG4g1AvikDNxWWU Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10087635597044ef9f077123745ddeb9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10087635597044ef9f077123745ddeb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10087635597044ef9f077123745ddeb9"}]}] Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 10087635597044ef9f077123745ddeb9 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1889792064 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 65bd95e55ccd4e43bf6afbec87feca73 Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1889792064-project Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: method: Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: exception: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '639f2bfb-9764-4a9e-8963-1715d96c5883'} Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. (HTTP 404) (Request-ID: req-f2080c10-7305-4dbc-8c6c-c76225635af2) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 03 04:38:41.569984 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b96dfa3-0217-44f5-aec6-6c0c4d38e1c8 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] Returning 404 to user: Volume 639f2bfb-9764-4a9e-8963-1715d96c5883 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b96dfa3-0217-44f5-aec6-6c0c4d38e1c8 tempest-VolumesSnapshotsTestJSON-1889792064 tempest-VolumesSnapshotsTestJSON-1889792064-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883" status: 404 len: 109 microversion: 2.1 time: 0.038023 Nov 03 04:38:41.578136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3304/6490] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Nov 3 04:38:41 2022] GET /compute/v2.1/os-volumes/639f2bfb-9764-4a9e-8963-1715d96c5883 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:38:45.737072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:45.737698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:45.743960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:45.744443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:45.744881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:45.745709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:45.746163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:45.746783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:45.881867 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce68bd11-b002-4041-b9cd-de4fd950e21a tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1831 microversion: 2.1 time: 0.149561 Nov 03 04:38:45.882646 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3187/6491] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:45 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1831 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:38:46.803518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:46.804317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:46.812376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:46.813191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:46.813805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:46.815146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:46.815718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:46.816495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:46.843583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:38:47.039785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d3fdc17b-f5bf-46cf-80b4-359b0bc595f2 req-0850ceac-ed0a-4a6c-a323-c8f848364979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:38:47.049441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d3fdc17b-f5bf-46cf-80b4-359b0bc595f2 req-0850ceac-ed0a-4a6c-a323-c8f848364979 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:47.049924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d3fdc17b-f5bf-46cf-80b4-359b0bc595f2 req-0850ceac-ed0a-4a6c-a323-c8f848364979 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:47.050351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d3fdc17b-f5bf-46cf-80b4-359b0bc595f2 req-0850ceac-ed0a-4a6c-a323-c8f848364979 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:47.061613 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d3fdc17b-f5bf-46cf-80b4-359b0bc595f2 req-0850ceac-ed0a-4a6c-a323-c8f848364979 service nova] Creating event network-changed:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h1-854653-7 Nov 03 04:38:47.067149 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d3fdc17b-f5bf-46cf-80b4-359b0bc595f2 req-0850ceac-ed0a-4a6c-a323-c8f848364979 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267395 Nov 03 04:38:47.071936 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3188/6492] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:47.176591 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-809b27cc-2f29-4446-8de5-4a28285259fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 204 len: 0 microversion: 2.1 time: 0.379910 Nov 03 04:38:47.181255 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3305/6493] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:38:46 2022] DELETE /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:38:47.187991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:47.188903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:47.195373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:47.196242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:47.196811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:47.197804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:47.198512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:47.199017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:47.340946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:38:47.349624 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c1660081-4b10-4bf1-974c-ea8d50dc0930 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1686 microversion: 2.1 time: 0.166527 Nov 03 04:38:47.350208 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3189/6494] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:47 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:38:48.376312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:48.377191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:48.384811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:48.385490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:48.385940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:48.386935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:48.387388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:48.387854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:48.621971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:38:48.629765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c96e3b8b-d8e9-4494-9feb-22320a5e04c9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1686 microversion: 2.1 time: 0.259970 Nov 03 04:38:48.634363 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3306/6495] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:48 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1686 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:38:49.220407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6dda5abc-35ad-4161-8be7-f18d29e0c56f req-5074af43-9964-4dc1-bdab-26bfee1e32ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bbe3ff3-759c-466b-a99c-6f47861f340a", "name": "network-vif-deleted", "tag": "6c782bad-d64c-4b4d-831b-5336d3fcbe34"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:38:49.231176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6dda5abc-35ad-4161-8be7-f18d29e0c56f req-5074af43-9964-4dc1-bdab-26bfee1e32ea service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:49.231749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6dda5abc-35ad-4161-8be7-f18d29e0c56f req-5074af43-9964-4dc1-bdab-26bfee1e32ea service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:49.232190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6dda5abc-35ad-4161-8be7-f18d29e0c56f req-5074af43-9964-4dc1-bdab-26bfee1e32ea service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:49.244464 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6dda5abc-35ad-4161-8be7-f18d29e0c56f req-5074af43-9964-4dc1-bdab-26bfee1e32ea service nova] Creating event network-vif-deleted:6c782bad-d64c-4b4d-831b-5336d3fcbe34 for instance 1bbe3ff3-759c-466b-a99c-6f47861f340a on n-h1-854653-7 Nov 03 04:38:49.249344 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6dda5abc-35ad-4161-8be7-f18d29e0c56f req-5074af43-9964-4dc1-bdab-26bfee1e32ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Nov 03 04:38:49.249948 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3190/6496] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:38:49.667339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:49.667339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:49.670373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:49.671257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:49.671748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:49.676074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:49.676074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:49.676074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:49.711176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:49.712077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:49.712624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:49.713196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lazy-loading 'fault' on Instance uuid 1bbe3ff3-759c-466b-a99c-6f47861f340a {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:38:49.756748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:38:49.764811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a115d01e-fccf-4936-ae29-4a23f36119c2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 200 len: 1355 microversion: 2.1 time: 0.114422 Nov 03 04:38:49.765442 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3307/6497] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:49 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 1355 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:38:50.800981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:50.801723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 1bbe3ff3-759c-466b-a99c-6f47861f340a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:38:50.807979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:50.808468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:50.808910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:50.809632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:38:50.810091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:38:50.810569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:38:50.826242 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] HTTP exception thrown: Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a could not be found. Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Request method failure captured: Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a HTTP/1.1 Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0VAHsMChhMJ4SSDnfsQJn1ExSAQcK-qK0C61h7g9mfDWA4lZewLtyFI0NJeDbsL2BFPXqzH_i_aRtJx2NZNHpL4on7CHw_KlIgilyvVNC2YHta4pffIuHzZXArq-kz_ZLkWPz-0dTdepkn7ADhuA8LZPM5toLxhOYIphnetY5GGuHc Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7fea2b758684fa9a57416aeb378b77a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7fea2b758684fa9a57416aeb378b77a"}]}] Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: e407ab02fb9f4e5aae907b6affa8c51b Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a could not be found. Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1bbe3ff3-759c-466b-a99c-6f47861f340a'} Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a could not be found. Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a could not be found. Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:50.827858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a could not be found. Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Returning 404 to user: Instance 1bbe3ff3-759c-466b-a99c-6f47861f340a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06e67ff6-273e-4331-b0df-a55d0eecde60 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a" status: 404 len: 111 microversion: 2.1 time: 0.034013 Nov 03 04:38:50.831158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3191/6498] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:38:50 2022] GET /compute/v2.1/servers/1bbe3ff3-759c-466b-a99c-6f47861f340a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:38:54.599388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-03628746-bfe3-4a3e-825d-0a84656b7bb3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '.version_select at 0x7ff7f3ee6a60>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:38:54.703461 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-03628746-bfe3-4a3e-825d-0a84656b7bb3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-707244016" status: 202 len: 0 microversion: 2.1 time: 0.108109 Nov 03 04:38:54.704059 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3308/6499] 10.222.0.30 () {58 vars in 1281 bytes} [Thu Nov 3 04:38:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-707244016 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:38:54.738317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-830f21e8-c34e-4010-bc0d-3a909fa830bb tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: .version_select at 0x7ff7f3e830d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1878836009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSPsmXN0MocqD60mT2miJbE/CZVxsXoZQvLLay4noyZd9g0tWzMQn0mmEg8Gj+/encFWTNW7DkH7b2cCaDyoy6WpeUKxH3LY6Uq8DJtLOqRdOtsnmWSzETzfv9uVlnAqg=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:38:54.755156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-830f21e8-c34e-4010-bc0d-3a909fa830bb tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:38:54.761198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-830f21e8-c34e-4010-bc0d-3a909fa830bb tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:38:54.775303 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-830f21e8-c34e-4010-bc0d-3a909fa830bb tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:38:55.783400 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [None req-830f21e8-c34e-4010-bc0d-3a909fa830bb tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 52794. Nov 03 04:38:55.873993 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-830f21e8-c34e-4010-bc0d-3a909fa830bb tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.139743 Nov 03 04:38:55.874601 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3192/6500] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:38:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:39:04.599374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:04.603607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1880276984", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "f23293e1-97c1-4a05-b223-7464cbee0374"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1878836009", "security_groups": [{"name": "tempest-secgroup-smoke-1145353019"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:39:04.746934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] validate_networks() for [('f23293e1-97c1-4a05-b223-7464cbee0374', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:39:05.280153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:39:05.280584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:39:05.281879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:39:05.282848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:39:05.283309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:39:05.294201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:05.294855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:05.298917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:05.298917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:05.298917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:05.298917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:05.315735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:39:05.321241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:39:05.334713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:39:05.337099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:39:05.472045 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a887e444-185c-415c-afea-669aac8cb2bc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874067 Nov 03 04:39:05.472935 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3309/6501] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:39:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:39:05.482585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=18 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:05.483630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:05.487801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba3b4942-aa19-42c4-9b19-e93e7765be63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:05.488427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba3b4942-aa19-42c4-9b19-e93e7765be63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:05.548659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba3b4942-aa19-42c4-9b19-e93e7765be63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:05.555685 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba3b4942-aa19-42c4-9b19-e93e7765be63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1267 microversion: 2.1 time: 0.074940 Nov 03 04:39:05.556305 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3193/6502] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:05 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:06.580532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6967a7d9-2f6f-4531-a413-9d20b4f1f934 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:06.581401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6967a7d9-2f6f-4531-a413-9d20b4f1f934 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:06.688348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6967a7d9-2f6f-4531-a413-9d20b4f1f934 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:06.696411 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6967a7d9-2f6f-4531-a413-9d20b4f1f934 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1267 microversion: 2.1 time: 0.121595 Nov 03 04:39:06.712628 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3310/6503] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:06 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:07.721585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02130541-3629-413b-ad11-c5a1269bfb2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:07.722782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-02130541-3629-413b-ad11-c5a1269bfb2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:07.782810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-02130541-3629-413b-ad11-c5a1269bfb2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:07.790893 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-02130541-3629-413b-ad11-c5a1269bfb2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1267 microversion: 2.1 time: 0.074445 Nov 03 04:39:07.791519 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3194/6504] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:07 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:08.816575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e061980-d3ca-471d-9cf0-3d6a8997e034 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:08.817228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e061980-d3ca-471d-9cf0-3d6a8997e034 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:08.895103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e061980-d3ca-471d-9cf0-3d6a8997e034 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:08.902825 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e061980-d3ca-471d-9cf0-3d6a8997e034 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1267 microversion: 2.1 time: 0.090641 Nov 03 04:39:08.903335 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3311/6505] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:08 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:09.930284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:09.930897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:09.933652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:09.938881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:09.939367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:09.939804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:09.940499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:09.940952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:09.941401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:10.004244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:10.012223 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc27a0b4-1e9c-4826-8d3f-824cfa2e748b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1271 microversion: 2.1 time: 0.085689 Nov 03 04:39:10.012847 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3195/6506] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:09 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:11.036279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:11.036919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:11.044134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:11.044627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:11.045106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:11.045811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:11.046312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:11.046766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:11.113700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:11.127617 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-498fe9a8-ddba-445e-9956-49f421d841a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1263 microversion: 2.1 time: 0.094893 Nov 03 04:39:11.128783 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3312/6507] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:11 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1263 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:12.153737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:12.161318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:12.168783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:12.169310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:12.169763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:12.170477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:12.170936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:12.176174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:12.268625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:12.276380 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-08269f48-1578-4cdf-94cd-93e9c5df14ad tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1337 microversion: 2.1 time: 0.127352 Nov 03 04:39:12.276997 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3196/6508] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:12 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1337 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:13.303839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:13.305155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:13.312822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:13.313516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:13.314140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:13.314993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:13.315597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:13.316181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:13.491201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:13.500425 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d612053-6aad-4a14-af28-5d9a66b0e55b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.199770 Nov 03 04:39:13.501180 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3313/6509] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:13 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:13.817768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-fbd1d614-d506-421f-81cf-b844f7a39dd0 req-fc8bb29d-49b1-48e3-a4b5-8e93231b9377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:39:13.829131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fbd1d614-d506-421f-81cf-b844f7a39dd0 req-fc8bb29d-49b1-48e3-a4b5-8e93231b9377 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:13.829734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fbd1d614-d506-421f-81cf-b844f7a39dd0 req-fc8bb29d-49b1-48e3-a4b5-8e93231b9377 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:13.830279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fbd1d614-d506-421f-81cf-b844f7a39dd0 req-fc8bb29d-49b1-48e3-a4b5-8e93231b9377 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:13.844341 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-fbd1d614-d506-421f-81cf-b844f7a39dd0 req-fc8bb29d-49b1-48e3-a4b5-8e93231b9377 service nova] Creating event network-changed:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:39:13.850751 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-fbd1d614-d506-421f-81cf-b844f7a39dd0 req-fc8bb29d-49b1-48e3-a4b5-8e93231b9377 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037566 Nov 03 04:39:13.851832 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3197/6510] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:39:14.528070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:14.528798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:14.535377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:14.535984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:14.536647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:14.537483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:14.538006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:14.538503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:14.689819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:14.700693 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d84c65b8-6941-45d4-859e-b81928548ed3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.177045 Nov 03 04:39:14.701328 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3314/6511] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:14 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:15.725989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:15.726687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:15.733829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:15.734307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:15.734747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:15.735447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:15.735890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:15.736314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:15.871777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:15.880244 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-baefed68-74df-4628-9743-bb346dd599e0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.158560 Nov 03 04:39:15.880822 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3198/6512] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:15 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:16.903908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:16.904618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:16.907026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:16.908547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:16.913295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:16.913883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:16.914418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:16.915119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:16.915579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:16.916008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:17.052282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:17.060282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6181e27c-b93c-4487-8328-baa63938de2b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.160258 Nov 03 04:39:17.060865 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3315/6513] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:16 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:18.083640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:18.084259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:18.088312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:18.091778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:18.092261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:18.092701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:18.093985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:18.094442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:18.094865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:18.229536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:18.238180 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c8c265dd-1ecb-4c64-8e58-7815e39c9596 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.158361 Nov 03 04:39:18.239043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3199/6514] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:18 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:19.262096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:19.262722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:19.265377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:19.270434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:19.270918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:19.271354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:19.272045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:19.272498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:19.274330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:19.424736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:19.433143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-57c1d8ee-2e88-4c65-96ae-13217f223cf6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.175374 Nov 03 04:39:19.433674 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3316/6515] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:19 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:20.457992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:20.458507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:20.466406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:20.466989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:20.467428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:20.468140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:20.468602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:20.469206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:20.637892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:20.647419 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3548a250-7b9f-4c87-9ea8-6081213d5f42 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.193335 Nov 03 04:39:20.647717 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3200/6516] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:20 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:20.895032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-72ef28e6-d2ca-4fb1-ac7f-38846d176e97 req-a08d0a1d-08e0-4da5-b85e-661eea26f795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "name": "network-vif-plugged", "status": "completed", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:39:20.904784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72ef28e6-d2ca-4fb1-ac7f-38846d176e97 req-a08d0a1d-08e0-4da5-b85e-661eea26f795 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:20.905592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72ef28e6-d2ca-4fb1-ac7f-38846d176e97 req-a08d0a1d-08e0-4da5-b85e-661eea26f795 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:20.905943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-72ef28e6-d2ca-4fb1-ac7f-38846d176e97 req-a08d0a1d-08e0-4da5-b85e-661eea26f795 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:20.917254 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-72ef28e6-d2ca-4fb1-ac7f-38846d176e97 req-a08d0a1d-08e0-4da5-b85e-661eea26f795 service nova] Creating event network-vif-plugged:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:39:20.922912 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-72ef28e6-d2ca-4fb1-ac7f-38846d176e97 req-a08d0a1d-08e0-4da5-b85e-661eea26f795 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240343 Nov 03 04:39:20.923520 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3317/6517] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:39:21.670481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:21.671106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:21.678537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:21.679028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:21.679465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:21.680255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:21.680674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:21.681100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:21.816573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:21.825862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ffcd94e-be61-42ee-a60e-8bfcbcd5cb62 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1393 microversion: 2.1 time: 0.159251 Nov 03 04:39:21.826450 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3201/6518] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:21 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:22.852477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:22.853325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:22.861410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:22.862212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:22.862820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:22.863748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:22.864377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:22.864973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:23.003795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:23.013976 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a249bfa7-0e5a-4bb4-afc1-24ebe69813d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1564 microversion: 2.1 time: 0.165741 Nov 03 04:39:23.017071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3318/6519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:22 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:23.037579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:23.038768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:23.045748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:23.046279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:23.046720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:23.047439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:23.047891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:23.048500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:23.191330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:23.200165 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2a19deca-e47d-488c-8140-9d0baa09f675 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1564 microversion: 2.1 time: 0.166442 Nov 03 04:39:23.201395 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3202/6520] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:23 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:25.870445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:39:25.875917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-42f73086-248d-4b30-bb7c-89836915647a req-05a92baa-a8c0-492c-be7b-6fb39cae0939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:39:25.878580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:25.887750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:25.888459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:25.888571 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:39:25.888738 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:39:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 03 04:39:25.889507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:25.890445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:25.891134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:25.891772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:25.923314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-42f73086-248d-4b30-bb7c-89836915647a req-05a92baa-a8c0-492c-be7b-6fb39cae0939 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:25.923807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-42f73086-248d-4b30-bb7c-89836915647a req-05a92baa-a8c0-492c-be7b-6fb39cae0939 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:25.926088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-42f73086-248d-4b30-bb7c-89836915647a req-05a92baa-a8c0-492c-be7b-6fb39cae0939 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:25.951081 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-42f73086-248d-4b30-bb7c-89836915647a req-05a92baa-a8c0-492c-be7b-6fb39cae0939 service nova] Creating event network-changed:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:39:25.956892 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-42f73086-248d-4b30-bb7c-89836915647a req-05a92baa-a8c0-492c-be7b-6fb39cae0939 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084577 Nov 03 04:39:25.961962 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3203/6521] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:39:26.266777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:39:26.275748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-11b0a353-ac98-4a41-b12d-7cb11d2f28a8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1564 microversion: 2.1 time: 0.409891 Nov 03 04:39:26.278125 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3319/6522] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:39:25 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1564 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:39:49.632342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=17 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:49.633155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=46 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:39:49.637325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:39:49.639887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:39:49.646020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:49.646500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:49.646936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:49.651154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:39:49.651154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:39:49.651154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:39:49.700219 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c4dc523-ab5a-4574-b652-43f92c1c1d12 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action" status: 200 len: 24562 microversion: 2.1 time: 0.070048 Nov 03 04:39:49.701084 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3204/6523] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:39:49 2022] POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action => generated 24562 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:40:00.799162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:00.799810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:00.802430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:00.803273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=46 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:00.808316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:00.808805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:00.809395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:00.810099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:00.810564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:00.810994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:01.267452 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-57f93c37-e3c0-4422-8727-6c0f85754f17 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1834 microversion: 2.1 time: 0.471995 Nov 03 04:40:01.268029 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3320/6524] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:00 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1834 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:01.290497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:01.291205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:01.293872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:01.294527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:01.300016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:01.300508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:01.300956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:01.301849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:01.309268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:01.309268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:01.440064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:01.447985 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-99f14797-cdc3-494c-a200-53a88d51ec9e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1683 microversion: 2.1 time: 0.161850 Nov 03 04:40:01.448640 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3205/6525] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:01 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:01.557943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:01.560136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:01.566428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:01.566956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:01.567399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:01.568132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:01.568589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:01.569037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:01.623421 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-163571a0-b48f-47aa-b07a-2cd802bb71bd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action" status: 200 len: 32639 microversion: 2.1 time: 0.069370 Nov 03 04:40:01.630783 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3321/6526] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:40:01 2022] POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action => generated 32639 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:40:01.796699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:01.797335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:01.807580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:01.808134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:01.808557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:01.809302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:01.809773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:01.810208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:01.999904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a83ba1d7d1db4e1cbc68e028d8b2d3f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5e86561d5544b9a8755c7857ce0f97', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:02.000574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] flavor_id is None. Assuming migration. {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4196}} Nov 03 04:40:02.001938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 04:40:02.265292 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3b7b6334-9062-4f66-9295-66202d92d96e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action" status: 202 len: 0 microversion: 2.1 time: 0.472450 Nov 03 04:40:02.266065 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3206/6527] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:40:01 2022] POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:40:02.275076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:02.275866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:02.283639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:02.284209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:02.285415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:02.285751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:02.286601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:02.286862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:02.432236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:02.440737 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e5ddd80-3d92-4691-a885-9d2b457588c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1692 microversion: 2.1 time: 0.169948 Nov 03 04:40:02.441596 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3322/6528] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:02 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:03.466546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:03.467170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:03.473964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:03.474452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:03.474890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:03.475586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:03.476040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:03.476583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:03.628653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:03.636878 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-858e7f5d-caaa-418e-ad76-cf7441c03852 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1692 microversion: 2.1 time: 0.175262 Nov 03 04:40:03.641191 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3207/6529] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:03 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:04.660820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:04.661478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:04.668190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:04.668679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:04.669142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:04.669839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:04.670289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:04.670712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:04.874414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:04.882681 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2468c8b-b061-4c57-a77c-8ad48386d831 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1692 microversion: 2.1 time: 0.225819 Nov 03 04:40:04.883253 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3323/6530] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:04 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:40:05.907451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:05.908272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:05.915472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:05.915880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:05.916396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:05.917159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:05.917625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:05.918058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:06.058107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:06.066480 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a291bf49-8034-4e29-98c8-895984bd0e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.162946 Nov 03 04:40:06.067066 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3208/6531] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:05 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:07.092093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:07.092755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:07.100191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:07.100690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:07.101174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:07.101895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:07.102362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:07.102801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:07.238802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:07.246989 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b490424-16eb-4391-9be4-72462b1cb286 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.158914 Nov 03 04:40:07.247593 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3324/6532] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:07 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:08.271963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:08.272576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:08.279412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:08.279898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:08.280332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:08.281216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:08.281674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:08.282703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:08.424959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:08.432763 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff0862d3-71df-42b3-87f5-e08483295377 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.164749 Nov 03 04:40:08.433377 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3209/6533] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:08 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:09.456456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:09.457102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:09.463940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:09.464434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:09.464872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:09.465610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:09.466067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:09.466493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:09.597969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:09.605877 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c1304672-d04b-4621-aa1d-c4943553d61d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.153921 Nov 03 04:40:09.606428 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3325/6534] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:09 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:10.629210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:10.629857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:10.636664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:10.638630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:10.638630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:10.638630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:10.639035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:10.639471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:10.774836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:10.783457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0f42034-f044-4c07-a163-b7658658c0f1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.158111 Nov 03 04:40:10.784035 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3210/6535] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:10 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:11.807951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:11.808610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:11.816330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:11.816800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:11.817287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:11.818007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:11.818472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:11.818909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:11.956070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:11.963843 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-129abce8-f805-4d26-805d-a0ec39d46dbc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.159979 Nov 03 04:40:11.964450 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3326/6536] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:11 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:12.986913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:12.987538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:12.994400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:12.994895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:12.995319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:12.996009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:12.996491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:12.996914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:13.139576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:13.147943 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b505b517-5eb3-447a-bad2-e50089df3a88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.164878 Nov 03 04:40:13.148580 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3211/6537] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:12 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:14.171470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:14.172172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:14.179121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:14.179711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:14.180153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:14.180847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:14.181315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:14.181901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:14.320111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:14.330352 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1bb70a70-a2d0-44d0-bbce-627b8844b7a3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.160953 Nov 03 04:40:14.330352 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3327/6538] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:14 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:15.353131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:15.353749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:15.361709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:15.362197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:15.363093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:15.363796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:15.364420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:15.364856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:15.507238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:15.515987 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82151b82-1e4b-4e68-ba9d-980dd99e61e6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.167007 Nov 03 04:40:15.517129 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3212/6539] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:15 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:16.541220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:16.541981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:16.549633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:16.550203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:16.550708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:16.551420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:16.551888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:16.552318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:16.691505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:16.699846 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48ac024d-18c8-4138-bbbb-1bcee9aeb617 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.162642 Nov 03 04:40:16.700418 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3328/6540] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:16 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:17.723834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:17.724364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:17.731341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:17.732354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:17.732806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:17.733534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:17.733991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:17.734424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:17.873917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:17.882662 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e28499bd-24d5-45bb-825a-2a1454e4cb4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.162817 Nov 03 04:40:17.883276 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3213/6541] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:17 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:18.906864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:18.908083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:18.915207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:18.915701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:18.916142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:18.916871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:18.917355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:18.917786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:19.056068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:19.064768 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-32eb29ee-63aa-4732-b829-c0e9768238ea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.161874 Nov 03 04:40:19.065374 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3329/6542] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:18 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:20.089771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:20.090391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:20.098954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:20.099461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:20.100322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:20.101302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:20.101603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:20.102920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:20.246196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:20.254769 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e137e204-fde7-4eb0-b8ba-074bd4974b08 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.168895 Nov 03 04:40:20.255294 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3214/6543] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:20 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:21.278928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:21.279552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:21.286204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:21.286703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:21.287153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:21.287888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:21.288349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:21.288785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:21.429610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:21.437780 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad6040cb-1454-429e-8ad6-b7211824b351 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.162688 Nov 03 04:40:21.438946 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3330/6544] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:21 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:22.461754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:22.462376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:22.469828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:22.470321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:22.470761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:22.471450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:22.471907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:22.472330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:22.651907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:22.660595 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-443a4277-553a-4e39-84b3-87fcf5d38fea tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1697 microversion: 2.1 time: 0.202665 Nov 03 04:40:22.661209 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3215/6545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:22 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1697 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:23.703060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:23.838752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:23.848623 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d7fbd1ca-3187-42d5-88d6-1525c461b009 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1696 microversion: 2.1 time: 0.167651 Nov 03 04:40:23.851453 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3331/6546] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:23 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:24.297621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-193a2b92-91f6-41cd-9a51-3c22ec203cf0 req-e1d52013-a4e7-4bb0-916a-924e6231c0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "name": "network-vif-unplugged", "status": "completed", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:24.309306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-193a2b92-91f6-41cd-9a51-3c22ec203cf0 req-e1d52013-a4e7-4bb0-916a-924e6231c0af service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:24.309306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-193a2b92-91f6-41cd-9a51-3c22ec203cf0 req-e1d52013-a4e7-4bb0-916a-924e6231c0af service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:24.309306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-193a2b92-91f6-41cd-9a51-3c22ec203cf0 req-e1d52013-a4e7-4bb0-916a-924e6231c0af service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:24.320925 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-193a2b92-91f6-41cd-9a51-3c22ec203cf0 req-e1d52013-a4e7-4bb0-916a-924e6231c0af service nova] Creating event network-vif-unplugged:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h1-854653-7 Nov 03 04:40:24.326183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-193a2b92-91f6-41cd-9a51-3c22ec203cf0 req-e1d52013-a4e7-4bb0-916a-924e6231c0af service nova] Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 04:40:24.338734 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-193a2b92-91f6-41cd-9a51-3c22ec203cf0 req-e1d52013-a4e7-4bb0-916a-924e6231c0af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044739 Nov 03 04:40:24.339362 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3216/6547] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:40:24.872523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:24.873339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:24.903635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:24.904161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:24.904598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:24.905402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:24.905873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:24.906410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:25.138967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:25.147664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d966b8e3-a010-45bb-a0f5-9cfa70b59619 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1696 microversion: 2.1 time: 0.279610 Nov 03 04:40:25.148244 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3332/6548] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:24 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1696 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:26.173902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:26.174519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:26.180614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:26.181132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:26.181573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:26.182261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:26.182715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:26.183144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:26.319361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:26.327131 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7facede-ddfc-41db-a100-d832f06e2dcd tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1694 microversion: 2.1 time: 0.159050 Nov 03 04:40:26.327688 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3217/6549] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:26 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:26.353668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d2e52fcd-6bf2-4d05-b9ac-0b5e29656d59 req-28f1fc12-fb57-4158-a38a-1c94994bcc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:26.364464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d2e52fcd-6bf2-4d05-b9ac-0b5e29656d59 req-28f1fc12-fb57-4158-a38a-1c94994bcc3e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:26.365051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d2e52fcd-6bf2-4d05-b9ac-0b5e29656d59 req-28f1fc12-fb57-4158-a38a-1c94994bcc3e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:26.365494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d2e52fcd-6bf2-4d05-b9ac-0b5e29656d59 req-28f1fc12-fb57-4158-a38a-1c94994bcc3e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:26.377430 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d2e52fcd-6bf2-4d05-b9ac-0b5e29656d59 req-28f1fc12-fb57-4158-a38a-1c94994bcc3e service nova] Creating event network-changed:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h1-854653-7 Nov 03 04:40:26.383510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-d2e52fcd-6bf2-4d05-b9ac-0b5e29656d59 req-28f1fc12-fb57-4158-a38a-1c94994bcc3e service nova] Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 04:40:26.395546 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d2e52fcd-6bf2-4d05-b9ac-0b5e29656d59 req-28f1fc12-fb57-4158-a38a-1c94994bcc3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045429 Nov 03 04:40:26.396155 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3333/6550] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:40:27.351200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:27.351799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:27.358661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:27.359152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:27.360209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:27.360915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:27.361404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:27.361840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:27.502944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:27.511517 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9ce8319-78f2-4c6d-b223-e52e20583e17 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1694 microversion: 2.1 time: 0.164240 Nov 03 04:40:27.512123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3218/6551] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:27 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:28.537696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:28.540268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:28.545119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:28.545300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:28.545638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:28.546351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:28.546811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:28.547793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:28.778249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:28.787119 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e22abc3-39ee-4209-bbe0-72078179c69c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1694 microversion: 2.1 time: 0.254462 Nov 03 04:40:28.787841 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3334/6552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:28 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:29.811933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:29.813318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:29.820662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:29.821202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:29.821653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:29.822363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:29.822834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:29.823270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:29.963419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:29.971335 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec87187f-dff0-4e07-8e2f-699e289cba9c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1691 microversion: 2.1 time: 0.163381 Nov 03 04:40:29.971915 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3219/6553] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:29 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:29.996076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:29.996606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:30.004048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:30.004579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:30.005044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:30.005737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:30.006200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:30.006639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:30.177408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:30.369251 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e3b115b-ee7d-4578-be96-16a9e8537769 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action" status: 202 len: 0 microversion: 2.1 time: 0.376826 Nov 03 04:40:30.370048 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3335/6554] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:40:29 2022] POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:40:30.379606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:30.380316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:30.387457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:30.388450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:30.389121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:30.390069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:30.391176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:30.391804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:30.396612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:30.567720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:30.575650 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-45439b16-e68f-434a-a4c4-eefe9eda451d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1690 microversion: 2.1 time: 0.201308 Nov 03 04:40:30.576233 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3220/6555] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:30 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:31.600803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:31.601540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:31.605122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=37 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:31.610228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:31.610718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:31.611156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:31.611858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:31.612313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:31.612743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:31.747240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:31.757279 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac2387be-7e8e-44fc-ba87-1c30cb67274c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1690 microversion: 2.1 time: 0.160241 Nov 03 04:40:31.757957 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3336/6556] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:31 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:31.931836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b24f7e27-610a-4cb3-a0a2-9e4d49f9a471 req-bf29d50c-a20f-46c4-a176-72d584b08a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "name": "network-vif-plugged", "status": "completed", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:31.939224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=35 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:40:31.944763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b24f7e27-610a-4cb3-a0a2-9e4d49f9a471 req-bf29d50c-a20f-46c4-a176-72d584b08a37 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:31.945295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b24f7e27-610a-4cb3-a0a2-9e4d49f9a471 req-bf29d50c-a20f-46c4-a176-72d584b08a37 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:31.945742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b24f7e27-610a-4cb3-a0a2-9e4d49f9a471 req-bf29d50c-a20f-46c4-a176-72d584b08a37 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:31.959012 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b24f7e27-610a-4cb3-a0a2-9e4d49f9a471 req-bf29d50c-a20f-46c4-a176-72d584b08a37 service nova] Creating event network-vif-plugged:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h1-854653-7 Nov 03 04:40:31.964758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-b24f7e27-610a-4cb3-a0a2-9e4d49f9a471 req-bf29d50c-a20f-46c4-a176-72d584b08a37 service nova] Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 04:40:31.975525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b24f7e27-610a-4cb3-a0a2-9e4d49f9a471 req-bf29d50c-a20f-46c4-a176-72d584b08a37 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047629 Nov 03 04:40:31.976132 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3221/6557] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:40:32.782388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:32.783042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:32.789938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:32.790433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:32.790875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:32.791583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:32.792076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:32.792505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:33.286760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:33.295091 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ee0acae4-29e0-422f-bf11-7e0f1d9aa8e5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1690 microversion: 2.1 time: 0.516602 Nov 03 04:40:33.295693 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3337/6558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:32 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1690 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:34.208396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d7f155a1-eb0a-4a74-a139-bb276fc4ad72 req-d10bd0fd-5e2e-4677-82ea-3f988cc235b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "name": "network-vif-unplugged", "status": "completed", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:34.221480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d7f155a1-eb0a-4a74-a139-bb276fc4ad72 req-d10bd0fd-5e2e-4677-82ea-3f988cc235b7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:34.222097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d7f155a1-eb0a-4a74-a139-bb276fc4ad72 req-d10bd0fd-5e2e-4677-82ea-3f988cc235b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:34.222545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d7f155a1-eb0a-4a74-a139-bb276fc4ad72 req-d10bd0fd-5e2e-4677-82ea-3f988cc235b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:34.234264 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d7f155a1-eb0a-4a74-a139-bb276fc4ad72 req-d10bd0fd-5e2e-4677-82ea-3f988cc235b7 service nova] Creating event network-vif-unplugged:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:40:34.241275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-d7f155a1-eb0a-4a74-a139-bb276fc4ad72 req-d10bd0fd-5e2e-4677-82ea-3f988cc235b7 service nova] Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 04:40:34.252589 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d7f155a1-eb0a-4a74-a139-bb276fc4ad72 req-d10bd0fd-5e2e-4677-82ea-3f988cc235b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048856 Nov 03 04:40:34.255845 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3222/6559] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:40:34.323279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:34.325405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:34.335014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:34.335503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:34.335976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:34.336676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:34.337362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:34.338169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:34.578228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:34.596630 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-571c1583-b31d-47a3-a0a4-37cdf8946393 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1690 microversion: 2.1 time: 0.279752 Nov 03 04:40:34.598082 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3338/6560] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:34 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1690 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:35.623624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:35.624342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:35.634089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:35.634581 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:35.635024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:35.635755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:35.636215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:35.636648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:35.810282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:35.819372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1c9dbfb-8dfa-482b-a690-c2b56256bbfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1690 microversion: 2.1 time: 0.201023 Nov 03 04:40:35.819972 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3223/6561] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:35 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:36.266980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1a75480f-cd1b-4a76-95ee-324e8ce4b529 req-0188ec8f-dbe4-43c9-b77a-3c35f57ac6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:36.277590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a75480f-cd1b-4a76-95ee-324e8ce4b529 req-0188ec8f-dbe4-43c9-b77a-3c35f57ac6cc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:36.278064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a75480f-cd1b-4a76-95ee-324e8ce4b529 req-0188ec8f-dbe4-43c9-b77a-3c35f57ac6cc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:36.278498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1a75480f-cd1b-4a76-95ee-324e8ce4b529 req-0188ec8f-dbe4-43c9-b77a-3c35f57ac6cc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:36.290090 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1a75480f-cd1b-4a76-95ee-324e8ce4b529 req-0188ec8f-dbe4-43c9-b77a-3c35f57ac6cc service nova] Creating event network-changed:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:40:36.295247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-1a75480f-cd1b-4a76-95ee-324e8ce4b529 req-0188ec8f-dbe4-43c9-b77a-3c35f57ac6cc service nova] Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 04:40:36.306688 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1a75480f-cd1b-4a76-95ee-324e8ce4b529 req-0188ec8f-dbe4-43c9-b77a-3c35f57ac6cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043693 Nov 03 04:40:36.307275 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3339/6562] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:40:36.843395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:36.844033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:36.851128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:36.851563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:36.852007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:36.852707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:36.853199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:36.853632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:37.093167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:37.105362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c17d05c4-4996-4f64-97a0-0abdc1a61e23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1690 microversion: 2.1 time: 0.265820 Nov 03 04:40:37.106050 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3224/6563] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:36 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1690 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:38.130235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:40:38.130956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:40:38.137069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:38.137555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:38.137994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:38.138948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:38.139406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:38.139833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:38.294606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:40:38.302890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8fe93f49-af0c-4ad7-9784-31c199ed782e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1683 microversion: 2.1 time: 0.177683 Nov 03 04:40:38.303560 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3340/6564] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:40:38 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:40:41.039635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-f64942eb-71de-4ab1-8ad3-b7107630908a req-02c2533e-690f-4cf0-b362-44e4f245437e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "name": "network-vif-plugged", "status": "completed", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:40:41.049687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f64942eb-71de-4ab1-8ad3-b7107630908a req-02c2533e-690f-4cf0-b362-44e4f245437e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:40:41.050171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f64942eb-71de-4ab1-8ad3-b7107630908a req-02c2533e-690f-4cf0-b362-44e4f245437e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:40:41.050600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f64942eb-71de-4ab1-8ad3-b7107630908a req-02c2533e-690f-4cf0-b362-44e4f245437e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:40:41.061874 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-f64942eb-71de-4ab1-8ad3-b7107630908a req-02c2533e-690f-4cf0-b362-44e4f245437e service nova] Creating event network-vif-plugged:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:40:41.066884 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-f64942eb-71de-4ab1-8ad3-b7107630908a req-02c2533e-690f-4cf0-b362-44e4f245437e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036924 Nov 03 04:40:41.067485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3225/6565] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:41:04.534124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:04.536253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:04.538746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:04.539423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:04.544274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:04.544758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:04.545253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:04.555192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:04.555192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:04.555192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:04.610559 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e219afd0-4b47-45db-bfb9-d879794c1c81 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action" status: 200 len: 63174 microversion: 2.1 time: 0.080075 Nov 03 04:41:04.619205 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3341/6566] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:41:04 2022] POST /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a/action => generated 63174 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:41:10.967504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:10.968264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=26 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:10.973155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:10.974063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:10.980558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:10.981143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:10.981510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:10.982910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:10.982910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:10.983084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:11.130764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fdedd731-be62-49c8-b3ff-368d00d7ab2e tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1834 microversion: 2.1 time: 0.165609 Nov 03 04:41:11.137316 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3226/6567] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:10 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1834 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:12.123927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:12.131717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:12.131894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8e3f87ef-3cf3-4d7d-968d-c28272e5d340 req-9665f23f-2f87-404a-9747-459535b089c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:12.133283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:12.133785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:12.134238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:12.134955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:12.135417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:12.135856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:12.158737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8e3f87ef-3cf3-4d7d-968d-c28272e5d340 req-9665f23f-2f87-404a-9747-459535b089c1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:12.160392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8e3f87ef-3cf3-4d7d-968d-c28272e5d340 req-9665f23f-2f87-404a-9747-459535b089c1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:12.161158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8e3f87ef-3cf3-4d7d-968d-c28272e5d340 req-9665f23f-2f87-404a-9747-459535b089c1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:12.165384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:41:12.195861 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8e3f87ef-3cf3-4d7d-968d-c28272e5d340 req-9665f23f-2f87-404a-9747-459535b089c1 service nova] Creating event network-changed:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:41:12.207585 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8e3f87ef-3cf3-4d7d-968d-c28272e5d340 req-9665f23f-2f87-404a-9747-459535b089c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086606 Nov 03 04:41:12.209306 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3227/6568] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:41:12.541355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-356f18f3-b482-4332-9085-5816ecf13ff6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 204 len: 0 microversion: 2.1 time: 0.422059 Nov 03 04:41:12.551394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:12.556414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:12.556545 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3342/6569] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:41:12 2022] DELETE /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:41:12.558304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:12.558835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:12.559275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:12.559984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:12.560442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:12.560927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:12.705068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:12.713365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ee17ea5-5ed3-4119-b193-2c3574ff5e8b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1689 microversion: 2.1 time: 0.166475 Nov 03 04:41:12.714143 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3228/6570] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:12 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:13.738990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:13.740422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:13.748227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:13.748725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:13.749194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:13.749940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:13.750400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:13.750862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:14.128928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:14.137433 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b7dc111-8ce3-446a-b548-b3432d73deb5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1689 microversion: 2.1 time: 0.403276 Nov 03 04:41:14.138164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3343/6571] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:13 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1689 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:14.881626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-facb53e2-c5b7-46e6-b0fb-406ea3be207e req-c963ee2b-ff8e-4be0-a362-4bf38a54d507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ad703d-e79f-4469-a33d-9457dee2ed4a", "name": "network-vif-deleted", "tag": "cedf133a-d90d-48f9-9825-3b1eecc8b667"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:14.892059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-facb53e2-c5b7-46e6-b0fb-406ea3be207e req-c963ee2b-ff8e-4be0-a362-4bf38a54d507 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:14.895885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-facb53e2-c5b7-46e6-b0fb-406ea3be207e req-c963ee2b-ff8e-4be0-a362-4bf38a54d507 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:14.895885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-facb53e2-c5b7-46e6-b0fb-406ea3be207e req-c963ee2b-ff8e-4be0-a362-4bf38a54d507 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:14.904801 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-facb53e2-c5b7-46e6-b0fb-406ea3be207e req-c963ee2b-ff8e-4be0-a362-4bf38a54d507 service nova] Creating event network-vif-deleted:cedf133a-d90d-48f9-9825-3b1eecc8b667 for instance 60ad703d-e79f-4469-a33d-9457dee2ed4a on n-h2-854653-7 Nov 03 04:41:14.909931 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-facb53e2-c5b7-46e6-b0fb-406ea3be207e req-c963ee2b-ff8e-4be0-a362-4bf38a54d507 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031980 Nov 03 04:41:14.910529 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3229/6572] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:41:15.162959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:15.163730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:15.171243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:15.171744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:15.172186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:15.173559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:15.174206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:15.174648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:15.250711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:15.260075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cfc77b85-08d1-4aca-913c-574951bfd40e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 200 len: 1352 microversion: 2.1 time: 0.101105 Nov 03 04:41:15.264971 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3344/6573] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:15 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:16.289526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:16.290526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 60ad703d-e79f-4469-a33d-9457dee2ed4a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:16.300692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:16.301214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:16.301784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:16.302517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:16.302974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:16.303402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:16.317901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] HTTP exception thrown: Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a could not be found. Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Request method failure captured: Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a HTTP/1.1 Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0VAHsMChhMJ4SSDnfsQJn1ExSAQcK-qK0C61h7g9mfDWA4lZewLtyFI0NJeDbsL2BFPXqzH_i_aRtJx2NZNHpL4on7CHw_KlIgilyvVNC2YHta4pffIuHzZXArq-kz_ZLkWPz-0dTdepkn7ADhuA8LZPM5toLxhOYIphnetY5GGuHc Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7fea2b758684fa9a57416aeb378b77a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7fea2b758684fa9a57416aeb378b77a"}]}] Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: e407ab02fb9f4e5aae907b6affa8c51b Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a could not be found. Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '60ad703d-e79f-4469-a33d-9457dee2ed4a'} Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a could not be found. Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a could not be found. Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:41:16.319447 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a could not be found. Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Returning 404 to user: Instance 60ad703d-e79f-4469-a33d-9457dee2ed4a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5a9884bf-70a8-4827-8fc1-02d8abdc5669 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a" status: 404 len: 111 microversion: 2.1 time: 0.036788 Nov 03 04:41:16.327148 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3230/6574] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:16 2022] GET /compute/v2.1/servers/60ad703d-e79f-4469-a33d-9457dee2ed4a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:41:20.242346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0da5a11f-4563-4454-8c0c-48d5b501ac33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '.version_select at 0x7ff7f3ea2f70>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:20.246824 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0da5a11f-4563-4454-8c0c-48d5b501ac33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:41:21.256655 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [None req-0da5a11f-4563-4454-8c0c-48d5b501ac33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 54232. Nov 03 04:41:21.341438 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0da5a11f-4563-4454-8c0c-48d5b501ac33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1878836009" status: 202 len: 0 microversion: 2.1 time: 1.102808 Nov 03 04:41:21.342086 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3345/6575] 10.222.0.30 () {58 vars in 1284 bytes} [Thu Nov 3 04:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1878836009 => generated 0 bytes in 1104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:41:21.380214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-580f3321-3666-4560-b4df-8e88f25066e4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: .version_select at 0x7ff7f8073940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1904416334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYEawAlHDzIrZfelEMCNQygWUII8+V6HpB7LUpK+b4CtrQsCZjQ9+z9t5TywSN7le4lZ6pcsouWgTBCr91Kk1aYwFdEUn3nLOvIaHPytij7b09ipMbYm95+9PjfgR8GWQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:21.398483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-580f3321-3666-4560-b4df-8e88f25066e4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:41:21.403804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-580f3321-3666-4560-b4df-8e88f25066e4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:41:21.490791 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-580f3321-3666-4560-b4df-8e88f25066e4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.114407 Nov 03 04:41:21.491611 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3231/6576] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:41:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:41:30.627395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:30.632790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-742571955", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "0dd07747-b322-49bf-b97e-25237dd7f27b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1904416334", "security_groups": [{"name": "tempest-secgroup-smoke-647827666"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:30.780703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] validate_networks() for [('0dd07747-b322-49bf-b97e-25237dd7f27b', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:41:31.311709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:41:31.312151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:41:31.312624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:41:31.313089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:41:31.313585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:41:31.323377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:31.323997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:31.324511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:31.325364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:31.325911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:31.326416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:31.345593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:41:31.351102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:41:31.364046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:41:31.366537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:41:31.515919 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [9d7458c6-7cc0-4617-8d65-c61ff10c0f25] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:41:32.523964 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [9d7458c6-7cc0-4617-8d65-c61ff10c0f25] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 54310. Nov 03 04:41:32.528748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61160f5b-d457-429a-b407-f7aefda9a096 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.903780 Nov 03 04:41:32.529838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3346/6577] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:41:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:41:32.539019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=18 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:32.540714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:32.541409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:32.545337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b19c3f56-c789-455a-95c7-625ad39379ba tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:32.546118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b19c3f56-c789-455a-95c7-625ad39379ba tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:32.607056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b19c3f56-c789-455a-95c7-625ad39379ba tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:32.615811 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b19c3f56-c789-455a-95c7-625ad39379ba tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1266 microversion: 2.1 time: 0.078451 Nov 03 04:41:32.631980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3232/6578] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:32 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:33.641040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:33.642385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:33.648678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:33.649473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:33.650106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:33.650890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:33.651282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:33.651713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:33.716665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:33.726421 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e4af9eb-e5e0-4b4d-a537-f85ac34e4f71 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1270 microversion: 2.1 time: 0.090758 Nov 03 04:41:33.727017 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3347/6579] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:33 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:34.750530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:34.751311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:34.760511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:34.761293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:34.761463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:34.762354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:34.762817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:34.763249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:34.985106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:34.992951 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ffa3006e-48a4-431f-a564-f583c89eb5b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1336 microversion: 2.1 time: 0.246684 Nov 03 04:41:34.993545 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3233/6580] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:34 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1336 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:36.016121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:36.017447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:36.019966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:36.027331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:36.027839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:36.028283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:36.029514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:36.034326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:36.034326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:36.259932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:36.268571 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45796e6b-ee05-4d95-a6c1-cff53eed8040 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.256679 Nov 03 04:41:36.269160 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3348/6581] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:36 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:36.817249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b636bdff-b3a7-46d6-b881-546baafbd696 req-4e49ceea-0a64-43f9-8000-5fd420a0dd31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2564ae-8796-4d12-969a-aaf488b1308d", "tag": "a4cb1c00-4686-4324-a0e8-0568ad9e2e4e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:36.827214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b636bdff-b3a7-46d6-b881-546baafbd696 req-4e49ceea-0a64-43f9-8000-5fd420a0dd31 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:36.827691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b636bdff-b3a7-46d6-b881-546baafbd696 req-4e49ceea-0a64-43f9-8000-5fd420a0dd31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:36.828439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b636bdff-b3a7-46d6-b881-546baafbd696 req-4e49ceea-0a64-43f9-8000-5fd420a0dd31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:36.840710 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b636bdff-b3a7-46d6-b881-546baafbd696 req-4e49ceea-0a64-43f9-8000-5fd420a0dd31 service nova] Creating event network-changed:a4cb1c00-4686-4324-a0e8-0568ad9e2e4e for instance de2564ae-8796-4d12-969a-aaf488b1308d on n-h2-854653-7 Nov 03 04:41:36.845844 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b636bdff-b3a7-46d6-b881-546baafbd696 req-4e49ceea-0a64-43f9-8000-5fd420a0dd31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Nov 03 04:41:36.846841 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3234/6582] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:41:37.292111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:37.293355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:37.301231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:37.301726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:37.302228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:37.303021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:37.303514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:37.303948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:37.529796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:37.539673 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7dbbf417-992b-4bf5-9aa3-bc19a95f66c8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.251648 Nov 03 04:41:37.540267 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3349/6583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:37 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:41:38.564266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:38.564936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:38.581466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:38.581978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:38.582551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:38.583513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:38.583973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:38.584457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:38.788466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:38.796702 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c5fe63a-509d-4409-84fa-f2cdc1698f73 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.237872 Nov 03 04:41:38.797337 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3235/6584] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:38 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:39.820596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:39.821268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:39.829783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:39.830335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:39.830821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:39.831543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:39.832010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:39.832937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:39.972209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:39.980259 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42897773-7d35-4eae-8039-5c11f8357ff2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.163627 Nov 03 04:41:39.980935 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3350/6585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:39 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:41.004424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:41.005076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:41.011928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:41.012422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:41.012866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:41.013603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:41.014326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:41.014757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:41.175303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:41.183051 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3af6e8aa-cc52-4eff-9fe1-79950ee5968e tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.183254 Nov 03 04:41:41.183842 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3236/6586] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:40 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:42.206828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:42.207447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:42.210450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:42.211263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:42.216064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:42.216552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:42.216994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:42.217724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:42.218182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:42.218612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:42.355355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:42.363176 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bbaed7bd-8cc4-4187-bcf0-28bb91c0c461 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.160213 Nov 03 04:41:42.363746 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3351/6587] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:42 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:43.317735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9291a0c1-8838-4ac3-aa99-e16655fdbbf5 req-e1e2015c-3c1e-4e32-b898-fdfcdf2ebbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2564ae-8796-4d12-969a-aaf488b1308d", "name": "network-vif-plugged", "status": "completed", "tag": "a4cb1c00-4686-4324-a0e8-0568ad9e2e4e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:43.328249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9291a0c1-8838-4ac3-aa99-e16655fdbbf5 req-e1e2015c-3c1e-4e32-b898-fdfcdf2ebbba service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:43.329402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9291a0c1-8838-4ac3-aa99-e16655fdbbf5 req-e1e2015c-3c1e-4e32-b898-fdfcdf2ebbba service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:43.329911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9291a0c1-8838-4ac3-aa99-e16655fdbbf5 req-e1e2015c-3c1e-4e32-b898-fdfcdf2ebbba service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:43.340864 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9291a0c1-8838-4ac3-aa99-e16655fdbbf5 req-e1e2015c-3c1e-4e32-b898-fdfcdf2ebbba service nova] Creating event network-vif-plugged:a4cb1c00-4686-4324-a0e8-0568ad9e2e4e for instance de2564ae-8796-4d12-969a-aaf488b1308d on n-h2-854653-7 Nov 03 04:41:43.346695 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9291a0c1-8838-4ac3-aa99-e16655fdbbf5 req-e1e2015c-3c1e-4e32-b898-fdfcdf2ebbba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Nov 03 04:41:43.349686 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3237/6588] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:41:43.385827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:43.386430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:43.394255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:43.394783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:43.395220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:43.395937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:43.396417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:43.396873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:43.592395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:43.600679 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9a7ea24-514c-4c27-b36e-694163a330cc tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.218780 Nov 03 04:41:43.601293 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3352/6589] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:43 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:44.625474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:44.626927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:44.633421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:44.633917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:44.634393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:44.635133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:44.635597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:44.636034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:44.760311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:41:44.778177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:44.786041 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-005605fd-65a2-4a74-989a-e37f3ce5d5ee tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1391 microversion: 2.1 time: 0.165743 Nov 03 04:41:44.786621 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3238/6590] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:44 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:45.809652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:45.810456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:45.817247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:45.817678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:45.818125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:45.818838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:45.819300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:45.819734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:45.955573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:45.963587 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4a36ba91-1523-405e-b6b2-ba67ebb45f4d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1564 microversion: 2.1 time: 0.158190 Nov 03 04:41:45.964146 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3353/6591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:45 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:45.987364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:45.991764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:45.995202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:45.995684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:45.996123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:45.996814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:45.997290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:45.997717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:46.129686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:46.140391 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5d4620c-cbed-42ce-a534-8d79c3c935b9 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1564 microversion: 2.1 time: 0.155725 Nov 03 04:41:46.141044 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3239/6592] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:45 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:41:48.051785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:41:48.053115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c22f8ed9-bb71-47f6-8d8c-fa0da4ab8bfd req-79ec9668-424c-412b-af0c-4d7a7ad4d5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2564ae-8796-4d12-969a-aaf488b1308d", "tag": "a4cb1c00-4686-4324-a0e8-0568ad9e2e4e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:41:48.053957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:41:48.062767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c22f8ed9-bb71-47f6-8d8c-fa0da4ab8bfd req-79ec9668-424c-412b-af0c-4d7a7ad4d5a0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:48.063894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c22f8ed9-bb71-47f6-8d8c-fa0da4ab8bfd req-79ec9668-424c-412b-af0c-4d7a7ad4d5a0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:48.064352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c22f8ed9-bb71-47f6-8d8c-fa0da4ab8bfd req-79ec9668-424c-412b-af0c-4d7a7ad4d5a0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:48.064613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:48.065350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:48.066385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:48.067325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:41:48.068384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:41:48.069527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:41:48.077604 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c22f8ed9-bb71-47f6-8d8c-fa0da4ab8bfd req-79ec9668-424c-412b-af0c-4d7a7ad4d5a0 service nova] Creating event network-changed:a4cb1c00-4686-4324-a0e8-0568ad9e2e4e for instance de2564ae-8796-4d12-969a-aaf488b1308d on n-h2-854653-7 Nov 03 04:41:48.083417 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c22f8ed9-bb71-47f6-8d8c-fa0da4ab8bfd req-79ec9668-424c-412b-af0c-4d7a7ad4d5a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034760 Nov 03 04:41:48.084253 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3240/6593] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:41:48.310850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:41:48.316185 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d117727-1bac-499e-baec-2a36aa723578 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1564 microversion: 2.1 time: 0.270135 Nov 03 04:41:48.316775 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3354/6594] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:41:48 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1564 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:11.609543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=20 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:11.610374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=36 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:11.615133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:11.623180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:11.623534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:11.624023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:11.624467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:11.627584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:11.628067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:11.628499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:11.685126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0acd476b-93fe-4917-a437-448d33467fb8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action" status: 200 len: 24571 microversion: 2.1 time: 0.077782 Nov 03 04:42:11.685688 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3241/6595] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:42:11 2022] POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:42:22.790869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:22.791514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:22.794791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=13 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:22.795503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=50 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:22.800830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:22.801345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:22.801788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:22.802497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:22.802953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:22.803379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:22.965368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:22.973961 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-33e37a9f-5e83-4bd4-bbc7-0ea0dd568db2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1683 microversion: 2.1 time: 0.187182 Nov 03 04:42:22.974529 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3355/6596] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:22 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:23.075110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:23.076018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:23.078602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:23.084622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:23.085128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:23.085568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:23.086604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:23.087098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:23.089123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:23.152649 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ad8ee190-6756-408d-b270-6a447faf9f33 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action" status: 200 len: 32648 microversion: 2.1 time: 0.084379 Nov 03 04:42:23.153363 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3242/6597] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:42:23 2022] POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action => generated 32648 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:42:23.311732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:23.312354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:23.318420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:23.318909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:23.319354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:23.320051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:23.320521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:23.320943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:23.452771 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0358f4a-1708-4fa9-ae70-aa6e7edf261c tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1834 microversion: 2.1 time: 0.144749 Nov 03 04:42:23.453400 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3356/6598] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:23 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1834 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:23.489333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:23.491871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:23.498839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:23.499326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:23.499773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:23.503513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:23.503513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:23.503513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:23.526696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lazy-loading 'flavor' on Instance uuid de2564ae-8796-4d12-969a-aaf488b1308d {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:42:23.539244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Going to try to live migrate instance to another host {{(pid=127593) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Nov 03 04:42:26.011773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-093aaca7-6a00-4ed5-85a4-0a2cd6bbdd27 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action" status: 202 len: 0 microversion: 2.1 time: 2.527204 Nov 03 04:42:26.013490 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3243/6599] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:42:23 2022] POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action => generated 0 bytes in 2530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:42:26.023484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:26.024263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:26.034180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:26.034678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:26.035122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:26.035828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:26.036318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:26.036749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:26.168635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:26.176423 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97242305-7992-4491-9e72-95246fd50fc4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.156813 Nov 03 04:42:26.177153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3357/6600] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:26 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:27.201521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:27.202736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:27.209841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:27.210407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:27.210958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:27.214798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:27.214798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:27.214798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:27.453735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:27.462834 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce0f8d57-1100-4bce-96e3-e0ed1fd1f229 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.265906 Nov 03 04:42:27.463470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3244/6601] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:27 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:27.527828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-69eefb16-ee8a-42f8-bed7-341f1852ed2d req-2261af04-8daf-4cc9-a849-1462f15e29a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2564ae-8796-4d12-969a-aaf488b1308d", "name": "network-vif-unplugged", "status": "completed", "tag": "a4cb1c00-4686-4324-a0e8-0568ad9e2e4e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:27.538011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69eefb16-ee8a-42f8-bed7-341f1852ed2d req-2261af04-8daf-4cc9-a849-1462f15e29a1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:27.538486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69eefb16-ee8a-42f8-bed7-341f1852ed2d req-2261af04-8daf-4cc9-a849-1462f15e29a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:27.538919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-69eefb16-ee8a-42f8-bed7-341f1852ed2d req-2261af04-8daf-4cc9-a849-1462f15e29a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:27.552152 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-69eefb16-ee8a-42f8-bed7-341f1852ed2d req-2261af04-8daf-4cc9-a849-1462f15e29a1 service nova] Creating event network-vif-unplugged:a4cb1c00-4686-4324-a0e8-0568ad9e2e4e for instance de2564ae-8796-4d12-969a-aaf488b1308d on n-h2-854653-7 Nov 03 04:42:27.557414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-69eefb16-ee8a-42f8-bed7-341f1852ed2d req-2261af04-8daf-4cc9-a849-1462f15e29a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033288 Nov 03 04:42:27.558017 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3358/6602] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:42:28.487827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:28.488438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:28.495801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:28.496286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:28.496729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:28.500127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:28.500127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:28.500127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:28.645203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:28.652898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-394797f4-1641-4b98-944a-fa6caa26b50a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.169030 Nov 03 04:42:28.653510 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3245/6603] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:28 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:28.813038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1665448407", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "603c7b34-3cd6-49c1-9011-4034ff999230"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:28.867673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] validate_networks() for [('603c7b34-3cd6-49c1-9011-4034ff999230', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:42:29.263198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:42:29.263570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:42:29.264051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:42:29.264466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:42:29.265178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:42:29.273924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:29.274411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:29.274851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:29.275586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:29.276043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:29.276474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:29.293594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Getting quotas for project 1a6767e85c1b406293b68c2a7fb62fab. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:42:29.299396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Getting quotas for user 7fb2d72e86fe43998ae130228b7b0180 and project 1a6767e85c1b406293b68c2a7fb62fab. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:42:29.311387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:42:29.313771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:42:29.421361 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b190a9f-903b-40d8-8f95-7373c02dafc0 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613324 Nov 03 04:42:29.422013 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3359/6604] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:42:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:42:29.433784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6fedc6e-3b47-499e-b1a1-f95b8b6cd4a6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:29.434403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6fedc6e-3b47-499e-b1a1-f95b8b6cd4a6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:29.488491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6fedc6e-3b47-499e-b1a1-f95b8b6cd4a6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:29.495733 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6fedc6e-3b47-499e-b1a1-f95b8b6cd4a6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1219 microversion: 2.1 time: 0.065803 Nov 03 04:42:29.496313 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3246/6605] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:29 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:29.572214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a1d6939e-a383-4e02-b9d0-2c04d32c2123 req-795dcc60-cbfc-483d-b841-2dbcb61ed10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2564ae-8796-4d12-969a-aaf488b1308d", "tag": "a4cb1c00-4686-4324-a0e8-0568ad9e2e4e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:29.582489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a1d6939e-a383-4e02-b9d0-2c04d32c2123 req-795dcc60-cbfc-483d-b841-2dbcb61ed10b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:29.582965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a1d6939e-a383-4e02-b9d0-2c04d32c2123 req-795dcc60-cbfc-483d-b841-2dbcb61ed10b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:29.583404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a1d6939e-a383-4e02-b9d0-2c04d32c2123 req-795dcc60-cbfc-483d-b841-2dbcb61ed10b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:29.593790 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a1d6939e-a383-4e02-b9d0-2c04d32c2123 req-795dcc60-cbfc-483d-b841-2dbcb61ed10b service nova] Creating event network-changed:a4cb1c00-4686-4324-a0e8-0568ad9e2e4e for instance de2564ae-8796-4d12-969a-aaf488b1308d on n-h2-854653-7 Nov 03 04:42:29.598890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a1d6939e-a383-4e02-b9d0-2c04d32c2123 req-795dcc60-cbfc-483d-b841-2dbcb61ed10b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030364 Nov 03 04:42:29.599475 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3360/6606] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:42:29.676874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:29.677547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:29.684422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:29.684916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:29.685387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:29.686093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:29.686555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:29.686993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:29.865759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:29.873511 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3bfca071-d935-457a-b452-5a54c48fd422 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.201002 Nov 03 04:42:29.874085 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3247/6607] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:29 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:30.521421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:30.522124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:30.528309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:30.528791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:30.529264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:30.529959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:30.530431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:30.530846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:30.599601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:30.607236 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-df9271c6-3a0e-4389-9b2c-a1ff88bd4ed6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1223 microversion: 2.1 time: 0.091403 Nov 03 04:42:30.607794 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3361/6608] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:30 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:30.899446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:30.900208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:30.907082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:30.907591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:30.908057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:30.908757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:30.909406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:30.909835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:31.052704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:31.060865 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c48cc211-dfd6-44ff-b459-085816e90e6b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.165357 Nov 03 04:42:31.061497 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3248/6609] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:30 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:31.629783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:31.630360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:31.637684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:31.637684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:31.638930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:31.638930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:31.639314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:31.639966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:31.736862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:31.744519 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eeef3af2-0b94-469e-85ee-782e18286c2c tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1279 microversion: 2.1 time: 0.118776 Nov 03 04:42:31.745309 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3362/6610] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:31 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:32.085768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:32.086521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:32.093351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:32.093848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:32.094310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:32.095599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:32.096247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:32.096676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:32.545355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:32.553893 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b355df75-e552-4e3f-a785-2ddb4492f350 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.472065 Nov 03 04:42:32.554458 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3249/6611] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:32 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:32.766987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:32.767608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:32.774483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:32.774975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:32.775418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:32.776120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:32.776577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:32.777007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:32.925431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:32.933198 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-523bf02c-a3c9-4c7f-b5be-57d5ef2d4373 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.170463 Nov 03 04:42:32.933779 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3363/6612] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:32 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:33.259484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-189ccb9e-fa80-403b-9cdb-c5a76ef6997c req-a0975d3d-8837-4691-a8bb-63eef2a9eec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d209f9ba-fef8-4ad8-916f-c0b0619538bd", "tag": "b7ef51b2-fa41-4436-bb31-33d0082061bb"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:33.270280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-189ccb9e-fa80-403b-9cdb-c5a76ef6997c req-a0975d3d-8837-4691-a8bb-63eef2a9eec5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:33.270758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-189ccb9e-fa80-403b-9cdb-c5a76ef6997c req-a0975d3d-8837-4691-a8bb-63eef2a9eec5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:33.271193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-189ccb9e-fa80-403b-9cdb-c5a76ef6997c req-a0975d3d-8837-4691-a8bb-63eef2a9eec5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:33.282126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-189ccb9e-fa80-403b-9cdb-c5a76ef6997c req-a0975d3d-8837-4691-a8bb-63eef2a9eec5 service nova] Creating event network-changed:b7ef51b2-fa41-4436-bb31-33d0082061bb for instance d209f9ba-fef8-4ad8-916f-c0b0619538bd on n-h2-854653-7 Nov 03 04:42:33.287619 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-189ccb9e-fa80-403b-9cdb-c5a76ef6997c req-a0975d3d-8837-4691-a8bb-63eef2a9eec5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Nov 03 04:42:33.288218 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3250/6613] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:42:33.578051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:33.578665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:33.585421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:33.585901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:33.586335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:33.587037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:33.587488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:33.587915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:33.798867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:33.807047 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d5fb553-03c1-46da-8c65-fc640aa88c74 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.232964 Nov 03 04:42:33.807629 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3364/6614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:33 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:42:33.957593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:33.958301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:33.964721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:33.965344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:33.965736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:33.966438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:33.966897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:33.967323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:34.124088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:34.132460 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3016a4e-e2ab-4a55-b553-33dd910f56a4 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.179948 Nov 03 04:42:34.133029 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3251/6615] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:33 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:34.832083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:34.832723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:34.839581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:34.840065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:34.840507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:34.841241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:34.841704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:34.842141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:34.987764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:34.996377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9cee965-d8da-442d-b997-714ce32fbfa7 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.168703 Nov 03 04:42:34.996967 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3365/6616] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:34 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:35.155632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:35.156244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:35.163725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:35.164209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:35.164642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:35.165436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:35.165896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:35.166325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:35.300711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:35.308651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e89b6be3-e9f5-47f7-b6ea-7d63cf4937f5 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.156942 Nov 03 04:42:35.309249 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3252/6617] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:35 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:36.020241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:36.020895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:36.028319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:36.028799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:36.029267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:36.029951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:36.030402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:36.030829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:36.165317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:36.173960 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d31f786-8258-4e16-a442-6ea322a172d8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.156991 Nov 03 04:42:36.174471 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3366/6618] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:36 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:36.332094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:36.332743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:36.339599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:36.340084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:36.340526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:36.341249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:36.341710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:36.342138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:36.475408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:36.483068 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d8525dc7-1c44-49cf-ac06-7839998704e6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.155346 Nov 03 04:42:36.483641 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3253/6619] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:36 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:37.197605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:37.198291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:37.205826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:37.206314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:37.207987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:37.207987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:37.207987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:37.208364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:37.340489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:37.348988 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dacef1f4-0c54-4070-b009-a0e1ba3dbe2d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.155264 Nov 03 04:42:37.349591 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3367/6620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:37 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:37.507266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:37.508278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:37.515925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:37.517262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:37.518038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:37.518969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:37.519715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:37.520163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:37.750113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:37.757968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cee39253-cb5c-4409-b893-ad0088cdbaa7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.254673 Nov 03 04:42:37.758680 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3254/6621] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:37 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:38.371802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:38.372422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:38.379691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:38.380182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:38.380627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:38.381391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:38.381842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:38.382278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:38.591402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:38.599882 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a2e18a4d-216b-4530-b70c-88aa4cc3ca0f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1693 microversion: 2.1 time: 0.231931 Nov 03 04:42:38.600666 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3368/6622] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:38 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:38.780792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:38.781469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:38.788954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:38.789654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:38.790102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:38.790804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:38.791262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:38.791690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:38.927939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:38.935833 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e98bd900-1fa8-45e3-b546-cbb877b78955 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.159054 Nov 03 04:42:38.936389 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3255/6623] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:38 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:39.611266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1401b879-1f6e-4235-b0df-ac6dce75af29 req-10aefb4a-785d-49e7-b035-5d49825e0ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209f9ba-fef8-4ad8-916f-c0b0619538bd", "name": "network-vif-plugged", "status": "completed", "tag": "b7ef51b2-fa41-4436-bb31-33d0082061bb"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:39.616825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:39.617844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:39.624438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:39.624922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1401b879-1f6e-4235-b0df-ac6dce75af29 req-10aefb4a-785d-49e7-b035-5d49825e0ab7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:39.625506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1401b879-1f6e-4235-b0df-ac6dce75af29 req-10aefb4a-785d-49e7-b035-5d49825e0ab7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:39.625660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:39.626798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1401b879-1f6e-4235-b0df-ac6dce75af29 req-10aefb4a-785d-49e7-b035-5d49825e0ab7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:39.629670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:39.633497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:39.634135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:39.634815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:39.635779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:39.636303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:39.636842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:39.638650 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1401b879-1f6e-4235-b0df-ac6dce75af29 req-10aefb4a-785d-49e7-b035-5d49825e0ab7 service nova] Creating event network-vif-plugged:b7ef51b2-fa41-4436-bb31-33d0082061bb for instance d209f9ba-fef8-4ad8-916f-c0b0619538bd on n-h2-854653-7 Nov 03 04:42:39.644137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1401b879-1f6e-4235-b0df-ac6dce75af29 req-10aefb4a-785d-49e7-b035-5d49825e0ab7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037064 Nov 03 04:42:39.644748 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3369/6624] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:42:39.952115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:39.960397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:39.961563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:39.962211 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6295ba13-0851-478e-bc1b-2548556d961d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1683 microversion: 2.1 time: 0.341761 Nov 03 04:42:39.964003 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3256/6625] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:39 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1683 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:42:39.969005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:39.970277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:39.970796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:39.971594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:39.972285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:39.972789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:39.987275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:39.987633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:39.995882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:39.996672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:39.997289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:39.998019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:39.998486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:39.998921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:40.257153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:40.260569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9183d6bf-c186-4f66-b748-6b56fdda6f08 tempest-TestNetworkAdvancedServerOps-1282857295 tempest-TestNetworkAdvancedServerOps-1282857295-project-admin] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1834 microversion: 2.1 time: 0.278769 Nov 03 04:42:40.261181 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3257/6626] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:39 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1834 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:40.265856 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ac324f76-0fe8-4fa4-b04e-a2f7f492a039 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.310146 Nov 03 04:42:40.266414 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3370/6627] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:39 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:40.285478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:40.286093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:40.292243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:40.292859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:40.293233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:40.293921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:40.294370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:40.294796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:40.298694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:40.426600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:40.434118 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-689631f5-29ec-471f-8d16-f94c7a211e2c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1683 microversion: 2.1 time: 0.153023 Nov 03 04:42:40.434685 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3258/6628] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:40 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:41.289518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:41.290135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:41.296922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:41.297513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:41.298568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:41.299269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:41.299707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:41.300128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:41.435175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:41.443147 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0bda669b-7684-4b3f-aa89-5923cff8cd20 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1319 microversion: 2.1 time: 0.157385 Nov 03 04:42:41.443600 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3371/6629] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:41 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:42.466368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:42.466981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:42.473968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:42.474540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:42.474979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:42.475677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:42.476138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:42.476599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:42.540215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:42.542483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:42.549875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:42.550366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:42.550809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:42.551545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:42.552008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:42.552445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:42.604340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c762588-5705-417c-b5a1-f2a91a9d45fa tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action" status: 200 len: 38624 microversion: 2.1 time: 0.067791 Nov 03 04:42:42.611896 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3372/6630] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:42:42 2022] POST /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d/action => generated 38624 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 04:42:42.616511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:42.624435 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e7d6c9fe-d629-479a-bda1-01216ee987bb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1508 microversion: 2.1 time: 0.162432 Nov 03 04:42:42.625038 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3259/6631] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:42 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:43.665612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-0510b016-ab99-4e27-a0c4-f760c9b5c1ef req-ca2b7f3a-e4b9-4b2e-a8e7-699c1cdb433c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2564ae-8796-4d12-969a-aaf488b1308d", "tag": "a4cb1c00-4686-4324-a0e8-0568ad9e2e4e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:43.679433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:43.680706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:43.688773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:43.689647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:43.690147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:43.690871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:43.691334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:43.691764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:43.694885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0510b016-ab99-4e27-a0c4-f760c9b5c1ef req-ca2b7f3a-e4b9-4b2e-a8e7-699c1cdb433c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:43.695563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0510b016-ab99-4e27-a0c4-f760c9b5c1ef req-ca2b7f3a-e4b9-4b2e-a8e7-699c1cdb433c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:43.697536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-0510b016-ab99-4e27-a0c4-f760c9b5c1ef req-ca2b7f3a-e4b9-4b2e-a8e7-699c1cdb433c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:43.718613 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-0510b016-ab99-4e27-a0c4-f760c9b5c1ef req-ca2b7f3a-e4b9-4b2e-a8e7-699c1cdb433c service nova] Creating event network-changed:a4cb1c00-4686-4324-a0e8-0568ad9e2e4e for instance de2564ae-8796-4d12-969a-aaf488b1308d on n-h1-854653-7 Nov 03 04:42:43.733748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-0510b016-ab99-4e27-a0c4-f760c9b5c1ef req-ca2b7f3a-e4b9-4b2e-a8e7-699c1cdb433c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073302 Nov 03 04:42:43.739620 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3260/6632] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:42:43.750620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:42:43.792022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:44.070876 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a7d9aeea-8da2-4256-961d-f5f74d369b50 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 204 len: 0 microversion: 2.1 time: 0.418572 Nov 03 04:42:44.071478 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3373/6633] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:42:43 2022] DELETE /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:42:44.082226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:44.082930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:44.089767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:44.090274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:44.090697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:44.091396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:44.091980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:44.092413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:44.288141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:44.297900 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3577a1db-69d1-4809-8580-ceae4eeca646 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1689 microversion: 2.1 time: 0.220793 Nov 03 04:42:44.314914 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3261/6634] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:44 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1689 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:42:45.324746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:45.325493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:45.334331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:45.334873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:45.335333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:45.336063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:45.336529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:45.337223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:45.403705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:42:45.416061 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ef6a471-85a6-41c6-b159-5d25e8142d5b tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 200 len: 1351 microversion: 2.1 time: 0.095457 Nov 03 04:42:45.418361 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3374/6635] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:45 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:42:45.761977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d004827c-752c-49f4-82ef-9c2b762ac1b1 req-06678215-8f39-4af2-918c-c104df4d93b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2564ae-8796-4d12-969a-aaf488b1308d", "name": "network-vif-deleted", "tag": "a4cb1c00-4686-4324-a0e8-0568ad9e2e4e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:45.779583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d004827c-752c-49f4-82ef-9c2b762ac1b1 req-06678215-8f39-4af2-918c-c104df4d93b1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:45.780075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d004827c-752c-49f4-82ef-9c2b762ac1b1 req-06678215-8f39-4af2-918c-c104df4d93b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:45.780517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d004827c-752c-49f4-82ef-9c2b762ac1b1 req-06678215-8f39-4af2-918c-c104df4d93b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:45.792459 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d004827c-752c-49f4-82ef-9c2b762ac1b1 req-06678215-8f39-4af2-918c-c104df4d93b1 service nova] Creating event network-vif-deleted:a4cb1c00-4686-4324-a0e8-0568ad9e2e4e for instance de2564ae-8796-4d12-969a-aaf488b1308d on n-h1-854653-7 Nov 03 04:42:45.797392 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d004827c-752c-49f4-82ef-9c2b762ac1b1 req-06678215-8f39-4af2-918c-c104df4d93b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039211 Nov 03 04:42:45.798639 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3262/6636] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:42:46.440777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:46.441434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: de2564ae-8796-4d12-969a-aaf488b1308d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:42:46.448700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:46.449236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:46.449691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:46.450403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:42:46.450867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:42:46.451303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:42:46.465634 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] HTTP exception thrown: Instance de2564ae-8796-4d12-969a-aaf488b1308d could not be found. Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Request method failure captured: Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d HTTP/1.1 Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0VAHsMChhMJ4SSDnfsQJn1ExSAQcK-qK0C61h7g9mfDWA4lZewLtyFI0NJeDbsL2BFPXqzH_i_aRtJx2NZNHpL4on7CHw_KlIgilyvVNC2YHta4pffIuHzZXArq-kz_ZLkWPz-0dTdepkn7ADhuA8LZPM5toLxhOYIphnetY5GGuHc Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7fea2b758684fa9a57416aeb378b77a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7fea2b758684fa9a57416aeb378b77a"}]}] Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: e407ab02fb9f4e5aae907b6affa8c51b Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance de2564ae-8796-4d12-969a-aaf488b1308d could not be found. Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'de2564ae-8796-4d12-969a-aaf488b1308d'} Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2564ae-8796-4d12-969a-aaf488b1308d could not be found. Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2564ae-8796-4d12-969a-aaf488b1308d could not be found. Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:42:46.467573 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2564ae-8796-4d12-969a-aaf488b1308d could not be found. Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Returning 404 to user: Instance de2564ae-8796-4d12-969a-aaf488b1308d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aaa4cbaa-ce3b-4d02-923b-2d0dd3b93fed tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d" status: 404 len: 111 microversion: 2.1 time: 0.032845 Nov 03 04:42:46.474646 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3375/6637] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:42:46 2022] GET /compute/v2.1/servers/de2564ae-8796-4d12-969a-aaf488b1308d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:42:50.488833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-49e24cee-d74f-44a3-b9e0-2dfa15e05b83 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '.version_select at 0x7ff7f3e8f820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:42:50.564198 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-49e24cee-d74f-44a3-b9e0-2dfa15e05b83 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1904416334" status: 202 len: 0 microversion: 2.1 time: 0.080315 Nov 03 04:42:50.564813 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3263/6638] 10.222.0.30 () {58 vars in 1284 bytes} [Thu Nov 3 04:42:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1904416334 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:42:50.597507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-708c9fc6-ef17-4b17-9689-5252a7a37685 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: .version_select at 0x7ff7f3fd8c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-721173445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPv9N+Xqwp4bmRlDpHFINpRT2BoyJ/fRlEQDPxtEh+E4bQ/5kgIQKVT55nGffPQVjHxO60dC3tElmEM5EmvUAtEabLo4lCLXBM41GKjdsPhBpETWO3BuMmXa9QbQECOHgQ=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:50.617040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-708c9fc6-ef17-4b17-9689-5252a7a37685 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:42:50.623655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-708c9fc6-ef17-4b17-9689-5252a7a37685 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:42:50.695584 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-708c9fc6-ef17-4b17-9689-5252a7a37685 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.101989 Nov 03 04:42:50.696128 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3376/6639] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:42:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:42:59.832039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=20 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:59.836153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-306368784", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "31519d27-f2df-477d-bbb1-0062abcfbd0e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-721173445", "security_groups": [{"name": "tempest-secgroup-smoke-1251531955"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:42:59.851268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:42:59.970734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] validate_networks() for [('31519d27-f2df-477d-bbb1-0062abcfbd0e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:43:00.432632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:43:00.433141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:43:00.433570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:43:00.434006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:43:00.434406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:43:00.443993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:00.444626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:00.445094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:00.445854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:00.446314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:00.446744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:00.471754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:43:00.478336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Getting quotas for user e407ab02fb9f4e5aae907b6affa8c51b and project f7fea2b758684fa9a57416aeb378b77a. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:43:00.492344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:43:00.494808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:43:00.653558 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dadf5431-b297-4c43-af86-623a5b1f1119 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.823395 Nov 03 04:43:00.654968 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3264/6640] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:42:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:43:00.667264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7749be1-d42a-480b-a766-5fb93c0e1316 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:00.668510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7749be1-d42a-480b-a766-5fb93c0e1316 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:00.672629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:00.673684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:00.675443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:00.740710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7749be1-d42a-480b-a766-5fb93c0e1316 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:00.754413 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7749be1-d42a-480b-a766-5fb93c0e1316 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1265 microversion: 2.1 time: 0.090971 Nov 03 04:43:00.755043 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3377/6641] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:00 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:01.780000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:01.785343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:01.788866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:01.789393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:01.789834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:01.790544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:01.791035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:01.791463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:01.876767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:01.885484 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-082b4646-bc9a-4067-96e2-56211348ee8c tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1269 microversion: 2.1 time: 0.110115 Nov 03 04:43:01.886095 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3265/6642] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:01 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:02.909838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:02.910689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:02.921848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:02.922782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:02.923257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:02.923978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:02.924849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:02.925445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:03.019900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:03.028925 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-66b4cac6-921f-4492-9fa2-7a179afd51d2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1325 microversion: 2.1 time: 0.123699 Nov 03 04:43:03.029731 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3378/6643] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:02 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1325 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:04.053073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:04.053660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:04.066448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:04.066875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:04.070588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:04.071512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:04.072128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:04.073052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:04.691395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:04.699212 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a401745c-0356-41d5-a728-1f24940138df tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.650119 Nov 03 04:43:04.699789 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3266/6644] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:04 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:05.236352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c468a3c0-00c5-4b1c-ae16-1fa99436ec9b req-7f9b0ce3-0751-43c2-bf5c-071d09fe1890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010cc622-b2f4-4fd7-b135-ce8ecbae89ef", "tag": "fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:05.251683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c468a3c0-00c5-4b1c-ae16-1fa99436ec9b req-7f9b0ce3-0751-43c2-bf5c-071d09fe1890 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:05.252383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c468a3c0-00c5-4b1c-ae16-1fa99436ec9b req-7f9b0ce3-0751-43c2-bf5c-071d09fe1890 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:05.252834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c468a3c0-00c5-4b1c-ae16-1fa99436ec9b req-7f9b0ce3-0751-43c2-bf5c-071d09fe1890 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:05.264766 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c468a3c0-00c5-4b1c-ae16-1fa99436ec9b req-7f9b0ce3-0751-43c2-bf5c-071d09fe1890 service nova] Creating event network-changed:fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7 for instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef on n-h1-854653-7 Nov 03 04:43:05.271549 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c468a3c0-00c5-4b1c-ae16-1fa99436ec9b req-7f9b0ce3-0751-43c2-bf5c-071d09fe1890 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042711 Nov 03 04:43:05.275705 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3379/6645] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:43:05.727912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:05.728536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:05.736915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:05.737533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:05.737975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:05.738704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:05.739161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:05.739588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:05.963172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:05.971942 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7aee5968-47be-4800-8564-35439ff5ffd8 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.248462 Nov 03 04:43:05.973533 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3267/6646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:05 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:06.794057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce3f28ae-8976-4768-b2a8-e5d849d88580", "device": "/dev/sdb"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:06.796583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:06.804170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:06.804660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:06.805134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:06.805839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:06.806300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:06.806729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:06.995631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:06.996169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:07.003461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:07.007846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:07.007846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:07.007846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:07.007846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:07.007846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:07.145060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:07.152769 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6573ee07-3d40-46b2-8990-496f20ccafac tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.161149 Nov 03 04:43:07.153368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3268/6647] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:06 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:43:07.502877 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-622292fb-1417-47dc-a86d-a1d692176a70 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "POST /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713044 Nov 03 04:43:07.503571 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3380/6648] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:43:06 2022] POST /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:43:08.176286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:08.176995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:08.183565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:08.184057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:08.184501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:08.185232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:08.185690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:08.186118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:08.322505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:08.331424 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dad30198-431a-4f6e-b9be-5cbad83cd0d4 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.158873 Nov 03 04:43:08.332011 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3269/6649] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:08 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:09.355946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:09.356642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:09.362744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:09.363230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:09.363668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:09.364358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:09.364811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:09.365261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:09.497582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:09.505347 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2524b91-ffbd-449d-b26b-3e1fcb552f27 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.154427 Nov 03 04:43:09.505925 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3381/6650] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:09 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:10.529888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:10.530601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:10.533868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:10.534549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:10.539363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:10.539853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:10.540293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:10.541056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:10.541511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:10.541937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:10.688085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:10.697404 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30aad930-35ae-4341-99b7-5a8d3cceeac3 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.171551 Nov 03 04:43:10.698019 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3270/6651] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:10 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:11.721886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:11.722462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:11.729390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:11.729887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:11.730329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:11.731027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:11.731493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:11.731925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:11.873567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:11.881256 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9253dedd-6cda-4713-a505-21cfbdacb011 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.163378 Nov 03 04:43:11.881827 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3382/6652] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:11 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:12.532390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-93165fad-b948-4b29-aa05-64d3582d1318 req-97a9cc00-dbb4-4a25-bc3e-129eb115525b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010cc622-b2f4-4fd7-b135-ce8ecbae89ef", "name": "network-vif-plugged", "status": "completed", "tag": "fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:12.543497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93165fad-b948-4b29-aa05-64d3582d1318 req-97a9cc00-dbb4-4a25-bc3e-129eb115525b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:12.543976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93165fad-b948-4b29-aa05-64d3582d1318 req-97a9cc00-dbb4-4a25-bc3e-129eb115525b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:12.544405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-93165fad-b948-4b29-aa05-64d3582d1318 req-97a9cc00-dbb4-4a25-bc3e-129eb115525b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:12.555976 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-93165fad-b948-4b29-aa05-64d3582d1318 req-97a9cc00-dbb4-4a25-bc3e-129eb115525b service nova] Creating event network-vif-plugged:fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7 for instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef on n-h1-854653-7 Nov 03 04:43:12.561143 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-93165fad-b948-4b29-aa05-64d3582d1318 req-97a9cc00-dbb4-4a25-bc3e-129eb115525b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Nov 03 04:43:12.561740 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3271/6653] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:43:12.903682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:12.904400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:12.911496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:12.912139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:12.912582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:12.913314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:12.913804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:12.914232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:12.929108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:13.045796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:13.053939 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ec25caa-c4ae-48d9-878e-c22fcf6b32d1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.154198 Nov 03 04:43:13.054503 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3383/6654] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:12 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:14.084964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:14.085937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:14.092232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:14.092725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:14.093205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:14.093910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:14.094368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:14.094798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:14.233484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:14.241466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cbed5383-0f64-4f02-8fb8-31846c3a7e53 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1391 microversion: 2.1 time: 0.162410 Nov 03 04:43:14.242037 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3272/6655] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:14 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:15.265859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:15.266483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:15.273871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:15.274358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:15.274804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:15.275496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:15.275954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:15.276383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:15.406818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:15.415169 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8ba1835-a823-457d-8cd0-70b8d6c8fb64 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1563 microversion: 2.1 time: 0.153451 Nov 03 04:43:15.415732 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3384/6656] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:15 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:15.438199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:15.438199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:15.445007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:15.445532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:15.445974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:15.446670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:15.447129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:15.447560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:15.579011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:15.587267 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec993b74-bcdf-4b6c-b6d5-36df9e734b88 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1563 microversion: 2.1 time: 0.153600 Nov 03 04:43:15.587819 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3273/6657] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:15 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:17.441519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:17.442448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:17.451262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:17.451759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:17.452411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:17.453150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:17.453614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:17.454047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:17.522416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b9ef3f38-e3bd-4606-a10a-253b5488eb35 req-9340de07-1927-432e-af5f-e579b9654658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010cc622-b2f4-4fd7-b135-ce8ecbae89ef", "tag": "fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:17.532926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b9ef3f38-e3bd-4606-a10a-253b5488eb35 req-9340de07-1927-432e-af5f-e579b9654658 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:17.533565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b9ef3f38-e3bd-4606-a10a-253b5488eb35 req-9340de07-1927-432e-af5f-e579b9654658 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:17.534066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b9ef3f38-e3bd-4606-a10a-253b5488eb35 req-9340de07-1927-432e-af5f-e579b9654658 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:17.545571 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b9ef3f38-e3bd-4606-a10a-253b5488eb35 req-9340de07-1927-432e-af5f-e579b9654658 service nova] Creating event network-changed:fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7 for instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef on n-h1-854653-7 Nov 03 04:43:17.551308 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b9ef3f38-e3bd-4606-a10a-253b5488eb35 req-9340de07-1927-432e-af5f-e579b9654658 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111881 Nov 03 04:43:17.552476 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3274/6658] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:43:17.625765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:17.634414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bec90c8a-6be3-49e4-8e84-edcda0fcf98d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1563 microversion: 2.1 time: 0.197598 Nov 03 04:43:17.634999 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3385/6659] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:17 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:33.328880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:33.329673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=54 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:33.334422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:33.335040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:33.340959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:33.344021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:33.344021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:33.344021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:33.344021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:33.344021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:33.425381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lazy-loading 'services' on Instance uuid d209f9ba-fef8-4ad8-916f-c0b0619538bd {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:43:33.576887 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b7d1c4d5-4baf-4672-b730-a1c3a54b7201 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd/os-volume_attachments/ce3f28ae-8976-4768-b2a8-e5d849d88580" status: 202 len: 0 microversion: 2.1 time: 0.249871 Nov 03 04:43:33.577439 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3275/6660] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:43:33 2022] DELETE /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd/os-volume_attachments/ce3f28ae-8976-4768-b2a8-e5d849d88580 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:43:38.944322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:38.944824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:38.947757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=20 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:38.948421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:43:38.953138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:38.959831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:38.959831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:38.959831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:38.959831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:38.959831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:38.983056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:43:39.549986 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-54755b37-ed60-4f68-95cb-6356c1a9cc37 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 204 len: 0 microversion: 2.1 time: 0.609318 Nov 03 04:43:39.550595 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3386/6661] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:43:38 2022] DELETE /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:43:39.560246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:39.561125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:39.567748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:39.568229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:39.568667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:39.569387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:39.569845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:39.570272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:39.699664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:39.708076 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5ee75dfa-19d8-45f7-8712-649265002e30 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1514 microversion: 2.1 time: 0.152939 Nov 03 04:43:39.708645 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3276/6662] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:39 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:40.731905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:40.732625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:40.740472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:40.740971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:40.741450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:40.742169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:40.742631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:40.743062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:41.032568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:41.040975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c935ef1d-59b6-4ef6-ab1e-593f659de3d3 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1514 microversion: 2.1 time: 0.313365 Nov 03 04:43:41.041566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3387/6663] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:40 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:41.901444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-dace6b82-b2f4-469a-8e07-47d930a5ecfe req-c8dc6974-3e42-4aeb-a7d0-b54fd0a1ce6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209f9ba-fef8-4ad8-916f-c0b0619538bd", "name": "network-vif-deleted", "tag": "b7ef51b2-fa41-4436-bb31-33d0082061bb"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:41.912985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dace6b82-b2f4-469a-8e07-47d930a5ecfe req-c8dc6974-3e42-4aeb-a7d0-b54fd0a1ce6b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:41.913566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dace6b82-b2f4-469a-8e07-47d930a5ecfe req-c8dc6974-3e42-4aeb-a7d0-b54fd0a1ce6b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:41.914001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-dace6b82-b2f4-469a-8e07-47d930a5ecfe req-c8dc6974-3e42-4aeb-a7d0-b54fd0a1ce6b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:41.925773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-dace6b82-b2f4-469a-8e07-47d930a5ecfe req-c8dc6974-3e42-4aeb-a7d0-b54fd0a1ce6b service nova] Creating event network-vif-deleted:b7ef51b2-fa41-4436-bb31-33d0082061bb for instance d209f9ba-fef8-4ad8-916f-c0b0619538bd on n-h2-854653-7 Nov 03 04:43:41.931406 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-dace6b82-b2f4-469a-8e07-47d930a5ecfe req-c8dc6974-3e42-4aeb-a7d0-b54fd0a1ce6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033874 Nov 03 04:43:41.932000 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3277/6664] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:43:42.063893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:42.064519 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:42.071425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:42.071918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:42.077218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:42.077218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:42.077218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:42.077218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:42.139749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:42.147814 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8789d559-5cd2-4b75-91c0-187ce75e68dd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 200 len: 1304 microversion: 2.1 time: 0.087991 Nov 03 04:43:42.151863 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3388/6665] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:42 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:43.172182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:43.172871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: d209f9ba-fef8-4ad8-916f-c0b0619538bd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:43.180404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:43.180886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:43.181374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:43.182063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:43.182520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:43.182949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:43.199253 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] HTTP exception thrown: Instance d209f9ba-fef8-4ad8-916f-c0b0619538bd could not be found. Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Request method failure captured: Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd HTTP/1.1 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0ZgVp6jRHO7J4YtniNnDt8RhnjbeTszv9iGcPQwTdGeY8Hf6J53Y55reIhu7m-HWBJ9omBD-NpoSMs9cw8caD-MoCoR98BKFcWQajorORfqZL-2j0UkmZIPcyOxWMKq06l1Dtf5eGQ-fL1dUvXNFn7LWQALckKlsLcxHmjkVffetk0 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 1a6767e85c1b406293b68c2a7fb62fab Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesSnapshotTestJSON-951337468 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a6767e85c1b406293b68c2a7fb62fab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1a6767e85c1b406293b68c2a7fb62fab", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a6767e85c1b406293b68c2a7fb62fab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1a6767e85c1b406293b68c2a7fb62fab"}]}] Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesSnapshotTestJSON-951337468 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 1a6767e85c1b406293b68c2a7fb62fab Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-951337468 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesSnapshotTestJSON-951337468-project Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7fb2d72e86fe43998ae130228b7b0180 Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesSnapshotTestJSON-951337468-project Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance d209f9ba-fef8-4ad8-916f-c0b0619538bd could not be found. Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'd209f9ba-fef8-4ad8-916f-c0b0619538bd'} Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d209f9ba-fef8-4ad8-916f-c0b0619538bd could not be found. Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d209f9ba-fef8-4ad8-916f-c0b0619538bd could not be found. Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:43:43.200887 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d209f9ba-fef8-4ad8-916f-c0b0619538bd could not be found. Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Returning 404 to user: Instance d209f9ba-fef8-4ad8-916f-c0b0619538bd could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-737f6a91-cff7-4cb7-abce-8cdb86748b7b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd" status: 404 len: 111 microversion: 2.1 time: 0.034559 Nov 03 04:43:43.205249 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3278/6666] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:43 2022] GET /compute/v2.1/servers/d209f9ba-fef8-4ad8-916f-c0b0619538bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:43:48.937621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:48.939884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:48.947191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:48.947685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:48.948160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:48.948869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:48.949357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:48.949786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:49.010168 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8e75e1e-31f4-4cac-9181-9829be2d7f63 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef/action" status: 200 len: 24571 microversion: 2.1 time: 0.075977 Nov 03 04:43:49.010729 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3389/6667] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:43:48 2022] POST /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:43:50.396852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1821473999", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "603c7b34-3cd6-49c1-9011-4034ff999230"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:50.450741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] validate_networks() for [('603c7b34-3cd6-49c1-9011-4034ff999230', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:43:50.796084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:43:50.796515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:43:50.796993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:43:50.797436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:43:50.797852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:43:50.807317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:50.807798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:50.808237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:50.808966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:50.809456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:50.809888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:50.826365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Getting quotas for project 1a6767e85c1b406293b68c2a7fb62fab. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:43:50.831543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Getting quotas for user 7fb2d72e86fe43998ae130228b7b0180 and project 1a6767e85c1b406293b68c2a7fb62fab. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:43:50.843725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:43:50.846060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:43:50.941000 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f6fd99b3-d132-4e1e-810e-81249b144431 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548726 Nov 03 04:43:50.941738 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3279/6668] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:43:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:43:50.953691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c04603bf-e8e7-4235-971e-44dbf461851f tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:50.954412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c04603bf-e8e7-4235-971e-44dbf461851f tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:51.010910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c04603bf-e8e7-4235-971e-44dbf461851f tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:51.018254 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c04603bf-e8e7-4235-971e-44dbf461851f tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1219 microversion: 2.1 time: 0.068903 Nov 03 04:43:51.018829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3390/6669] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:50 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:52.041274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:52.041899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:52.048970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:52.049498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:52.050489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:52.051193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:52.051650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:52.052081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:52.114828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:52.122541 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1b8bccce-47f7-497c-bca4-1249a83fdd35 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1215 microversion: 2.1 time: 0.086227 Nov 03 04:43:52.123119 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3280/6670] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:52 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:53.150878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:53.151405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:53.158683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:53.163996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:53.163996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:53.163996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:53.163996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:53.163996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:53.231841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:53.239803 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-be94266d-68c8-4bd6-aa92-2bdd9ef065d7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1277 microversion: 2.1 time: 0.092877 Nov 03 04:43:53.244305 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3391/6671] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:53 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:54.263617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:54.264369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:54.271897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:54.272401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:54.272841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:54.273568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:54.274056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:54.274489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:54.444175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:54.453861 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0819915-f931-4011-9748-4593a5a623cd tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1319 microversion: 2.1 time: 0.194232 Nov 03 04:43:54.454435 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3281/6672] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:54 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:43:54.492572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-840b7734-3338-4b2e-b9ba-5970e3829927 req-3de5a58b-fd15-42b5-ac56-59ecfedc7ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b3e18d1-1646-426a-b787-e94ff399e833", "tag": "772df3e2-78e9-4b4a-8a71-c980fb7ca791"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:43:54.502874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-840b7734-3338-4b2e-b9ba-5970e3829927 req-3de5a58b-fd15-42b5-ac56-59ecfedc7ad6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:54.503358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-840b7734-3338-4b2e-b9ba-5970e3829927 req-3de5a58b-fd15-42b5-ac56-59ecfedc7ad6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:54.503798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-840b7734-3338-4b2e-b9ba-5970e3829927 req-3de5a58b-fd15-42b5-ac56-59ecfedc7ad6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:54.516274 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-840b7734-3338-4b2e-b9ba-5970e3829927 req-3de5a58b-fd15-42b5-ac56-59ecfedc7ad6 service nova] Creating event network-changed:772df3e2-78e9-4b4a-8a71-c980fb7ca791 for instance 1b3e18d1-1646-426a-b787-e94ff399e833 on n-h2-854653-7 Nov 03 04:43:54.521653 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-840b7734-3338-4b2e-b9ba-5970e3829927 req-3de5a58b-fd15-42b5-ac56-59ecfedc7ad6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033055 Nov 03 04:43:54.522258 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3392/6673] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:43:55.476909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:55.477564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:55.484283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:55.484770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:55.485251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:55.485946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:55.486403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:55.486831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:55.617971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:55.625588 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3fadf517-0aba-475c-b566-7540e3b72c19 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1319 microversion: 2.1 time: 0.152915 Nov 03 04:43:55.626157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3282/6674] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:55 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:56.651193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:56.651825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:56.657996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:56.658486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:56.658934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:56.659629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:56.660090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:56.661132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:56.794824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:56.802622 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-604a0d18-11ff-40ab-a95c-907f77535ab6 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1319 microversion: 2.1 time: 0.156746 Nov 03 04:43:56.803189 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3393/6675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:56 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:57.826285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:57.827032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:57.834717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:57.835216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:57.835667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:57.836373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:57.836836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:57.837301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:57.967239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:57.974907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80ca9fe6-f337-4520-a722-e33c8b068185 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1319 microversion: 2.1 time: 0.152566 Nov 03 04:43:57.975469 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3283/6676] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:57 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:43:58.997467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:43:58.998090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:43:59.005545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:59.006030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:59.006467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:59.007160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:43:59.007615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:43:59.008042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:43:59.142725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:43:59.150329 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b447c08-7a59-494b-8e05-d23261644a25 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1319 microversion: 2.1 time: 0.156736 Nov 03 04:43:59.150888 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3394/6677] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:43:58 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:00.023867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1030fe75-30de-4b0a-be85-5cedda36f433 req-5ada149a-481e-41da-9a75-98904db7e44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b3e18d1-1646-426a-b787-e94ff399e833", "name": "network-vif-plugged", "status": "completed", "tag": "772df3e2-78e9-4b4a-8a71-c980fb7ca791"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:44:00.034433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1030fe75-30de-4b0a-be85-5cedda36f433 req-5ada149a-481e-41da-9a75-98904db7e44a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:00.034920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1030fe75-30de-4b0a-be85-5cedda36f433 req-5ada149a-481e-41da-9a75-98904db7e44a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:00.035364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1030fe75-30de-4b0a-be85-5cedda36f433 req-5ada149a-481e-41da-9a75-98904db7e44a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:00.046125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1030fe75-30de-4b0a-be85-5cedda36f433 req-5ada149a-481e-41da-9a75-98904db7e44a service nova] Creating event network-vif-plugged:772df3e2-78e9-4b4a-8a71-c980fb7ca791 for instance 1b3e18d1-1646-426a-b787-e94ff399e833 on n-h2-854653-7 Nov 03 04:44:00.051197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1030fe75-30de-4b0a-be85-5cedda36f433 req-5ada149a-481e-41da-9a75-98904db7e44a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031790 Nov 03 04:44:00.051836 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3284/6678] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:44:00.173845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:00.174466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:00.181712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:00.182199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:00.182655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:00.183330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:00.183782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:00.184205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:00.312918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:00.321991 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6696c92f-8c05-449e-b22a-e7547d311134 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1319 microversion: 2.1 time: 0.152004 Nov 03 04:44:00.322563 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3395/6679] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:00 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:01.341661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:44:01.342449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:44:01.347462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:01.348237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:01.354345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:01.354825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:01.355266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:01.355957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:01.356408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:01.356863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:01.492020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:01.499814 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70a27f5f-831f-4d3b-9696-199d0afa6b17 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1319 microversion: 2.1 time: 0.159148 Nov 03 04:44:01.500398 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3285/6680] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:01 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:02.524021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:02.524635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:02.526635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:44:02.532538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:02.538473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:02.538473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:02.538473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:02.538473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:02.538473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:02.667289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:02.675952 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-765f56b0-87b7-42e7-89e9-eb10c873df8e tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1508 microversion: 2.1 time: 0.156650 Nov 03 04:44:02.676764 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3396/6681] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:02 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:02.700732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1932c1b8-26f5-4914-9e82-894931b59295", "device": "/dev/sdb"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:44:02.704506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:02.712150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:02.712645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:02.713125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:02.713833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:02.714302 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:02.714732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:03.274082 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b727bb1f-a7be-457a-a7b9-63c11dfad2b7 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "POST /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578072 Nov 03 04:44:03.274693 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3286/6682] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 04:44:02 2022] POST /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:44:19.478812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:44:19.481686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:19.484793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:44:19.485545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:44:19.491009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:19.491518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:19.491968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:19.496002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:19.496002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:19.496002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:19.573117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:44:19.573543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:44:19.574019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:44:19.574431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:44:19.574853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:44:19.718036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:19.724179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:19.724701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:19.725171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:19.725884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:19.726340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:19.726776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:19.756480 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-64ed68a6-1d26-4ddb-9800-1d6e125912af tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef/action" status: 202 len: 1137 microversion: 2.1 time: 0.281714 Nov 03 04:44:19.757776 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3397/6683] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:44:19 2022] POST /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef/action => generated 1137 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 03 04:44:19.780146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:44:19.781059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:44:19.785095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:19.785810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:19.791921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:19.792417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:19.792860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:19.793593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:19.794052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:19.794485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:19.946048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:19.958047 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1db56ba-c228-42c8-a8cc-3f4f26a617c5 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.177439 Nov 03 04:44:19.958047 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3287/6684] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:19 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:20.982650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:20.983310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:20.990219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:20.990719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:20.991164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:20.991877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:20.992339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:20.992781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:21.165143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:21.181768 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-25e6c368-28f8-479c-9085-e7d586640289 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.201809 Nov 03 04:44:21.182801 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3398/6685] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:20 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:22.209554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:22.210263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:22.217525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:22.218069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:22.218510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:22.219206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:22.219663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:22.220091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:22.356460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:22.364960 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4ea1e1ec-b85b-4a5e-b6d6-429cdc678b23 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.159620 Nov 03 04:44:22.365500 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3288/6686] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:22 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:23.389816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:23.390373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:23.398271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:23.398765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:23.399209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:23.399952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:23.400370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:23.400804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:23.542366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:23.551496 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e4b19d7-9267-4a34-b3b5-97ec2b8af302 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.167214 Nov 03 04:44:23.552082 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3399/6687] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:23 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:24.575861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:24.576370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:24.583853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:24.584338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:24.584776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:24.585514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:24.585973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:24.586397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:24.724561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:24.732525 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d7caa587-0d12-4d7b-aa4d-3593da8bab15 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.160640 Nov 03 04:44:24.733122 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3289/6688] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:24 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:25.755818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:25.756545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:25.763676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:25.764181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:25.764637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:25.765397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:25.765867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:25.766572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:25.903640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:25.912627 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3302f7df-a577-41ba-902f-69cd5b63e282 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.160059 Nov 03 04:44:25.917864 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3400/6689] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:25 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:26.394952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:26.395449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:26.401904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:26.402329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:26.402775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:26.403462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:26.403917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:26.404344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:26.482594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lazy-loading 'services' on Instance uuid 1b3e18d1-1646-426a-b787-e94ff399e833 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:44:26.697056 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0d65b248-7e33-4c20-9126-43a207b81c48 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833/os-volume_attachments/1932c1b8-26f5-4914-9e82-894931b59295" status: 202 len: 0 microversion: 2.1 time: 0.306743 Nov 03 04:44:26.697683 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3290/6690] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 04:44:26 2022] DELETE /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833/os-volume_attachments/1932c1b8-26f5-4914-9e82-894931b59295 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 04:44:26.935044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:26.935670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:26.942457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:26.942933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:26.943377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:26.944075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:26.944537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:26.944972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:27.079786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:27.087573 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5d3ec1b-a52a-4d3e-926f-56227e9cbc92 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.156441 Nov 03 04:44:27.088140 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3401/6691] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:26 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:28.112380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:28.113689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:28.119950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:28.120437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:28.120880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:28.121607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:28.122065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:28.122498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:28.262925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:28.271094 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e18a108-2a48-4105-8dd8-0b3cc55dba46 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.163970 Nov 03 04:44:28.271664 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3291/6692] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:28 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:29.295581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:29.296244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:29.303154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:29.303656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:29.304149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:29.304844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:29.305344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:29.305783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:29.439562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:29.447949 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d880665f-c80a-444b-8f1c-10f5c2f63dfe tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.156312 Nov 03 04:44:29.448521 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3402/6693] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:29 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:30.471680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:30.472972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:30.480297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:30.480805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:30.481295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:30.482015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:30.482481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:30.482920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:30.620694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:30.629306 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d48259b0-1a95-49f7-ab3f-147827ce1fb2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.161587 Nov 03 04:44:30.629891 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3292/6694] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:30 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:31.654473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:31.655106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:31.662697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:31.663181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:31.663621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:31.664310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:31.664764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:31.665216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:31.799525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:31.807279 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b6d79c2-af3f-4de3-8688-af4ca7c2912f tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1691 microversion: 2.1 time: 0.156867 Nov 03 04:44:31.809424 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3403/6695] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:31 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:32.063619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:32.064161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:32.071387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:32.072765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:32.072765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:32.072979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:32.073450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:32.073879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:32.099732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:44:32.372573 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bc844f08-6254-4788-a8b9-7be817d63efb tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 204 len: 0 microversion: 2.1 time: 0.312617 Nov 03 04:44:32.373213 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3293/6696] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:44:32 2022] DELETE /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:44:32.382145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:32.385086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:32.388693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:32.389225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:32.389668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:32.390363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:32.390827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:32.391520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:32.518403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:32.526140 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6b07ef27-88c1-4ec3-84d8-f57869d65e97 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1514 microversion: 2.1 time: 0.148567 Nov 03 04:44:32.526710 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3404/6697] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:32 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:32.832595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:32.833327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:32.839316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:32.839807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:32.840253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:32.840949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:32.841433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:32.841863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:32.977874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:32.985679 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a474dd8-1f62-4630-88c9-8137fd20cfc0 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1697 microversion: 2.1 time: 0.157463 Nov 03 04:44:32.986258 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3294/6698] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:32 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:33.549569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:33.550194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:33.557043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:33.557535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:33.557979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:33.558678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:33.559138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:33.559571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:33.687047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:33.695312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc57ff62-f4b8-4dfd-90d8-e7119540ec56 tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1514 microversion: 2.1 time: 0.149887 Nov 03 04:44:33.695882 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3405/6699] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:33 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:34.012348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:34.012979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:34.020056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:34.020609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:34.020989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:34.021717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:34.022185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:34.022624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:34.247421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:34.255963 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba897bf2-a7a0-415e-9b29-41cb422e4d29 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1697 microversion: 2.1 time: 0.247054 Nov 03 04:44:34.256542 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3295/6700] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:34 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1697 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:34.665866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8f4e0293-4d7d-419c-8097-ef3c364016a2 req-6a83d54a-301b-468a-b6f4-61b579829277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b3e18d1-1646-426a-b787-e94ff399e833", "name": "network-vif-deleted", "tag": "772df3e2-78e9-4b4a-8a71-c980fb7ca791"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:44:34.676916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8f4e0293-4d7d-419c-8097-ef3c364016a2 req-6a83d54a-301b-468a-b6f4-61b579829277 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:34.686011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8f4e0293-4d7d-419c-8097-ef3c364016a2 req-6a83d54a-301b-468a-b6f4-61b579829277 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:34.686483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8f4e0293-4d7d-419c-8097-ef3c364016a2 req-6a83d54a-301b-468a-b6f4-61b579829277 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:34.709827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8f4e0293-4d7d-419c-8097-ef3c364016a2 req-6a83d54a-301b-468a-b6f4-61b579829277 service nova] Creating event network-vif-deleted:772df3e2-78e9-4b4a-8a71-c980fb7ca791 for instance 1b3e18d1-1646-426a-b787-e94ff399e833 on n-h2-854653-7 Nov 03 04:44:34.718439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8f4e0293-4d7d-419c-8097-ef3c364016a2 req-6a83d54a-301b-468a-b6f4-61b579829277 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056387 Nov 03 04:44:34.719968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:34.720770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:34.721681 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3406/6701] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:44:34.738774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:34.738774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:34.739181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:34.740400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:34.741057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:34.743080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:34.816016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fb2d72e86fe43998ae130228b7b0180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a6767e85c1b406293b68c2a7fb62fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:34.826546 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-05c4da92-ca86-4551-bb3b-e431ba74b47b tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 200 len: 1472 microversion: 2.1 time: 0.111274 Nov 03 04:44:34.827368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3296/6702] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:34 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 1472 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:35.280504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:35.281281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:35.288399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:35.288884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:35.289359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:35.290059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:35.290769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:35.291198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:35.451343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:35.462546 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c888b4c-6b04-41ab-812b-0647551baedf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1697 microversion: 2.1 time: 0.186260 Nov 03 04:44:35.463457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3407/6703] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:35 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:35.851733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:35.852516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] [instance: 1b3e18d1-1646-426a-b787-e94ff399e833] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:35.859639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:35.860127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:35.860566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:35.861296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:35.861753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:35.862181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:35.878309 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] HTTP exception thrown: Instance 1b3e18d1-1646-426a-b787-e94ff399e833 could not be found. Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Request method failure captured: Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 HTTP/1.1 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0ZgVp6jRHO7J4YtniNnDt8RhnjbeTszv9iGcPQwTdGeY8Hf6J53Y55reIhu7m-HWBJ9omBD-NpoSMs9cw8caD-MoCoR98BKFcWQajorORfqZL-2j0UkmZIPcyOxWMKq06l1Dtf5eGQ-fL1dUvXNFn7LWQALckKlsLcxHmjkVffetk0 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 1a6767e85c1b406293b68c2a7fb62fab Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-VolumesSnapshotTestJSON-951337468 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a6767e85c1b406293b68c2a7fb62fab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1a6767e85c1b406293b68c2a7fb62fab", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1a6767e85c1b406293b68c2a7fb62fab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1a6767e85c1b406293b68c2a7fb62fab"}]}] Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-VolumesSnapshotTestJSON-951337468 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 1a6767e85c1b406293b68c2a7fb62fab Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-951337468 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-VolumesSnapshotTestJSON-951337468-project Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7fb2d72e86fe43998ae130228b7b0180 Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-VolumesSnapshotTestJSON-951337468-project Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1b3e18d1-1646-426a-b787-e94ff399e833 could not be found. Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1b3e18d1-1646-426a-b787-e94ff399e833'} Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3e18d1-1646-426a-b787-e94ff399e833 could not be found. Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3e18d1-1646-426a-b787-e94ff399e833 could not be found. Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:44:35.880152 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3e18d1-1646-426a-b787-e94ff399e833 could not be found. Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] Returning 404 to user: Instance 1b3e18d1-1646-426a-b787-e94ff399e833 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c4f66497-adca-4980-9c80-00fc14795efa tempest-VolumesSnapshotTestJSON-951337468 tempest-VolumesSnapshotTestJSON-951337468-project] 10.222.0.30 "GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833" status: 404 len: 111 microversion: 2.1 time: 0.034597 Nov 03 04:44:35.884504 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3297/6704] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:35 2022] GET /compute/v2.1/servers/1b3e18d1-1646-426a-b787-e94ff399e833 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:44:36.489283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:44:36.489283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:44:36.495814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:36.496335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:36.496774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:36.497539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:36.498002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:36.498436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:36.633068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:44:36.641505 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1308456e-dce9-437b-9521-cdd3e4275de6 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1682 microversion: 2.1 time: 0.158511 Nov 03 04:44:36.642078 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3408/6705] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:44:36 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:44:36.956031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e22b2174-2ad5-4678-8ca8-0bc295e685e1 req-bcecb5d6-adb4-4ec4-89dd-f852023167f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010cc622-b2f4-4fd7-b135-ce8ecbae89ef", "name": "network-vif-plugged", "status": "completed", "tag": "fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:44:36.966939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e22b2174-2ad5-4678-8ca8-0bc295e685e1 req-bcecb5d6-adb4-4ec4-89dd-f852023167f0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:44:36.967432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e22b2174-2ad5-4678-8ca8-0bc295e685e1 req-bcecb5d6-adb4-4ec4-89dd-f852023167f0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:44:36.967868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e22b2174-2ad5-4678-8ca8-0bc295e685e1 req-bcecb5d6-adb4-4ec4-89dd-f852023167f0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:44:36.979282 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e22b2174-2ad5-4678-8ca8-0bc295e685e1 req-bcecb5d6-adb4-4ec4-89dd-f852023167f0 service nova] Creating event network-vif-plugged:fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7 for instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef on n-h1-854653-7 Nov 03 04:44:36.984532 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e22b2174-2ad5-4678-8ca8-0bc295e685e1 req-bcecb5d6-adb4-4ec4-89dd-f852023167f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115989 Nov 03 04:44:36.992164 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3298/6706] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:45:10.900218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:45:10.903837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:45:10.906466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=28 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:45:10.907148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:45:10.911949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:10.912439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:10.912897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:10.913634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:10.914083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:10.914518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:10.964480 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c6198fad-7e4b-4cc3-b77b-40d64b5c136a tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "POST /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef/action" status: 200 len: 24571 microversion: 2.1 time: 0.068004 Nov 03 04:45:10.965449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3409/6707] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:45:10 2022] POST /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 04:45:51.163593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:45:51.164370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:45:51.165313 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:45:51.165651 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:45:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef (ip 10.222.0.30) !!! Nov 03 04:45:51.169330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4f9a0137-a5b0-49d5-bf95-6f4a65f019b5 req-ce476f28-e2e9-418f-b55b-a9f6308bd6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010cc622-b2f4-4fd7-b135-ce8ecbae89ef", "tag": "fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:45:51.174199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:45:51.174199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:45:51.179178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:51.179901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:51.180544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:51.181470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:51.182112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:51.182876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:51.190024 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:45:51.190221 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 04:45:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 03 04:45:51.191328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:45:51.193700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4f9a0137-a5b0-49d5-bf95-6f4a65f019b5 req-ce476f28-e2e9-418f-b55b-a9f6308bd6b5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:51.197134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4f9a0137-a5b0-49d5-bf95-6f4a65f019b5 req-ce476f28-e2e9-418f-b55b-a9f6308bd6b5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:51.197134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4f9a0137-a5b0-49d5-bf95-6f4a65f019b5 req-ce476f28-e2e9-418f-b55b-a9f6308bd6b5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:51.214444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:45:51.235500 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4f9a0137-a5b0-49d5-bf95-6f4a65f019b5 req-ce476f28-e2e9-418f-b55b-a9f6308bd6b5 service nova] Creating event network-changed:fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7 for instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef on n-h1-854653-7 Nov 03 04:45:51.246053 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4f9a0137-a5b0-49d5-bf95-6f4a65f019b5 req-ce476f28-e2e9-418f-b55b-a9f6308bd6b5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080685 Nov 03 04:45:51.249942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3410/6708] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:45:51.537350 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f8f3cfb-4ea3-41c8-bef0-3f492c26a571 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 204 len: 0 microversion: 2.1 time: 0.376322 Nov 03 04:45:51.541482 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3299/6709] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:45:51 2022] DELETE /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:45:51.548267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:45:51.549080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:45:51.561737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:51.562236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:51.562683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:51.563392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:51.563850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:51.564281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:51.730614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:45:51.734769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3b753122-d122-49d1-8eb6-f8c2d1acc2cf tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1688 microversion: 2.1 time: 0.191274 Nov 03 04:45:51.735757 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3411/6710] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:45:51 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:45:52.763718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:45:52.772264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:45:52.780191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:52.781212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:52.783443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:52.785052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:52.787538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:52.792333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:52.959499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:45:52.972989 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-515c09bf-ecfb-4784-8c31-05c62fbd52b1 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1688 microversion: 2.1 time: 0.214267 Nov 03 04:45:52.974343 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3300/6711] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:45:52 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1688 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:45:53.664958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8c6dc8b2-e9e3-475d-ba2e-d0cd02eea2b1 req-624486e8-ef28-45cc-a48c-1dbc34ee676e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010cc622-b2f4-4fd7-b135-ce8ecbae89ef", "name": "network-vif-deleted", "tag": "fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:45:53.679842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8c6dc8b2-e9e3-475d-ba2e-d0cd02eea2b1 req-624486e8-ef28-45cc-a48c-1dbc34ee676e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:53.681218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8c6dc8b2-e9e3-475d-ba2e-d0cd02eea2b1 req-624486e8-ef28-45cc-a48c-1dbc34ee676e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:53.681218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8c6dc8b2-e9e3-475d-ba2e-d0cd02eea2b1 req-624486e8-ef28-45cc-a48c-1dbc34ee676e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:53.694002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8c6dc8b2-e9e3-475d-ba2e-d0cd02eea2b1 req-624486e8-ef28-45cc-a48c-1dbc34ee676e service nova] Creating event network-vif-deleted:fe42ae15-29fb-4a56-abd3-3a0ce8bdf4b7 for instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef on n-h1-854653-7 Nov 03 04:45:53.700199 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8c6dc8b2-e9e3-475d-ba2e-d0cd02eea2b1 req-624486e8-ef28-45cc-a48c-1dbc34ee676e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038934 Nov 03 04:45:53.701460 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3412/6712] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:45:53.996821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:45:53.998127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:45:54.009135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:54.009890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:54.010793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:54.011750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:54.012381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:54.012814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:54.065165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:54.066077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:54.066865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:54.068026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lazy-loading 'fault' on Instance uuid 010cc622-b2f4-4fd7-b135-ce8ecbae89ef {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:45:54.150690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e407ab02fb9f4e5aae907b6affa8c51b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7fea2b758684fa9a57416aeb378b77a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:45:54.160038 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ab8bf51-cd94-4318-a04b-01b88454cef2 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 200 len: 1355 microversion: 2.1 time: 0.166667 Nov 03 04:45:54.160839 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3301/6713] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:45:53 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 1355 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:45:55.186510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:45:55.187225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] [instance: 010cc622-b2f4-4fd7-b135-ce8ecbae89ef] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:45:55.194841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:55.195335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:55.195772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:55.196526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:45:55.196980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:45:55.197435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:45:55.219442 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] HTTP exception thrown: Instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef could not be found. Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Request method failure captured: Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef HTTP/1.1 Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0VAHsMChhMJ4SSDnfsQJn1ExSAQcK-qK0C61h7g9mfDWA4lZewLtyFI0NJeDbsL2BFPXqzH_i_aRtJx2NZNHpL4on7CHw_KlIgilyvVNC2YHta4pffIuHzZXArq-kz_ZLkWPz-0dTdepkn7ADhuA8LZPM5toLxhOYIphnetY5GGuHc Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f7fea2b758684fa9a57416aeb378b77a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f7fea2b758684fa9a57416aeb378b77a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f7fea2b758684fa9a57416aeb378b77a"}]}] Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: f7fea2b758684fa9a57416aeb378b77a Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1368384998 Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: e407ab02fb9f4e5aae907b6affa8c51b Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1368384998-project Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef could not be found. Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '010cc622-b2f4-4fd7-b135-ce8ecbae89ef'} Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef could not be found. Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef could not be found. Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:45:55.223886 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef could not be found. Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Returning 404 to user: Instance 010cc622-b2f4-4fd7-b135-ce8ecbae89ef could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b28b2eb0-fe9b-45d3-8860-20a4a09bbd02 tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef" status: 404 len: 111 microversion: 2.1 time: 0.045726 Nov 03 04:45:55.231697 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3413/6714] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:45:55 2022] GET /compute/v2.1/servers/010cc622-b2f4-4fd7-b135-ce8ecbae89ef => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:45:59.887550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8f11c1f-3c70-4f77-a449-7902a5e9617d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] Calling method '.version_select at 0x7ff7f912f820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:45:59.985876 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f8f11c1f-3c70-4f77-a449-7902a5e9617d tempest-TestNetworkAdvancedServerOps-1368384998 tempest-TestNetworkAdvancedServerOps-1368384998-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-721173445" status: 202 len: 0 microversion: 2.1 time: 0.102326 Nov 03 04:45:59.987778 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3302/6715] 10.222.0.30 () {58 vars in 1281 bytes} [Thu Nov 3 04:45:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-721173445 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 04:46:07.022957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1508589878", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "481bbd84-d927-4d87-831c-7f43c2d59e2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:46:07.036441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:07.037231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=16 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:07.099192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:46:07.492987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:46:07.492987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:46:07.493221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:46:07.493544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:46:07.494906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:46:07.505293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:07.505786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:07.506238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:07.506976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:07.507437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:07.507875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:07.527042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:46:07.532767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:46:07.594330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:46:07.596714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='481bbd84-d927-4d87-831c-7f43c2d59e2d',volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:46:08.048089 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98bee65f-6389-4289-b8b0-56cf460cc52f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029691 Nov 03 04:46:08.055469 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3414/6716] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:46:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:46:08.061419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36cddd31-4085-4bae-b809-ea143ae0264b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:08.068473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36cddd31-4085-4bae-b809-ea143ae0264b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:08.068473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:08.129203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-36cddd31-4085-4bae-b809-ea143ae0264b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:08.136446 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36cddd31-4085-4bae-b809-ea143ae0264b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1057 microversion: 2.1 time: 0.079390 Nov 03 04:46:08.137368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3303/6717] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:08 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1057 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:09.161512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-940f9e02-afaa-4a3d-a66d-3c3c4b373857 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:09.162190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-940f9e02-afaa-4a3d-a66d-3c3c4b373857 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:09.214049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-940f9e02-afaa-4a3d-a66d-3c3c4b373857 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:09.220831 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-940f9e02-afaa-4a3d-a66d-3c3c4b373857 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1057 microversion: 2.1 time: 0.064912 Nov 03 04:46:09.226185 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3415/6718] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:09 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1057 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:10.244550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:10.245213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:10.252436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:10.252936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:10.253408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:10.254115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:10.254582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:10.255016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:10.317741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:10.326223 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d729ae84-4065-4ab7-8712-2189d2763cc6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1155 microversion: 2.1 time: 0.085938 Nov 03 04:46:10.329425 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3304/6719] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:10 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1155 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:11.353601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:11.354413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:11.364947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:11.366092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:11.366614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:11.367412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:11.368819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:11.369272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:11.610418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:11.620728 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-418d9730-1a58-4e60-b4be-e6983b259bf4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1215 microversion: 2.1 time: 0.274360 Nov 03 04:46:11.622281 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3416/6720] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:11 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:12.167171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-31ace1a5-f2c8-443f-ad86-fb8ab4123be4 req-9bcd95e0-fc28-44c2-8953-16132096d1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ae3c5a-56c0-4afb-a5d7-4af6fb476539", "tag": "1f21865c-232c-4a53-b778-d9c512e44681"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:46:12.178531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-31ace1a5-f2c8-443f-ad86-fb8ab4123be4 req-9bcd95e0-fc28-44c2-8953-16132096d1bd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:12.179009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-31ace1a5-f2c8-443f-ad86-fb8ab4123be4 req-9bcd95e0-fc28-44c2-8953-16132096d1bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:12.179440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-31ace1a5-f2c8-443f-ad86-fb8ab4123be4 req-9bcd95e0-fc28-44c2-8953-16132096d1bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:12.191035 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-31ace1a5-f2c8-443f-ad86-fb8ab4123be4 req-9bcd95e0-fc28-44c2-8953-16132096d1bd service nova] Creating event network-changed:1f21865c-232c-4a53-b778-d9c512e44681 for instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 on n-h2-854653-7 Nov 03 04:46:12.196316 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-31ace1a5-f2c8-443f-ad86-fb8ab4123be4 req-9bcd95e0-fc28-44c2-8953-16132096d1bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033849 Nov 03 04:46:12.196921 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3305/6721] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:46:12.646077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:12.647609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:12.653780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:12.654280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:12.654747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:12.655459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:12.656131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:12.656566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:12.863281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:12.871481 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d980dc59-42bf-4dac-ad37-255cc3d58da7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1215 microversion: 2.1 time: 0.231437 Nov 03 04:46:12.872086 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3417/6722] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:12 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:13.896223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:13.897057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:13.905864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:13.906352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:13.906788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:13.907488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:13.907947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:13.908382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:14.046789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:14.055644 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aeb6e8f6-6709-4ebb-b745-fb4086f94664 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1215 microversion: 2.1 time: 0.164384 Nov 03 04:46:14.058645 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3306/6723] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:13 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:15.079217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:15.079843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:15.087089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:15.087587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:15.088088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:15.088795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:15.089922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:15.090357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:15.403118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:15.411915 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48d69837-1bcc-4063-b95d-112cdbd4aac3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1215 microversion: 2.1 time: 0.336822 Nov 03 04:46:15.412489 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3418/6724] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:15 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:16.434119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:16.434656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:16.441583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:16.442068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:16.442513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:16.443199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:16.443652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:16.444076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:16.571051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:16.578774 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-922909e0-1a58-48f9-9be7-0d80d81ea54b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.148653 Nov 03 04:46:16.579397 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3307/6725] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:16 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:17.602239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:17.602863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:17.605546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:17.610399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:17.610879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:17.611321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:17.612626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:17.613124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:17.613618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:17.747485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:17.755215 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c8178a83-ab26-4cf2-b9ae-1b7f41e3605e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.156893 Nov 03 04:46:17.755799 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3419/6726] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:17 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:18.778135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:18.778785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:18.781671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:18.786574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:18.787066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:18.787512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:18.788208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:18.788667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:18.789131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:18.918673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:18.927112 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a033de98-665e-4e1b-b4bb-f0ea4d4b26d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.152958 Nov 03 04:46:18.927685 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3308/6727] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:18 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:19.950226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:19.950855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:19.953557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:19.958945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:19.959434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:19.959875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:19.960579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:19.961053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:19.961486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:20.088587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:20.096440 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d4880c65-506a-48c5-8921-626417b98036 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.150116 Nov 03 04:46:20.097030 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3420/6728] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:19 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:21.119429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:21.120046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:21.126837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:21.127364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:21.127803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:21.128492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:21.128951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:21.129402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:21.261706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:21.270260 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60a88dcb-8457-4fe6-8186-85d8ab86d06e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.154797 Nov 03 04:46:21.270859 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3309/6729] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:21 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:22.293499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:22.294123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:22.301416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:22.301905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:22.302367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:22.303052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:22.303517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:22.303953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:22.430267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:22.437971 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-907008ad-d85e-47d3-80a8-97070f7748a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.148546 Nov 03 04:46:22.438542 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3421/6730] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:22 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:23.460344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:23.460949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:23.463621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:23.468347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:23.468840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:23.469310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:23.470003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:23.470456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:23.470899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:23.601698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:23.609383 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcd56138-eb65-45b4-871d-fd4106a1c642 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.152909 Nov 03 04:46:23.609955 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3310/6731] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:23 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:24.632730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:24.633383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:24.640240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:24.640741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:24.641215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:24.641919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:24.642648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:24.643659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:24.773160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:24.781004 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d43b2d1-cae6-426e-bb9e-eda3b05a47da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.152221 Nov 03 04:46:24.781594 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3422/6732] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:24 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:25.803754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:25.804467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:25.811279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:25.811777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:25.812844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:25.813593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:25.814065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:25.814685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:25.947917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:25.956522 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f99a85d-8c8c-4e96-a7c0-dc247a63e1e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.156762 Nov 03 04:46:25.957099 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3311/6733] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:25 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:46:26.831170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4c3441f1-bb95-4b67-b5ba-c477e4daf2ab req-4d544830-a4d5-461a-8373-f586ffb4d19b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ae3c5a-56c0-4afb-a5d7-4af6fb476539", "name": "network-vif-plugged", "status": "completed", "tag": "1f21865c-232c-4a53-b778-d9c512e44681"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:46:26.837592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c3441f1-bb95-4b67-b5ba-c477e4daf2ab req-4d544830-a4d5-461a-8373-f586ffb4d19b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:26.838075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c3441f1-bb95-4b67-b5ba-c477e4daf2ab req-4d544830-a4d5-461a-8373-f586ffb4d19b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:26.838514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4c3441f1-bb95-4b67-b5ba-c477e4daf2ab req-4d544830-a4d5-461a-8373-f586ffb4d19b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:26.850071 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4c3441f1-bb95-4b67-b5ba-c477e4daf2ab req-4d544830-a4d5-461a-8373-f586ffb4d19b service nova] Creating event network-vif-plugged:1f21865c-232c-4a53-b778-d9c512e44681 for instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 on n-h2-854653-7 Nov 03 04:46:26.855068 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4c3441f1-bb95-4b67-b5ba-c477e4daf2ab req-4d544830-a4d5-461a-8373-f586ffb4d19b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032053 Nov 03 04:46:26.859875 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3423/6734] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:46:26.979162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:26.979793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:26.987912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:26.988489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:26.989055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:26.989828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:26.990355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:26.990887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:27.120352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:27.128035 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f0bdc467-39f8-43d7-9f11-66fcd80e17fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.152849 Nov 03 04:46:27.128602 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3312/6735] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:26 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:28.152742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:28.153483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:28.159690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:28.160188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:28.160638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:28.161390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:28.161858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:28.162298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:28.296025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:28.304577 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8d5f0a03-8f7a-47d5-a0f1-64170187ee1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1203 microversion: 2.1 time: 0.157019 Nov 03 04:46:28.305166 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3424/6736] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:28 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:29.327722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:29.328333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:29.335336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.335823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.336260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.336950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.337432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.337855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.468651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:29.476383 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96b08771-4047-4acb-b64d-e842dd50af68 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1391 microversion: 2.1 time: 0.152628 Nov 03 04:46:29.477375 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3313/6737] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:29 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:29.499086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:29.499713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:29.507289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.507786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.508238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.508954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.509657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.510102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.639995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:29.648084 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98a8ca05-3f78-44ee-9add-f102c3f4d386 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1391 microversion: 2.1 time: 0.152946 Nov 03 04:46:29.648656 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3425/6738] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:29 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:29.669503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:29.670215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:29.677912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.678407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.678852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.679557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.680045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.680475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.807408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:29.815131 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57b3f3e7-e6f9-46f8-9221-09f7aefb06cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1391 microversion: 2.1 time: 0.149488 Nov 03 04:46:29.815707 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3314/6739] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:29 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:29.836836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:29.837301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:29.843230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.843710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.844147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.844834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:29.845322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:29.846311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:29.873785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:46:30.131404 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-41068892-80e6-4e13-9f7c-44e174b36784 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 204 len: 0 microversion: 2.1 time: 0.298129 Nov 03 04:46:30.131958 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3426/6740] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:46:29 2022] DELETE /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 04:46:30.140261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:30.140884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:30.147796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:30.148295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:30.148741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:30.149650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:30.149932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:30.150368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:30.278755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:30.287297 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b3d01b1-f865-46be-8adc-2fc08c1de076 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1397 microversion: 2.1 time: 0.150985 Nov 03 04:46:30.287881 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3315/6741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:30 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1397 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:46:31.311171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:31.311874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:31.319768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:31.320262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:31.320703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:31.321425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:31.321884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:31.322342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:31.457541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:31.465409 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a736f79e-c885-43b1-b1d0-721bc0dd5fcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1397 microversion: 2.1 time: 0.158468 Nov 03 04:46:31.465977 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3427/6742] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:31 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1397 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:32.266222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3ecc632e-f038-4eb0-b6f3-51f3b4a572ad req-025dfdbf-4ef7-49bf-8171-560a2b300b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ae3c5a-56c0-4afb-a5d7-4af6fb476539", "name": "network-vif-deleted", "tag": "1f21865c-232c-4a53-b778-d9c512e44681"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:46:32.277848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3ecc632e-f038-4eb0-b6f3-51f3b4a572ad req-025dfdbf-4ef7-49bf-8171-560a2b300b2a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:32.278332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3ecc632e-f038-4eb0-b6f3-51f3b4a572ad req-025dfdbf-4ef7-49bf-8171-560a2b300b2a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:32.286685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3ecc632e-f038-4eb0-b6f3-51f3b4a572ad req-025dfdbf-4ef7-49bf-8171-560a2b300b2a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:32.291613 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3ecc632e-f038-4eb0-b6f3-51f3b4a572ad req-025dfdbf-4ef7-49bf-8171-560a2b300b2a service nova] Creating event network-vif-deleted:1f21865c-232c-4a53-b778-d9c512e44681 for instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 on n-h2-854653-7 Nov 03 04:46:32.297006 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3ecc632e-f038-4eb0-b6f3-51f3b4a572ad req-025dfdbf-4ef7-49bf-8171-560a2b300b2a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034469 Nov 03 04:46:32.297650 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3316/6743] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:46:32.489328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:32.489946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:32.497077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:32.497573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:32.498014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:32.498724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:32.499179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:32.499608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:32.566364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:32.574449 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-223d7f90-7479-432f-9643-fa979f94b147 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1188 microversion: 2.1 time: 0.089452 Nov 03 04:46:32.575626 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3428/6744] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:32 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:33.600259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:33.601079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:33.607474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:33.608083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:33.608590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:33.609388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:33.609850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:33.610281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:33.672662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:33.681180 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-738233f1-f3b7-40f7-825e-1642fb952718 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1188 microversion: 2.1 time: 0.086519 Nov 03 04:46:33.681755 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3317/6745] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:33 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:34.706813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:34.707744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:34.715026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:34.715518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:34.715966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:34.716681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:34.717304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:34.717983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:34.789581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:34.798382 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a06cd8b-cd8c-4bfb-8d0d-27e27c4c12ef tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1188 microversion: 2.1 time: 0.097872 Nov 03 04:46:34.800617 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3429/6746] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:34 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:35.826924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:35.827489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:35.834413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:35.834902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:35.835342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:35.836037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:35.836491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:35.836918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:35.899093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:35.907019 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f65c941b-e768-4254-b3cf-d6266c7aa409 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1188 microversion: 2.1 time: 0.084113 Nov 03 04:46:35.907588 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3318/6747] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:35 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:36.930502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:36.931410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:36.938312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:36.938803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:36.939903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:36.940600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:36.941086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:36.941522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:36.972561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:36.973088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:36.973533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:36.974007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lazy-loading 'fault' on Instance uuid e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:46:37.017273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:37.021003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:37.025723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8a774e0f-d408-4e63-bad4-a0e45bb3e481 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 200 len: 1193 microversion: 2.1 time: 0.099070 Nov 03 04:46:37.026238 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3430/6748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:36 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 1193 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:38.053680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:38.054300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: e3ae3c5a-56c0-4afb-a5d7-4af6fb476539] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:38.060814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:38.067918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:38.067918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:38.067918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:38.067918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:38.067918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:38.077266 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 could not be found. Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 HTTP/1.1 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 could not be found. Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'e3ae3c5a-56c0-4afb-a5d7-4af6fb476539'} Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 could not be found. Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 could not be found. Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:46:38.078940 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 could not be found. Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65491f89-f8fd-47ea-b74c-3c0ff795e125 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539" status: 404 len: 111 microversion: 2.1 time: 0.031404 Nov 03 04:46:38.083736 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3319/6749] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:38 2022] GET /compute/v2.1/servers/e3ae3c5a-56c0-4afb-a5d7-4af6fb476539 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 04:46:44.824510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1493834414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3206ed98-f688-46a9-bdf1-3e91683ad5fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:46:44.836050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:44.884646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:46:45.583296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:46:45.583731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:46:45.584214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:46:45.584626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:46:45.585067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:46:45.594044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:45.594530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:45.595500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:45.596227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:45.596682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:45.597131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:45.614306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:46:45.619529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:46:45.677392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:46:45.679604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3206ed98-f688-46a9-bdf1-3e91683ad5fc',volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:46:46.039870 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-301fb912-d5c2-4305-91cb-d5744cde90df tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219247 Nov 03 04:46:46.040475 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3431/6750] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:46:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 04:46:46.052109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f120a042-1db3-41f1-81be-a33b45290d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:46.052726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f120a042-1db3-41f1-81be-a33b45290d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:46.166190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f120a042-1db3-41f1-81be-a33b45290d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:46.175344 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f120a042-1db3-41f1-81be-a33b45290d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1057 microversion: 2.1 time: 0.127670 Nov 03 04:46:46.175910 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3320/6751] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:46 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1057 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:47.199693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:47.200212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:47.207015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:47.207499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:47.207962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:47.208654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:47.209203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:47.209635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:47.273249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:47.281270 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ea7a19e-a82f-48fa-9955-4b23207904a6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1107 microversion: 2.1 time: 0.086486 Nov 03 04:46:47.281851 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3432/6752] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:47 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1107 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:48.301518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=84 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:48.305688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:48.306299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:48.312347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:48.312921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:48.313396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:48.314103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:48.314569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:48.315003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:48.410425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:48.419255 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba4764ce-20e9-458a-b653-ad0c52c3bd7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1173 microversion: 2.1 time: 0.119448 Nov 03 04:46:48.430140 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3321/6753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:48 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1173 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:49.443939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:49.444568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:49.451887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:49.452762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:49.453452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:49.454407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:49.455084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:49.455729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:49.651046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:49.659940 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-337568db-02b0-4875-b3c1-7276cb20decf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1215 microversion: 2.1 time: 0.219870 Nov 03 04:46:49.660527 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3433/6754] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:49 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:46:49.797476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b2b41b58-9307-4675-853b-66fdfe142bcf req-a1497848-ebba-406c-ba74-de04077fa318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fe38ebd-3176-4ccd-bc45-1f2d09574946", "tag": "14ff80fb-5c8b-41ab-ae60-54042578cac4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:46:49.810567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2b41b58-9307-4675-853b-66fdfe142bcf req-a1497848-ebba-406c-ba74-de04077fa318 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:49.811421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2b41b58-9307-4675-853b-66fdfe142bcf req-a1497848-ebba-406c-ba74-de04077fa318 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:49.811976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2b41b58-9307-4675-853b-66fdfe142bcf req-a1497848-ebba-406c-ba74-de04077fa318 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:49.824669 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b2b41b58-9307-4675-853b-66fdfe142bcf req-a1497848-ebba-406c-ba74-de04077fa318 service nova] Creating event network-changed:14ff80fb-5c8b-41ab-ae60-54042578cac4 for instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 on n-h2-854653-7 Nov 03 04:46:49.831121 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b2b41b58-9307-4675-853b-66fdfe142bcf req-a1497848-ebba-406c-ba74-de04077fa318 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037753 Nov 03 04:46:49.831897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3322/6755] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:46:50.684092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:50.684709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:50.691510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:50.692052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:50.692561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:50.693367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:50.694107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:50.694608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:50.823593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:50.831484 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d6404f54-b0ac-4ab9-aec1-5831115d7c12 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1215 microversion: 2.1 time: 0.151566 Nov 03 04:46:50.832049 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3434/6756] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:50 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1215 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:51.855898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:51.856599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:51.862824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:51.863306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:51.863754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:51.864435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:51.864891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:51.865346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:51.997590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:52.005778 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a726d22-baa4-4681-b1c8-db2f08871e7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1215 microversion: 2.1 time: 0.155034 Nov 03 04:46:52.006451 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3323/6757] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:51 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:53.029721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:53.030362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:53.038243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:53.038738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:53.039182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:53.039898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:53.040358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:53.040782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:53.178865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:53.186544 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-330b8f02-afec-4005-ba5e-4f2e79b28d21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1215 microversion: 2.1 time: 0.160788 Nov 03 04:46:53.187115 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3435/6758] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:53 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:54.209561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:54.210104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:54.213659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=30 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:54.218506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:54.221805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:54.221805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:54.221805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:54.221805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:54.221805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:54.350160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:54.358140 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dbf0ede4-dac0-4a5c-9381-c9edf26147e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.152618 Nov 03 04:46:54.358702 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3324/6759] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:54 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:55.381450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:55.382100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:55.388994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:55.389506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:55.389949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:55.390647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:55.391107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:55.391540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:55.523803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:55.531517 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cd5bf755-8693-4ba6-9442-b394b499528d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.154080 Nov 03 04:46:55.532621 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3436/6760] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:55 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:56.555069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:56.555687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:56.558098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:56.562841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:56.563914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:56.564359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:56.565069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:56.565577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:56.566003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:56.696239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:56.703967 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7175cddb-96f4-4f37-ac3e-723a20dd1654 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.152992 Nov 03 04:46:56.704537 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3325/6761] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:56 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:57.726721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:57.727374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:57.729252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:57.729933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:46:57.735655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:57.736181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:57.736632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:57.737375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:57.740710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:57.740710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:57.869733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:57.878080 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c83cce0b-bf14-4eec-ad28-450a74e8d455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.155407 Nov 03 04:46:57.878682 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3437/6762] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:57 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:46:58.900735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:46:58.901299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:46:58.909001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:58.909526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:58.909998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:58.910700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:46:58.911155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:46:58.911641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:46:59.041005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:46:59.048665 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0c3e0e0f-9eb3-4668-8259-7079971c4be6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.152010 Nov 03 04:46:59.049283 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3326/6763] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:46:58 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:00.072035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:00.073230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:00.080223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:00.080713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:00.081261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:00.081964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:00.082425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:00.082860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:00.211221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:00.218837 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ed03892-29a4-4358-84bc-ea2f7b654955 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.150866 Nov 03 04:47:00.219446 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3438/6764] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:00 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:01.242098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:01.242738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:01.249624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:01.250146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:01.250589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:01.251296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:01.251761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:01.252196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:01.387967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:01.396542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-310e96cb-a515-4ef3-83a9-219975f1f61b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.158378 Nov 03 04:47:01.397140 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3327/6765] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:01 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:02.419275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:02.419905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:02.426857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:02.427349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:02.427799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:02.428503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:02.428965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:02.429428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:02.558562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:02.566249 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a1c8a45-1354-4f19-b83b-574f6a267f21 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.150930 Nov 03 04:47:02.566839 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3439/6766] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:02 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:02.976273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-fae56a9c-5f42-4dd0-8a57-088b31325923 req-2c8c7567-91e5-4fe4-a46b-b966d701f44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe38ebd-3176-4ccd-bc45-1f2d09574946", "name": "network-vif-plugged", "status": "completed", "tag": "14ff80fb-5c8b-41ab-ae60-54042578cac4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:47:02.986692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fae56a9c-5f42-4dd0-8a57-088b31325923 req-2c8c7567-91e5-4fe4-a46b-b966d701f44a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:02.987172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fae56a9c-5f42-4dd0-8a57-088b31325923 req-2c8c7567-91e5-4fe4-a46b-b966d701f44a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:02.987611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fae56a9c-5f42-4dd0-8a57-088b31325923 req-2c8c7567-91e5-4fe4-a46b-b966d701f44a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:02.998420 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-fae56a9c-5f42-4dd0-8a57-088b31325923 req-2c8c7567-91e5-4fe4-a46b-b966d701f44a service nova] Creating event network-vif-plugged:14ff80fb-5c8b-41ab-ae60-54042578cac4 for instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 on n-h2-854653-7 Nov 03 04:47:03.004017 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-fae56a9c-5f42-4dd0-8a57-088b31325923 req-2c8c7567-91e5-4fe4-a46b-b966d701f44a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Nov 03 04:47:03.004402 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3328/6767] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:47:03.589517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:03.590190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:03.597536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:03.598020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:03.598455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:03.599149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:03.599607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:03.600036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:03.729479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:03.737708 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91300488-882a-482c-901c-dd4e24d561bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1203 microversion: 2.1 time: 0.152376 Nov 03 04:47:03.738274 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3440/6768] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:03 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:04.764217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:04.765069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:04.772049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:04.772510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:04.772950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:04.773673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:04.774130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:04.774554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:04.915645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:04.924404 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38902d81-3053-4051-b819-658329cc745c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1390 microversion: 2.1 time: 0.168242 Nov 03 04:47:04.924990 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3329/6769] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:04 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:04.949854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:04.950480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:04.957626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:04.958643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:04.959128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:04.959841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:04.960303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:04.960738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:05.104923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:05.114129 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c78c4d73-af24-449b-b400-ecde6e7b8600 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1390 microversion: 2.1 time: 0.168233 Nov 03 04:47:05.114716 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3441/6770] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:04 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:05.138505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:05.139134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:05.145484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:05.145980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:05.146430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:05.147135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:05.147601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:05.148041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:05.284073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:05.292110 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20ec66ba-be3d-4a66-abfe-d58739ac166a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1390 microversion: 2.1 time: 0.157560 Nov 03 04:47:05.292679 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3330/6771] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:05 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:05.315829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:05.316254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:05.322278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:05.322830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:05.323276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:05.323970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:05.324432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:05.325148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:05.351756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:47:05.656230 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-645206f1-ae46-418c-9276-eabd5d91c601 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 204 len: 0 microversion: 2.1 time: 0.344136 Nov 03 04:47:05.657591 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3442/6772] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:47:05 2022] DELETE /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:47:05.666018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:05.666670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:05.672705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:05.673231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:05.673674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:05.674364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:05.674822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:05.675248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:05.808304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:05.816501 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6bc1fc79-eecb-4a0c-8148-6f9d96fbf89c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1396 microversion: 2.1 time: 0.154373 Nov 03 04:47:05.817087 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3331/6773] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:05 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:06.841052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:06.841768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:06.849194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:06.849687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:06.850130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:06.850832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:06.851296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:06.851726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:06.980102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:06.988393 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e1be01cf-f758-47f2-b212-b33633ce2e58 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1396 microversion: 2.1 time: 0.151753 Nov 03 04:47:06.988965 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3443/6774] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:06 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1396 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:07.763690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e67e00e5-05c9-47cd-84d3-11491f882003 req-83674799-e966-4350-97c2-9561eecd866b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fe38ebd-3176-4ccd-bc45-1f2d09574946", "name": "network-vif-deleted", "tag": "14ff80fb-5c8b-41ab-ae60-54042578cac4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:47:07.776842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e67e00e5-05c9-47cd-84d3-11491f882003 req-83674799-e966-4350-97c2-9561eecd866b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:07.777367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e67e00e5-05c9-47cd-84d3-11491f882003 req-83674799-e966-4350-97c2-9561eecd866b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:07.777806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e67e00e5-05c9-47cd-84d3-11491f882003 req-83674799-e966-4350-97c2-9561eecd866b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:07.791005 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e67e00e5-05c9-47cd-84d3-11491f882003 req-83674799-e966-4350-97c2-9561eecd866b service nova] Creating event network-vif-deleted:14ff80fb-5c8b-41ab-ae60-54042578cac4 for instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 on n-h2-854653-7 Nov 03 04:47:07.796310 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e67e00e5-05c9-47cd-84d3-11491f882003 req-83674799-e966-4350-97c2-9561eecd866b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037762 Nov 03 04:47:07.797008 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3332/6775] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:47:08.012164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:08.012793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:08.020830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:08.021527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:08.021988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:08.022703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:08.023171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:08.023608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:08.086469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:08.094699 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4dab2fca-82ba-4835-8200-7c063f539e1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1188 microversion: 2.1 time: 0.086721 Nov 03 04:47:08.095285 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3444/6776] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:08 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:09.118235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:09.118846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:09.126634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:09.127120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:09.127600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:09.128255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:09.128711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:09.129168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:09.192616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:09.200678 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a8148771-4560-4db9-bb83-b90d1fdd2fd7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1188 microversion: 2.1 time: 0.086946 Nov 03 04:47:09.201288 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3333/6777] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:09 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:10.223003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:10.223677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:10.230620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:10.231124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:10.231573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:10.232298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:10.232760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:10.233251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:10.304858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:10.313563 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5823d98-b715-437a-9175-36419cc744ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1188 microversion: 2.1 time: 0.094061 Nov 03 04:47:10.314392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3445/6778] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:10 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:11.337187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:11.337885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:11.345670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:11.346164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:11.346610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:11.347314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:11.347785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:11.348244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:11.410388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:11.418446 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c797ee21-920d-451d-a242-e7d9dea8e981 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1188 microversion: 2.1 time: 0.085550 Nov 03 04:47:11.419023 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3334/6779] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:11 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:12.441231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:12.441849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:12.448607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:12.449126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:12.449569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:12.450274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:12.450735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:12.451171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:12.469920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:47:12.482218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:12.483225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:12.483225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:12.483628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lazy-loading 'fault' on Instance uuid 1fe38ebd-3176-4ccd-bc45-1f2d09574946 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:47:12.525217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:12.533051 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e5c4f10-e6d1-41bf-9e9d-479845fe5b7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 200 len: 1193 microversion: 2.1 time: 0.095714 Nov 03 04:47:12.534135 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3446/6780] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:12 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:13.555795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:13.556417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 1fe38ebd-3176-4ccd-bc45-1f2d09574946] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:13.563250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:13.563737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:13.564178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:13.564867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:13.565348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:13.565777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:13.579507 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 could not be found. Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 HTTP/1.1 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 could not be found. Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '1fe38ebd-3176-4ccd-bc45-1f2d09574946'} Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 could not be found. Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 could not be found. Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:47:13.581721 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 could not be found. Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 1fe38ebd-3176-4ccd-bc45-1f2d09574946 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1244918-476d-4de8-bf13-a1256bb24937 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946" status: 404 len: 111 microversion: 2.1 time: 0.031256 Nov 03 04:47:13.586700 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3335/6781] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:13 2022] GET /compute/v2.1/servers/1fe38ebd-3176-4ccd-bc45-1f2d09574946 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:47:40.714516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-626508268", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "1ed3e19e-5b49-456d-a2fc-ac3a6b5267dd", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:47:40.725230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:47:40.806679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:47:41.231269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:47:41.231695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:47:41.232224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:47:41.232580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:47:41.232994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:47:41.243751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:41.244228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:41.244667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:41.245422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:41.245879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:41.246306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:41.262533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:47:41.267727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:47:41.280051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:47:41.282104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1ed3e19e-5b49-456d-a2fc-ac3a6b5267dd',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:47:41.417508 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9daeecd-72fb-48cd-9468-f4c7ae429426 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706984 Nov 03 04:47:41.418164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3447/6782] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:47:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:47:41.430126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4eb7f1e8-0f01-43b8-9952-df3a5ad680e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:41.430803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4eb7f1e8-0f01-43b8-9952-df3a5ad680e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:41.433386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=23 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:47:41.434212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=74 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:47:41.435224 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:47:41.435377 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 (ip 10.222.0.30) !!! Nov 03 04:47:41.496883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4eb7f1e8-0f01-43b8-9952-df3a5ad680e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:41.504125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4eb7f1e8-0f01-43b8-9952-df3a5ad680e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1056 microversion: 2.1 time: 0.078570 Nov 03 04:47:41.504708 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3336/6783] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:41 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1056 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:42.528210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:42.528840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:42.536601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:42.537114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:42.537583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:42.538279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:42.538793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:42.539223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:42.604491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:42.612370 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6588bb16-8b3c-4cc6-b1aa-7dbe69734a25 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1060 microversion: 2.1 time: 0.089354 Nov 03 04:47:42.613153 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3448/6784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:42 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1060 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:43.635521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:43.641478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:43.643350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:43.643890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:43.644837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:43.645629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:43.646102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:43.646531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:43.721134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:43.730925 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c61fa78b-e805-4230-bf9c-1e41641cb4ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1126 microversion: 2.1 time: 0.099286 Nov 03 04:47:43.731509 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3337/6785] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:43 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1126 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:44.754241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:44.756662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:44.762761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:44.763272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:44.764436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:44.765827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:44.765827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:44.766420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:44.992557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:45.000553 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c26eb63b-0040-4f16-85df-0377fc3a114c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.250908 Nov 03 04:47:45.001172 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3449/6786] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:44 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:45.266977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7ba407e3-9cba-4787-9a13-4deacef3dd1c req-4bc1da62-45a7-4dc8-834c-2f01018c2d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc1429e-f049-47ab-99cf-9600cbc278c1", "tag": "27b33c50-e6f1-4cf1-ae61-eaff15413815"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:47:45.279015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7ba407e3-9cba-4787-9a13-4deacef3dd1c req-4bc1da62-45a7-4dc8-834c-2f01018c2d31 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:45.279578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7ba407e3-9cba-4787-9a13-4deacef3dd1c req-4bc1da62-45a7-4dc8-834c-2f01018c2d31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:45.285588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7ba407e3-9cba-4787-9a13-4deacef3dd1c req-4bc1da62-45a7-4dc8-834c-2f01018c2d31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:45.291349 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7ba407e3-9cba-4787-9a13-4deacef3dd1c req-4bc1da62-45a7-4dc8-834c-2f01018c2d31 service nova] Creating event network-changed:27b33c50-e6f1-4cf1-ae61-eaff15413815 for instance ecc1429e-f049-47ab-99cf-9600cbc278c1 on n-h2-854653-7 Nov 03 04:47:45.296214 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7ba407e3-9cba-4787-9a13-4deacef3dd1c req-4bc1da62-45a7-4dc8-834c-2f01018c2d31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033080 Nov 03 04:47:45.296999 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3338/6787] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:47:46.024081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:46.024712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:46.031949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:46.032446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:46.032942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:46.033634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:46.034099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:46.035079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:46.178527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:46.181990 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cdcdde63-07fc-4364-9de0-7575de78260e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.161832 Nov 03 04:47:46.182576 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3450/6788] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:46 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:47.206459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:47.207175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:47.213451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:47.213942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:47.214389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:47.215087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:47.215549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:47.215977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:47.348772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:47.356460 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0df255d7-191a-4abd-9415-d51da07cc6aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.155224 Nov 03 04:47:47.357291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3339/6789] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:47 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:48.380899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:48.381593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:48.389049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:48.389615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:48.390085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:48.390797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:48.391249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:48.391697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:48.526584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:48.535370 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-418e6ccc-3475-4732-aa8b-4d2688ebef05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.159119 Nov 03 04:47:48.535975 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3451/6790] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:48 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:49.559354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:49.559973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:49.567984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:49.568479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:49.568921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:49.569679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:49.570147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:49.570632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:49.705888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:49.713679 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b10baebf-4531-4360-932e-9b35558e8c7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.158290 Nov 03 04:47:49.714258 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3340/6791] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:49 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:50.739928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:50.741106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:50.747768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:50.749211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:50.749211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:50.753556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:50.753556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:50.753556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:50.886138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:50.894377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0099370-fd2a-4358-a8ba-2360c09a04d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.158632 Nov 03 04:47:50.894974 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3452/6792] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:50 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:51.922467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:51.923469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:51.926569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:47:51.931445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:51.931937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:51.933356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:51.933356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:51.933626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:51.934057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:52.075441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:52.084547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-34337cae-6d36-45da-8cca-af5f2289d239 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.166995 Nov 03 04:47:52.085560 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3341/6793] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:51 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:53.112481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:53.113150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:53.115329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:47:53.116000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:47:53.121838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:53.122289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:53.122732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:53.123429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:53.123886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:53.124318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:53.263793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:53.272093 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb9fb9c4-41a7-448e-9752-238a8fb8ebad tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.163647 Nov 03 04:47:53.272654 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3453/6794] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:53 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:54.296378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:54.296993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:54.305095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:54.305095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:54.305414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:54.306020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:54.306522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:54.307244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:54.447481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:54.455299 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ea09abb-7856-4826-a910-bfb08f6202e1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.162956 Nov 03 04:47:54.455881 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3342/6795] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:54 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:55.479244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:55.479866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:55.486704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:55.487190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:55.487635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:55.488389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:55.488919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:55.489268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:55.635724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:55.647197 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85651eef-0206-4e52-8a5f-7b121152dc02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.172439 Nov 03 04:47:55.647778 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3454/6796] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:55 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:56.675478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:56.676107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:56.683598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:56.684077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:56.684515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:56.686786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:56.686786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:56.686786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:56.830656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:56.840908 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-abddb2c7-da48-47f8-a8f6-5d5740a5888a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.169668 Nov 03 04:47:56.841853 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3343/6797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:56 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:57.864177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:57.864798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:57.872362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:57.872849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:57.873318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:57.874019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:57.874477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:57.874907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:58.009155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:58.017167 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d46b940b-6189-4f3a-9e83-c5606e350ac2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.157204 Nov 03 04:47:58.022293 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3455/6798] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:57 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:47:59.040404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:47:59.041898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:47:59.049387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:59.059332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:59.059332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:59.059332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:47:59.059332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:47:59.059332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:47:59.188360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:47:59.198069 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-840181f8-9a32-48ad-9288-ecf6184e1202 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.161181 Nov 03 04:47:59.198652 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3344/6799] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:47:59 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:00.223746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:00.224421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:00.232037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:00.232526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:00.232980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:00.233911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:00.234468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:00.234899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:00.364542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:00.373049 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce7057d5-4f45-42c3-a9b5-4967022808be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.153379 Nov 03 04:48:00.373629 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3456/6800] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:00 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:01.399827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:01.400454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:01.408054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:01.408517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:01.408961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:01.409681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:01.410138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:01.410573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:01.874415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:01.882319 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f8dda601-8956-4392-94dd-668d93e4607b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.486681 Nov 03 04:48:01.882903 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3345/6801] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:01 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:02.906690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:02.907225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:02.914367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:02.914855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:02.915660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:02.915996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:02.916454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:02.916885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:03.046371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:03.054406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3bef2a42-b864-46c2-949b-aa806928a3f5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.152291 Nov 03 04:48:03.054982 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3457/6802] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:02 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:04.078533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:04.079160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:04.086327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:04.086825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:04.087326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:04.088032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:04.088491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:04.088930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:04.224374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:04.232800 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de499058-396d-4616-886b-5192149fa0ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.158798 Nov 03 04:48:04.233409 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3346/6803] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:04 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:05.255825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:05.256485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:05.264116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:05.264610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:05.265090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:05.265798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:05.266289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:05.266695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:05.400801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:05.409182 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a12a8c4e-f400-47b7-8547-5b4a9eb0ac79 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.157307 Nov 03 04:48:05.409771 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3458/6804] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:05 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:48:06.432280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:06.432873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:06.440102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:06.440600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:06.441068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:06.441882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:06.442355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:06.442791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:06.575956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:06.584009 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-303e217e-1404-4b9c-a248-c22f73596982 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.156051 Nov 03 04:48:06.584591 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3347/6805] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:06 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:07.611016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:07.612064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:07.619711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:07.620210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:07.621288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:07.622051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:07.622508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:07.622937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:07.755916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:07.764388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53847a49-f687-4e59-b31d-a60fce65b945 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.160669 Nov 03 04:48:07.764956 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3459/6806] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:07 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:08.787538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:08.788163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:08.794920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:08.795411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:08.795854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:08.796560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:08.797037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:08.797474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:08.932805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:08.940828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc870328-76f9-418a-b0f9-e74724b36ad6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.157192 Nov 03 04:48:08.947043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3348/6807] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:08 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:09.968364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:09.968989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:09.976329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:09.976829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:09.977326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:09.978034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:09.978500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:09.978936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:10.117288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:10.124802 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a68f9a13-e87c-43ad-9a07-3e75137aa6be tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1168 microversion: 2.1 time: 0.160964 Nov 03 04:48:10.125408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3460/6808] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:09 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:11.147814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:11.148336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:11.155175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:11.159255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:11.159255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:11.159255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:11.159255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:11.159255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:11.290757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:11.298581 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9b39606e-7ee5-450f-9dff-79d2f3cf7f2d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1214 microversion: 2.1 time: 0.155206 Nov 03 04:48:11.299158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3349/6809] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:11 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1214 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:12.321467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:12.322094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:12.324821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:48:12.329717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:12.330210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:12.330661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:12.331366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:12.331834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:12.332269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:12.334875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=85 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:48:12.466768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:12.474632 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d5bea8dc-eb85-45f1-88cc-5dc829dd4b1f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.157136 Nov 03 04:48:12.475204 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3461/6810] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:12 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:13.499009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:13.499624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:13.502402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=31 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:48:13.507256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:13.507748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:13.508183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:13.508875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:13.509352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:13.509776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:13.512822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=75 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:48:13.640939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:13.649127 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0293cfde-c35e-450d-973e-edfbdf3fbd17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.154329 Nov 03 04:48:13.649710 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3350/6811] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:13 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:14.671991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:14.672605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:14.679253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:14.679735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:14.680170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:14.680868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:14.681351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:14.681783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:14.812723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:14.820475 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-64bb26ff-4e47-4a4d-9482-bc7ee8199d8d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.152997 Nov 03 04:48:14.821066 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3462/6812] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:14 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:15.844669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:15.845372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:15.852413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:15.852914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:15.853382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:15.854082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:15.854540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:15.854969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:15.982142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:15.989935 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-97a6983c-1e0f-470a-a699-4dcbb8307750 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.149880 Nov 03 04:48:15.990510 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3351/6813] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:15 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:17.014135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:17.014764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:17.022002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:17.022500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:17.022952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:17.023664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:17.024134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:17.024572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:17.155531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:17.163412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eb81f39a-854a-4aa2-9a54-3c5be4a31346 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.153745 Nov 03 04:48:17.163982 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3463/6814] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:17 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:18.186510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:18.187061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:18.193927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:18.194417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:18.194857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:18.195549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:18.196010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:18.196448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:18.326664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:18.334468 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f126d842-e98b-44d6-83f5-dc800a3ce349 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.151981 Nov 03 04:48:18.335043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3352/6815] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:18 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:19.358435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:19.359063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:19.365982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:19.366478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:19.366930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:19.367644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:19.368111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:19.368550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:19.502616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:19.510345 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4bee1ae-3db6-4264-bf8e-be0c7a6030f4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.156418 Nov 03 04:48:19.510922 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3464/6816] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:19 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:20.533890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:20.534522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:20.541472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:20.541983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:20.542430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:20.543186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:20.544195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:20.544636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:20.678891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:20.686700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-08ac89c7-0f43-401f-97c9-60a2cbac3394 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.156760 Nov 03 04:48:20.687264 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3353/6817] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:20 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:21.370739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dfb5dc07-3833-400f-ba1b-70b3b40f9564 req-3ba1cf94-ac2f-401d-b6af-d9c9afc2a349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc1429e-f049-47ab-99cf-9600cbc278c1", "name": "network-vif-plugged", "status": "completed", "tag": "27b33c50-e6f1-4cf1-ae61-eaff15413815"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:48:21.381687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dfb5dc07-3833-400f-ba1b-70b3b40f9564 req-3ba1cf94-ac2f-401d-b6af-d9c9afc2a349 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:21.382174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dfb5dc07-3833-400f-ba1b-70b3b40f9564 req-3ba1cf94-ac2f-401d-b6af-d9c9afc2a349 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:21.382685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dfb5dc07-3833-400f-ba1b-70b3b40f9564 req-3ba1cf94-ac2f-401d-b6af-d9c9afc2a349 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:21.394437 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dfb5dc07-3833-400f-ba1b-70b3b40f9564 req-3ba1cf94-ac2f-401d-b6af-d9c9afc2a349 service nova] Creating event network-vif-plugged:27b33c50-e6f1-4cf1-ae61-eaff15413815 for instance ecc1429e-f049-47ab-99cf-9600cbc278c1 on n-h2-854653-7 Nov 03 04:48:21.399851 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dfb5dc07-3833-400f-ba1b-70b3b40f9564 req-3ba1cf94-ac2f-401d-b6af-d9c9afc2a349 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032999 Nov 03 04:48:21.400458 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3465/6818] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:48:21.709622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:21.710169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:21.717335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:21.717826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:21.718272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:21.718969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:21.719429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:21.719861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:21.852521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:21.860837 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27ded1cd-8761-4418-a196-6e22534eb0f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.155234 Nov 03 04:48:21.861439 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3354/6819] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:21 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:22.884394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:22.885143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:22.892708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:22.893249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:22.893985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:22.894717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:22.895189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:22.895630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:23.031001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:23.039001 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e0a06b0-708a-4d91-be6f-b064fad093ac tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1202 microversion: 2.1 time: 0.158936 Nov 03 04:48:23.039602 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3466/6820] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:22 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:24.061971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:24.062599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:24.069483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.069978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.070422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.071118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.071658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.072091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.204279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:24.212121 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-77514853-c1ac-4bfb-85f7-6f13cbc63904 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1389 microversion: 2.1 time: 0.154168 Nov 03 04:48:24.212700 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3355/6821] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:24 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:24.234027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:24.234656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:24.241450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.241941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.242386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.243085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.243545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.243980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.376899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:24.384680 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d952395-76f0-491b-9525-85e24156b81d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1389 microversion: 2.1 time: 0.154593 Nov 03 04:48:24.385287 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3467/6822] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:24 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:24.407322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:24.407979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:24.414012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.414495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.414935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.415627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.416088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.416517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.547215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:24.555046 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f29e6ba6-5ccf-4914-9ceb-ff7bacf2b283 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1389 microversion: 2.1 time: 0.151675 Nov 03 04:48:24.555654 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3356/6823] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:24 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:24.637217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:24.637813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:24.644107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.644602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.645104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.645816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.646312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.646744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.671592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:48:24.939758 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dcad8ca3-1169-43f3-ad73-21b4d48c974e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 204 len: 0 microversion: 2.1 time: 0.306258 Nov 03 04:48:24.940368 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3468/6824] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:48:24 2022] DELETE /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:48:24.948645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:24.949321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:24.955377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.955858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.956296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:24.956983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:24.957465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:24.957893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:25.093448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:25.101228 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6df8e315-ee70-4c43-9a30-ed17527233ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1395 microversion: 2.1 time: 0.156531 Nov 03 04:48:25.101803 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3357/6825] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:24 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:26.125799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:26.126549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:26.133358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:26.133851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:26.134301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:26.135004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:26.135467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:26.135900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:26.264459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:26.272629 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-069851ec-1383-4b5b-b8f3-c07032ced92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1395 microversion: 2.1 time: 0.151824 Nov 03 04:48:26.273236 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3469/6826] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:26 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1395 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:27.142737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d6f85eb3-d4f0-4193-b084-3df4b2afa094 req-2c55375e-4bed-410a-82c2-adfd3297093d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc1429e-f049-47ab-99cf-9600cbc278c1", "name": "network-vif-deleted", "tag": "27b33c50-e6f1-4cf1-ae61-eaff15413815"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:48:27.153049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d6f85eb3-d4f0-4193-b084-3df4b2afa094 req-2c55375e-4bed-410a-82c2-adfd3297093d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:27.153507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d6f85eb3-d4f0-4193-b084-3df4b2afa094 req-2c55375e-4bed-410a-82c2-adfd3297093d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:27.153941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d6f85eb3-d4f0-4193-b084-3df4b2afa094 req-2c55375e-4bed-410a-82c2-adfd3297093d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:27.166508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d6f85eb3-d4f0-4193-b084-3df4b2afa094 req-2c55375e-4bed-410a-82c2-adfd3297093d service nova] Creating event network-vif-deleted:27b33c50-e6f1-4cf1-ae61-eaff15413815 for instance ecc1429e-f049-47ab-99cf-9600cbc278c1 on n-h2-854653-7 Nov 03 04:48:27.171644 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d6f85eb3-d4f0-4193-b084-3df4b2afa094 req-2c55375e-4bed-410a-82c2-adfd3297093d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111615 Nov 03 04:48:27.172253 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3358/6827] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:48:27.295432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:27.296059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:27.303035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:27.303528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:27.303972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:27.304680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:27.305161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:27.305586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:27.369961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:27.378323 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e54f2a75-3380-4bea-860e-85ae8156760b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1187 microversion: 2.1 time: 0.086798 Nov 03 04:48:27.378888 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3470/6828] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:27 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:28.405709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:28.406801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:28.413294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:28.413851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:28.414327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:28.415041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:28.415501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:28.415988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:28.480402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:28.488779 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6d99138-5a38-4fda-b465-87d65f687bcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1187 microversion: 2.1 time: 0.090032 Nov 03 04:48:28.489387 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3359/6829] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:28 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:48:29.511895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:29.512776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:29.520445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:29.520939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:29.521413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:29.522152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:29.522616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:29.523051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:29.592451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:29.600616 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16a50afe-10e9-4eae-844c-853d6b6ee9a3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1187 microversion: 2.1 time: 0.092659 Nov 03 04:48:29.601479 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3471/6830] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:29 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:30.624807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:30.625471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:30.632781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:30.633338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:30.633787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:30.635369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:30.635837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:30.636275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:30.702445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:30.710389 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cccb581b-6aa7-4f77-a0b2-f658ffb2d0cf tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1187 microversion: 2.1 time: 0.090515 Nov 03 04:48:30.711003 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3360/6831] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:30 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:31.734134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:31.737105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:31.741708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:31.742206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:31.742657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:31.743370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:31.743837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:31.744278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:31.776945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:31.777479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:31.778014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:31.778562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lazy-loading 'fault' on Instance uuid ecc1429e-f049-47ab-99cf-9600cbc278c1 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:48:31.823368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:48:31.836323 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0d3bbc97-9e57-45a4-bdc1-cf69ce2373f2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 200 len: 1192 microversion: 2.1 time: 0.106045 Nov 03 04:48:31.841859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3472/6832] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:31 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 1192 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:48:32.859718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:32.860371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:32.867525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:32.868012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:32.868451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:32.869176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:32.869635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:32.870066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:32.884050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 HTTP/1.1 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ecc1429e-f049-47ab-99cf-9600cbc278c1'} Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:48:32.885779 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d320f279-d76c-4d96-abf7-ad794a0f8947 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 404 len: 111 microversion: 2.1 time: 0.031921 Nov 03 04:48:32.890649 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3361/6833] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:32 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:48:35.034840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:35.035403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:35.047512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:35.047512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:35.047512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:35.047512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:35.047512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:35.047512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:35.062777 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 HTTP/1.1 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ecc1429e-f049-47ab-99cf-9600cbc278c1'} Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:48:35.064502 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:48:35.068280 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fffcef5c-f3f8-4b9e-8907-376d18edc92e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 404 len: 111 microversion: 2.1 time: 0.035596 Nov 03 04:48:35.070011 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3473/6834] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:48:35 2022] DELETE /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:48:35.075744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:48:35.077147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: ecc1429e-f049-47ab-99cf-9600cbc278c1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:48:35.084167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:35.084735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:35.085292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:35.086060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:48:35.086553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:48:35.086984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:48:35.101077 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 HTTP/1.1 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ecc1429e-f049-47ab-99cf-9600cbc278c1'} Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:48:35.102625 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance ecc1429e-f049-47ab-99cf-9600cbc278c1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b5cedbd-c153-4499-b132-c204d69d439c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1" status: 404 len: 111 microversion: 2.1 time: 0.032393 Nov 03 04:48:35.107411 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3362/6835] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:48:35 2022] GET /compute/v2.1/servers/ecc1429e-f049-47ab-99cf-9600cbc278c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:49:00.496397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-157704424", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2637af4a-a2e5-4baa-8687-0b95d33ddc95", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:49:00.507525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:00.508194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:00.712023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:49:01.079831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:49:01.080301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:49:01.080788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:49:01.081239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:49:01.081697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:49:01.090760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:01.091254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:01.092209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:01.092986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:01.093472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:01.093917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:01.111263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:49:01.116852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:49:01.174783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:49:01.177004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2637af4a-a2e5-4baa-8687-0b95d33ddc95',volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:49:01.587792 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-795dd470-d3d7-453c-b3a7-0b3942294f05 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095336 Nov 03 04:49:01.588770 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3474/6836] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:49:01.599930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf6fa0fd-8089-4be2-818a-6670699934e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:01.600551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bf6fa0fd-8089-4be2-818a-6670699934e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:01.602918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=25 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:01.603681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=65 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:01.776086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bf6fa0fd-8089-4be2-818a-6670699934e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:01.783135 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bf6fa0fd-8089-4be2-818a-6670699934e3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1070 microversion: 2.1 time: 0.187279 Nov 03 04:49:01.783706 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3363/6837] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:01 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1070 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:02.805382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1fbffa82-630c-492a-99dd-66b7722eb4d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:02.806009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1fbffa82-630c-492a-99dd-66b7722eb4d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:02.859078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1fbffa82-630c-492a-99dd-66b7722eb4d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:02.866351 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1fbffa82-630c-492a-99dd-66b7722eb4d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1070 microversion: 2.1 time: 0.064719 Nov 03 04:49:02.866861 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3475/6838] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:02 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1070 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:03.888533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:03.889178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:03.898331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:03.898937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:03.899381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:03.900081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:03.900577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:03.901008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:03.968500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:03.976298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5762a6a3-9c3f-4f5f-8442-f2cd2bed5216 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1120 microversion: 2.1 time: 0.091778 Nov 03 04:49:03.980925 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3364/6839] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:03 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1120 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:04.998944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:05.000236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:05.007930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:05.008418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:05.008860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:05.009593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:05.010061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:05.010498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:05.072788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:05.080905 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d73c7d07-d81b-4831-9403-253668a7d1d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1168 microversion: 2.1 time: 0.085921 Nov 03 04:49:05.081534 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3476/6840] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:04 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1168 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:06.114094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:06.114686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:06.121797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:06.122451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:06.123710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:06.125993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:06.125993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:06.125993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:06.195638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:06.204587 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3e58f769-aed9-4d0b-82c8-d444e940de20 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1186 microversion: 2.1 time: 0.095003 Nov 03 04:49:06.205220 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3365/6841] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:06 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:07.228007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:07.229295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:07.237279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:07.237777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:07.238270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:07.239610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:07.240079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:07.240512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:07.406407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:07.407035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6da62004-178a-4b51-9454-eef71f0e6c67 req-28e32ad7-c476-47e3-9b0c-cf4bd81c2040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5f377c-e95b-4d39-b14b-5afafbea156e", "tag": "cbf8aebb-04ae-4ffb-be02-568896281b04"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:49:07.417454 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f100802d-fc46-47a7-ae15-11f22d5d73aa tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1228 microversion: 2.1 time: 0.193351 Nov 03 04:49:07.420088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6da62004-178a-4b51-9454-eef71f0e6c67 req-28e32ad7-c476-47e3-9b0c-cf4bd81c2040 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:07.420737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6da62004-178a-4b51-9454-eef71f0e6c67 req-28e32ad7-c476-47e3-9b0c-cf4bd81c2040 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:07.421227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6da62004-178a-4b51-9454-eef71f0e6c67 req-28e32ad7-c476-47e3-9b0c-cf4bd81c2040 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:07.428321 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3477/6842] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:07 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1228 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:07.436641 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6da62004-178a-4b51-9454-eef71f0e6c67 req-28e32ad7-c476-47e3-9b0c-cf4bd81c2040 service nova] Creating event network-changed:cbf8aebb-04ae-4ffb-be02-568896281b04 for instance fb5f377c-e95b-4d39-b14b-5afafbea156e on n-h2-854653-7 Nov 03 04:49:07.442030 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6da62004-178a-4b51-9454-eef71f0e6c67 req-28e32ad7-c476-47e3-9b0c-cf4bd81c2040 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041789 Nov 03 04:49:07.442655 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3366/6843] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:49:08.442485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:08.443054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:08.449948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:08.450440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:08.451496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:08.452195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:08.452657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:08.453116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:08.590639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:08.598968 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c3be46b-07eb-4c23-ba2d-b4d2509d23bb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1228 microversion: 2.1 time: 0.160580 Nov 03 04:49:08.599765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3478/6844] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:08 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1228 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:09.623470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:09.624316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:09.630761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:09.631353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:09.631862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:09.632624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:09.633193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:09.633694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:09.764813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:09.773298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9f7c0c45-d993-435a-99e4-a2aff5db2721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1228 microversion: 2.1 time: 0.154897 Nov 03 04:49:09.773882 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3367/6845] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:09 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:10.797641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:10.798269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:10.805265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:10.805700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:10.806148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:10.806860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:10.807321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:10.807750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:10.939651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:10.947444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84b41020-90ea-4835-90cc-bff45840e057 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1228 microversion: 2.1 time: 0.154476 Nov 03 04:49:10.947955 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3479/6846] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:10 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:11.971790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:11.972416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:11.975284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:11.980093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:11.980577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:11.981040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:11.982243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:11.982710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:11.983140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:12.118792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:12.126755 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7bbb0d9-5cb1-4565-9583-2f021e405b73 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.158865 Nov 03 04:49:12.127328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3368/6847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:11 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:13.150002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:13.150647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:13.152542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:13.154135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:13.158954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:13.159434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:13.159873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:13.160690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:13.161241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:13.161671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:13.290007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:13.298253 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cc981e8-5300-4a55-83ec-43e2b64360ec tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.152219 Nov 03 04:49:13.298813 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3480/6848] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:13 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:14.321385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:14.322030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:14.329557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:14.330053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:14.330501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:14.331192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:14.331653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:14.332081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:14.464566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:14.472418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e98166b3-57d6-453a-b938-07e1a40b7178 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.154981 Nov 03 04:49:14.472985 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3369/6849] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:14 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:15.495171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:15.495789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:15.502255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:15.502759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:15.503186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:15.503882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:15.504343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:15.504778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:15.634319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:15.642818 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f46a8e94-b564-4ac8-a5ff-aab10085ce3c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.151792 Nov 03 04:49:15.643387 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3481/6850] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:15 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:16.665498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:16.666129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:16.673687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:16.674181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:16.674630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:16.675351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:16.675814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:16.676244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:16.807977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:16.816220 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-422e109a-e5f2-402e-ab2f-edd1124bf675 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.154762 Nov 03 04:49:16.816795 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3370/6851] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:16 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:17.838750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:17.839366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:17.846225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:17.846710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:17.847502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:17.848198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:17.848653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:17.849115 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:17.978670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:17.987157 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1f788c7-463b-4689-91b2-f1fe33e4618d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.152428 Nov 03 04:49:17.987724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3482/6852] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:17 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:19.010362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:19.010985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:19.018568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:19.021201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:19.021201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:19.021201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:19.021201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:19.021557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:19.153904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:19.161712 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-34c2cc77-4fbf-4c90-ac83-02e97e64aefe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.155366 Nov 03 04:49:19.162290 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3371/6853] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:19 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:20.184231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:20.184879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:20.191401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:20.191885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:20.192322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:20.193009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:20.193487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:20.193912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:20.325620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:20.333952 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abb9303f-23b3-4bf1-944c-09d31635c6f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.153856 Nov 03 04:49:20.334520 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3483/6854] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:20 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:21.357331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:21.358585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:21.365542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:21.366038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:21.366490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:21.367195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:21.367659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:21.368096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:21.440737 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:49:21.440999 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e (ip 10.222.0.30) !!! Nov 03 04:49:21.509515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:21.517907 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-911a382f-1593-4909-8d80-6653c051fee3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.165474 Nov 03 04:49:21.518531 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3372/6855] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:21 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:21.682544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-75bbedcf-995f-4039-bf9e-43fb4e2ee816 req-38e155e1-5e7d-49d9-8ec5-b9e657d107f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5f377c-e95b-4d39-b14b-5afafbea156e", "name": "network-vif-plugged", "status": "completed", "tag": "cbf8aebb-04ae-4ffb-be02-568896281b04"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:49:21.689728 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:49:21.689878 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 04:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 03 04:49:21.699281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-75bbedcf-995f-4039-bf9e-43fb4e2ee816 req-38e155e1-5e7d-49d9-8ec5-b9e657d107f8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:21.699771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-75bbedcf-995f-4039-bf9e-43fb4e2ee816 req-38e155e1-5e7d-49d9-8ec5-b9e657d107f8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:21.700213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-75bbedcf-995f-4039-bf9e-43fb4e2ee816 req-38e155e1-5e7d-49d9-8ec5-b9e657d107f8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:21.711376 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-75bbedcf-995f-4039-bf9e-43fb4e2ee816 req-38e155e1-5e7d-49d9-8ec5-b9e657d107f8 service nova] Creating event network-vif-plugged:cbf8aebb-04ae-4ffb-be02-568896281b04 for instance fb5f377c-e95b-4d39-b14b-5afafbea156e on n-h2-854653-7 Nov 03 04:49:21.716468 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-75bbedcf-995f-4039-bf9e-43fb4e2ee816 req-38e155e1-5e7d-49d9-8ec5-b9e657d107f8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037778 Nov 03 04:49:21.717093 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3484/6856] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:49:22.547779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:22.548391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:22.555405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:22.555890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:22.556329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:22.557034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:22.557512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:22.557944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:22.684822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:22.692550 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a37919f-dda8-43d2-8076-c9fed9239a5d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1216 microversion: 2.1 time: 0.149304 Nov 03 04:49:22.693147 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3373/6857] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:22 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:23.716916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:23.717668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:23.724396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:23.724875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:23.725348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:23.726040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:23.726497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:23.726926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:23.858581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:23.866945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-539f79bd-9a6e-4fc1-8d3b-a6e9ada1b2e0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1403 microversion: 2.1 time: 0.155227 Nov 03 04:49:23.875875 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3485/6858] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:23 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:23.890063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:23.890629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:23.897894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:23.901156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:23.901156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:23.901156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:23.901156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:23.901156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:24.034943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:24.042822 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-15b350b0-58ac-4347-bd4f-4926874a0350 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1403 microversion: 2.1 time: 0.156785 Nov 03 04:49:24.043389 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3374/6859] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:23 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:24.065584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-32432034"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:49:24.067951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:24.073957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:24.077234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:24.077234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:24.077234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:24.077234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:24.077234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:24.167403 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Attempting to quiesce instance before volume snapshot. Nov 03 04:49:24.230929 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Nov 03 04:49:24.430219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Creating snapshot from volume 2637af4a-a2e5-4baa-8687-0b95d33ddc95. {{(pid=127594) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Nov 03 04:49:25.875252 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8835840b-9349-475a-9ce6-0bad3a6bff40 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e/action" status: 202 len: 0 microversion: 2.1 time: 1.813563 Nov 03 04:49:25.876248 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3486/6860] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 04:49:24 2022] POST /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e/action => generated 0 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 04:49:27.029977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-2044837053", "imageRef": "57ccf24c-d5fa-4899-b68b-36046216aa7d", "flavorRef": "452", "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:49:27.086619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:49:27.533851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:49:27.534279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:49:27.534781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:49:27.535192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:49:27.535606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:49:27.544264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:27.544749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:27.545223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:27.545945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:27.546400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:27.546825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:27.563813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:49:27.569632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:49:27.581725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:49:27.584266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b8514c10-2f26-4092-a26e-5884a44d3ef1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:49:27.733460 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0b594bc2-646b-4eaf-9600-d7c63099e23f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707298 Nov 03 04:49:27.734237 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3375/6861] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:49:27.747493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa8c32d6-1552-43ee-9449-5fc0f28ac02b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:27.748217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa8c32d6-1552-43ee-9449-5fc0f28ac02b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:27.804085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa8c32d6-1552-43ee-9449-5fc0f28ac02b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:27.811797 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa8c32d6-1552-43ee-9449-5fc0f28ac02b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1230 microversion: 2.1 time: 0.069441 Nov 03 04:49:27.812373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3487/6862] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:27 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1230 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:28.835612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:28.836582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:28.842608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:28.843108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:28.843586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:28.844297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:28.844761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:28.845253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:28.907747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:28.915796 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f19294a-d4b2-4bd0-a577-663304fff520 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1234 microversion: 2.1 time: 0.084989 Nov 03 04:49:28.916584 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3376/6863] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:28 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:29.939149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:29.939807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:29.947627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:29.948132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:29.948585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:29.949326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:29.949795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:29.950238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:30.046955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:30.055019 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17af1a87-4ea5-4145-b9ec-ef71113c5472 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1300 microversion: 2.1 time: 0.119783 Nov 03 04:49:30.055589 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3488/6864] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:29 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:31.080461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:31.082038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:31.089409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:31.089960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:31.090402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:31.091135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:31.091597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:31.092023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:31.307566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:31.315775 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73bc6b68-1ac9-45db-bf58-455dbf9b6e90 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.240254 Nov 03 04:49:31.316372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3377/6865] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:31 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:32.227247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dfb1dacf-fa0f-43b3-9887-11b732677501 req-595007cc-e13e-4813-a18f-92fb10678179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e122fd8-65b5-4e45-895d-52bd62047163", "tag": "7f21e6f8-d8fc-4bf1-bb8e-1ace2ffcf440"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:49:32.232227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:32.254723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dfb1dacf-fa0f-43b3-9887-11b732677501 req-595007cc-e13e-4813-a18f-92fb10678179 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:32.256697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dfb1dacf-fa0f-43b3-9887-11b732677501 req-595007cc-e13e-4813-a18f-92fb10678179 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:32.256697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dfb1dacf-fa0f-43b3-9887-11b732677501 req-595007cc-e13e-4813-a18f-92fb10678179 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:32.260083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:32.266170 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dfb1dacf-fa0f-43b3-9887-11b732677501 req-595007cc-e13e-4813-a18f-92fb10678179 service nova] Creating event network-changed:7f21e6f8-d8fc-4bf1-bb8e-1ace2ffcf440 for instance 4e122fd8-65b5-4e45-895d-52bd62047163 on n-h1-854653-7 Nov 03 04:49:32.271827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dfb1dacf-fa0f-43b3-9887-11b732677501 req-595007cc-e13e-4813-a18f-92fb10678179 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114023 Nov 03 04:49:32.272427 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3489/6866] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:49:32.339512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:32.340135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:32.344073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:32.349806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:32.350304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:32.351144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:32.352032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:32.352494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:32.352938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:32.357472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=77 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:32.619757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:32.628529 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96cc8cff-fdc1-4fcc-8a63-97b01435bf7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.293189 Nov 03 04:49:32.629324 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3378/6867] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:32 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:33.653646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:33.654690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:33.664288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:33.672693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:33.672693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:33.672693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:33.672693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:33.672693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:33.815717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:33.824276 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9750505c-fa85-4108-a2e7-3e6cca025dd5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.175321 Nov 03 04:49:33.824864 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3490/6868] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:33 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:34.848219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:34.848987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:34.860710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:34.861244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:34.861770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:34.862613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:34.863111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:34.863548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:35.024872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:35.033760 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9a025936-071c-4abf-9386-2faa5d4cabcb tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.189475 Nov 03 04:49:35.037125 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3379/6869] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:34 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:36.059920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:36.060581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:36.067909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:36.072026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:36.072026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:36.072026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:36.072026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:36.072026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:36.205275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:36.213930 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-92729902-76bf-4414-999b-67a3f54004d7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.158221 Nov 03 04:49:36.214559 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3491/6870] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:36 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:37.238151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:37.238932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:37.246718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:37.248881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:37.248881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:37.248881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:37.248881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:37.249282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:37.393073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:37.402936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ef3bf9f-44ca-47a4-afd9-2056dcbd13dc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.168834 Nov 03 04:49:37.403549 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3380/6871] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:37 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:38.428098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:38.428754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:38.431605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:38.436366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:38.436865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:38.437360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:38.438062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:38.438531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:38.438970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:38.579145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:38.587033 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-25dfe351-e91b-4216-9859-30006536d214 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.162909 Nov 03 04:49:38.587613 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3492/6872] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:38 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:39.614317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:39.614938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:39.617512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:39.618178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:49:39.623534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:39.624023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:39.624469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:39.625223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:39.625668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:39.628928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:39.777307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:39.784958 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7eedcf7-3556-49d6-8052-1520adc30fed tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.174594 Nov 03 04:49:39.787282 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3381/6873] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:39 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:40.810913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:40.811525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:40.819582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:40.820089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:40.820550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:40.821304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:40.821786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:40.822234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:40.965630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:40.974781 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8185e57-5b8f-40ed-865b-1b08d31f7559 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.167495 Nov 03 04:49:40.975422 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3493/6874] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:40 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:49:41.999336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:41.999956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:42.008307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:42.008800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:42.009299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:42.010019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:42.010496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:42.010946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:42.156205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:42.165714 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-003cce88-3206-4c2f-9d4e-0c7aa0f3643d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.169989 Nov 03 04:49:42.166816 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3382/6875] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:41 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:43.192095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:43.192761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:43.200153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:43.200653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:43.201135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:43.201841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:43.202308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:43.202747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:43.339392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:43.348510 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ccc221ba-2079-4835-baac-024ea9a224a4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.160378 Nov 03 04:49:43.349118 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3494/6876] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:43 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:44.372042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:44.372653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:44.379742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:44.380230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:44.380668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:44.381443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:44.381901 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:44.382329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:44.524145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:44.532137 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed76b9a6-d242-4c65-b9f0-dd4ef745da52 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.164071 Nov 03 04:49:44.532723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3383/6877] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:44 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:45.555652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:45.556282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:45.564252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:45.564655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:45.565200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:45.565970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:45.566447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:45.566897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:45.705358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:45.715719 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-edbee55d-c1f2-4b93-abf2-f2c041fc6a13 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.164279 Nov 03 04:49:45.716315 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3495/6878] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:45 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:46.740353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:46.741682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:46.748626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:46.749152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:46.749597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:46.750296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:46.750757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:46.751188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:46.892350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:46.900593 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf638437-0430-463b-be3b-647226e03add tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.164215 Nov 03 04:49:46.905561 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3384/6879] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:46 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:47.926163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:47.926798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:47.934597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:47.935229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:47.935814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:47.936718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:47.937237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:47.937682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:48.078140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:48.083880 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a20bce6b-4b8f-4150-8298-3ebe32e52be0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.161743 Nov 03 04:49:48.084498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3496/6880] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:47 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:49.107382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:49.108001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:49.114958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:49.115450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:49.115893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:49.117278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:49.117763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:49.118239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:49.266859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:49.275323 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c572c541-fd52-4645-8540-6917a91b7e04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.172015 Nov 03 04:49:49.278338 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3385/6881] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:49 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:50.299356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:50.299973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:50.307143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:50.307644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:50.308096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:50.308800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:50.309300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:50.309752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:50.445388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:50.453719 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a2241cc-ea9f-454f-be98-654619810bd6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.158425 Nov 03 04:49:50.454298 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3497/6882] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:50 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:51.477802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:51.478420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:51.485563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:51.486050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:51.486488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:51.487182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:51.487643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:51.488071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:51.622740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:51.630513 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7ac85444-81f2-470c-9f00-71c770b88f9d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.157165 Nov 03 04:49:51.631091 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3386/6883] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:51 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:52.653792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:52.654439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:52.661458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:52.661960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:52.662416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:52.663127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:52.663608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:52.664055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:52.795173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:52.802973 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8feff8a-8a19-4a6c-91c5-5159a0250d09 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.153167 Nov 03 04:49:52.803541 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3498/6884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:52 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:53.826369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:53.826992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:53.833954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:53.834446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:53.834891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:53.835592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:53.836054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:53.836484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:53.972218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:53.979999 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f97d4f14-5ddc-422e-b25a-facd1666d067 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.157568 Nov 03 04:49:53.980582 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3387/6885] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:53 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:55.003591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:55.004305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:55.011800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:55.012298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:55.012746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:55.013481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:55.013948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:55.014388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:55.151997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:55.159878 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7fddb2ae-cb19-4151-96f0-3dd3d31b7bb1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.160401 Nov 03 04:49:55.160464 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3499/6886] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:54 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:56.182186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:56.182861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:56.189699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:56.190182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:56.190619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:56.191390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:56.191854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:56.192340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:56.324634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:56.332547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e517e537-ee7d-4ffd-9a76-2cd52ee0b6fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.154430 Nov 03 04:49:56.333148 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3388/6887] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:56 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:57.355875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:57.356512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:57.363475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:57.363981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:57.364443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:57.365191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:57.365789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:57.366185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:57.502433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:57.510854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e9d958cb-6669-4f88-a01b-43fa169a0683 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.158389 Nov 03 04:49:57.511441 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3500/6888] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:57 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:58.534157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:58.534779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:58.542428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:58.542920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:58.543365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:58.544068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:58.544528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:58.544959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:58.679089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:58.686908 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ebda76cb-3a76-4f7d-9375-4b170f3f32fe tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.156671 Nov 03 04:49:58.687512 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3389/6889] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:58 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:49:59.710920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:49:59.711550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:49:59.718997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:59.719492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:59.719941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:59.720643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:49:59.721366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:49:59.721808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:49:59.851542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:49:59.859903 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50721eaf-e720-4990-af46-e7d91770d6cd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.153131 Nov 03 04:49:59.860476 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3501/6890] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:49:59 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:00.882686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:00.883299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:00.890173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:00.890667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:00.891115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:00.891865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:00.892331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:00.892764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:01.028022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:01.036326 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71748f2a-be5a-42e9-9411-d1728d59335d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.157639 Nov 03 04:50:01.036895 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3390/6891] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:00 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:02.062759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:02.063880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:02.072521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:02.073825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:02.074403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:02.075145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:02.075633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:02.076086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:02.215305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:02.223079 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abdac0c3-1a4c-4569-9468-8984d446bc24 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.165987 Nov 03 04:50:02.223884 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3502/6892] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:02 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:03.246107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:03.246757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:03.250063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=26 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:03.254830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:03.255365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:03.255808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:03.256501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:03.256955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:03.257403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:03.263873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=78 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:03.400386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:03.409587 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d4905dd0-4e55-4cbd-9f9b-3fcf3b0f67b0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.167537 Nov 03 04:50:03.410171 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3391/6893] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:03 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:04.432469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:04.433074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:04.438665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=28 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:04.443848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:04.444387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:04.444851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:04.445608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:04.446084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:04.446530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:04.452107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=80 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:04.587448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:04.596151 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02839ac9-b643-47a1-816d-5261fd63ff3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.168078 Nov 03 04:50:04.596835 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3503/6894] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:04 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:05.619791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:05.620884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:05.630997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:05.631490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:05.631961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:05.632664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:05.633151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:05.633580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:05.771042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:05.779752 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fdfddef7-21b4-41c5-b117-0e5efcd177c9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1342 microversion: 2.1 time: 0.164035 Nov 03 04:50:05.782707 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3392/6895] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:05 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:06.803577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:06.804202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:06.811215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:06.811723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:06.812184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:06.812907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:06.813416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:06.813859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:06.949426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:06.957753 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b8f10255-55bc-4251-aded-fbf104ff204e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1388 microversion: 2.1 time: 0.158157 Nov 03 04:50:06.958371 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3504/6896] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:06 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:07.989183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:07.989813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:07.997686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:08.002065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:08.002065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:08.002065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:08.002065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:08.002065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:08.140367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:08.148550 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af20e6cb-4bb4-4313-9a07-38b03631fcc5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.163699 Nov 03 04:50:08.149146 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3393/6897] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:07 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:09.174143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:09.174722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:09.181688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:09.182191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:09.183300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:09.184024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:09.184497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:09.184945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:09.317477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:09.325351 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-211e35c3-4e3a-4943-8b77-03ce5576723f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.155305 Nov 03 04:50:09.325934 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3505/6898] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:09 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:10.347653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:10.348273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:10.355862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:10.356362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:10.356879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:10.357712 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:10.358176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:10.358604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:10.489582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:10.497989 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64ac95d2-7488-4dd4-93e8-af2f5c4bed1b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.154376 Nov 03 04:50:10.498562 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3394/6899] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:10 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:11.521645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:11.522280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:11.530078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:11.533171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:11.533171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:11.533171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:11.533171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:11.533171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:11.666128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:11.673939 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1db008b1-0e3c-4e75-a64d-343d95733840 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.156551 Nov 03 04:50:11.677823 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3506/6900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:11 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:12.696874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:12.697537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:12.705105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:12.707301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:12.707301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:12.707301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:12.707301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:12.707723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:12.840593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:12.849325 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9d33768-cb3d-4859-a2a8-d4cc3f872f3b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.156347 Nov 03 04:50:12.849912 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3395/6901] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:12 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:13.873525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:13.874167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:13.881083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:13.885175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:13.885175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:13.885175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:13.885175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:13.885175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:14.016439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:14.024530 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17febe65-cf71-41a7-aab8-5ded858d71d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.155088 Nov 03 04:50:14.025181 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3507/6902] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:13 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:15.048243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:15.049512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:15.056434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:15.060682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:15.060682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:15.060682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:15.060682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:15.060682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:15.193495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:15.201237 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d0a59cef-e60f-4f87-b395-253be4e7358b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.156925 Nov 03 04:50:15.202008 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3396/6903] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:15 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:16.223854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:16.224489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:16.231082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:16.231583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:16.232036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:16.232752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:16.233275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:16.233723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:16.370921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:16.379635 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27ee3525-d4fa-4d6c-bcdd-ab9f960484e2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.159736 Nov 03 04:50:16.380237 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3508/6904] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:16 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:16.420575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-fcef29a9-027d-4780-8bdc-8b65f736cf20 req-74800c1c-e0f9-4563-a354-a72e98f071a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e122fd8-65b5-4e45-895d-52bd62047163", "name": "network-vif-plugged", "status": "completed", "tag": "7f21e6f8-d8fc-4bf1-bb8e-1ace2ffcf440"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:50:16.430689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fcef29a9-027d-4780-8bdc-8b65f736cf20 req-74800c1c-e0f9-4563-a354-a72e98f071a1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:16.433993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fcef29a9-027d-4780-8bdc-8b65f736cf20 req-74800c1c-e0f9-4563-a354-a72e98f071a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:16.433993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-fcef29a9-027d-4780-8bdc-8b65f736cf20 req-74800c1c-e0f9-4563-a354-a72e98f071a1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:16.443934 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-fcef29a9-027d-4780-8bdc-8b65f736cf20 req-74800c1c-e0f9-4563-a354-a72e98f071a1 service nova] Creating event network-vif-plugged:7f21e6f8-d8fc-4bf1-bb8e-1ace2ffcf440 for instance 4e122fd8-65b5-4e45-895d-52bd62047163 on n-h1-854653-7 Nov 03 04:50:16.449112 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-fcef29a9-027d-4780-8bdc-8b65f736cf20 req-74800c1c-e0f9-4563-a354-a72e98f071a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084631 Nov 03 04:50:16.449821 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3397/6905] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:50:17.403441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:17.404081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:17.411691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:17.415246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:17.415246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:17.415246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:17.415246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:17.415246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:17.546074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:17.553831 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77f588ae-ad21-4bdc-97e7-6ad1f18c0a62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1376 microversion: 2.1 time: 0.154380 Nov 03 04:50:17.554415 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3509/6906] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:17 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1376 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:18.578835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:18.579565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:18.586259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:18.586748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:18.587188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:18.587871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:18.588463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:18.588891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:18.723032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:18.730811 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc431ae3-0113-4248-bd0d-73f0b74395a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1563 microversion: 2.1 time: 0.157425 Nov 03 04:50:18.731470 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3398/6907] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:18 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:18.753153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:18.753927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:18.760830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:18.761429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:18.761880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:18.762588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:18.763055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:18.763529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:18.892941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:18.901794 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7843ee0a-74dd-4d76-b603-d315cf57ce7c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1563 microversion: 2.1 time: 0.152571 Nov 03 04:50:18.902373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3510/6908] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:18 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:18.982527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:18.983077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:18.989135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:18.989624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:18.990065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:18.990759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:18.991219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:18.991652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:19.018050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:50:19.319769 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9914aac-f700-4182-a148-127b7a7f5535 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 204 len: 0 microversion: 2.1 time: 0.340817 Nov 03 04:50:19.320373 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3399/6909] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:50:18 2022] DELETE /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:50:19.329675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:19.331896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:19.337283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:19.337779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:19.338227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:19.338937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:19.339404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:19.339839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:19.469433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:19.477371 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72e103eb-7132-4ee5-9cf8-1267eeb4ae7a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1569 microversion: 2.1 time: 0.152794 Nov 03 04:50:19.477945 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3511/6910] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:19 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:20.501232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:20.501942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:20.509267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:20.509757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:20.510198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:20.510893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:20.511355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:20.511782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:20.648003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:20.655985 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-858e66dc-c320-4e67-bf37-d4e7db153760 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1569 microversion: 2.1 time: 0.159084 Nov 03 04:50:20.656564 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3400/6911] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:20 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:21.418391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-646c562e-7e67-4a33-a8c9-09c2201bcbc8 req-42cce6bb-27af-442d-971b-c943ad88166d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e122fd8-65b5-4e45-895d-52bd62047163", "name": "network-vif-deleted", "tag": "7f21e6f8-d8fc-4bf1-bb8e-1ace2ffcf440"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:50:21.431132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-646c562e-7e67-4a33-a8c9-09c2201bcbc8 req-42cce6bb-27af-442d-971b-c943ad88166d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:21.433153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-646c562e-7e67-4a33-a8c9-09c2201bcbc8 req-42cce6bb-27af-442d-971b-c943ad88166d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:21.433688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-646c562e-7e67-4a33-a8c9-09c2201bcbc8 req-42cce6bb-27af-442d-971b-c943ad88166d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:21.447500 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-646c562e-7e67-4a33-a8c9-09c2201bcbc8 req-42cce6bb-27af-442d-971b-c943ad88166d service nova] Creating event network-vif-deleted:7f21e6f8-d8fc-4bf1-bb8e-1ace2ffcf440 for instance 4e122fd8-65b5-4e45-895d-52bd62047163 on n-h1-854653-7 Nov 03 04:50:21.453181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-646c562e-7e67-4a33-a8c9-09c2201bcbc8 req-42cce6bb-27af-442d-971b-c943ad88166d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041714 Nov 03 04:50:21.454422 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3512/6912] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:50:21.679462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:21.680087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:21.687477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:21.687636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:21.688083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:21.688944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:21.689438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:21.689875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:21.762576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:21.771239 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5d1feb42-0e65-4dcd-8299-8f3f2693e4c4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1361 microversion: 2.1 time: 0.095628 Nov 03 04:50:21.771818 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3401/6913] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:21 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1361 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:22.796576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:22.831927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:22.831927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:22.831927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:22.831927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:22.831927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:22.831927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:22.831927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:22.875113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:22.883661 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8861dfc5-fbda-4b54-8434-a4e0e5e2b36b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1361 microversion: 2.1 time: 0.092697 Nov 03 04:50:22.884237 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3513/6914] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:22 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1361 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:23.907967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:23.908546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:23.921111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:23.921111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:23.921111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:23.921111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:23.921111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:23.921111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:23.984981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:23.993153 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ae4f10c3-6881-4d93-b52d-a96fa1715e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1361 microversion: 2.1 time: 0.089249 Nov 03 04:50:24.001708 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3402/6915] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:23 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1361 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:25.015995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:25.016637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:25.024190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:25.024700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:25.025198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:25.025927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:25.026411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:25.026861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:25.091566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:25.100190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b27aa455-746c-469e-a420-398c66737721 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1361 microversion: 2.1 time: 0.088319 Nov 03 04:50:25.100765 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3514/6916] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:25 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:26.124031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:26.124651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:26.132306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:26.132800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:26.133274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:26.133974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:26.134434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:26.134862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:26.202387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:26.210600 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bf8ff3c8-2d58-4dd9-b294-e2dbead9e27a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 200 len: 1361 microversion: 2.1 time: 0.090488 Nov 03 04:50:26.211379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3403/6917] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:26 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:27.233246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:27.233959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:27.240789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:27.241314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:27.241768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:27.242515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:27.242988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:27.243471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:27.260718 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 HTTP/1.1 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4e122fd8-65b5-4e45-895d-52bd62047163'} Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:27.262446 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c9c6ff3d-b6d2-45b1-8d81-3a39c210bdf5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 404 len: 111 microversion: 2.1 time: 0.034693 Nov 03 04:50:27.267024 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3515/6918] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:27 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:50:31.607701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:31.611222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:31.615563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:31.616055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:31.616532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:31.617365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:31.617832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:31.618266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:31.643997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:50:31.988327 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c0686dc-57f9-4f31-9334-9e1d60a83398 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 204 len: 0 microversion: 2.1 time: 0.384350 Nov 03 04:50:31.988931 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3404/6919] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:50:31 2022] DELETE /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:50:31.998417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:31.999155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:32.006389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:32.006885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:32.007339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:32.008042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:32.008509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:32.008953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:32.138833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:32.147433 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c3070523-a429-4ff7-b138-b1539f7a5497 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1409 microversion: 2.1 time: 0.153414 Nov 03 04:50:32.147996 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3516/6920] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:31 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:33.172047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:33.172681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:33.179631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:33.180122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:33.180564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:33.181309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:33.181773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:33.182203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:33.187050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:33.313540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:33.321881 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9d51937-87da-4561-b97a-57e6f22c33e9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1409 microversion: 2.1 time: 0.154202 Nov 03 04:50:33.322460 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3405/6921] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:33 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:34.274921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1974e02d-5ce9-4768-915f-8d22cb719d9c req-dced716d-e9c8-4c61-841c-2a5daefd304a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5f377c-e95b-4d39-b14b-5afafbea156e", "name": "network-vif-deleted", "tag": "cbf8aebb-04ae-4ffb-be02-568896281b04"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:50:34.285169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1974e02d-5ce9-4768-915f-8d22cb719d9c req-dced716d-e9c8-4c61-841c-2a5daefd304a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:34.285681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1974e02d-5ce9-4768-915f-8d22cb719d9c req-dced716d-e9c8-4c61-841c-2a5daefd304a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:34.286132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1974e02d-5ce9-4768-915f-8d22cb719d9c req-dced716d-e9c8-4c61-841c-2a5daefd304a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:34.297414 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1974e02d-5ce9-4768-915f-8d22cb719d9c req-dced716d-e9c8-4c61-841c-2a5daefd304a service nova] Creating event network-vif-deleted:cbf8aebb-04ae-4ffb-be02-568896281b04 for instance fb5f377c-e95b-4d39-b14b-5afafbea156e on n-h2-854653-7 Nov 03 04:50:34.303201 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1974e02d-5ce9-4768-915f-8d22cb719d9c req-dced716d-e9c8-4c61-841c-2a5daefd304a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033345 Nov 03 04:50:34.303978 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3517/6922] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:50:34.344829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:34.345723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:34.348391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:34.353128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:34.353633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:34.354060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:34.356196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:34.357026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:34.357525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:34.444416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:34.452658 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eddaef90-6fe0-402e-b450-4ad2ab7047c8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1367 microversion: 2.1 time: 0.111792 Nov 03 04:50:34.453277 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3406/6923] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:34 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1367 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:35.478471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:35.479138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:35.482637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=30 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:35.486667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:35.487179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:35.487642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:35.488745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:35.489257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:35.489712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:35.493484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=78 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:50:35.572231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:35.580643 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9bd361fb-525e-4c6d-8571-00670a1b49fd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1201 microversion: 2.1 time: 0.108365 Nov 03 04:50:35.581280 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3518/6924] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:35 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:36.603878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:36.604495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:36.612051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:36.612541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:36.612979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:36.613703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:36.614158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:36.614587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:36.683477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:36.691398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-36babff1-b808-4540-ab89-0dd10f965e6a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1201 microversion: 2.1 time: 0.091448 Nov 03 04:50:36.692227 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3407/6925] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:36 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:37.715337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:37.715979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:37.723236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:37.723750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:37.724360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:37.725173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:37.725655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:37.726107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:37.789833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:37.799035 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a870cc98-00f9-4012-81fb-40a2f2e399a1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1201 microversion: 2.1 time: 0.087077 Nov 03 04:50:37.799616 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3519/6926] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:37 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:38.822252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:38.822899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:38.829326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:38.829816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:38.830250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:38.830940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:38.831398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:38.831822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:38.896520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:50:38.906494 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7c1b486a-84e7-4dda-bcab-1e7384d96a3a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 200 len: 1201 microversion: 2.1 time: 0.088409 Nov 03 04:50:38.907086 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3408/6927] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:38 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:50:39.930702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:39.931283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:39.938256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:39.938752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:39.939234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:39.939943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:39.940411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:39.940851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:39.954364 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e HTTP/1.1 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'fb5f377c-e95b-4d39-b14b-5afafbea156e'} Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:39.956041 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-65c2f675-c386-4a49-818c-95f0dc0d427c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 404 len: 111 microversion: 2.1 time: 0.031518 Nov 03 04:50:39.960233 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3520/6928] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:39 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:50:42.096766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:42.098294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:42.105997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.106426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.106866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.107563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.108018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.108519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.122208 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 HTTP/1.1 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '4e122fd8-65b5-4e45-895d-52bd62047163'} Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:50:42.123904 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba0059ea-19e2-49fc-964e-f4e0722fab15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 404 len: 111 microversion: 2.1 time: 0.032758 Nov 03 04:50:42.127754 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3409/6929] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:50:42 2022] DELETE /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:50:42.134899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:42.135543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 4e122fd8-65b5-4e45-895d-52bd62047163] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:42.142658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.143389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.143853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.144831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.145395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.145848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.160607 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 HTTP/1.1 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '4e122fd8-65b5-4e45-895d-52bd62047163'} Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.162209 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 4e122fd8-65b5-4e45-895d-52bd62047163 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f4fdcfab-d27d-4fe4-b663-cf8c0e159333 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163" status: 404 len: 111 microversion: 2.1 time: 0.033252 Nov 03 04:50:42.169764 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3521/6930] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:42 2022] GET /compute/v2.1/servers/4e122fd8-65b5-4e45-895d-52bd62047163 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:50:42.909634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:42.910365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:42.916655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.917175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.917623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.918325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.918781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.919206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.933305 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e HTTP/1.1 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'fb5f377c-e95b-4d39-b14b-5afafbea156e'} Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:50:42.934878 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6b6a9640-e49e-4a7c-b0fe-50966a8c3a0a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 404 len: 111 microversion: 2.1 time: 0.031043 Nov 03 04:50:42.939391 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3410/6931] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:50:42 2022] DELETE /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:50:42.946207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:50:42.946884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: fb5f377c-e95b-4d39-b14b-5afafbea156e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:50:42.952963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.953498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.953958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.954668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:50:42.955145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:50:42.955593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:50:42.970191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e HTTP/1.1 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'fb5f377c-e95b-4d39-b14b-5afafbea156e'} Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:50:42.971735 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance fb5f377c-e95b-4d39-b14b-5afafbea156e could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-88980295-bf2c-4cce-b908-ae19d0449e7d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e" status: 404 len: 111 microversion: 2.1 time: 0.031488 Nov 03 04:50:42.976323 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3522/6932] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:50:42 2022] GET /compute/v2.1/servers/fb5f377c-e95b-4d39-b14b-5afafbea156e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:50:43.054211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e65fa795-65b2-4d52-8e41-c949ad136455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: .version_select at 0x7ff7f3f89b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1199888532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKy+Fmi7C4MDWCXdpF6u1cI45LYZiXWhjp8oXr74W11QJ1AY+0Aj/bA4x387lntl0Itw8XDkMfSIHCAFajGmSpUrfxz/Fm1oW69X/DYKYmHgfDIzPscom1WCNDM5J5QKWg=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:50:43.073540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-e65fa795-65b2-4d52-8e41-c949ad136455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:50:43.079361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-e65fa795-65b2-4d52-8e41-c949ad136455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:50:43.192113 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e65fa795-65b2-4d52-8e41-c949ad136455 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.141911 Nov 03 04:50:43.192705 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3411/6933] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 04:50:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:51:05.297882 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2133388138", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1199888532", "security_groups": [{"name": "tempest-secgroup-smoke-503303599"}], "block_device_mapping_v2": [{"uuid": "aadf5c53-bc8b-4d8d-8bd9-d58954b02026", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:51:05.308510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=9 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:05.309214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=17 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:05.412803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:51:05.849390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:51:05.849835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:51:05.850361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:51:05.850787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:51:05.851859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:51:05.863642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:05.864149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:05.864609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:05.865398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:05.865877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:05.866324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:05.888804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:51:05.894147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:51:05.953329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:51:05.955461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aadf5c53-bc8b-4d8d-8bd9-d58954b02026',volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:51:06.345913 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-36714ad0-8db7-4947-b864-321f8b714049 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.052181 Nov 03 04:51:06.346637 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3523/6934] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:51:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:51:06.356200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=27 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:06.357008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:06.357684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:06.363131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-191c630b-856c-453b-9294-97118623330d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:06.363758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-191c630b-856c-453b-9294-97118623330d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:06.419364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-191c630b-856c-453b-9294-97118623330d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:06.426838 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-191c630b-856c-453b-9294-97118623330d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1095 microversion: 2.1 time: 0.072408 Nov 03 04:51:06.427419 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3412/6935] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:06 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:07.452745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:07.453376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:07.460683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:07.461244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:07.461706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:07.462424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:07.462974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:07.463398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:07.863172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:07.871984 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e3dc4c46-a7fa-4576-9eff-032b8d30114a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1145 microversion: 2.1 time: 0.425597 Nov 03 04:51:07.872789 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3524/6936] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:07 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1145 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:08.896059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:08.897573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:08.911027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:08.911864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:08.912473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:08.915632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:08.915813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:08.916445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:09.020182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:09.028937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4603b6d-4f33-4a43-a053-3728d5dec3ae tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1211 microversion: 2.1 time: 0.137829 Nov 03 04:51:09.029814 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3413/6937] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:08 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1211 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:51:10.056110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:10.056889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:10.063996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:10.064512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:10.064975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:10.065817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:10.066323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:10.066757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:10.159360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-919fc302-47b6-4582-a7bd-606361f45c72 req-9700e03e-dc47-4fde-9620-181094bbe6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8353dfb1-e85f-48e1-8f9e-a4d35d405dc8", "tag": "4a06af79-22f4-4cbf-8713-9a2fd934b756"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:51:10.171951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-919fc302-47b6-4582-a7bd-606361f45c72 req-9700e03e-dc47-4fde-9620-181094bbe6b1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:10.172438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-919fc302-47b6-4582-a7bd-606361f45c72 req-9700e03e-dc47-4fde-9620-181094bbe6b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:10.172872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-919fc302-47b6-4582-a7bd-606361f45c72 req-9700e03e-dc47-4fde-9620-181094bbe6b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:10.186841 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-919fc302-47b6-4582-a7bd-606361f45c72 req-9700e03e-dc47-4fde-9620-181094bbe6b1 service nova] Creating event network-changed:4a06af79-22f4-4cbf-8713-9a2fd934b756 for instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 on n-h2-854653-7 Nov 03 04:51:10.192152 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-919fc302-47b6-4582-a7bd-606361f45c72 req-9700e03e-dc47-4fde-9620-181094bbe6b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037573 Nov 03 04:51:10.192765 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3414/6938] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:51:10.300511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:10.309760 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-911c8f99-e5ea-484f-8842-90791af54d17 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1278 microversion: 2.1 time: 0.257752 Nov 03 04:51:10.310349 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3525/6939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:10 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:11.334924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:11.336311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:11.345181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:11.345673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:11.346120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:11.346820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:11.347280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:11.347727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:11.484636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:11.492625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee3532e0-4c63-4c8c-aaa4-ecfb59233526 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1278 microversion: 2.1 time: 0.163032 Nov 03 04:51:11.493225 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3415/6940] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:11 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:12.515952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:12.516583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:12.524044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:12.525694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:12.526167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:12.526916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:12.527411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:12.527861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:12.671289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:12.679901 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-02f5d4fb-b544-4f1c-8c0c-3586cf2853ea tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1278 microversion: 2.1 time: 0.167357 Nov 03 04:51:12.680479 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3526/6941] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:12 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:13.703461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:13.708829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:13.712172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:13.712670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:13.713141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:13.713846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:13.714309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:13.714746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:13.856419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:13.864259 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e654b3b4-0a76-4abd-8baa-d81ad5e84d53 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1278 microversion: 2.1 time: 0.164850 Nov 03 04:51:13.864870 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3416/6942] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:13 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:14.887101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:14.887753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:14.894235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:14.894739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:14.895452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:14.896158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:14.896628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:14.897096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:15.028851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:15.036508 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b26f47e-d0fd-485c-a94a-45fa6aecfad3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.154166 Nov 03 04:51:15.037097 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3527/6943] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:14 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:16.059101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:16.059652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:16.066541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:16.067034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:16.067480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:16.068178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:16.068640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:16.069096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:16.201892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:16.209568 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f5f57162-f45f-481d-bb98-7bf217890247 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.154478 Nov 03 04:51:16.210142 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3417/6944] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:16 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:17.233125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:17.236021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:17.236021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:17.237220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:17.242034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:17.242533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:17.242992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:17.243702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:17.244176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:17.244623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:17.379925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:17.388245 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5369dae7-40af-49c8-a5dd-31142b9a2e8e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.159097 Nov 03 04:51:17.388817 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3528/6945] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:17 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:18.410954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:18.411493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:18.413537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:51:18.419129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:18.419616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:18.420059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:18.420757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:18.421246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:18.424634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:18.550452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:18.558730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5bb103e8-29f0-425d-8ac7-5f4b64a67a49 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.151802 Nov 03 04:51:18.559308 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3418/6946] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:18 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:19.582147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:19.582814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:19.590192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:19.590691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:19.591147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:19.591850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:19.592323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:19.592768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:19.725121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:19.732797 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8fc0618b-60b9-4ccf-986e-c4100aae9852 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.154605 Nov 03 04:51:19.733408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3529/6947] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:19 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:51:20.755248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:20.755873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:20.764891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:20.765418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:20.765869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:20.766572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:20.767039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:20.767473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:20.898744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:20.906573 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f9eeea6-4fc7-45a3-9505-a6f5175bf25b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.155264 Nov 03 04:51:20.907156 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3419/6948] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:20 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:21.930690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:21.931333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:21.938055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:21.938564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:21.939026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:21.939744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:21.940224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:21.940681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:22.079176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:22.086863 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ed9a9ede-2b89-4609-9220-d0ac47a99a02 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.160759 Nov 03 04:51:22.095752 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3530/6949] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:21 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:23.117896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:23.118640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:23.125543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:23.126029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:23.126466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:23.127157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:23.127619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:23.128048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:23.257626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:23.265259 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-661a4594-21f5-4988-a3e3-51206a5f0d23 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.151900 Nov 03 04:51:23.265827 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3420/6950] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:23 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:24.205770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-940f39ff-06c4-4a6e-96d5-d71c47aee7c0 req-5ce007e0-701b-4438-beb5-dd1867b42e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8353dfb1-e85f-48e1-8f9e-a4d35d405dc8", "name": "network-vif-plugged", "status": "completed", "tag": "4a06af79-22f4-4cbf-8713-9a2fd934b756"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:51:24.216804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-940f39ff-06c4-4a6e-96d5-d71c47aee7c0 req-5ce007e0-701b-4438-beb5-dd1867b42e82 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:24.217326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-940f39ff-06c4-4a6e-96d5-d71c47aee7c0 req-5ce007e0-701b-4438-beb5-dd1867b42e82 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:24.217771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-940f39ff-06c4-4a6e-96d5-d71c47aee7c0 req-5ce007e0-701b-4438-beb5-dd1867b42e82 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:24.228801 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-940f39ff-06c4-4a6e-96d5-d71c47aee7c0 req-5ce007e0-701b-4438-beb5-dd1867b42e82 service nova] Creating event network-vif-plugged:4a06af79-22f4-4cbf-8713-9a2fd934b756 for instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 on n-h2-854653-7 Nov 03 04:51:24.233774 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-940f39ff-06c4-4a6e-96d5-d71c47aee7c0 req-5ce007e0-701b-4438-beb5-dd1867b42e82 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031837 Nov 03 04:51:24.238233 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3531/6951] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:51:24.288382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:24.289006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:24.295918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:24.296409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:24.296856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:24.297594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:24.298057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:24.298494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:24.474244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:24.481970 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eaf09b4c-19a5-4693-8bcc-4b4067fb2e33 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.197951 Nov 03 04:51:24.482548 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3421/6952] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:24 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:25.506497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:25.507214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:25.514023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:25.514522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:25.514974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:25.515678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:25.516149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:25.516589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:25.647945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:25.655876 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4fe8e70f-07d9-4346-b2ad-27c4bdafab04 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1266 microversion: 2.1 time: 0.154651 Nov 03 04:51:25.656449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3532/6953] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:25 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:26.679194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:26.679819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:26.686811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:26.696246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:26.696246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:26.696246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:26.696246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:26.696246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:26.828005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:26.835843 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c72a07b3-9f08-4556-9c2c-0f9ceddde8d5 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1453 microversion: 2.1 time: 0.160830 Nov 03 04:51:26.836423 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3422/6954] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:26 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:26.858011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:51:26.858643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:51:26.865450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:26.865949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:26.866404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:26.867143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:26.868123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:26.868568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:26.998362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:51:27.006211 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f4a06af1-92a8-4ace-ad70-dbeac66a73d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1453 microversion: 2.1 time: 0.152172 Nov 03 04:51:27.006790 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3533/6955] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:51:26 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:51:28.937800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7a560c0a-95dd-4b72-8623-8250ac3e0c89 req-baaedec9-f5f9-4d45-83ac-a514bb066dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8353dfb1-e85f-48e1-8f9e-a4d35d405dc8", "tag": "4a06af79-22f4-4cbf-8713-9a2fd934b756"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:51:28.948978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7a560c0a-95dd-4b72-8623-8250ac3e0c89 req-baaedec9-f5f9-4d45-83ac-a514bb066dfa service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:51:28.949554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7a560c0a-95dd-4b72-8623-8250ac3e0c89 req-baaedec9-f5f9-4d45-83ac-a514bb066dfa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:51:28.950047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7a560c0a-95dd-4b72-8623-8250ac3e0c89 req-baaedec9-f5f9-4d45-83ac-a514bb066dfa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:51:28.961779 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7a560c0a-95dd-4b72-8623-8250ac3e0c89 req-baaedec9-f5f9-4d45-83ac-a514bb066dfa service nova] Creating event network-changed:4a06af79-22f4-4cbf-8713-9a2fd934b756 for instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 on n-h2-854653-7 Nov 03 04:51:28.966831 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7a560c0a-95dd-4b72-8623-8250ac3e0c89 req-baaedec9-f5f9-4d45-83ac-a514bb066dfa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033023 Nov 03 04:51:28.967656 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3423/6956] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:53:55.302599 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 04:53:55.303535 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 04:53:55.304127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:53:55.304921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=58 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:53:55.306234 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 04:53:55.306381 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 04:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 (ip 10.222.0.30) !!! Nov 03 04:53:55.307584 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:53:55.307715 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 04:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 (ip 10.222.0.30) !!! Nov 03 04:53:55.312442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:53:55.312956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:53:55.327049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:55.327547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:55.327996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:55.328704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:55.329845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:55.330286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:55.355091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:53:55.644611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4effa19e-ea37-484c-85c6-24a3892569b9 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 204 len: 0 microversion: 2.1 time: 0.343873 Nov 03 04:53:55.645195 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3534/6957] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:53:55 2022] DELETE /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:53:55.652040 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:53:55.653151 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 03 04:53:55.654009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=26 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:53:55.654773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=58 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:53:55.656059 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:53:55.656202 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 (ip 10.222.0.30) !!! Nov 03 04:53:55.657287 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:53:55.657413 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:53:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 (ip 10.222.0.30) !!! Nov 03 04:53:55.662767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:53:55.666297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:53:55.671686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:55.672173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:55.672618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:55.673858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:55.674307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:55.674725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:55.815136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:53:55.823270 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc9b980a-fc37-43f3-9d63-8fb76fad097b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1577 microversion: 2.1 time: 0.173252 Nov 03 04:53:55.823980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3424/6958] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:53:55 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:53:56.847663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:53:56.848387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:53:56.857257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:56.857754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:56.858204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:56.858903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:56.859371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:56.859809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:56.877320 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57948. Nov 03 04:53:56.881817 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57946. Nov 03 04:53:56.993556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:53:57.001450 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-340d150b-2927-49d1-9fec-ff7ed0bf2d71 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1577 microversion: 2.1 time: 0.158571 Nov 03 04:53:57.002025 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3535/6959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:53:56 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:53:58.024020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:53:58.024670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:53:58.036566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:58.037006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:58.037480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:58.038204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:58.038671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:58.039220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:58.045580 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57952. Nov 03 04:53:58.046515 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57954. Nov 03 04:53:58.114911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:53:58.122934 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31f5861b-685a-4e08-be61-106412a2800b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1510 microversion: 2.1 time: 0.103210 Nov 03 04:53:58.123508 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3425/6960] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:53:58 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1510 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:53:58.419879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7f5c3d85-273d-4ad5-94a5-1982b9ffdac9 req-7bbf178b-58ac-4b9c-8104-10fb80b293e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8353dfb1-e85f-48e1-8f9e-a4d35d405dc8", "name": "network-vif-deleted", "tag": "4a06af79-22f4-4cbf-8713-9a2fd934b756"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:53:58.432208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7f5c3d85-273d-4ad5-94a5-1982b9ffdac9 req-7bbf178b-58ac-4b9c-8104-10fb80b293e7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:58.432714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7f5c3d85-273d-4ad5-94a5-1982b9ffdac9 req-7bbf178b-58ac-4b9c-8104-10fb80b293e7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:58.433203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7f5c3d85-273d-4ad5-94a5-1982b9ffdac9 req-7bbf178b-58ac-4b9c-8104-10fb80b293e7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:58.444811 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7f5c3d85-273d-4ad5-94a5-1982b9ffdac9 req-7bbf178b-58ac-4b9c-8104-10fb80b293e7 service nova] Creating event network-vif-deleted:4a06af79-22f4-4cbf-8713-9a2fd934b756 for instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 on n-h2-854653-7 Nov 03 04:53:58.450089 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7f5c3d85-273d-4ad5-94a5-1982b9ffdac9 req-7bbf178b-58ac-4b9c-8104-10fb80b293e7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034167 Nov 03 04:53:58.450710 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3536/6961] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 04:53:59.152286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:53:59.152286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:53:59.158261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:59.158769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:59.159293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:59.160014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:53:59.160476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:53:59.160910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:53:59.230377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:53:59.238492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c24efab7-833c-40a6-b784-6169f196172a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1226 microversion: 2.1 time: 0.095538 Nov 03 04:53:59.239093 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3426/6962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:53:59 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:00.262178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:00.262897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:00.270622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:00.271406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:00.271922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:00.272663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:00.273169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:00.273620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:00.343344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:00.352363 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ab47e38-793a-46bb-b099-566757a6984d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1226 microversion: 2.1 time: 0.094414 Nov 03 04:54:00.353076 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3537/6963] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:00 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:01.375020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:01.375563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:01.382526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:01.383017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:01.383464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:01.384166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:01.384630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:01.385100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:01.447789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:01.455662 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96fa7c3a-eff2-4872-9d73-b1de8ae7c96c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1226 microversion: 2.1 time: 0.084740 Nov 03 04:54:01.456245 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3427/6964] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:01 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:02.478971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:02.479598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:02.486954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:02.487454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:02.487904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:02.488635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:02.489131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:02.489572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:02.615809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:02.622779 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e1b2e4bd-0a93-41ed-b8a2-8f879e210315 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1226 microversion: 2.1 time: 0.147746 Nov 03 04:54:02.623351 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3538/6965] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:02 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1226 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:03.646735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:03.647322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:03.654201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:03.654908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:03.655352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:03.656058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:03.656518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:03.657486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:03.688655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:03.689174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:03.689621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:03.690072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lazy-loading 'fault' on Instance uuid 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:54:03.778376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:03.786123 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42d5cb16-8752-4d64-a4ca-6f0c2a746d2f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 200 len: 1185 microversion: 2.1 time: 0.143903 Nov 03 04:54:03.787002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3428/6966] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:03 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 1185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:04.809909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:04.823736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:04.823736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:04.823736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:04.823736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:04.823736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:04.823736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:04.823736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:04.833535 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 HTTP/1.1 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8353dfb1-e85f-48e1-8f9e-a4d35d405dc8'} Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:54:04.835227 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3b687535-26a3-4c1b-b45a-05bbb28c042c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 404 len: 111 microversion: 2.1 time: 0.030681 Nov 03 04:54:04.839413 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3539/6967] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:04 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:54:04.885869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-696994235", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1199888532", "security_groups": [{"name": "tempest-secgroup-smoke-503303599"}], "block_device_mapping_v2": [{"uuid": "aadf5c53-bc8b-4d8d-8bd9-d58954b02026", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:54:05.004487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:54:05.371290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:54:05.371747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:54:05.372223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:54:05.372635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:54:05.373079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:54:05.382484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:05.382969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:05.383412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:05.384136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:05.384591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:05.385040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:05.404228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:54:05.409518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:54:05.466943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:54:05.469145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aadf5c53-bc8b-4d8d-8bd9-d58954b02026',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:54:05.860466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-596f7294-b6d6-4497-9c39-29c555f29428 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.977928 Nov 03 04:54:05.861159 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3429/6968] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:54:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:54:05.872363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97cd46fb-45d1-419f-ac91-c7ec9cf27597 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:05.873089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97cd46fb-45d1-419f-ac91-c7ec9cf27597 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:05.931966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97cd46fb-45d1-419f-ac91-c7ec9cf27597 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:05.940096 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97cd46fb-45d1-419f-ac91-c7ec9cf27597 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1094 microversion: 2.1 time: 0.071783 Nov 03 04:54:05.940751 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3540/6969] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:05 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:06.963741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:06.964454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:06.971533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:06.972023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:06.972461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:06.973189 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:06.973648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:06.974078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:07.035461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:07.043461 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ab8d1ce6-a949-4a6c-a31b-bdd723bfab95 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1144 microversion: 2.1 time: 0.084500 Nov 03 04:54:07.052789 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3430/6970] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:06 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:08.067485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:08.068139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:08.075169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:08.075674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:08.076127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:08.076845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:08.077341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:08.077785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:08.153599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:08.161467 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68068187-d261-4251-83fe-8fd87dc02927 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1200 microversion: 2.1 time: 0.098606 Nov 03 04:54:08.162051 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3541/6971] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:08 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:09.190790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:09.191426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:09.201609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:09.202254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:09.202769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:09.203585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:09.204275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:09.204809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:09.422130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:09.430769 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-175653ca-6caa-4782-8e18-e0f9f7755910 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1277 microversion: 2.1 time: 0.245194 Nov 03 04:54:09.431634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3431/6972] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:09 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:09.950760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8a961beb-a3b2-498d-92f1-be8d5bffea3d req-3c4825f8-9130-4569-a3cd-ff8a108bd871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd755f94-d1ee-4039-9836-673a5e2e39f1", "tag": "036c2e68-7653-48bc-a164-83f322d142c7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:54:09.962002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8a961beb-a3b2-498d-92f1-be8d5bffea3d req-3c4825f8-9130-4569-a3cd-ff8a108bd871 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:09.962002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8a961beb-a3b2-498d-92f1-be8d5bffea3d req-3c4825f8-9130-4569-a3cd-ff8a108bd871 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:09.962536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8a961beb-a3b2-498d-92f1-be8d5bffea3d req-3c4825f8-9130-4569-a3cd-ff8a108bd871 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:09.974029 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8a961beb-a3b2-498d-92f1-be8d5bffea3d req-3c4825f8-9130-4569-a3cd-ff8a108bd871 service nova] Creating event network-changed:036c2e68-7653-48bc-a164-83f322d142c7 for instance bd755f94-d1ee-4039-9836-673a5e2e39f1 on n-h2-854653-7 Nov 03 04:54:09.979870 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8a961beb-a3b2-498d-92f1-be8d5bffea3d req-3c4825f8-9130-4569-a3cd-ff8a108bd871 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Nov 03 04:54:09.980865 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3542/6973] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:54:10.455035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:10.455730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:10.463313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:10.464333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:10.464625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:10.465362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:10.465823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:10.466246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:10.712098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:10.721126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-500d6b63-1cd0-47f9-b0e7-52d8d831a0f0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1277 microversion: 2.1 time: 0.269261 Nov 03 04:54:10.721849 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3432/6974] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:10 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:11.747740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:11.748618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:11.755207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:11.755710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:11.756163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:11.756873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:11.757382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:11.757823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:11.910570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:11.919402 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c94a9a59-313c-4732-9d0f-6d3f6413796b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1277 microversion: 2.1 time: 0.177928 Nov 03 04:54:11.920021 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3543/6975] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:11 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:12.944381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:12.945002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:12.951887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:12.952373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:12.952814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:12.953584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:12.954050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:12.954532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:13.089571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:13.097382 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7dcad020-2ced-415e-9eeb-3fca9a02445b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1277 microversion: 2.1 time: 0.156977 Nov 03 04:54:13.097956 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3433/6976] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:12 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:14.120757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:14.121333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:14.128181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:14.128681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:14.129176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:14.129974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:14.130449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:14.130889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:14.291552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:14.300074 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30aad4ab-b185-4380-8166-0c878f6404d6 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.183412 Nov 03 04:54:14.300669 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3544/6977] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:14 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:15.322373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:15.322989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:15.329853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:15.330381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:15.330820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:15.331513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:15.331968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:15.332390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:15.395982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:54:15.415767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:54:15.469495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:15.477889 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bee16e95-ff39-434b-8b5c-8f4c0a9d2d1d tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.159498 Nov 03 04:54:15.478460 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3434/6978] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:15 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:16.502471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:16.503112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:16.506076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:54:16.510877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:16.516155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:16.516155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:16.516155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:16.516155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:16.516155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:16.644708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:16.652732 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95042d21-8860-4645-b64c-268821b856bd tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.154847 Nov 03 04:54:16.653346 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3545/6979] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:16 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:17.675719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:17.676380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:17.683190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:17.683676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:17.684116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:17.684858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:17.685336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:17.685764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:17.821197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:17.828880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3ce40f5a-8452-4f31-bc41-0f9bdcf13902 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.157191 Nov 03 04:54:17.830192 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3435/6980] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:17 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:18.851990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:18.852630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:18.859550 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:18.860055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:18.860513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:18.861256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:18.861733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:18.862183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:18.992153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:18.999857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-07947fb5-0586-437a-a6b0-af9347b6e273 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.151853 Nov 03 04:54:19.000424 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3546/6981] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:18 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:20.023935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:20.024556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:20.031368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:20.031849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:20.032320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:20.033005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:20.033497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:20.033925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:20.162743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:20.170511 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-98a431b7-6ad1-4933-9460-0801ff1498b8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.151062 Nov 03 04:54:20.171078 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3436/6982] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:20 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:54:21.193571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:21.194213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:21.201182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:21.201670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:21.202129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:21.202841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:21.203316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:21.203761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:21.668642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:21.676258 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc76225e-cf96-4187-bc7f-0777163fb93f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.486720 Nov 03 04:54:21.676820 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3547/6983] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:21 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:22.699512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:22.700196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:22.707159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:22.707637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:22.708078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:22.708777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:22.709273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:22.709708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:22.839055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:22.846806 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1279f488-738d-4bc6-939f-88aabefe5d8a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.151240 Nov 03 04:54:22.847379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3437/6984] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:22 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:23.116980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-38b31cf6-55fc-430e-b956-79a851830947 req-d87780da-9918-4d23-87e0-ac97a3f56b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd755f94-d1ee-4039-9836-673a5e2e39f1", "name": "network-vif-plugged", "status": "completed", "tag": "036c2e68-7653-48bc-a164-83f322d142c7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:54:23.127434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-38b31cf6-55fc-430e-b956-79a851830947 req-d87780da-9918-4d23-87e0-ac97a3f56b10 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:23.127931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-38b31cf6-55fc-430e-b956-79a851830947 req-d87780da-9918-4d23-87e0-ac97a3f56b10 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:23.128387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-38b31cf6-55fc-430e-b956-79a851830947 req-d87780da-9918-4d23-87e0-ac97a3f56b10 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:23.139276 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-38b31cf6-55fc-430e-b956-79a851830947 req-d87780da-9918-4d23-87e0-ac97a3f56b10 service nova] Creating event network-vif-plugged:036c2e68-7653-48bc-a164-83f322d142c7 for instance bd755f94-d1ee-4039-9836-673a5e2e39f1 on n-h2-854653-7 Nov 03 04:54:23.144336 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-38b31cf6-55fc-430e-b956-79a851830947 req-d87780da-9918-4d23-87e0-ac97a3f56b10 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031214 Nov 03 04:54:23.144924 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3548/6985] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:54:23.872401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:23.872401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:23.877265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:23.877739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:23.878180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:23.878919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:23.879377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:23.879812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:24.013801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:24.020574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-719fd238-a0d1-4a5f-910a-62b44cf9d055 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1265 microversion: 2.1 time: 0.155447 Nov 03 04:54:24.021484 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3438/6986] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:23 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:25.044213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:25.044921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:25.051575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:25.052084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:25.052544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:25.053280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:25.053755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:25.054203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:25.188120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:25.196511 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f98101c8-77da-4660-83f0-5c3687984238 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1453 microversion: 2.1 time: 0.157469 Nov 03 04:54:25.197104 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3549/6987] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:25 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:25.218395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:54:25.219014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:54:25.226379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:25.226862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:25.227303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:25.227986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:25.228445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:25.228873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:25.358177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:54:25.366516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc6b3e6e-d976-465c-9ec4-4141685549e4 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1453 microversion: 2.1 time: 0.152056 Nov 03 04:54:25.367090 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3439/6988] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:54:25 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:54:27.261900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-4b179048-ee42-45c4-bfbf-78d31e0fad29 req-912d5940-297f-4739-9359-164717c1f2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd755f94-d1ee-4039-9836-673a5e2e39f1", "tag": "036c2e68-7653-48bc-a164-83f322d142c7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:54:27.268073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:54:27.273506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4b179048-ee42-45c4-bfbf-78d31e0fad29 req-912d5940-297f-4739-9359-164717c1f2d8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:54:27.274010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4b179048-ee42-45c4-bfbf-78d31e0fad29 req-912d5940-297f-4739-9359-164717c1f2d8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:54:27.274469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-4b179048-ee42-45c4-bfbf-78d31e0fad29 req-912d5940-297f-4739-9359-164717c1f2d8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:54:27.278278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:54:27.286253 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-4b179048-ee42-45c4-bfbf-78d31e0fad29 req-912d5940-297f-4739-9359-164717c1f2d8 service nova] Creating event network-changed:036c2e68-7653-48bc-a164-83f322d142c7 for instance bd755f94-d1ee-4039-9836-673a5e2e39f1 on n-h2-854653-7 Nov 03 04:54:27.296315 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-4b179048-ee42-45c4-bfbf-78d31e0fad29 req-912d5940-297f-4739-9359-164717c1f2d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033424 Nov 03 04:54:27.296315 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3550/6989] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:56:51.936574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-726061791", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1199888532", "security_groups": [{"name": "tempest-secgroup-smoke-503303599"}], "block_device_mapping_v2": [{"uuid": "47110a8d-7706-4a01-b6a8-bdaef81848fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f510631e-b773-47d6-93f5-ae6e41236388"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:56:51.948061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:56:51.948747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=94 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:56:51.949588 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:56:51.949738 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:56:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Nov 03 04:56:52.056689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] validate_networks() for [('f510631e-b773-47d6-93f5-ae6e41236388', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 04:56:52.506389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 04:56:52.506835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 04:56:52.507314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 04:56:52.507725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 04:56:52.508146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 04:56:52.516654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:52.517168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:52.517607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:52.518328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:52.518782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:52.519209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:52.535861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 04:56:52.541445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Getting quotas for user 7ee7516af8914747a194bcae12b4a823 and project 4096c247ec0947bfae574ea7f4564c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 04:56:52.597927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 04:56:52.599937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47110a8d-7706-4a01-b6a8-bdaef81848fe',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 04:56:53.034066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2eba46e-ddd8-4972-8a3d-19b76f2d7626 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.101962 Nov 03 04:56:53.035029 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3440/6990] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 04:56:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 04:56:53.051732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5fcb3c2a-1ac1-4d9e-ba07-1ca5c2e3081a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:56:53.053547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5fcb3c2a-1ac1-4d9e-ba07-1ca5c2e3081a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:56:53.112453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5fcb3c2a-1ac1-4d9e-ba07-1ca5c2e3081a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:56:53.120466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5fcb3c2a-1ac1-4d9e-ba07-1ca5c2e3081a tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1094 microversion: 2.1 time: 0.077341 Nov 03 04:56:53.121055 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3551/6991] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:56:53 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:56:54.145142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:56:54.145677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:56:54.152394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:54.152881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:54.153585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:54.154116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:54.154574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:54.155000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:54.223171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:56:54.231768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7731f912-438c-4e43-8c36-27ba6616115b tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1144 microversion: 2.1 time: 0.091643 Nov 03 04:56:54.232368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3441/6992] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:56:54 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:56:55.255083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:56:55.255717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:56:55.265367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:55.265878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:55.266416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:55.267199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:55.267675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:55.268120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:55.340820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:56:55.348873 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75fcde00-5915-4709-a7d5-ae2c26b03977 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1200 microversion: 2.1 time: 0.097733 Nov 03 04:56:55.354761 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3552/6993] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:56:55 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:56:56.374008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:56:56.376439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:56:56.386917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:56.388448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:56.389166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:56.390015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:56.390554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:56.391082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:56.845472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:56:56.854449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43e21b5a-f950-4d9d-92c5-1db41e4c6f62 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1277 microversion: 2.1 time: 0.484359 Nov 03 04:56:56.855161 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3442/6994] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:56:56 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1277 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:56:57.662742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d9d1c72a-2791-441d-8a52-a9401c072a75 req-8c220280-ece2-4d72-9e8e-af31cb560e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900f39a6-f047-4ad6-b241-cfa4a3d0d08a", "tag": "40bc58c6-9ff4-4136-abde-c49129732495"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:56:57.673186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d9d1c72a-2791-441d-8a52-a9401c072a75 req-8c220280-ece2-4d72-9e8e-af31cb560e60 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:57.673694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d9d1c72a-2791-441d-8a52-a9401c072a75 req-8c220280-ece2-4d72-9e8e-af31cb560e60 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:57.674150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d9d1c72a-2791-441d-8a52-a9401c072a75 req-8c220280-ece2-4d72-9e8e-af31cb560e60 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:57.686829 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d9d1c72a-2791-441d-8a52-a9401c072a75 req-8c220280-ece2-4d72-9e8e-af31cb560e60 service nova] Creating event network-changed:40bc58c6-9ff4-4136-abde-c49129732495 for instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a on n-h1-854653-7 Nov 03 04:56:57.692035 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d9d1c72a-2791-441d-8a52-a9401c072a75 req-8c220280-ece2-4d72-9e8e-af31cb560e60 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172358 Nov 03 04:56:57.692951 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3553/6995] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:56:57.879085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:56:57.880359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:56:57.888211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:57.888817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:57.889373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:57.890334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:57.891071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:57.891721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:58.101329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:56:58.109268 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7037a77e-2c21-4dd9-b5c3-1d0bf976c5ca tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1277 microversion: 2.1 time: 0.234076 Nov 03 04:56:58.109853 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3443/6996] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:56:57 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:56:59.134915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:56:59.135639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:56:59.142065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:59.147543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:59.147543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:59.147543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:56:59.147543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:56:59.147543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:56:59.284534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:56:59.292572 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e4ff5f6e-df55-4d3b-811b-fa6f2dcee1ff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1277 microversion: 2.1 time: 0.163329 Nov 03 04:56:59.293336 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3554/6997] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:56:59 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:00.315916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:00.316526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:00.324041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:00.324536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:00.324978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:00.325716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:00.326173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:00.326598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:00.460985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:00.468936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-01779ec9-258e-45f8-90eb-8c8211063b77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1277 microversion: 2.1 time: 0.156927 Nov 03 04:57:00.469473 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3444/6998] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:00 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:01.492887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:01.493551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:01.500302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:01.500801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:01.501286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:01.501994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:01.502466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:01.502908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:01.637669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:01.645666 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f71bb3d-fc66-4661-af6f-2c01933f4c83 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.157471 Nov 03 04:57:01.646235 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3555/6999] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:01 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:02.669442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:02.670067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:02.672777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:57:02.673525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:57:02.678284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:02.678777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:02.679946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:02.680617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:02.681031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:02.681465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:02.816193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:02.823884 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d31b325-8fe1-4c3a-8a75-c47f7fa33bf3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.158507 Nov 03 04:57:02.824460 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3445/7000] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:02 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:03.847084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:03.847715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:03.850564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:57:03.855329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:03.855826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:03.856283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:03.856990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:03.857481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:03.857923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:03.990283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:03.998531 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce65a293-cf6e-40dd-9633-0403eb1c26da tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.155464 Nov 03 04:57:03.999100 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3556/7001] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:03 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:05.022010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:05.022888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:05.030003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:05.035331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:05.035331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:05.035331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:05.035331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:05.035331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:05.170792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:05.178655 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64fe10f4-d572-4405-b76d-c773bfe9cb44 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.160650 Nov 03 04:57:05.179225 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3446/7002] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:05 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:06.202679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:06.203220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:06.210209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:06.210713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:06.211172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:06.211880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:06.212357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:06.212802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:06.342281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:06.350180 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-415b941b-5cd4-4d50-a6ec-dbe03da2fa5c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.151567 Nov 03 04:57:06.350751 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3557/7003] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:06 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:07.373299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:07.373905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:07.380676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:07.381195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:07.381640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:07.382357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:07.382812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:07.383240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:07.523482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:07.531879 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0a7cb7e2-6757-4e65-9dc8-92e44c621bbc tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.162730 Nov 03 04:57:07.532514 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3447/7004] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:07 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:08.554791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:08.555426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:08.562836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:08.563337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:08.563790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:08.564498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:08.564965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:08.565434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:08.697400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:08.705195 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0161a368-4823-4641-8158-e03494ff448e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.154333 Nov 03 04:57:08.705764 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3558/7005] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:08 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:09.728503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:09.729247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:09.736136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:09.736632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:09.737108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:09.737819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:09.738305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:09.738744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:09.877895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:09.886484 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a21355b-31a8-4bf9-a806-09f9f4d68806 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.162554 Nov 03 04:57:09.887066 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3448/7006] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:09 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:10.910180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:10.911010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:10.918667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:10.919184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:10.919685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:10.920422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:10.920929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:10.921411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:11.061041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:11.068781 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-915fbb85-b924-42c9-8b30-9db7b83554f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.162646 Nov 03 04:57:11.069392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3559/7007] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:10 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:12.092263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:12.096804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:12.099655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:12.100152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:12.100596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:12.101333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:12.101792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:12.102259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:12.236144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:12.244790 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-022aadbf-8b23-4435-b564-ceab8e009a15 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.156682 Nov 03 04:57:12.245399 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3449/7008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:12 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:12.347562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-461460d2-d4cc-4b92-aec1-b5c996435ebe req-81f98378-e16d-4f4d-b66f-f8e33e660bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900f39a6-f047-4ad6-b241-cfa4a3d0d08a", "name": "network-vif-plugged", "status": "completed", "tag": "40bc58c6-9ff4-4136-abde-c49129732495"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:57:12.357041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-461460d2-d4cc-4b92-aec1-b5c996435ebe req-81f98378-e16d-4f4d-b66f-f8e33e660bce service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:12.357749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-461460d2-d4cc-4b92-aec1-b5c996435ebe req-81f98378-e16d-4f4d-b66f-f8e33e660bce service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:12.357988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-461460d2-d4cc-4b92-aec1-b5c996435ebe req-81f98378-e16d-4f4d-b66f-f8e33e660bce service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:12.370087 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-461460d2-d4cc-4b92-aec1-b5c996435ebe req-81f98378-e16d-4f4d-b66f-f8e33e660bce service nova] Creating event network-vif-plugged:40bc58c6-9ff4-4136-abde-c49129732495 for instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a on n-h1-854653-7 Nov 03 04:57:12.375091 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-461460d2-d4cc-4b92-aec1-b5c996435ebe req-81f98378-e16d-4f4d-b66f-f8e33e660bce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080312 Nov 03 04:57:12.375709 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3560/7009] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:57:13.268856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:13.269508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:13.276744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:13.277278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:13.277723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:13.278418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:13.278879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:13.279311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:13.410050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:13.419146 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42788d8d-c367-40bd-bb0c-f41a53c6498e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1265 microversion: 2.1 time: 0.154226 Nov 03 04:57:13.420137 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3450/7010] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:13 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:14.444451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:14.445203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:14.452112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:14.452756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:14.453169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:14.453893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:14.454370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:14.454816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:14.592453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:14.600534 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5499d251-ed5c-4417-93b0-cc44ef7e72d1 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1452 microversion: 2.1 time: 0.161354 Nov 03 04:57:14.601252 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3561/7011] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:14 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:14.623488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:57:14.624170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:57:14.631072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:14.637563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:14.637563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:14.637563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:14.637563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:14.637563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:14.766217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:57:14.774356 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-882688b1-4c12-4a27-ac06-c782f802f8c3 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1452 microversion: 2.1 time: 0.155450 Nov 03 04:57:14.775240 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3451/7012] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:57:14 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:57:16.970659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d224b2da-362d-448d-a5a8-2429d074d349 req-6ab224e9-04d0-4aae-8d1e-e3f0689e6cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900f39a6-f047-4ad6-b241-cfa4a3d0d08a", "tag": "40bc58c6-9ff4-4136-abde-c49129732495"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:57:16.982427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d224b2da-362d-448d-a5a8-2429d074d349 req-6ab224e9-04d0-4aae-8d1e-e3f0689e6cbb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:57:16.982947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d224b2da-362d-448d-a5a8-2429d074d349 req-6ab224e9-04d0-4aae-8d1e-e3f0689e6cbb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:57:16.983408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d224b2da-362d-448d-a5a8-2429d074d349 req-6ab224e9-04d0-4aae-8d1e-e3f0689e6cbb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:57:16.995377 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d224b2da-362d-448d-a5a8-2429d074d349 req-6ab224e9-04d0-4aae-8d1e-e3f0689e6cbb service nova] Creating event network-changed:40bc58c6-9ff4-4136-abde-c49129732495 for instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a on n-h1-854653-7 Nov 03 04:57:17.000530 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d224b2da-362d-448d-a5a8-2429d074d349 req-6ab224e9-04d0-4aae-8d1e-e3f0689e6cbb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033795 Nov 03 04:57:17.011250 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3562/7013] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:59:19.922605 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 04:59:19.923670 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 04:59:19.924290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:59:19.925124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=68 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:59:19.925965 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:59:19.926629 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a (ip 10.222.0.30) !!! Nov 03 04:59:19.928116 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 04:59:19.928266 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 04:59:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a (ip 10.222.0.30) !!! Nov 03 04:59:19.933447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:19.934070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:19.944298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:19.944791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:19.945267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:19.946201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:19.946429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:19.946970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:19.975308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:59:20.185907 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:59:20.186746 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 04:59:20.187370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=27 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:59:20.188106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=55 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 04:59:20.189459 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:59:20.189604 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 04:59:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 03 04:59:20.190650 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 04:59:20.190978 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 04:59:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 03 04:59:20.247366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aa8a34fe-706d-4a79-ab6d-2f2d72630a77 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 204 len: 0 microversion: 2.1 time: 0.326533 Nov 03 04:59:20.247969 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3452/7014] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:59:19 2022] DELETE /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:59:20.259156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8246bef9-b428-4702-935b-685d6845c016 req-c1187723-c8ad-4145-b262-df4a31a62fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900f39a6-f047-4ad6-b241-cfa4a3d0d08a", "tag": "40bc58c6-9ff4-4136-abde-c49129732495"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:59:20.259654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:20.259654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:20.264127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:20.264636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:20.265116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:20.265836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:20.266401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:20.266639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8246bef9-b428-4702-935b-685d6845c016 req-c1187723-c8ad-4145-b262-df4a31a62fd3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:20.266766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:20.267286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8246bef9-b428-4702-935b-685d6845c016 req-c1187723-c8ad-4145-b262-df4a31a62fd3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:20.267838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8246bef9-b428-4702-935b-685d6845c016 req-c1187723-c8ad-4145-b262-df4a31a62fd3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:20.287710 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8246bef9-b428-4702-935b-685d6845c016 req-c1187723-c8ad-4145-b262-df4a31a62fd3 service nova] Creating event network-changed:40bc58c6-9ff4-4136-abde-c49129732495 for instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a on n-h1-854653-7 Nov 03 04:59:20.288190 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8246bef9-b428-4702-935b-685d6845c016 req-c1187723-c8ad-4145-b262-df4a31a62fd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104247 Nov 03 04:59:20.288909 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3563/7015] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:59:20.461361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:20.469233 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8419bafc-76a0-42b0-a110-b9a80695792e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1576 microversion: 2.1 time: 0.216388 Nov 03 04:59:20.469820 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3453/7016] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:20 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 04:59:21.496951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:21.497627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:21.506490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:21.507030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:21.507489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:21.508199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:21.508670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:21.509158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:21.512990 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58348. Nov 03 04:59:21.516115 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58350. Nov 03 04:59:21.725276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:21.733208 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bcec5e67-e100-4c6f-a80c-eca94896adff tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1576 microversion: 2.1 time: 0.242628 Nov 03 04:59:21.733787 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3564/7017] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:21 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:22.370825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-67b9f873-db8d-43d8-99e1-3e16945e2372 req-af8e65c8-6dcf-43ad-a012-7053e6ba0020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900f39a6-f047-4ad6-b241-cfa4a3d0d08a", "name": "network-vif-deleted", "tag": "40bc58c6-9ff4-4136-abde-c49129732495"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:59:22.384423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-67b9f873-db8d-43d8-99e1-3e16945e2372 req-af8e65c8-6dcf-43ad-a012-7053e6ba0020 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:22.384916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-67b9f873-db8d-43d8-99e1-3e16945e2372 req-af8e65c8-6dcf-43ad-a012-7053e6ba0020 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:22.385381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-67b9f873-db8d-43d8-99e1-3e16945e2372 req-af8e65c8-6dcf-43ad-a012-7053e6ba0020 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:22.397026 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58358. Nov 03 04:59:22.398288 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 58356. Nov 03 04:59:22.400499 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-67b9f873-db8d-43d8-99e1-3e16945e2372 req-af8e65c8-6dcf-43ad-a012-7053e6ba0020 service nova] Creating event network-vif-deleted:40bc58c6-9ff4-4136-abde-c49129732495 for instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a on n-h1-854653-7 Nov 03 04:59:22.405351 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-67b9f873-db8d-43d8-99e1-3e16945e2372 req-af8e65c8-6dcf-43ad-a012-7053e6ba0020 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038218 Nov 03 04:59:22.408550 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3454/7018] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:59:22.756135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:22.756777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:22.764185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:22.764696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:22.765259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:22.766081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:22.766557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:22.766999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:22.832512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:22.840999 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-43b5df45-e900-4879-86cb-f3f6586531f8 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1225 microversion: 2.1 time: 0.088926 Nov 03 04:59:22.841599 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3565/7019] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:22 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:23.866763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:23.867680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:23.873968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:23.874457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:23.875041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:23.875826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:23.876413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:23.876847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:23.954682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:23.962818 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9618869b-f173-450c-b2d3-576022cf4813 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1225 microversion: 2.1 time: 0.101922 Nov 03 04:59:23.963402 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3455/7020] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:23 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:24.986235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:24.987062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:24.994199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:24.994722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:24.995161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:24.995880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:24.996361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:24.996805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:25.063085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:25.071388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a25f274-d413-4958-a6ef-7ed1d58ec652 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1225 microversion: 2.1 time: 0.089298 Nov 03 04:59:25.071967 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3566/7021] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:24 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:26.095301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:26.095918 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:26.103172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:26.103661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:26.104133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:26.104830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:26.105314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:26.105744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:26.168022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:26.176582 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2492f61-616f-4102-840f-528c7a09e46c tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1225 microversion: 2.1 time: 0.084547 Nov 03 04:59:26.177169 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3456/7022] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:26 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:27.199879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:27.200516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:27.207743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:27.208808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:27.209294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:27.210086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:27.210569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:27.210991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:27.242348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:27.242841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:27.243290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:27.243796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lazy-loading 'fault' on Instance uuid 900f39a6-f047-4ad6-b241-cfa4a3d0d08a {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:59:27.287602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:27.294885 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6898049-6ac5-4d8c-b72e-3be7ea92b3ab tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 200 len: 1184 microversion: 2.1 time: 0.099003 Nov 03 04:59:27.295457 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3567/7023] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:27 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 1184 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:28.318522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:28.319243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 900f39a6-f047-4ad6-b241-cfa4a3d0d08a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:28.326137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:28.326627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:28.327100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:28.327797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:28.328290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:28.328721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:28.342670 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a could not be found. Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a HTTP/1.1 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a could not be found. Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '900f39a6-f047-4ad6-b241-cfa4a3d0d08a'} Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a could not be found. Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a could not be found. Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:28.344322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a could not be found. Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 900f39a6-f047-4ad6-b241-cfa4a3d0d08a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:59:28.349837 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b69b5f21-853a-402a-910f-4778fd9eb576 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a" status: 404 len: 111 microversion: 2.1 time: 0.031255 Nov 03 04:59:28.350487 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3457/7024] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:28 2022] GET /compute/v2.1/servers/900f39a6-f047-4ad6-b241-cfa4a3d0d08a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:59:35.072492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-f2c1c068-732e-46b2-b671-09a726b5cc9a req-6a4e0d8b-1552-4ef4-957c-0776972b582b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd755f94-d1ee-4039-9836-673a5e2e39f1", "tag": "036c2e68-7653-48bc-a164-83f322d142c7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:59:35.075722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:35.076352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:35.090725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:35.091148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f2c1c068-732e-46b2-b671-09a726b5cc9a req-6a4e0d8b-1552-4ef4-957c-0776972b582b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:35.091636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:35.092109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:35.092326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f2c1c068-732e-46b2-b671-09a726b5cc9a req-6a4e0d8b-1552-4ef4-957c-0776972b582b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:35.092972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:35.093129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f2c1c068-732e-46b2-b671-09a726b5cc9a req-6a4e0d8b-1552-4ef4-957c-0776972b582b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:35.093487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:35.093931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:35.105810 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-f2c1c068-732e-46b2-b671-09a726b5cc9a req-6a4e0d8b-1552-4ef4-957c-0776972b582b service nova] Creating event network-changed:036c2e68-7653-48bc-a164-83f322d142c7 for instance bd755f94-d1ee-4039-9836-673a5e2e39f1 on n-h2-854653-7 Nov 03 04:59:35.112410 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-f2c1c068-732e-46b2-b671-09a726b5cc9a req-6a4e0d8b-1552-4ef4-957c-0776972b582b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043605 Nov 03 04:59:35.113786 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3458/7025] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:59:35.135936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 04:59:35.390115 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8415f7dd-92e1-44f8-b630-e07da461ebf7 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 204 len: 0 microversion: 2.1 time: 0.323385 Nov 03 04:59:35.390769 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3568/7026] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:59:35 2022] DELETE /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 04:59:35.400152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:35.400875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:35.407258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:35.407757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:35.408205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:35.408942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:35.409583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:35.410169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:35.643091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:35.653328 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ddfa40cb-4b24-4c3c-8d55-2c5a013e2d7f tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1577 microversion: 2.1 time: 0.257711 Nov 03 04:59:35.654399 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3459/7027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:35 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1577 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:36.616209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a4fa5789-7796-4704-8d66-1da097940c9b req-323c7a52-c154-49e1-8f70-16c0c6eeff81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd755f94-d1ee-4039-9836-673a5e2e39f1", "name": "network-vif-deleted", "tag": "036c2e68-7653-48bc-a164-83f322d142c7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 04:59:36.627459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a4fa5789-7796-4704-8d66-1da097940c9b req-323c7a52-c154-49e1-8f70-16c0c6eeff81 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:36.627962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a4fa5789-7796-4704-8d66-1da097940c9b req-323c7a52-c154-49e1-8f70-16c0c6eeff81 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:36.628419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a4fa5789-7796-4704-8d66-1da097940c9b req-323c7a52-c154-49e1-8f70-16c0c6eeff81 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:36.639201 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a4fa5789-7796-4704-8d66-1da097940c9b req-323c7a52-c154-49e1-8f70-16c0c6eeff81 service nova] Creating event network-vif-deleted:036c2e68-7653-48bc-a164-83f322d142c7 for instance bd755f94-d1ee-4039-9836-673a5e2e39f1 on n-h2-854653-7 Nov 03 04:59:36.644298 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a4fa5789-7796-4704-8d66-1da097940c9b req-323c7a52-c154-49e1-8f70-16c0c6eeff81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032859 Nov 03 04:59:36.644948 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3569/7028] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 04:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 04:59:36.678504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:36.679124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:36.687855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:36.688347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:36.688816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:36.689552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:36.690008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:36.690437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:36.756704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:36.764606 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5a93aca3-f026-4ec0-938a-60bb20bbd276 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1392 microversion: 2.1 time: 0.091534 Nov 03 04:59:36.765402 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3460/7029] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:36 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1392 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:37.789765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:37.790572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:37.797746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:37.798253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:37.798708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:37.799419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:37.799892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:37.800344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:37.874920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:37.883986 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42b87a4c-9bf0-41dc-8526-2e0a0e69d221 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1225 microversion: 2.1 time: 0.098500 Nov 03 04:59:37.890311 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3570/7030] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:37 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:38.907913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:38.908715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:38.915903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:38.916470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:38.916978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:38.917799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:38.918325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:38.918818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:38.983613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:38.992165 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-53278b24-0e33-4a1a-9269-6e65f024d545 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1225 microversion: 2.1 time: 0.088294 Nov 03 04:59:38.992840 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3461/7031] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:38 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:40.015629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:40.016311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:40.024135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:40.024646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:40.025139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:40.025919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:40.026324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:40.026771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:40.089442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:40.097380 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c73816c8-f1e2-42dd-8957-007c8419f34e tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1225 microversion: 2.1 time: 0.085723 Nov 03 04:59:40.097954 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3571/7032] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:40 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:41.119904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:41.120531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:41.127265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:41.127757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:41.128204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:41.128897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:41.129465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:41.129899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:41.161574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:41.162061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:41.162504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:41.162978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lazy-loading 'fault' on Instance uuid bd755f94-d1ee-4039-9836-673a5e2e39f1 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 04:59:41.202266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ee7516af8914747a194bcae12b4a823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4096c247ec0947bfae574ea7f4564c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 04:59:41.210503 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19509948-2199-445e-9a95-e979f6efc7d2 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 200 len: 1230 microversion: 2.1 time: 0.094504 Nov 03 04:59:41.211081 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3462/7033] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:41 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 04:59:42.234510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:42.235152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: bd755f94-d1ee-4039-9836-673a5e2e39f1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:42.242609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:42.243110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:42.243570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:42.244279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:42.244754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:42.245243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:42.258529 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance bd755f94-d1ee-4039-9836-673a5e2e39f1 could not be found. Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 HTTP/1.1 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance bd755f94-d1ee-4039-9836-673a5e2e39f1 could not be found. Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'bd755f94-d1ee-4039-9836-673a5e2e39f1'} Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd755f94-d1ee-4039-9836-673a5e2e39f1 could not be found. Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd755f94-d1ee-4039-9836-673a5e2e39f1 could not be found. Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:42.260245 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd755f94-d1ee-4039-9836-673a5e2e39f1 could not be found. Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance bd755f94-d1ee-4039-9836-673a5e2e39f1 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58ba5844-12f8-4fbc-87e2-fd23f11c32d0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1" status: 404 len: 111 microversion: 2.1 time: 0.031193 Nov 03 04:59:42.264899 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3572/7034] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:42 2022] GET /compute/v2.1/servers/bd755f94-d1ee-4039-9836-673a5e2e39f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:59:42.763785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:42.764301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:42.771865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:42.772394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:42.772846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:42.773846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:42.774314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:42.774753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:42.788706 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 HTTP/1.1 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '8353dfb1-e85f-48e1-8f9e-a4d35d405dc8'} Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:59:42.790345 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-652725e0-df0d-45c6-9306-7a7b4e3efcb0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 404 len: 111 microversion: 2.1 time: 0.032040 Nov 03 04:59:42.795002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3463/7035] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 04:59:42 2022] DELETE /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:59:42.800904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:42.801609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] [instance: 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 04:59:42.807612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:42.808116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:42.808572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:42.809312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 04:59:42.809787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 04:59:42.810232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 04:59:42.826692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] HTTP exception thrown: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Request method failure captured: Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 HTTP/1.1 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0eEw85_1jxtth-ZSciZHrOynMKQZ_aFrl-GgzZ_yl67RRU0cvmE9EDB6FeVk8ZbQlZR019OT36ipBxzSsiQNCvWslrlqHPIwwIh7l9sMNDMyGhmhZzyaoNXbBKJR7EUTm2-eq841i2G_rBX_h3_J_o5LIHKl2r30yiZ0YDevoPvi6g Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4096c247ec0947bfae574ea7f4564c9f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4096c247ec0947bfae574ea7f4564c9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4096c247ec0947bfae574ea7f4564c9f"}]}] Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4096c247ec0947bfae574ea7f4564c9f Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1362998636 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 7ee7516af8914747a194bcae12b4a823 Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestVolumeBootPattern-1362998636-project Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '8353dfb1-e85f-48e1-8f9e-a4d35d405dc8'} Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 04:59:42.828236 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Returning 404 to user: Instance 8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-adddba7f-7076-47d5-ab2e-f311c129f9a0 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8" status: 404 len: 111 microversion: 2.1 time: 0.032723 Nov 03 04:59:42.833509 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3573/7036] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 04:59:42 2022] GET /compute/v2.1/servers/8353dfb1-e85f-48e1-8f9e-a4d35d405dc8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 04:59:46.434131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24a9b729-c8d4-4cac-8d8a-ba979b570584 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] Calling method '.version_select at 0x7ff7f9d1b4c0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 04:59:46.504759 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24a9b729-c8d4-4cac-8d8a-ba979b570584 tempest-TestVolumeBootPattern-1362998636 tempest-TestVolumeBootPattern-1362998636-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1199888532" status: 202 len: 0 microversion: 2.1 time: 0.074577 Nov 03 04:59:46.505514 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3464/7037] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Nov 3 04:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1199888532 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:00:06.715445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:06.716241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:06.824209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-386845630", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:06.877642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] validate_networks() for None {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:00:07.069844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:00:07.070306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:00:07.070794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:00:07.071219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:00:07.071646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:00:07.080805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:07.082745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:07.082745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:07.082745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:07.083093 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:07.083477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:07.100909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Getting quotas for project dae9d0fba46247978b6e0d6a6d8b4363. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:00:07.106534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Getting quotas for user f0973eeb5a334bf49856b0a96bdd6fbd and project dae9d0fba46247978b6e0d6a6d8b4363. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:00:07.119395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:00:07.121731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:00:07.253003 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-186a456a-4cad-49bc-8494-466676af651e tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542724 Nov 03 05:00:07.253884 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3574/7038] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:00:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:00:07.264111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:07.265476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:07.272582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7ca3bb4-73c5-4c8c-82e0-1dc2d00e5363 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:07.273801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7ca3bb4-73c5-4c8c-82e0-1dc2d00e5363 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:07.328353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7ca3bb4-73c5-4c8c-82e0-1dc2d00e5363 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:07.338958 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7ca3bb4-73c5-4c8c-82e0-1dc2d00e5363 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1221 microversion: 2.1 time: 0.076565 Nov 03 05:00:07.339969 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3465/7039] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:07 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1221 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:08.365379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:08.366020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:08.372381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:08.372872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:08.373369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:08.374083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:08.374602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:08.375047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:08.443198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:08.451951 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2ad437f3-f030-4822-ba6e-42c5dd4dd1e0 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1225 microversion: 2.1 time: 0.091666 Nov 03 05:00:08.452522 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3575/7040] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:08 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:09.476577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:09.477261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:09.486315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:09.486807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:09.487251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:09.488082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:09.488554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:09.488984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:09.580715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:09.588898 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-13ac4a60-3ba5-429b-ba5f-dd66fb51d297 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1281 microversion: 2.1 time: 0.116861 Nov 03 05:00:09.589517 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3466/7041] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:09 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:10.618321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:10.619757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:10.626642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:10.634483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:10.634483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:10.634483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:10.634483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:10.634483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:10.867559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:10.875665 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5ac1c06e-ba26-4d37-9eeb-4c4351e91bfb tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1321 microversion: 2.1 time: 0.262752 Nov 03 05:00:10.876255 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3576/7042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:10 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:11.443689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b25f3e37-206f-4db0-9ba4-1b25d9aa0922 req-fe33dae4-3c1a-45f5-8487-dfa292a41645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27f9ace-95c1-495f-952b-96efd4e928c3", "tag": "01effb60-f2ab-4e00-9a51-da4534d7a212"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:11.458046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b25f3e37-206f-4db0-9ba4-1b25d9aa0922 req-fe33dae4-3c1a-45f5-8487-dfa292a41645 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:11.458046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b25f3e37-206f-4db0-9ba4-1b25d9aa0922 req-fe33dae4-3c1a-45f5-8487-dfa292a41645 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:11.458046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b25f3e37-206f-4db0-9ba4-1b25d9aa0922 req-fe33dae4-3c1a-45f5-8487-dfa292a41645 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:11.468333 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b25f3e37-206f-4db0-9ba4-1b25d9aa0922 req-fe33dae4-3c1a-45f5-8487-dfa292a41645 service nova] Creating event network-changed:01effb60-f2ab-4e00-9a51-da4534d7a212 for instance b27f9ace-95c1-495f-952b-96efd4e928c3 on n-h2-854653-7 Nov 03 05:00:11.473527 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b25f3e37-206f-4db0-9ba4-1b25d9aa0922 req-fe33dae4-3c1a-45f5-8487-dfa292a41645 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034549 Nov 03 05:00:11.474130 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3467/7043] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:00:11.899378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:11.900022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:11.906818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:11.907322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:11.907820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:11.908549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:11.909062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:11.909501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:12.126173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:12.131664 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cd05a9c7-0da3-446b-a01f-c94633c7cb41 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1321 microversion: 2.1 time: 0.236423 Nov 03 05:00:12.132628 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3577/7044] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:11 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:13.155310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:13.156014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:13.163272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:13.163756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:13.164241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:13.164880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:13.165377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:13.165805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:13.296407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:13.304644 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1a9b8d39-a1f6-4a4e-81a0-0dbb1da1b047 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1321 microversion: 2.1 time: 0.153602 Nov 03 05:00:13.305259 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3468/7045] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:13 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:14.327864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:14.328506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:14.336090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:14.336598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:14.337094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:14.337819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:14.338298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:14.338749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:14.466052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:14.474075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-51d72531-c586-417f-b5a4-45ee35b770ee tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1321 microversion: 2.1 time: 0.150204 Nov 03 05:00:14.474655 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3578/7046] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:14 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:15.496769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:15.497420 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:15.504308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:15.504798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:15.505284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:15.505989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:15.506450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:15.506884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:15.970836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:15.978545 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8df3f941-75cd-4ae7-b696-f09ae3c95aa5 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1321 microversion: 2.1 time: 0.485783 Nov 03 05:00:15.979127 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3469/7047] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:15 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:16.674023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-87854ed8-2574-4130-bedc-b97386ddea48 req-005a5926-dd82-4467-afe4-2678bab8ff23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f9ace-95c1-495f-952b-96efd4e928c3", "name": "network-vif-plugged", "status": "completed", "tag": "01effb60-f2ab-4e00-9a51-da4534d7a212"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:16.684839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-87854ed8-2574-4130-bedc-b97386ddea48 req-005a5926-dd82-4467-afe4-2678bab8ff23 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:16.685365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-87854ed8-2574-4130-bedc-b97386ddea48 req-005a5926-dd82-4467-afe4-2678bab8ff23 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:16.685815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-87854ed8-2574-4130-bedc-b97386ddea48 req-005a5926-dd82-4467-afe4-2678bab8ff23 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:16.696762 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-87854ed8-2574-4130-bedc-b97386ddea48 req-005a5926-dd82-4467-afe4-2678bab8ff23 service nova] Creating event network-vif-plugged:01effb60-f2ab-4e00-9a51-da4534d7a212 for instance b27f9ace-95c1-495f-952b-96efd4e928c3 on n-h2-854653-7 Nov 03 05:00:16.702015 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-87854ed8-2574-4130-bedc-b97386ddea48 req-005a5926-dd82-4467-afe4-2678bab8ff23 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031921 Nov 03 05:00:16.702647 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3579/7048] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:00:17.000914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:17.001564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:17.008331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:17.008858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:17.009341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:17.010042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:17.010510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:17.010944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:17.139429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:17.147697 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4fbc39d6-f73c-4df8-8223-341fe7f69860 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1321 microversion: 2.1 time: 0.150673 Nov 03 05:00:17.148550 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3470/7049] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:16 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:18.168648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:18.169451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:18.174474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:18.175197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:18.182030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:18.182541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:18.183002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:18.183726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:18.184202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:18.184649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:18.319094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:18.326954 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0b49d022-6105-4556-82e7-b1077cb7a423 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1470 microversion: 2.1 time: 0.159378 Nov 03 05:00:18.327545 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3580/7050] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:18 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:18.354445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:18.406139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-57cb2a99-f4e0-4794-9d73-6c709f3af5da tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Calling method '.version_select at 0x7ff7f8714d30>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:18.470799 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-57cb2a99-f4e0-4794-9d73-6c709f3af5da tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7be2ba1e10c54423b84d756d11751b70" status: 200 len: 371 microversion: 2.1 time: 0.120981 Nov 03 05:00:18.471379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3471/7051] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 05:00:18 2022] GET /compute/v2.1/os-quota-sets/7be2ba1e10c54423b84d756d11751b70 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:00:18.483856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-76b74167-6ea2-4db7-b5c0-428d56c17546 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-330233930", "id": 73831079, "os-flavor-access:is_public": "True"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:18.558582 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-76b74167-6ea2-4db7-b5c0-428d56c17546 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.078424 Nov 03 05:00:18.559182 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3581/7052] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:00:18 2022] POST /compute/v2.1/flavors => generated 431 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:00:18.571972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "73831079"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:18.574357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:18.580562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:18.581077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:18.581529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:18.582230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:18.583215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:18.583651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:18.669299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd3a24775de93452a9c1753bce4a78389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be2ba1e10c54423b84d756d11751b70', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:18.675421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-330233930 {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:00:18.682036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:18.682517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:18.682954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:18.683683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:18.684141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:18.684572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:18.706171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Getting quotas for project dae9d0fba46247978b6e0d6a6d8b4363. Resources: {'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:00:18.711827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Getting quotas for user f0973eeb5a334bf49856b0a96bdd6fbd and project dae9d0fba46247978b6e0d6a6d8b4363. Resources: {'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:00:18.726699 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.compute.api [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] ram quota exceeded for 7be2ba1e10c54423b84d756d11751b70, tried to resize instance. Nov 03 05:00:18.727241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Request method failure captured: Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3/action HTTP/1.1 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 37 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0rWtBXO3jD-EeU45aGlOPOpzpH-R3xSNh3Qpr2-DXbo4Dc4SsJYF_37wQz2HpTLjAxqbIo094M-raD2nE_6p6lpFnNHDSOoQ2NDS3zouqd9tMaB1QNY3Zm5sFdbBTrdaHsep0Ge1nvpecZYCWrEkMZ_aRSMVyrCH1562s40bAjPYH0 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 7be2ba1e10c54423b84d756d11751b70 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-586645480 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Role: admin,reader,member Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: admin,reader,member Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7be2ba1e10c54423b84d756d11751b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7be2ba1e10c54423b84d756d11751b70", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7be2ba1e10c54423b84d756d11751b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7be2ba1e10c54423b84d756d11751b70"}]}] Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersAdminNegativeTestJSON-586645480 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 7be2ba1e10c54423b84d756d11751b70 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-586645480 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersAdminNegativeTestJSON-586645480-project-admin Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d3a24775de93452a9c1753bce4a78389 Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersAdminNegativeTestJSON-586645480-project-admin Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: {"resize": {"flavorRef": "73831079"}} Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'b27f9ace-95c1-495f-952b-96efd4e928c3', 'body': {'resize': {'flavorRef': '73831079'}}} Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:00:18.729325 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3bd741b7-1dc7-4ece-afc0-b317b4d55be0 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3/action" status: 403 len: 118 microversion: 2.1 time: 0.163056 Nov 03 05:00:18.734467 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3472/7053] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:00:18 2022] POST /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3/action => generated 118 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:00:18.739718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-64ed73e7-76f7-44c3-a477-082309bc7350 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:18.850903 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-64ed73e7-76f7-44c3-a477-082309bc7350 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/73831079" status: 202 len: 0 microversion: 2.1 time: 0.114930 Nov 03 05:00:18.851500 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3582/7054] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Nov 3 05:00:18 2022] DELETE /compute/v2.1/flavors/73831079 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:00:18.859471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd803fcf-b867-4a8c-88d5-81dbd8691048 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:18.879856 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd803fcf-b867-4a8c-88d5-81dbd8691048 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023582 Nov 03 05:00:18.880423 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3473/7055] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 05:00:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:18.901196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb619090-b333-49af-811c-f8adf75110da tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Calling method '.version_select at 0x7ff7f921cee0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:18.966844 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb619090-b333-49af-811c-f8adf75110da tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "GET /compute/v2.1/os-quota-sets/7be2ba1e10c54423b84d756d11751b70" status: 200 len: 371 microversion: 2.1 time: 0.069729 Nov 03 05:00:18.967427 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3583/7056] 10.222.0.30 () {58 vars in 1242 bytes} [Thu Nov 3 05:00:18 2022] GET /compute/v2.1/os-quota-sets/7be2ba1e10c54423b84d756d11751b70 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:00:18.979156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-598bf93a-b06c-4ef1-9951-3662a47f2d42 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1658774982", "id": 1479899887, "os-flavor-access:is_public": "True"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:19.078538 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-598bf93a-b06c-4ef1-9951-3662a47f2d42 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.103078 Nov 03 05:00:19.079127 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3474/7057] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:00:18 2022] POST /compute/v2.1/flavors => generated 437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:00:19.091954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1479899887"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:19.094437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:19.100483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.100983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.101486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.102202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.102680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.103126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.281087 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd3a24775de93452a9c1753bce4a78389', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be2ba1e10c54423b84d756d11751b70', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:19.287238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1658774982 {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:00:19.293936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.294432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.294887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.295632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.296106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.296549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.318839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Getting quotas for project dae9d0fba46247978b6e0d6a6d8b4363. Resources: {'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:00:19.323861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Getting quotas for user f0973eeb5a334bf49856b0a96bdd6fbd and project dae9d0fba46247978b6e0d6a6d8b4363. Resources: {'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:00:19.335658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.compute.api [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] cores quota exceeded for 7be2ba1e10c54423b84d756d11751b70, tried to resize instance. Nov 03 05:00:19.336249 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Request method failure captured: Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3/action HTTP/1.1 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 39 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0rWtBXO3jD-EeU45aGlOPOpzpH-R3xSNh3Qpr2-DXbo4Dc4SsJYF_37wQz2HpTLjAxqbIo094M-raD2nE_6p6lpFnNHDSOoQ2NDS3zouqd9tMaB1QNY3Zm5sFdbBTrdaHsep0Ge1nvpecZYCWrEkMZ_aRSMVyrCH1562s40bAjPYH0 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 7be2ba1e10c54423b84d756d11751b70 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-586645480 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Role: admin,reader,member Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: admin,reader,member Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7be2ba1e10c54423b84d756d11751b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7be2ba1e10c54423b84d756d11751b70", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7be2ba1e10c54423b84d756d11751b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7be2ba1e10c54423b84d756d11751b70"}]}] Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersAdminNegativeTestJSON-586645480 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 7be2ba1e10c54423b84d756d11751b70 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-586645480 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersAdminNegativeTestJSON-586645480-project-admin Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d3a24775de93452a9c1753bce4a78389 Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersAdminNegativeTestJSON-586645480-project-admin Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: {"resize": {"flavorRef": "1479899887"}} Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'b27f9ace-95c1-495f-952b-96efd4e928c3', 'body': {'resize': {'flavorRef': '1479899887'}}} Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:00:19.338395 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-343aa99a-9ef4-46d4-bb90-cf57ccf2f03f tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "POST /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3/action" status: 403 len: 113 microversion: 2.1 time: 0.251949 Nov 03 05:00:19.343177 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3584/7058] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:00:19 2022] POST /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3/action => generated 113 bytes in 253 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:00:19.349464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41c0a165-edf9-4a07-8f7f-5f3ff24aafd9 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:19.445499 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41c0a165-edf9-4a07-8f7f-5f3ff24aafd9 tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "DELETE /compute/v2.1/flavors/1479899887" status: 202 len: 0 microversion: 2.1 time: 0.099980 Nov 03 05:00:19.446102 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3475/7059] 10.222.0.30 () {58 vars in 1161 bytes} [Thu Nov 3 05:00:19 2022] DELETE /compute/v2.1/flavors/1479899887 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:00:19.453820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-37a5b283-b801-488d-a64b-d375f68ecd8b tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:19.473504 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-37a5b283-b801-488d-a64b-d375f68ecd8b tempest-ServersAdminNegativeTestJSON-586645480 tempest-ServersAdminNegativeTestJSON-586645480-project-admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023301 Nov 03 05:00:19.474046 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3585/7060] 10.222.0.30 () {58 vars in 1146 bytes} [Thu Nov 3 05:00:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:00:19.497196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:19.497715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:19.503797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.504291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.504774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.505504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.506636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.507068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.535154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:00:19.811003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c5ad17da-6e69-442c-8160-527a1f9cbb07 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 204 len: 0 microversion: 2.1 time: 0.317507 Nov 03 05:00:19.811636 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3476/7061] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:00:19 2022] DELETE /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:00:19.822843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:19.822843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:19.826832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.827333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.827791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.828503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:19.828979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:19.829459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:19.971048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:19.979848 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a2236739-4511-4ab1-a94c-6a381fec9104 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1476 microversion: 2.1 time: 0.163706 Nov 03 05:00:19.980413 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3586/7062] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:19 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1476 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:21.004050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:21.004757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:21.012214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:21.012704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:21.013178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:21.013875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:21.014332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:21.014761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:21.143849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:21.152514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31f7a877-780d-4a8f-87c4-eb5cee1c7f54 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1476 microversion: 2.1 time: 0.152855 Nov 03 05:00:21.153109 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3477/7063] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:20 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:21.753329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a6360648-0458-46fe-bce2-5171d8395620 req-e3383961-dd46-4271-92e2-0f17d3a1e8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27f9ace-95c1-495f-952b-96efd4e928c3", "name": "network-vif-deleted", "tag": "01effb60-f2ab-4e00-9a51-da4534d7a212"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:21.764419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6360648-0458-46fe-bce2-5171d8395620 req-e3383961-dd46-4271-92e2-0f17d3a1e8da service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:21.764918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6360648-0458-46fe-bce2-5171d8395620 req-e3383961-dd46-4271-92e2-0f17d3a1e8da service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:21.765405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a6360648-0458-46fe-bce2-5171d8395620 req-e3383961-dd46-4271-92e2-0f17d3a1e8da service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:21.777705 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a6360648-0458-46fe-bce2-5171d8395620 req-e3383961-dd46-4271-92e2-0f17d3a1e8da service nova] Creating event network-vif-deleted:01effb60-f2ab-4e00-9a51-da4534d7a212 for instance b27f9ace-95c1-495f-952b-96efd4e928c3 on n-h2-854653-7 Nov 03 05:00:21.783075 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a6360648-0458-46fe-bce2-5171d8395620 req-e3383961-dd46-4271-92e2-0f17d3a1e8da service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036702 Nov 03 05:00:21.783900 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3587/7064] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:00:22.174449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:22.175044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:22.182030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:22.182524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:22.182967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:22.183675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:22.184141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:22.184667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:22.216531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:22.217053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:22.217560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:22.218025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lazy-loading 'fault' on Instance uuid b27f9ace-95c1-495f-952b-96efd4e928c3 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:00:22.258884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0973eeb5a334bf49856b0a96bdd6fbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dae9d0fba46247978b6e0d6a6d8b4363', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:22.266614 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-114b06c5-0ec4-4ec1-a1cb-f1c5cd260666 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 200 len: 1311 microversion: 2.1 time: 0.096140 Nov 03 05:00:22.267186 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3478/7065] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:22 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:23.303880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:23.304602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] [instance: b27f9ace-95c1-495f-952b-96efd4e928c3] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:23.310837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:23.311339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:23.311821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:23.312529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:23.313006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:23.313510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:23.326595 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] HTTP exception thrown: Instance b27f9ace-95c1-495f-952b-96efd4e928c3 could not be found. Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Request method failure captured: Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 HTTP/1.1 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0rVQ5YobTXEKB5cbsduN_wH21xm5iStRvdl1sF_-9g8RisQekbeIyPzDtVvEtJxCQSNFa85JVJPBB-c6uLTcih7z6X3iWXCwISK6LrMciPx5MbAtZogZIx23DhmDlXufcEfokG8ke1GqLbS33I64eoHKR8Kz7XtDqt9eU00nOh0YBA Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: dae9d0fba46247978b6e0d6a6d8b4363 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-959251004 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dae9d0fba46247978b6e0d6a6d8b4363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_dae9d0fba46247978b6e0d6a6d8b4363", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/dae9d0fba46247978b6e0d6a6d8b4363"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/dae9d0fba46247978b6e0d6a6d8b4363"}]}] Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersAdminNegativeTestJSON-959251004 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: dae9d0fba46247978b6e0d6a6d8b4363 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-959251004 Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersAdminNegativeTestJSON-959251004-project Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: f0973eeb5a334bf49856b0a96bdd6fbd Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersAdminNegativeTestJSON-959251004-project Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance b27f9ace-95c1-495f-952b-96efd4e928c3 could not be found. Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'b27f9ace-95c1-495f-952b-96efd4e928c3'} Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b27f9ace-95c1-495f-952b-96efd4e928c3 could not be found. Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b27f9ace-95c1-495f-952b-96efd4e928c3 could not be found. Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:23.328222 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b27f9ace-95c1-495f-952b-96efd4e928c3 could not be found. Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] Returning 404 to user: Instance b27f9ace-95c1-495f-952b-96efd4e928c3 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f31defc6-f9d6-493d-8ed5-4ff1b9570e13 tempest-ServersAdminNegativeTestJSON-959251004 tempest-ServersAdminNegativeTestJSON-959251004-project] 10.222.0.30 "GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3" status: 404 len: 111 microversion: 2.1 time: 0.031787 Nov 03 05:00:23.332700 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3588/7066] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:23 2022] GET /compute/v2.1/servers/b27f9ace-95c1-495f-952b-96efd4e928c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:00:31.616983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:31.617808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:31.734697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1677403960", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "4801bbef-502c-4067-bb46-5967abd5e212"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:31.790223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] validate_networks() for [('4801bbef-502c-4067-bb46-5967abd5e212', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:00:32.173320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:00:32.173748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:00:32.174223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:00:32.174638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:00:32.175072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:00:32.184619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:32.185163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:32.185616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:32.186395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:32.186917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:32.187355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:32.205728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Getting quotas for project 4a49fe0944c944789f6ffc9497dd3b15. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:00:32.211841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Getting quotas for user 375274dabfd747f9858aa4103f0d2b6e and project 4a49fe0944c944789f6ffc9497dd3b15. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:00:32.227917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:00:32.230685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:00:32.369189 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-806def56-58ea-404b-bc9c-465c72401211 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757321 Nov 03 05:00:32.369850 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3479/7067] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 05:00:32.381175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-413ada31-ca1a-459f-bc5e-639b276dd791 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:32.382127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-413ada31-ca1a-459f-bc5e-639b276dd791 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:32.395710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:32.395710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:32.452010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-413ada31-ca1a-459f-bc5e-639b276dd791 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:32.460070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-413ada31-ca1a-459f-bc5e-639b276dd791 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1215 microversion: 2.1 time: 0.083021 Nov 03 05:00:32.461480 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3589/7068] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:32 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:33.483034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:33.485836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:33.492422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:33.492912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:33.493387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:33.494110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:33.494565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:33.495048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:33.559877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:33.572810 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-937eec01-2308-4093-81b8-d8c1b5a07e54 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1211 microversion: 2.1 time: 0.090021 Nov 03 05:00:33.572810 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3480/7069] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:33 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:34.593545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:34.594299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:34.596196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=57 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:34.603929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:34.604536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:34.605153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:34.605927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:34.606611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:34.607280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:34.699192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:34.707254 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-68f38b64-b032-4451-8878-5651d2da87f8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1267 microversion: 2.1 time: 0.118562 Nov 03 05:00:34.707926 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3590/7070] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:34 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:35.733852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:35.734830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:35.748564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:35.749112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:35.749566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:35.750474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:35.751232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:35.751679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:36.011902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:36.020269 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ecff45e-c0d1-4d43-9384-5c01e86d0026 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.293372 Nov 03 05:00:36.020851 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3481/7071] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:35 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:36.618668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dcaf3d5e-a202-4d34-889b-12da8a7d7905 req-44007902-c43b-433b-85c3-cd0babaf0991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59c3871-7780-44be-8569-13b826a67d84", "tag": "b9d4b5f0-d61b-41ad-9bcc-6ceda754639d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:36.629772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dcaf3d5e-a202-4d34-889b-12da8a7d7905 req-44007902-c43b-433b-85c3-cd0babaf0991 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:36.630268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dcaf3d5e-a202-4d34-889b-12da8a7d7905 req-44007902-c43b-433b-85c3-cd0babaf0991 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:36.634670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dcaf3d5e-a202-4d34-889b-12da8a7d7905 req-44007902-c43b-433b-85c3-cd0babaf0991 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:36.642332 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dcaf3d5e-a202-4d34-889b-12da8a7d7905 req-44007902-c43b-433b-85c3-cd0babaf0991 service nova] Creating event network-changed:b9d4b5f0-d61b-41ad-9bcc-6ceda754639d for instance f59c3871-7780-44be-8569-13b826a67d84 on n-h2-854653-7 Nov 03 05:00:36.647229 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dcaf3d5e-a202-4d34-889b-12da8a7d7905 req-44007902-c43b-433b-85c3-cd0babaf0991 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033279 Nov 03 05:00:36.648023 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3591/7072] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:00:37.044332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:37.044956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:37.051802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:37.052297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:37.052747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:37.054029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:37.054498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:37.055272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:37.260346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:37.268123 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c623c9bf-fcb0-49e8-927f-d0358b35510a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.227747 Nov 03 05:00:37.268690 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3482/7073] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:37 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:38.294211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:38.294968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:38.296960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:38.301897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:38.302405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:38.302870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:38.304161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:38.304640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:38.305165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:38.435338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:38.442984 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b92f5b10-d0e3-46d5-8f2e-179bcc8cea7b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.153944 Nov 03 05:00:38.443552 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3592/7074] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:38 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:00:39.465354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:39.466012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:39.472732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:39.473251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:39.473694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:39.474415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:39.474870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:39.475297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:39.604755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:39.611914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6598b0cd-2e15-457d-be6e-58265cf3a443 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.150460 Nov 03 05:00:39.612489 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3483/7075] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:39 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:40.636768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:40.637453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:40.644326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:40.644825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:40.645327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:40.646042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:40.646516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:40.646984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:40.780805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:40.789382 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d6cadb8c-6cd4-4aae-99aa-74977aa692f1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.157449 Nov 03 05:00:40.789967 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3593/7076] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:40 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:41.814845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:41.815469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:41.818213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:41.823600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:41.825464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:41.825464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:41.825464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:41.825773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:41.826153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:41.828716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:41.958111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:41.965588 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-483fdbf1-dc31-432f-8a58-5dd1aa534126 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.154652 Nov 03 05:00:41.966773 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3484/7077] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:41 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:42.767720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d72e0f5d-ba12-49d0-ba7b-fdd924ae8eac req-3b91b6c5-cb8e-4167-8f18-04e7a14427bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59c3871-7780-44be-8569-13b826a67d84", "name": "network-vif-plugged", "status": "completed", "tag": "b9d4b5f0-d61b-41ad-9bcc-6ceda754639d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:42.779055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d72e0f5d-ba12-49d0-ba7b-fdd924ae8eac req-3b91b6c5-cb8e-4167-8f18-04e7a14427bd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:42.779548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d72e0f5d-ba12-49d0-ba7b-fdd924ae8eac req-3b91b6c5-cb8e-4167-8f18-04e7a14427bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:42.779993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d72e0f5d-ba12-49d0-ba7b-fdd924ae8eac req-3b91b6c5-cb8e-4167-8f18-04e7a14427bd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:42.790765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d72e0f5d-ba12-49d0-ba7b-fdd924ae8eac req-3b91b6c5-cb8e-4167-8f18-04e7a14427bd service nova] Creating event network-vif-plugged:b9d4b5f0-d61b-41ad-9bcc-6ceda754639d for instance f59c3871-7780-44be-8569-13b826a67d84 on n-h2-854653-7 Nov 03 05:00:42.797386 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d72e0f5d-ba12-49d0-ba7b-fdd924ae8eac req-3b91b6c5-cb8e-4167-8f18-04e7a14427bd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031934 Nov 03 05:00:42.797386 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3594/7078] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:00:42.989248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:42.992294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:42.992440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:42.992989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:42.998871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:42.999366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:42.999810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:43.000517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:43.000976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:43.001436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:43.130675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:43.139184 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-96dd7f20-edf4-455b-a642-c54d4d9428e0 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.153871 Nov 03 05:00:43.139760 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3485/7079] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:42 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:44.162818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:44.163596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:44.170621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:44.171129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:44.171588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:44.172307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:44.172781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:44.178432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:44.306813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:44.316000 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1f1d88c1-04f1-476a-a678-92b8e0449346 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1315 microversion: 2.1 time: 0.157514 Nov 03 05:00:44.316947 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3595/7080] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:44 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:45.338700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:45.339329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:45.346380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:45.346874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:45.347321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:45.348026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:45.348525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:45.348957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:45.482232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:45.490092 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe0e5284-a1f6-4499-83b2-f748d896add1 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1501 microversion: 2.1 time: 0.155868 Nov 03 05:00:45.490707 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3486/7081] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:45 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:45.513391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:00:45.515604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:45.517870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:00:45.524301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:45.524799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:45.525322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:45.526037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:45.526511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:45.526961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:45.555974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:45.561610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Old instance type m1.heat2, new instance type m1.heat {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:00:45.568280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:00:45.568749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:00:45.569271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:00:45.569695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:00:45.570119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:00:45.728982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6106ab8d-99e6-4bba-9aa9-087d0272d37f tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "POST /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84/action" status: 202 len: 0 microversion: 2.1 time: 0.219582 Nov 03 05:00:45.729675 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3596/7082] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:00:45 2022] POST /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:00:45.742153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:45.742777 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:45.748809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:45.749353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:45.749801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:45.750515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:45.750973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:45.751402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:45.883751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:45.892037 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-520817ab-f0fe-4b0c-9081-2d073c24c132 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1510 microversion: 2.1 time: 0.153774 Nov 03 05:00:45.892620 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3487/7083] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:45 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:46.917376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:46.918043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:46.924104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:46.924606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:46.925099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:46.925806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:46.926456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:46.926906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:47.062246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:47.070045 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a16ad02-b05e-4d24-b7a1-cc6b344a74bb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1510 microversion: 2.1 time: 0.158105 Nov 03 05:00:47.070827 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3597/7084] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:46 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:48.093630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:48.094254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:48.101748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:48.102240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:48.102684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:48.103397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:48.103856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:48.104289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:48.341343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:48.349251 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6cd23412-d8ea-4a4b-82c3-6baa5b954241 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1510 microversion: 2.1 time: 0.259472 Nov 03 05:00:48.349840 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3488/7085] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:48 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:49.372837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:49.373503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:49.380588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:49.381129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:49.382220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:49.382981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:49.383460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:49.383909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:49.513120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:49.520784 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce98ce03-dc93-4106-a2ef-2e166e4e38bc tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.151904 Nov 03 05:00:49.521379 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3598/7086] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:49 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:50.543960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:50.544556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:50.551341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:50.551828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:50.552268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:50.552961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:50.553452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:50.553880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:50.683616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:50.691394 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-51a378d6-c9bd-46f9-8daa-7ad99a4d6854 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.151495 Nov 03 05:00:50.691970 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3489/7087] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:50 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:51.715791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:51.716422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:51.722418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:51.722920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:51.723373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:51.724107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:51.724579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:51.725680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:51.859116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:51.866818 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a09b68a8-149a-45f6-ac25-f50ed86cc177 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.155282 Nov 03 05:00:51.867379 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3599/7088] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:51 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:52.890795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:52.891423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:52.897562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:52.898059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:52.898774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:52.899483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:52.899956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:52.900392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:53.028592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:53.036563 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24955608-3784-49f9-bbcf-ab95cc68b7c8 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.150039 Nov 03 05:00:53.037161 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3490/7089] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:52 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:54.060271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:54.060925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:54.068156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:54.068679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:54.069164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:54.069935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:54.070404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:54.070843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:54.204894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:54.212891 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dc13f535-091b-479a-9e6f-5b897cdb658e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.156517 Nov 03 05:00:54.213497 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3600/7090] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:54 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:55.236048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:55.236683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:55.244112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:55.244603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:55.245066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:55.245765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:55.246227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:55.246660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:55.379659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:55.388207 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2402cebc-5ef4-4dbd-bce6-ad93d8d3fedb tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.156050 Nov 03 05:00:55.388784 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3491/7091] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:55 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:56.410864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:56.411441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:56.418650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:56.419157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:56.419616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:56.420328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:56.420799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:56.421293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:56.548521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:56.556260 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-48896995-e218-4dad-9169-ee628dda9ff5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.149426 Nov 03 05:00:56.556824 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3601/7092] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:56 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:57.580811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:57.581470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:57.588834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:57.589354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:57.589794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:57.590490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:57.590957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:57.591386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:57.723813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:57.732158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-af0a8ceb-578f-41b3-8562-a77731b49f86 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.155219 Nov 03 05:00:57.732733 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3492/7093] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:57 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:58.754898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:58.755569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:58.762463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:58.762966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:58.763428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:58.764149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:58.764627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:58.765119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:58.893487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:00:58.902222 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a017323-ba0f-4e89-8956-667971941fad tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.151237 Nov 03 05:00:58.902806 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3602/7094] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:58 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:00:59.925985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:00:59.926807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:00:59.934159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:59.934649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:59.935091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:00:59.935790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:00:59.936251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:00:59.936683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:00.071400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:00.079309 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-93482b8c-2b8f-4c75-9112-fd97840a743b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.157370 Nov 03 05:01:00.079922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3493/7095] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:00:59 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:01.102413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:01.103047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:01.110487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:01.110990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:01.111445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:01.112155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:01.112629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:01.113100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:01.243666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:01.251362 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b2c8d042-892b-47e3-bb70-b9464500417b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.152892 Nov 03 05:01:01.251942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3603/7096] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:01 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:02.275682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:02.276327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:02.283183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:02.283672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:02.284117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:02.284814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:02.285297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:02.285732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:02.418021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:02.425652 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-724eae69-116f-4bef-bb83-33645a1f2375 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.154576 Nov 03 05:01:02.426224 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3494/7097] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:02 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:01:03.448573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:03.449233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:03.456034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:03.456528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:03.456982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:03.457715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:03.458183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:03.458621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:03.586692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:03.594444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2a6c5ef7-c8ea-44c8-a7ad-e40a2f895565 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.149889 Nov 03 05:01:03.595025 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3604/7098] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:03 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:04.617502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:04.619007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:04.624940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:04.625460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:04.625898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:04.626594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:04.627050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:04.627482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:04.760652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:04.768340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e22e89eb-cbf7-4aab-825a-b78a1116404a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.154828 Nov 03 05:01:04.768928 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3495/7099] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:04 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:05.792402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:05.793175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:05.800049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:05.800551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:05.801008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:05.801747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:05.802222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:05.802668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:05.806640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:05.936184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:05.943980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-01b8bc74-d0a2-4641-8b74-74f475827cb7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.155561 Nov 03 05:01:05.944549 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3605/7100] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:05 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:06.967409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:06.968025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:06.975342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:06.975824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:06.976261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:06.976979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:06.977456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:06.977883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:07.106221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:07.113936 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a4c9dd5c-a4d9-480b-a4c4-502e97a39574 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.150469 Nov 03 05:01:07.114506 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3496/7101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:06 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:08.137632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:08.147617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:08.147617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:08.147617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:08.147617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:08.147617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:08.147617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:08.148159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:08.278854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:08.286560 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-576630a3-278c-4ac4-8088-3d44b1c23092 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.153004 Nov 03 05:01:08.287641 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3606/7102] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:08 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:09.309329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:09.309952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:09.316781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:09.317303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:09.317740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:09.318996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:09.319454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:09.319913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:09.448244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:09.456109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-222d22ce-b529-467e-8ff3-579595f15cd2 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.150718 Nov 03 05:01:09.456692 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3497/7103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:09 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:10.479646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:10.480288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:10.483006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=34 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:10.487836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:10.488983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:10.488983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:10.489531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:10.490011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:10.490466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:10.620434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:10.628287 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f94f5353-d365-4d9c-a5ef-9f0b1e4077ef tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.152598 Nov 03 05:01:10.628865 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3607/7104] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:10 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:11.652415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:11.653114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:11.659978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:11.660475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:11.660923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:11.661650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:11.662118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:11.663160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:11.798707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:11.806504 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d61b5124-9e26-4bce-8b96-74b741896a2a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.158246 Nov 03 05:01:11.807075 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3498/7105] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:11 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:12.829287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:12.829911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:12.836759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:12.837297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:12.837757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:12.838510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:12.838986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:12.839433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:12.968507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:12.976779 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-731af282-b582-41c6-8bf7-e0a6685f8076 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.151525 Nov 03 05:01:12.977382 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3608/7106] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:12 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:14.000160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:14.000778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:14.004475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=30 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:14.008505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:14.008990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:14.009452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:14.010141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:14.010595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:14.011023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:14.013627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=90 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:14.143738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:14.152298 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb139c5f-eb86-4cdd-8212-49a60b9edf3c tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.156047 Nov 03 05:01:14.152878 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3499/7107] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:13 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:15.175624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:15.176187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:15.183051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:15.183554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:15.184013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:15.184730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:15.185229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:15.185678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:15.351570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:15.359252 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3137110c-a872-48f6-81d7-de0698eedce5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.187717 Nov 03 05:01:15.360767 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3609/7108] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:15 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:16.383498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:16.384080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:16.391667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:16.392157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:16.392601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:16.393476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:16.393979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:16.394412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:16.529989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:16.537791 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-02a5e3a9-e0e0-4112-b93e-2b048b14c546 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1515 microversion: 2.1 time: 0.158494 Nov 03 05:01:16.538379 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3500/7109] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:16 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:17.074941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dc94a714-1fc1-4f5d-8c71-7429f4abd133 req-feed8ffc-ab10-4849-a4da-2e64af45aa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59c3871-7780-44be-8569-13b826a67d84", "name": "network-vif-unplugged", "status": "completed", "tag": "b9d4b5f0-d61b-41ad-9bcc-6ceda754639d"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:17.085336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc94a714-1fc1-4f5d-8c71-7429f4abd133 req-feed8ffc-ab10-4849-a4da-2e64af45aa20 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:17.085836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc94a714-1fc1-4f5d-8c71-7429f4abd133 req-feed8ffc-ab10-4849-a4da-2e64af45aa20 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:17.086287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc94a714-1fc1-4f5d-8c71-7429f4abd133 req-feed8ffc-ab10-4849-a4da-2e64af45aa20 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:17.097945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dc94a714-1fc1-4f5d-8c71-7429f4abd133 req-feed8ffc-ab10-4849-a4da-2e64af45aa20 service nova] Creating event network-vif-unplugged:b9d4b5f0-d61b-41ad-9bcc-6ceda754639d for instance f59c3871-7780-44be-8569-13b826a67d84 on n-h1-854653-7 Nov 03 05:01:17.103239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-dc94a714-1fc1-4f5d-8c71-7429f4abd133 req-feed8ffc-ab10-4849-a4da-2e64af45aa20 service nova] Instance f59c3871-7780-44be-8569-13b826a67d84 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:01:17.113975 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dc94a714-1fc1-4f5d-8c71-7429f4abd133 req-feed8ffc-ab10-4849-a4da-2e64af45aa20 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043113 Nov 03 05:01:17.114571 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3610/7110] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:01:17.567313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:17.567964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:17.575053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:17.575542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:17.575982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:17.576923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:17.577597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:17.578161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:17.720436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:17.729317 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a37fe8a4-a3ff-482d-aeee-d9455035e0b7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1514 microversion: 2.1 time: 0.165805 Nov 03 05:01:17.729931 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3501/7111] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:17 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:18.755023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:18.755703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:18.761898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:18.762389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:18.762841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:18.763536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:18.764003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:18.764442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:18.895826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:18.903948 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f30c59a-7d7e-4088-b38a-925361aa1f0a tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1512 microversion: 2.1 time: 0.154224 Nov 03 05:01:18.904538 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3611/7112] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:18 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:19.128507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c547bd17-8c20-41c8-af00-082c61620fd0 req-dc714b1e-0ea2-43ff-8036-6cf398bbc91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f59c3871-7780-44be-8569-13b826a67d84", "tag": "b9d4b5f0-d61b-41ad-9bcc-6ceda754639d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:19.138691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c547bd17-8c20-41c8-af00-082c61620fd0 req-dc714b1e-0ea2-43ff-8036-6cf398bbc91f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:19.142322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c547bd17-8c20-41c8-af00-082c61620fd0 req-dc714b1e-0ea2-43ff-8036-6cf398bbc91f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:19.142322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c547bd17-8c20-41c8-af00-082c61620fd0 req-dc714b1e-0ea2-43ff-8036-6cf398bbc91f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:19.152622 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c547bd17-8c20-41c8-af00-082c61620fd0 req-dc714b1e-0ea2-43ff-8036-6cf398bbc91f service nova] Creating event network-changed:b9d4b5f0-d61b-41ad-9bcc-6ceda754639d for instance f59c3871-7780-44be-8569-13b826a67d84 on n-h1-854653-7 Nov 03 05:01:19.157951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-c547bd17-8c20-41c8-af00-082c61620fd0 req-dc714b1e-0ea2-43ff-8036-6cf398bbc91f service nova] Instance f59c3871-7780-44be-8569-13b826a67d84 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:01:19.169807 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c547bd17-8c20-41c8-af00-082c61620fd0 req-dc714b1e-0ea2-43ff-8036-6cf398bbc91f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045007 Nov 03 05:01:19.170391 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3502/7113] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:01:19.928233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:19.928810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:19.935589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:19.936086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:19.936536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:19.937259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:19.937728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:19.938165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:20.068790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:20.076649 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1bbb389b-f79e-4d5c-95b3-5ede6ccc9e67 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1512 microversion: 2.1 time: 0.152834 Nov 03 05:01:20.077271 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3612/7114] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:19 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:21.100266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:21.100976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:21.109868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:21.110366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:21.111172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:21.112051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:21.112887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:21.113459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:21.248307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:21.256801 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8d75e92e-9a33-4161-9c8e-a75d176d1271 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1512 microversion: 2.1 time: 0.160739 Nov 03 05:01:21.257488 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3503/7115] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:21 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:22.280669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:22.281322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:22.287621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:22.288117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:22.288561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:22.289296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:22.289763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:22.290210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:22.749875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:22.757611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7ce8a9b-7645-4e38-bcae-f5126c2f3a2e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1509 microversion: 2.1 time: 0.480847 Nov 03 05:01:22.758175 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3613/7116] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:22 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1509 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:22.781576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:22.782078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:22.788830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:22.789369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:22.789809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:22.790496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:22.790949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:22.791376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:22.816985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:01:22.932492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.compute.api [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Found an unconfirmed migration during delete, id: 16, status: finished Nov 03 05:01:25.105751 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60322373-9ec0-4408-a6ad-0754aa64d13b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 204 len: 0 microversion: 2.1 time: 2.327702 Nov 03 05:01:25.106475 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3504/7117] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:01:22 2022] DELETE /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 0 bytes in 2329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:01:25.114538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:25.115324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:25.123594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:25.124089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:25.124544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:25.125286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:25.125755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:25.126320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:25.263362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:25.271459 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b85c8879-509b-4d7f-8834-594991438597 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1501 microversion: 2.1 time: 0.160781 Nov 03 05:01:25.272044 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3614/7118] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:25 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:25.404478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8c1bbd86-b9a2-4525-932e-a38055abbd86 req-0bf69202-e730-407d-a0d6-ff20f66f7b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59c3871-7780-44be-8569-13b826a67d84", "name": "network-vif-plugged", "status": "completed", "tag": "b9d4b5f0-d61b-41ad-9bcc-6ceda754639d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:25.415290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c1bbd86-b9a2-4525-932e-a38055abbd86 req-0bf69202-e730-407d-a0d6-ff20f66f7b2e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:25.415780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c1bbd86-b9a2-4525-932e-a38055abbd86 req-0bf69202-e730-407d-a0d6-ff20f66f7b2e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:25.416220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c1bbd86-b9a2-4525-932e-a38055abbd86 req-0bf69202-e730-407d-a0d6-ff20f66f7b2e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:25.426497 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8c1bbd86-b9a2-4525-932e-a38055abbd86 req-0bf69202-e730-407d-a0d6-ff20f66f7b2e service nova] Creating event network-vif-plugged:b9d4b5f0-d61b-41ad-9bcc-6ceda754639d for instance f59c3871-7780-44be-8569-13b826a67d84 on n-h1-854653-7 Nov 03 05:01:25.431988 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8c1bbd86-b9a2-4525-932e-a38055abbd86 req-0bf69202-e730-407d-a0d6-ff20f66f7b2e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031825 Nov 03 05:01:25.432582 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3505/7119] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:01:26.293950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:26.294620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:26.302006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:26.302509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:26.302963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:26.303696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:26.304204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:26.304655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:26.434870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:26.442682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2a026ae-9f91-4ac8-9659-0a19f28d380e tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1501 microversion: 2.1 time: 0.152654 Nov 03 05:01:26.443250 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3615/7120] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:26 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:27.055576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-53412051-afd5-43ab-b882-c87272d443eb req-04026b5f-14c9-4c0f-bd73-01f9320ef709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f59c3871-7780-44be-8569-13b826a67d84", "name": "network-vif-deleted", "tag": "b9d4b5f0-d61b-41ad-9bcc-6ceda754639d"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:27.067753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-53412051-afd5-43ab-b882-c87272d443eb req-04026b5f-14c9-4c0f-bd73-01f9320ef709 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:27.067753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-53412051-afd5-43ab-b882-c87272d443eb req-04026b5f-14c9-4c0f-bd73-01f9320ef709 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:27.067753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-53412051-afd5-43ab-b882-c87272d443eb req-04026b5f-14c9-4c0f-bd73-01f9320ef709 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:27.078337 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-53412051-afd5-43ab-b882-c87272d443eb req-04026b5f-14c9-4c0f-bd73-01f9320ef709 service nova] Creating event network-vif-deleted:b9d4b5f0-d61b-41ad-9bcc-6ceda754639d for instance f59c3871-7780-44be-8569-13b826a67d84 on n-h1-854653-7 Nov 03 05:01:27.083165 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-53412051-afd5-43ab-b882-c87272d443eb req-04026b5f-14c9-4c0f-bd73-01f9320ef709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Nov 03 05:01:27.084395 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3506/7121] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:01:27.467164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:27.467809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:27.476792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:27.477366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:27.477835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:27.478558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:27.479046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:27.479498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:27.513722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:27.514231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:27.514691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:27.515163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lazy-loading 'fault' on Instance uuid f59c3871-7780-44be-8569-13b826a67d84 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:01:27.556799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375274dabfd747f9858aa4103f0d2b6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a49fe0944c944789f6ffc9497dd3b15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:27.564730 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b198e1aa-ce1a-41f5-b485-16554170d8c5 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 200 len: 1305 microversion: 2.1 time: 0.102079 Nov 03 05:01:27.565345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3616/7122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:27 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:28.589133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:28.589840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:28.595923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:28.596407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:28.596846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:28.597564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:28.598020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:28.598447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:28.611937 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] HTTP exception thrown: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Request method failure captured: Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 HTTP/1.1 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0rv8qUnvceJ1tPr0CPfk33-5NJEgtdduzM9lR7qTk6sQuND2jsxffQXlXegbz_B84aaudjLFlxHLaONIsVbeI9ZlQSwOXdLY2FYwg7A6UHOW-9LWOH072rABNmrM9g93UeRPVV26qu_ivShlQL3c-m9s4Z0w6uzW-K93OT1J6oaFNo Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4a49fe0944c944789f6ffc9497dd3b15 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a49fe0944c944789f6ffc9497dd3b15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4a49fe0944c944789f6ffc9497dd3b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a49fe0944c944789f6ffc9497dd3b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4a49fe0944c944789f6ffc9497dd3b15"}]}] Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4a49fe0944c944789f6ffc9497dd3b15 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-1758684730-project Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 375274dabfd747f9858aa4103f0d2b6e Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-1758684730-project Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f59c3871-7780-44be-8569-13b826a67d84'} Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:01:28.613577 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Returning 404 to user: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-915f25fa-65a6-4b8f-aad5-7ab77c812c17 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 404 len: 111 microversion: 2.1 time: 0.031142 Nov 03 05:01:28.618670 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3507/7123] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:28 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:01:28.631654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:28.632182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:28.639031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:28.639531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:28.639988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:28.640695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:28.641199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:28.641648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:28.655064 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] HTTP exception thrown: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Request method failure captured: Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 HTTP/1.1 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0rv8qUnvceJ1tPr0CPfk33-5NJEgtdduzM9lR7qTk6sQuND2jsxffQXlXegbz_B84aaudjLFlxHLaONIsVbeI9ZlQSwOXdLY2FYwg7A6UHOW-9LWOH072rABNmrM9g93UeRPVV26qu_ivShlQL3c-m9s4Z0w6uzW-K93OT1J6oaFNo Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 4a49fe0944c944789f6ffc9497dd3b15 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a49fe0944c944789f6ffc9497dd3b15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4a49fe0944c944789f6ffc9497dd3b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a49fe0944c944789f6ffc9497dd3b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4a49fe0944c944789f6ffc9497dd3b15"}]}] Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 4a49fe0944c944789f6ffc9497dd3b15 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-DeleteServersTestJSON-1758684730-project Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 375274dabfd747f9858aa4103f0d2b6e Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-DeleteServersTestJSON-1758684730-project Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'f59c3871-7780-44be-8569-13b826a67d84'} Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:01:28.656736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Returning 404 to user: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c2657bf8-02da-4de8-94de-c6576e65aae7 tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 404 len: 111 microversion: 2.1 time: 0.030467 Nov 03 05:01:28.660790 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3617/7124] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:01:28 2022] DELETE /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:01:28.667275 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:28.667895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] [instance: f59c3871-7780-44be-8569-13b826a67d84] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:28.673786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:28.674270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:28.674709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:28.675393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:28.675845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:28.676269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:28.689914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] HTTP exception thrown: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Request method failure captured: Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 HTTP/1.1 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0rv8qUnvceJ1tPr0CPfk33-5NJEgtdduzM9lR7qTk6sQuND2jsxffQXlXegbz_B84aaudjLFlxHLaONIsVbeI9ZlQSwOXdLY2FYwg7A6UHOW-9LWOH072rABNmrM9g93UeRPVV26qu_ivShlQL3c-m9s4Z0w6uzW-K93OT1J6oaFNo Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 4a49fe0944c944789f6ffc9497dd3b15 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a49fe0944c944789f6ffc9497dd3b15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4a49fe0944c944789f6ffc9497dd3b15", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4a49fe0944c944789f6ffc9497dd3b15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4a49fe0944c944789f6ffc9497dd3b15"}]}] Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 4a49fe0944c944789f6ffc9497dd3b15 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1758684730 Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-DeleteServersTestJSON-1758684730-project Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 375274dabfd747f9858aa4103f0d2b6e Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-DeleteServersTestJSON-1758684730-project Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'f59c3871-7780-44be-8569-13b826a67d84'} Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:01:28.691424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] Returning 404 to user: Instance f59c3871-7780-44be-8569-13b826a67d84 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4b7b6782-4fdc-4114-96b4-a6a3c049685b tempest-DeleteServersTestJSON-1758684730 tempest-DeleteServersTestJSON-1758684730-project] 10.222.0.30 "GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84" status: 404 len: 111 microversion: 2.1 time: 0.029400 Nov 03 05:01:28.696004 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3508/7125] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:28 2022] GET /compute/v2.1/servers/f59c3871-7780-44be-8569-13b826a67d84 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:01:39.331261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=23 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:39.332097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=73 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:39.440903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-443113529", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1a43d614-9a1b-4ca2-90bd-d9d201602c8e"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:39.496158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] validate_networks() for [('1a43d614-9a1b-4ca2-90bd-d9d201602c8e', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:01:39.892308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:01:39.892756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:01:39.893406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:01:39.893878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:01:39.894276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:01:39.903788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:39.904442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:39.904904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:39.905697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:39.906171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:39.907035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:39.928769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Getting quotas for project cf89f9597e5641b48e620a498eb50f6b. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:01:39.934424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Getting quotas for user b3cbaf5194954c048d0b33b4e4549ac5 and project cf89f9597e5641b48e620a498eb50f6b. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:01:39.947460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:01:39.949820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:01:40.057241 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6669301f-f96c-4c42-a20a-e3a8a1c5de38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731652 Nov 03 05:01:40.058142 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3618/7126] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:01:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:01:40.069882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-86d756b9-54a0-475a-8742-ee523187c5b0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:40.071100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-86d756b9-54a0-475a-8742-ee523187c5b0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:40.075365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:40.076229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:40.171847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-86d756b9-54a0-475a-8742-ee523187c5b0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:40.187571 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-86d756b9-54a0-475a-8742-ee523187c5b0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1217 microversion: 2.1 time: 0.121802 Nov 03 05:01:40.193510 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3509/7127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:40 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:41.213688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:41.219134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:41.221808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:41.222320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:41.222790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:41.223531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:41.224001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:41.224969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:41.288827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:41.297201 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b622b0a-5114-49c8-8ac6-359ba8a1483d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1221 microversion: 2.1 time: 0.089000 Nov 03 05:01:41.297929 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3619/7128] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:41 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:42.321237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:42.321937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:42.338258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:42.338767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:42.339219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:42.339947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:42.340414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:42.340893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:42.445961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:42.455247 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9e962d6-60a4-469b-9ea0-bd4001e2e999 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1277 microversion: 2.1 time: 0.138705 Nov 03 05:01:42.457680 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3510/7129] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:42 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:43.479847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:43.486000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:43.487559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:43.488063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:43.488516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:43.489264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:43.489733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:43.490206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:44.031501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:44.040315 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-15182c44-9918-4c9e-ad9a-1431bb54e2d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1317 microversion: 2.1 time: 0.564510 Nov 03 05:01:44.055165 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3620/7130] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:43 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:44.487381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-affd6054-5730-4255-9982-bd34ac9f09a5 req-dd7c3533-b746-4bad-85df-1225cddda27e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b61896-54c2-40e8-b395-de3b00264422", "tag": "096660b4-0c65-4107-8886-4885e8036454"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:44.499058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-affd6054-5730-4255-9982-bd34ac9f09a5 req-dd7c3533-b746-4bad-85df-1225cddda27e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:44.499539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-affd6054-5730-4255-9982-bd34ac9f09a5 req-dd7c3533-b746-4bad-85df-1225cddda27e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:44.500004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-affd6054-5730-4255-9982-bd34ac9f09a5 req-dd7c3533-b746-4bad-85df-1225cddda27e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:44.511087 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-affd6054-5730-4255-9982-bd34ac9f09a5 req-dd7c3533-b746-4bad-85df-1225cddda27e service nova] Creating event network-changed:096660b4-0c65-4107-8886-4885e8036454 for instance d0b61896-54c2-40e8-b395-de3b00264422 on n-h2-854653-7 Nov 03 05:01:44.516207 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-affd6054-5730-4255-9982-bd34ac9f09a5 req-dd7c3533-b746-4bad-85df-1225cddda27e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 Nov 03 05:01:44.516832 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3511/7131] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:01:45.063925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:45.064703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:45.072067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:45.072581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:45.073042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:45.073764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:45.074240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:45.074684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:45.276617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:45.284865 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f101a4e9-7941-47d3-af1b-4006f4218704 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1317 microversion: 2.1 time: 0.224868 Nov 03 05:01:45.285399 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3621/7132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:45 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:46.310284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:46.311013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:46.317471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:46.320330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:46.320330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:46.320330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:46.320330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:46.320330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:46.453798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:46.462130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ee90677d-2591-4a6e-be6d-1f801a267bea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1317 microversion: 2.1 time: 0.158110 Nov 03 05:01:46.462707 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3512/7133] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:46 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:47.484800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:47.485471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:47.492825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:47.493369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:47.493826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:47.494538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:47.495075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:47.495527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:47.622609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:47.630268 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c245e3b6-54eb-41ab-8065-bab863d1be61 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1317 microversion: 2.1 time: 0.149440 Nov 03 05:01:47.630841 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3622/7134] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:47 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:48.652361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:48.652982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:48.659739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:48.660286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:48.660661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:48.661375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:48.661830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:48.662254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:48.794680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:48.802603 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-859e7096-a483-4ffe-b764-e1224b754905 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1317 microversion: 2.1 time: 0.154388 Nov 03 05:01:48.803185 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3513/7135] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:48 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:49.070435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-109077a7-98d6-47b2-8eca-ca68d274e8ae req-9ffd5018-27fa-459f-8aa1-88a52099a2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b61896-54c2-40e8-b395-de3b00264422", "name": "network-vif-plugged", "status": "completed", "tag": "096660b4-0c65-4107-8886-4885e8036454"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:49.080853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-109077a7-98d6-47b2-8eca-ca68d274e8ae req-9ffd5018-27fa-459f-8aa1-88a52099a2a7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:49.081377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-109077a7-98d6-47b2-8eca-ca68d274e8ae req-9ffd5018-27fa-459f-8aa1-88a52099a2a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:49.081830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-109077a7-98d6-47b2-8eca-ca68d274e8ae req-9ffd5018-27fa-459f-8aa1-88a52099a2a7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:49.096237 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-109077a7-98d6-47b2-8eca-ca68d274e8ae req-9ffd5018-27fa-459f-8aa1-88a52099a2a7 service nova] Creating event network-vif-plugged:096660b4-0c65-4107-8886-4885e8036454 for instance d0b61896-54c2-40e8-b395-de3b00264422 on n-h2-854653-7 Nov 03 05:01:49.101892 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-109077a7-98d6-47b2-8eca-ca68d274e8ae req-9ffd5018-27fa-459f-8aa1-88a52099a2a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035321 Nov 03 05:01:49.102495 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3623/7136] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:01:49.826496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:49.827117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:49.834172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:49.834660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:49.835102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:49.835797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:49.836255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:49.836680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:49.968474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:49.976506 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-30011975-a32c-4a01-a6b1-25e29befc4f9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1317 microversion: 2.1 time: 0.154071 Nov 03 05:01:49.977563 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3514/7137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:49 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:50.998906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:50.999741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:51.004767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:51.005535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:51.012109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.012615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.013104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.013820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.016088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.016088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.146368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:51.155528 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a8a79a81-3af6-4751-b9e3-010057126736 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1507 microversion: 2.1 time: 0.157615 Nov 03 05:01:51.156103 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3624/7138] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:50 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:51.177639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:51.178220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:51.180244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:01:51.185890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.186375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.188377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.188377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.188377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.188377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.320541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:51.329651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79a937ef-7fb9-4555-a2da-0831e5b9b986 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1507 microversion: 2.1 time: 0.155899 Nov 03 05:01:51.330230 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3515/7139] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:51 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:51.351471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:51.353915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:51.360149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.360646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.361150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.361849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.362316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.362752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.469606 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d02055df-e268-4457-aaf2-f4bc9caa93c0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "PUT /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1079 microversion: 2.1 time: 0.122000 Nov 03 05:01:51.470158 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3625/7140] 10.222.0.30 () {60 vars in 1256 bytes} [Thu Nov 3 05:01:51 2022] PUT /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1079 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:51.488534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:51.489183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:51.495974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.496474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.496926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.497694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.498180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.498637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.634114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:51.641897 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-22c02c96-e091-4289-91cb-0055e9296526 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1505 microversion: 2.1 time: 0.157528 Nov 03 05:01:51.642485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3516/7141] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:51 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:51.664439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:51.665128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:51.671384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.671888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.672348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.673095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.673576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.674024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.801233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:51.809708 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-690ef51a-1781-4baf-9a3b-7cc99576c49d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1505 microversion: 2.1 time: 0.149728 Nov 03 05:01:51.810283 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3626/7142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:51 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:51.834632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:01:51.836950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:51.842942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.843428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.843873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.844572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:51.845054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:51.845487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:51.874371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:51.879742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Old instance type m1.heat2, new instance type m1.heat {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:01:51.886290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:01:51.886749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:01:51.887227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:01:51.887637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:01:51.888049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:01:52.080255 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2675b296-5cad-4b15-8448-e26562a31366 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "POST /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422/action" status: 202 len: 0 microversion: 2.1 time: 0.249471 Nov 03 05:01:52.080787 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3517/7143] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:01:51 2022] POST /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:01:52.089812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:52.090474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:52.096437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:52.096939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:52.097426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:52.098132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:52.098599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:52.099057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:52.260449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:52.268447 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-025265b0-175e-481f-8c31-dfbf4ae0e4f1 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1516 microversion: 2.1 time: 0.182708 Nov 03 05:01:52.269051 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3627/7144] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:52 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:53.293127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:53.293745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:53.300665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:53.301172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:53.301614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:53.302305 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:53.302760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:53.303313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:53.444307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:53.452166 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52c4f816-ca56-4a7d-9a67-5ccbbbdc1261 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1516 microversion: 2.1 time: 0.163895 Nov 03 05:01:53.452736 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3518/7145] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:53 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:54.476612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:54.477280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:54.484204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:54.484701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:54.485188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:54.485907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:54.486380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:54.486833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:54.621733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:54.629604 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-daafbcff-3c3e-4391-9315-ee1d342645a0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1516 microversion: 2.1 time: 0.158459 Nov 03 05:01:54.630188 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3628/7146] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:54 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:55.653836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:55.654460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:55.661295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:55.661944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:55.662924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:55.663602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:55.664101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:55.664531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:55.793562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:55.801153 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9dd241d9-9921-4331-b975-b6d41062f02d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.151221 Nov 03 05:01:55.801726 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3519/7147] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:55 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:56.825235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:56.825864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:56.832739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:56.833273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:56.833733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:56.834470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:56.834944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:56.835388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:56.968743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:56.976941 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98fdc1bc-716c-4267-bd26-89168ad8493c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.155815 Nov 03 05:01:56.977541 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3629/7148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:56 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:58.000541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:58.001204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:58.008416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:58.008898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:58.009360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:58.010048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:58.010502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:58.010933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:58.140758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:58.148657 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6364906d-574d-4880-a972-6722b53df37c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.151777 Nov 03 05:01:58.150578 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3520/7149] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:57 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:01:59.171888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:01:59.172511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:01:59.179384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:59.179875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:59.180327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:59.181044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:01:59.181513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:01:59.181953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:01:59.312706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:01:59.320869 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e44fd3e7-a324-4929-bc48-5238c3f89331 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.153033 Nov 03 05:01:59.321468 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3630/7150] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:01:59 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:00.344299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:00.344951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:00.352389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:00.353143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:00.353593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:00.354280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:00.354735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:00.355161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:00.486046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:00.493722 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff106b9a-2104-4361-a84e-75b712afc5aa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.153295 Nov 03 05:02:00.494305 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3521/7151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:00 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:01.515887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:01.516559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:01.524498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:01.525008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:01.525500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:01.526217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:01.526698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:01.527158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:01.655899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:01.663727 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c2eb9f3-d6dd-4982-9feb-11b80187e247 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.151770 Nov 03 05:02:01.664303 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3631/7152] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:01 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:02.686687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:02.687307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:02.694359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:02.694841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:02.695274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:02.695962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:02.696431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:02.696840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:02.831693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:02.840168 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4e4fd190-e483-4033-9d04-08fbb49d3c71 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.157347 Nov 03 05:02:02.840741 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3522/7153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:02 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:03.863562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:03.864193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:03.871715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:03.872159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:03.872621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:03.873356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:03.873840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:03.874286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:04.007332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:04.015161 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f54d17eb-3ac6-4519-8fcb-f4a7cf947259 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.155585 Nov 03 05:02:04.015721 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3632/7154] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:03 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:05.038902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:05.039569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:05.046589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:05.051767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:05.051767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:05.051767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:05.051767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:05.051767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:05.184523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:05.192247 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9e815c9c-93bd-4ae1-bd82-1d55cb22a97e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.157317 Nov 03 05:02:05.192825 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3523/7155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:05 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:06.215125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:06.215690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:06.222859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:06.223366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:06.223824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:06.224536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:06.225031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:06.225474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:06.354358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:06.362155 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-52bf7693-619e-4ff7-8724-6867dec3214e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.151034 Nov 03 05:02:06.362728 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3633/7156] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:06 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:07.386123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:07.386749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:07.393502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:07.394038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:07.394483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:07.395177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:07.395632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:07.396059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:07.525654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:07.533748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ac06548-ffa4-4de1-b87f-e365ab11d6d8 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.151552 Nov 03 05:02:07.534314 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3524/7157] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:07 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:08.555754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:08.556391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:08.563577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:08.564086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:08.564544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:08.565305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:08.565782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:08.566227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:08.697357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:08.705028 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f003582c-5efc-4596-b814-7a02671cd9ed tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.153224 Nov 03 05:02:08.705611 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3634/7158] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:08 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:09.729372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:09.729964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:09.736795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:09.737313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:09.737749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:09.738727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:09.739186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:09.739614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:09.868416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:09.873293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:09.880810 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1b3233eb-a631-4d2f-a3e6-43d97297ed21 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.155186 Nov 03 05:02:09.881806 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3525/7159] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:09 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:10.904596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:10.905265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:10.908044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:10.913163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:10.913673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:10.914137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:10.914863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:10.915581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:10.915764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:10.918686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:11.056792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:11.064639 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-66bcf2a0-72cb-4622-b38b-523d2b456399 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.164535 Nov 03 05:02:11.065489 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3635/7160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:10 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:12.088418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:12.089086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:12.091784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=41 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:12.096926 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:12.097440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:12.097879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:12.098568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:12.099063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:12.099991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:12.230516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:12.238250 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1487a67a-c878-452e-90d5-f42156dd7ec6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.154103 Nov 03 05:02:12.238817 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3526/7161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:12 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:13.262575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:13.263200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:13.270127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:13.270619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:13.271118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:13.271838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:13.272301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:13.272740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:13.401768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:13.409582 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb59d14d-7105-4ec6-a826-e3bb0cca4fea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.150943 Nov 03 05:02:13.410155 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3636/7162] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:13 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:14.433745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:14.434372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:14.441462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:14.441956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:14.442401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:14.443101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:14.443563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:14.443995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:14.574988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:14.582728 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a7f729a2-62a9-4820-b05f-2a7dc1312cba tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.152960 Nov 03 05:02:14.583316 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3527/7163] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:14 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:15.605667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:15.606234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:15.613191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:15.613696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:15.614156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:15.615392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:15.615871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:15.616318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:15.746386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:15.754149 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c483a3a-1c14-4807-8aeb-75cc125f96e2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.152514 Nov 03 05:02:15.757686 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3637/7164] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:15 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:16.778807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:16.779415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:16.786266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:16.787409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:16.787853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:16.788550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:16.789071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:16.789504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:16.925087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:16.932793 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94d748ff-7cf3-4db6-8d4b-5d65be8f283e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.158387 Nov 03 05:02:16.933409 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3528/7165] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:16 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:17.954640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:17.955275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:17.962090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:17.962594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:17.963050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:17.963767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:17.964245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:17.964695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:18.096118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:18.103803 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fd2bc26f-9082-4f86-9718-d95526115052 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.153118 Nov 03 05:02:18.104367 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3638/7166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:17 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:19.126441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:19.127061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:19.133937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:19.134423 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:19.134862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:19.135547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:19.135998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:19.136421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:19.271955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:19.279861 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-229c383c-e7d9-43e4-a366-6b149d490dac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.157340 Nov 03 05:02:19.280434 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3529/7167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:19 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:20.303196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:20.303836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:20.310722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:20.311224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:20.311680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:20.312388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:20.312867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:20.313347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:20.441577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:20.449623 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e42402c-e97c-47d2-9cd1-6f8b14ef85fc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.150349 Nov 03 05:02:20.450194 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3639/7168] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:20 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:21.473558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:21.474785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:21.481586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:21.482073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:21.482512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:21.483202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:21.483654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:21.484083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:21.614701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:21.622390 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f1ce20af-87ae-4c5f-983e-5d6a12136934 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1521 microversion: 2.1 time: 0.152749 Nov 03 05:02:21.623215 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3530/7169] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:21 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:22.647426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:22.650127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:22.655670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:22.656230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:22.656724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:22.657413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:22.657889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:22.658334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:22.688380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e5fcf3d3-95e8-40a1-b188-b4c8f8667135 req-b9b50b51-b890-4112-9469-93072ccef132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b61896-54c2-40e8-b395-de3b00264422", "name": "network-vif-unplugged", "status": "completed", "tag": "096660b4-0c65-4107-8886-4885e8036454"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:22.698993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e5fcf3d3-95e8-40a1-b188-b4c8f8667135 req-b9b50b51-b890-4112-9469-93072ccef132 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:22.699492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e5fcf3d3-95e8-40a1-b188-b4c8f8667135 req-b9b50b51-b890-4112-9469-93072ccef132 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:22.699920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e5fcf3d3-95e8-40a1-b188-b4c8f8667135 req-b9b50b51-b890-4112-9469-93072ccef132 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:22.712167 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e5fcf3d3-95e8-40a1-b188-b4c8f8667135 req-b9b50b51-b890-4112-9469-93072ccef132 service nova] Creating event network-vif-unplugged:096660b4-0c65-4107-8886-4885e8036454 for instance d0b61896-54c2-40e8-b395-de3b00264422 on n-h1-854653-7 Nov 03 05:02:22.717570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-e5fcf3d3-95e8-40a1-b188-b4c8f8667135 req-b9b50b51-b890-4112-9469-93072ccef132 service nova] Instance d0b61896-54c2-40e8-b395-de3b00264422 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:02:22.729117 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e5fcf3d3-95e8-40a1-b188-b4c8f8667135 req-b9b50b51-b890-4112-9469-93072ccef132 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044853 Nov 03 05:02:22.729731 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3531/7170] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:02:22.797600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:22.805726 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-62bbfb39-eb9e-4e21-8507-56426666592a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1520 microversion: 2.1 time: 0.163468 Nov 03 05:02:22.815986 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3640/7171] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:22 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:23.830468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:23.831090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:23.837190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:23.839449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:23.839449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:23.839449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:23.839449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:23.839858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:23.974887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:23.982710 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6bdc898e-4b16-4cd2-b05d-c1f2394423fa tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1520 microversion: 2.1 time: 0.157539 Nov 03 05:02:23.983286 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3532/7172] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:23 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:24.743579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b9221958-c34c-4464-b67b-c2e9462b1bb7 req-b9d4503b-4288-4fd8-94f5-1c3eaa5957b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b61896-54c2-40e8-b395-de3b00264422", "tag": "096660b4-0c65-4107-8886-4885e8036454"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:24.753692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b9221958-c34c-4464-b67b-c2e9462b1bb7 req-b9d4503b-4288-4fd8-94f5-1c3eaa5957b2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:24.754178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b9221958-c34c-4464-b67b-c2e9462b1bb7 req-b9d4503b-4288-4fd8-94f5-1c3eaa5957b2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:24.754620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b9221958-c34c-4464-b67b-c2e9462b1bb7 req-b9d4503b-4288-4fd8-94f5-1c3eaa5957b2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:24.766659 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b9221958-c34c-4464-b67b-c2e9462b1bb7 req-b9d4503b-4288-4fd8-94f5-1c3eaa5957b2 service nova] Creating event network-changed:096660b4-0c65-4107-8886-4885e8036454 for instance d0b61896-54c2-40e8-b395-de3b00264422 on n-h1-854653-7 Nov 03 05:02:24.772391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-b9221958-c34c-4464-b67b-c2e9462b1bb7 req-b9d4503b-4288-4fd8-94f5-1c3eaa5957b2 service nova] Instance d0b61896-54c2-40e8-b395-de3b00264422 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:02:24.783073 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b9221958-c34c-4464-b67b-c2e9462b1bb7 req-b9d4503b-4288-4fd8-94f5-1c3eaa5957b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043315 Nov 03 05:02:24.783654 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3641/7173] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:02:25.006446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:25.007910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:25.014432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:25.014930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:25.015378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:25.016094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:25.016596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:25.017043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:25.236276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:25.244714 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-782cd27a-e7b5-4a30-8865-19ee8502a2b6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1518 microversion: 2.1 time: 0.242725 Nov 03 05:02:25.248575 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3533/7174] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:25 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1518 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:26.271276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:26.272017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:26.278364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:26.278858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:26.279310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:26.280014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:26.280483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:26.280921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:26.417156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:26.425208 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50ef2745-a6a0-4eab-96f0-eed6c6e48b4d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1518 microversion: 2.1 time: 0.159737 Nov 03 05:02:26.425780 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3642/7175] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:26 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:27.447739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:27.448355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:27.455182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:27.455671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:27.456111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:27.456807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:27.457289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:27.457721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:27.592623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:27.601176 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b00ddebd-0612-46de-837a-42be394e6357 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1515 microversion: 2.1 time: 0.157239 Nov 03 05:02:27.601764 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3534/7176] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:27 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:27.623902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:27.624455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:27.632019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:27.632613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:27.632949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:27.633680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:27.634144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:27.634581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:27.841450 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1ab5467-d8a6-4339-8758-eb3dd5d032ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "POST /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422/action" status: 204 len: 0 microversion: 2.1 time: 0.221326 Nov 03 05:02:27.842114 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3643/7177] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:02:27 2022] POST /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422/action => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:02:27.850213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:27.850946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:27.857821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:27.858308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:27.858790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:27.859807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:27.859971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:27.860307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:28.024560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:28.033122 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e5499a4-90ae-46d7-82fa-19f93c759916 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1515 microversion: 2.1 time: 0.186712 Nov 03 05:02:28.034154 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3535/7178] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:27 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:29.058222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:29.058834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:29.065991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:29.066489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:29.067020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:29.067736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:29.068203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:29.068643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:29.205530 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:29.214036 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ce2464cb-2e69-4c53-85b0-87e1c4bd1b96 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1515 microversion: 2.1 time: 0.161899 Nov 03 05:02:29.214829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3644/7179] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:29 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:29.738209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-32b1d5e0-6921-4d32-b15c-fd9a4d7afd48 req-b96d5330-a833-457f-8fac-6af04c551050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b61896-54c2-40e8-b395-de3b00264422", "name": "network-vif-plugged", "status": "completed", "tag": "096660b4-0c65-4107-8886-4885e8036454"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:29.748131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-32b1d5e0-6921-4d32-b15c-fd9a4d7afd48 req-b96d5330-a833-457f-8fac-6af04c551050 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:29.748608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-32b1d5e0-6921-4d32-b15c-fd9a4d7afd48 req-b96d5330-a833-457f-8fac-6af04c551050 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:29.749057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-32b1d5e0-6921-4d32-b15c-fd9a4d7afd48 req-b96d5330-a833-457f-8fac-6af04c551050 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:29.761524 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-32b1d5e0-6921-4d32-b15c-fd9a4d7afd48 req-b96d5330-a833-457f-8fac-6af04c551050 service nova] Creating event network-vif-plugged:096660b4-0c65-4107-8886-4885e8036454 for instance d0b61896-54c2-40e8-b395-de3b00264422 on n-h1-854653-7 Nov 03 05:02:29.766396 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-32b1d5e0-6921-4d32-b15c-fd9a4d7afd48 req-b96d5330-a833-457f-8fac-6af04c551050 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093417 Nov 03 05:02:29.769395 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3536/7180] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:02:30.237600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:30.238241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:30.245721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:30.246226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:30.246687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:30.247398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:30.247872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:30.248318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:30.375792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:30.383443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8384f8fe-f166-4c37-8838-89e54da57f8e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1507 microversion: 2.1 time: 0.149803 Nov 03 05:02:30.384005 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3645/7181] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:30 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:30.406523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:30.407174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:30.413944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:30.414433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:30.414877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:30.415570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:30.416032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:30.416462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:30.547436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:30.555197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4d3522fd-fdd8-400b-8912-2eb59a343ad9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1507 microversion: 2.1 time: 0.153019 Nov 03 05:02:30.555780 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3537/7182] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:30 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:30.580624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f2aa8d17-e7b9-4a75-bd5b-0eda60b120ca tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'create', calling method: .version_select at 0x7ff7f8099f70>, body: {"keypair": {"name": "tempest-keypair-1214992690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRZ0KRpvep3w1rf89o/28IrxOEgf/HwSRjw/BFEJlD03921aO2nGEWrEz6Y7LbLOhf7NQ6YCeLnk6CNPiPou3KEfSVjxwn956RI6F2eX6U8gOFHLBaD6orqRu5SmfMrzQ=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:30.596274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f2aa8d17-e7b9-4a75-bd5b-0eda60b120ca tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Getting quotas for project cf89f9597e5641b48e620a498eb50f6b. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:02:30.602059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f2aa8d17-e7b9-4a75-bd5b-0eda60b120ca tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Getting quotas for user b3cbaf5194954c048d0b33b4e4549ac5 and project cf89f9597e5641b48e620a498eb50f6b. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:02:30.615660 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f2aa8d17-e7b9-4a75-bd5b-0eda60b120ca tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:02:31.624096 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [None req-f2aa8d17-e7b9-4a75-bd5b-0eda60b120ca tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59044. Nov 03 05:02:31.699947 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f2aa8d17-e7b9-4a75-bd5b-0eda60b120ca tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.123110 Nov 03 05:02:31.700563 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3646/7183] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:02:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:02:33.652466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:33.653151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:33.660020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:33.660542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:33.660985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:33.661861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:33.662325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:33.662759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:33.790147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:33.797889 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0c643c3-bf91-4267-8864-b6ea43fb76db tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 200 len: 1507 microversion: 2.1 time: 0.149613 Nov 03 05:02:33.798404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3538/7184] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:33 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:33.821090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:33.822404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:33.828369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:33.828874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:33.829374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:33.830092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:33.830569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:33.831020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:33.855731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:02:34.167709 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf41c451-fe49-47e4-8445-b1206b885211 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 204 len: 0 microversion: 2.1 time: 0.351639 Nov 03 05:02:34.168333 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3647/7185] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:02:33 2022] DELETE /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:02:34.226675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-448073867", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "1a43d614-9a1b-4ca2-90bd-d9d201602c8e"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:34.279823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] validate_networks() for [('1a43d614-9a1b-4ca2-90bd-d9d201602c8e', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:02:34.700307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:02:34.700883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:02:34.701263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:02:34.701686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:02:34.702112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:02:34.711416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:34.712188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:34.713139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:34.714212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:34.714915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:34.715476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:34.733721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Getting quotas for project cf89f9597e5641b48e620a498eb50f6b. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:02:34.739058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Getting quotas for user b3cbaf5194954c048d0b33b4e4549ac5 and project cf89f9597e5641b48e620a498eb50f6b. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:02:34.752095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:02:34.754488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:02:34.850045 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a6b9e35-f648-40b5-ae3c-398db268cc68 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626617 Nov 03 05:02:34.857116 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3539/7186] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:02:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:02:34.862845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9fa91159-e8c4-4459-bef6-c6ad87c65f11 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:34.863575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9fa91159-e8c4-4459-bef6-c6ad87c65f11 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:34.920915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9fa91159-e8c4-4459-bef6-c6ad87c65f11 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:34.929634 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9fa91159-e8c4-4459-bef6-c6ad87c65f11 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1217 microversion: 2.1 time: 0.071201 Nov 03 05:02:34.944519 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3648/7187] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:34 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:02:35.953958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:35.954516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:35.961445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:35.961948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:35.962397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:35.963107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:35.963604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:35.964038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:36.026478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:36.034418 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2cdbb116-844d-437b-b013-b7ec665abd22 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1221 microversion: 2.1 time: 0.085938 Nov 03 05:02:36.038195 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3540/7188] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:35 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:36.117648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1374cd3a-c791-4910-9eda-f49d465cb199 req-d3716a3e-b743-4cac-9a78-1d8a13ddd047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b61896-54c2-40e8-b395-de3b00264422", "name": "network-vif-deleted", "tag": "096660b4-0c65-4107-8886-4885e8036454"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:36.130923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1374cd3a-c791-4910-9eda-f49d465cb199 req-d3716a3e-b743-4cac-9a78-1d8a13ddd047 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:36.131413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1374cd3a-c791-4910-9eda-f49d465cb199 req-d3716a3e-b743-4cac-9a78-1d8a13ddd047 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:36.131861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1374cd3a-c791-4910-9eda-f49d465cb199 req-d3716a3e-b743-4cac-9a78-1d8a13ddd047 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:36.153938 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1374cd3a-c791-4910-9eda-f49d465cb199 req-d3716a3e-b743-4cac-9a78-1d8a13ddd047 service nova] Creating event network-vif-deleted:096660b4-0c65-4107-8886-4885e8036454 for instance d0b61896-54c2-40e8-b395-de3b00264422 on n-h1-854653-7 Nov 03 05:02:36.159998 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1374cd3a-c791-4910-9eda-f49d465cb199 req-d3716a3e-b743-4cac-9a78-1d8a13ddd047 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046801 Nov 03 05:02:36.160805 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3649/7189] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:02:37.060017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:37.060660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:37.067491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:37.067998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:37.068433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:37.069723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:37.070235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:37.077362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:37.136896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:37.144895 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-571e28ec-4436-42a0-9490-992378191d89 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1287 microversion: 2.1 time: 0.089013 Nov 03 05:02:37.145502 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3541/7190] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:37 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:38.169638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:38.170366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:38.176599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:38.177129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:38.177589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:38.178301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:38.178776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:38.179312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:38.315076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:38.323676 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c1da021a-f158-473f-b3b2-c3cb490725f7 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.159305 Nov 03 05:02:38.324348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3650/7191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:38 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:38.482238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-7dcfe91c-0e74-4d93-ad45-f92ff7fb8694 req-31415ad3-34e4-4908-a603-1b12e3d4c9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a654276b-6122-453d-9d3e-373f2d3f2c83", "tag": "b0f50a7f-d72a-4eb8-ad38-b1e1402751c2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:38.492989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7dcfe91c-0e74-4d93-ad45-f92ff7fb8694 req-31415ad3-34e4-4908-a603-1b12e3d4c9e6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:38.493524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7dcfe91c-0e74-4d93-ad45-f92ff7fb8694 req-31415ad3-34e4-4908-a603-1b12e3d4c9e6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:38.493962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-7dcfe91c-0e74-4d93-ad45-f92ff7fb8694 req-31415ad3-34e4-4908-a603-1b12e3d4c9e6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:38.504950 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-7dcfe91c-0e74-4d93-ad45-f92ff7fb8694 req-31415ad3-34e4-4908-a603-1b12e3d4c9e6 service nova] Creating event network-changed:b0f50a7f-d72a-4eb8-ad38-b1e1402751c2 for instance a654276b-6122-453d-9d3e-373f2d3f2c83 on n-h1-854653-7 Nov 03 05:02:38.510518 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-7dcfe91c-0e74-4d93-ad45-f92ff7fb8694 req-31415ad3-34e4-4908-a603-1b12e3d4c9e6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032115 Nov 03 05:02:38.511194 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3542/7192] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:02:39.346750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:39.347514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:39.354485 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:39.355176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:39.355565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:39.356281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:39.356753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:39.357231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:39.498096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:39.501819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:39.506976 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0c82bf67-cad4-450e-bf78-a47aeb71d442 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.163581 Nov 03 05:02:39.511501 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3651/7193] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:39 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:40.527922 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:02:40.528448 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 (ip 10.222.0.30) !!! Nov 03 05:02:40.532560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:40.533311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:40.543700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:40.544240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:40.544683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:40.545424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:40.545882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:40.546313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:40.679705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:40.687849 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4eab1d95-c69c-4acd-a7fe-89a263e99c2b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.162058 Nov 03 05:02:40.688441 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3543/7194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:40 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:41.714728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:41.714728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:41.716298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:41.721561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:41.722076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:41.722509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:41.723209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:41.723676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:41.724122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:41.856636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:41.864205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97d88f2a-f0fc-48db-af70-1f6b25fa4869 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.156740 Nov 03 05:02:41.864988 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3652/7195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:41 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:42.887622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:42.888211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:42.890978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:42.895792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:42.896284 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:42.896731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:42.898046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:42.898767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:42.899202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:42.901889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=95 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:43.033729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:43.041449 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1070c32c-0c2c-4cbd-ad14-00a8079fd0a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.157831 Nov 03 05:02:43.042012 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3544/7196] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:42 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:44.065349 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:44.066137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:44.074383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:44.074900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:44.075363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:44.076127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:44.076627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:44.077131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:44.215429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:44.223388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-22347875-6979-4123-bb9a-6f6103008e06 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.162482 Nov 03 05:02:44.231687 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3653/7197] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:44 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:45.246507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:45.247617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:45.250322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:45.251059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:45.255937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:45.260674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:45.260674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:45.260674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:45.260674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:45.260674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:45.389487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:45.397310 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2cfea0d-9560-4d9f-ae80-a0fd4d02f262 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.154874 Nov 03 05:02:45.397889 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3545/7198] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:45 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:45.705044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d3756b29-2186-4a4c-b773-926a9bb4c22a req-7d9c6d4c-e5e4-4e6d-b25f-eb87cdaf08b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a654276b-6122-453d-9d3e-373f2d3f2c83", "name": "network-vif-plugged", "status": "completed", "tag": "b0f50a7f-d72a-4eb8-ad38-b1e1402751c2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:45.710621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:02:45.716575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d3756b29-2186-4a4c-b773-926a9bb4c22a req-7d9c6d4c-e5e4-4e6d-b25f-eb87cdaf08b3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:45.717132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d3756b29-2186-4a4c-b773-926a9bb4c22a req-7d9c6d4c-e5e4-4e6d-b25f-eb87cdaf08b3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:45.717582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d3756b29-2186-4a4c-b773-926a9bb4c22a req-7d9c6d4c-e5e4-4e6d-b25f-eb87cdaf08b3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:45.729221 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d3756b29-2186-4a4c-b773-926a9bb4c22a req-7d9c6d4c-e5e4-4e6d-b25f-eb87cdaf08b3 service nova] Creating event network-vif-plugged:b0f50a7f-d72a-4eb8-ad38-b1e1402751c2 for instance a654276b-6122-453d-9d3e-373f2d3f2c83 on n-h1-854653-7 Nov 03 05:02:45.734225 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d3756b29-2186-4a4c-b773-926a9bb4c22a req-7d9c6d4c-e5e4-4e6d-b25f-eb87cdaf08b3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Nov 03 05:02:45.734819 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3654/7199] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:02:46.420374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:46.420937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:46.427872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:46.428368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:46.428819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:46.429551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:46.430019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:46.430460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:46.564859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:46.573003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a732dd68-4324-4333-b4be-fc6e1a7b11ea tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1317 microversion: 2.1 time: 0.156635 Nov 03 05:02:46.573599 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3546/7200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:46 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:47.597398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:47.598122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:47.604989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:47.605512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:47.605968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:47.606675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:47.607148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:47.607590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:47.735365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:47.743042 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a9d1cf77-4e9f-427b-841d-a01f4aef239d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1506 microversion: 2.1 time: 0.151244 Nov 03 05:02:47.743614 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3655/7201] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:47 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:47.764891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:47.765576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:47.772865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:47.773394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:47.774097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:47.774802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:47.775267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:47.775705 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:47.906714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:47.915031 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-714392b0-897b-4866-8f60-c9676ff8bf75 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1506 microversion: 2.1 time: 0.153561 Nov 03 05:02:47.915164 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3547/7202] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:47 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:47.936214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:02:47.938523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:47.944987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:47.945596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:47.946052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:47.946764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:47.947235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:47.947679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:47.975360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:47.980726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Old instance type m1.heat2, new instance type m1.heat {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:02:47.987223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:02:47.987668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:02:47.988160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:02:47.988584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:02:47.989038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:02:48.227914 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-259ba73a-4928-4244-9083-7ba184725994 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "POST /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83/action" status: 202 len: 0 microversion: 2.1 time: 0.295503 Nov 03 05:02:48.228533 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3656/7203] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:02:47 2022] POST /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:02:48.236665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:48.237347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:48.244031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:48.244626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:48.245096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:48.245804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:48.246267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:48.246700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:48.377300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:48.385625 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23a02d04-16b4-40c3-85c4-c57dad69562a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1513 microversion: 2.1 time: 0.152851 Nov 03 05:02:48.386201 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3548/7204] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:48 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:49.409784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:49.410469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:49.417328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:49.417942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:49.418287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:49.418995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:49.419468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:49.419914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:49.552944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:49.561135 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c997d90e-d348-44f2-ad2c-b6c38dcba98b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1513 microversion: 2.1 time: 0.156211 Nov 03 05:02:49.561715 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3657/7205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:49 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:50.583702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:50.584925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:50.592034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:50.592526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:50.592978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:50.593707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:50.594400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:50.594831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:50.730083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:50.737973 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1adb3d3e-333c-4d49-a63e-289ee80243b9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1513 microversion: 2.1 time: 0.158117 Nov 03 05:02:50.738597 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3549/7206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:50 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:02:51.761734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:51.762393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:51.768331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:51.768827 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:51.769317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:51.770030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:51.770497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:51.770937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:51.902040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:51.910086 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e354c4c0-7cc3-4cc2-a79b-882af2574600 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.152672 Nov 03 05:02:51.910661 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3658/7207] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:51 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:52.934564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:52.935215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:52.941261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:52.941742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:52.942212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:52.942899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:52.944017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:52.944446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:53.072778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:53.080572 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39f86eb3-ac9f-4b6e-b39c-4f626ea9a5bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.150172 Nov 03 05:02:53.081173 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3550/7208] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:52 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:54.103742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:54.104360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:54.111132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:54.111630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:54.112083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:54.112789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:54.113284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:54.113729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:54.246418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:54.254249 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6bc3c561-2d02-4abd-814c-3dfef534f517 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.154932 Nov 03 05:02:54.254812 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3659/7209] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:54 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:55.277799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:55.278418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:55.285230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:55.285717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:55.286158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:55.286882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:55.287324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:55.287756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:55.418093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:55.425931 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-56968759-4143-40f0-ba82-8b994a3b39bb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.152498 Nov 03 05:02:55.426513 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3551/7210] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:55 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:56.450304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:56.450834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:56.457697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:56.458193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:56.458645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:56.460015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:56.460486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:56.460926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:56.591407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:56.599100 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-75c1c128-2a04-48d7-a2ea-787bbcaee5d2 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.152864 Nov 03 05:02:56.599680 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3660/7211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:56 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:02:57.621884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:57.622512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:57.629465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:57.629958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:57.630408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:57.631618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:57.632081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:57.632520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:57.760119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:57.767832 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-02384941-6dec-4753-9030-0205b3a5f478 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.149909 Nov 03 05:02:57.768411 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3552/7212] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:57 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:58.791547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:58.792102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:58.799018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:58.799512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:58.799962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:58.800661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:58.801150 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:58.801587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:58.929700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:02:58.937374 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1fb8bc1a-e488-45f3-be0a-46d18e13358d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.149801 Nov 03 05:02:58.937949 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3661/7213] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:58 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:02:59.961525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:02:59.962152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:02:59.969166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:59.969663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:59.970210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:02:59.970915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:02:59.971381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:02:59.971814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:00.432173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:00.440184 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-82650105-133d-4d3c-92b0-065951a9f9a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.483229 Nov 03 05:03:00.440757 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3553/7214] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:02:59 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:01.464235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:01.464869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:01.471697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:01.472201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:01.472658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:01.473402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:01.473877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:01.474323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:01.599752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:01.607350 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d4566bea-621c-4b8e-a861-beeb25867a6e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.147062 Nov 03 05:03:01.607919 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3662/7215] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:01 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:02.629508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:02.630127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:02.637640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:02.638127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:02.638569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:02.639267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:02.639721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:02.640146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:02.769527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:02.777455 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-540e972e-d6aa-401f-a706-82f13c8bf845 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.151813 Nov 03 05:03:02.778028 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3554/7216] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:02 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:03.800526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:03.801210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:03.808664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:03.809209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:03.809670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:03.810391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:03.810868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:03.811317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:03.939584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:03.947679 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82f5d372-1958-4495-a4dd-b7f9619e8f59 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.151000 Nov 03 05:03:03.948254 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3663/7217] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:03 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:04.970339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:04.970996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:04.978300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:04.978790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:04.979236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:04.979938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:04.980398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:04.980875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:05.112679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:05.120462 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26a7168d-bd52-4ccf-826f-c7ee2c7dd8ff tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.153974 Nov 03 05:03:05.121060 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3555/7218] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:04 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:06.143811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:06.144570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:06.152140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:06.162412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:06.162412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:06.162412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:06.162412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:06.162412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:06.290885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:06.298671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e84b36d4-1b8b-452d-8503-5332f27d6f38 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.158781 Nov 03 05:03:06.299259 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3664/7219] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:06 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:07.322463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:07.323106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:07.330025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:07.330511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:07.330951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:07.331643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:07.332102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:07.332530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:07.464195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:07.472091 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe2935e6-b6a4-4987-8d50-16c3b388a54f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.154068 Nov 03 05:03:07.472685 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3556/7220] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:07 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:08.495460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:08.496097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:08.503043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:08.503547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:08.504015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:08.504717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:08.505225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:08.505671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:08.636274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:08.643980 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0fd42d8b-5b56-4d38-b0fd-e0072c234ec9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.152544 Nov 03 05:03:08.644566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3665/7221] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:08 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:09.668282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:09.668913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:09.675863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:09.676360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:09.676807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:09.678152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:09.678615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:09.679051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:09.810133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:09.817955 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-096ef34b-4423-4cdf-b32f-5012ae7e23fe tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.153611 Nov 03 05:03:09.818541 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3557/7222] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:09 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:10.840734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:10.841424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:10.848219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:10.848724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:10.849238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:10.849952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:10.850430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:10.850876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:10.982324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:10.990540 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a16f22da-8b46-4334-a3d4-d32457f55e52 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.153735 Nov 03 05:03:10.991100 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3666/7223] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:10 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:12.013484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:12.014105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:12.020934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:12.021454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:12.021902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:12.022601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:12.023066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:12.023497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:12.155220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:12.163630 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d28de9a-d654-43d0-9509-1a72e0fa1272 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.154195 Nov 03 05:03:12.164768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3558/7224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:12 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:13.187234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:13.187788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:13.195231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:13.195727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:13.196180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:13.196879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:13.197376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:13.197817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:13.324120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:13.327756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:13.332244 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e48380f3-d7e9-47fa-837c-345669a6fed4 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.149073 Nov 03 05:03:13.332813 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3667/7225] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:13 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:14.355571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:14.356201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:14.358953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=30 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:14.363664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:14.364158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:14.365279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:14.366068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:14.366537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:14.366974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:14.369766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=90 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:14.499601 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:14.507592 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-76deb303-478e-44d4-accd-0520e72187cc tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.155905 Nov 03 05:03:14.508173 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3559/7226] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:14 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:15.531133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:15.531702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:15.534386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=36 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:15.539477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:15.545640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:15.545640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:15.545640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:15.545640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:15.545640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:15.672003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:15.680484 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c76c390a-c13b-490c-b276-bccf4fb7c04e tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.153759 Nov 03 05:03:15.681079 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3668/7227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:15 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:16.703692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:16.704333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:16.711718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:16.712201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:16.712637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:16.713358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:16.713815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:16.714245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:16.845743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:16.854467 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb984b86-4c07-4efe-8d0d-03ad883031c6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.154685 Nov 03 05:03:16.855044 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3560/7228] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:16 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:17.877381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:17.878044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:17.885432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:17.885933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:17.886396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:17.887110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:17.887586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:17.888028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:18.017856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:18.025957 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-81cfcd2d-4308-4439-85bb-7aa650da47e0 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1518 microversion: 2.1 time: 0.152495 Nov 03 05:03:18.026835 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3669/7229] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:17 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:18.947545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c9fb3207-4973-4d26-896e-d502747974f3 req-76798fd4-f927-4eaa-932c-b36c95d8e125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a654276b-6122-453d-9d3e-373f2d3f2c83", "name": "network-vif-unplugged", "status": "completed", "tag": "b0f50a7f-d72a-4eb8-ad38-b1e1402751c2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:18.957133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c9fb3207-4973-4d26-896e-d502747974f3 req-76798fd4-f927-4eaa-932c-b36c95d8e125 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:18.959181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c9fb3207-4973-4d26-896e-d502747974f3 req-76798fd4-f927-4eaa-932c-b36c95d8e125 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:18.959181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c9fb3207-4973-4d26-896e-d502747974f3 req-76798fd4-f927-4eaa-932c-b36c95d8e125 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:18.970052 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c9fb3207-4973-4d26-896e-d502747974f3 req-76798fd4-f927-4eaa-932c-b36c95d8e125 service nova] Creating event network-vif-unplugged:b0f50a7f-d72a-4eb8-ad38-b1e1402751c2 for instance a654276b-6122-453d-9d3e-373f2d3f2c83 on n-h2-854653-7 Nov 03 05:03:18.976151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-c9fb3207-4973-4d26-896e-d502747974f3 req-76798fd4-f927-4eaa-932c-b36c95d8e125 service nova] Instance a654276b-6122-453d-9d3e-373f2d3f2c83 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:03:18.987220 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c9fb3207-4973-4d26-896e-d502747974f3 req-76798fd4-f927-4eaa-932c-b36c95d8e125 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101439 Nov 03 05:03:18.987923 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3561/7230] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:19.050099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:19.050744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:19.057713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:19.058222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:19.058687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:19.059407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:19.059886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:19.060336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:19.258951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:19.266774 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e1001c2a-1b7f-4f8c-a7d3-77ece31d4a5f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1517 microversion: 2.1 time: 0.220617 Nov 03 05:03:19.267358 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3670/7231] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:19 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:20.293103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:20.293807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:20.299827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:20.300309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:20.300753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:20.301466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:20.302574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:20.302985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:20.438620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:20.446485 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3d670b03-a5a0-44a6-8d2d-ad62eb4c3c45 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1515 microversion: 2.1 time: 0.158479 Nov 03 05:03:20.447068 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3562/7232] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:20 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:21.016482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-031e7bb0-06c4-453c-94af-eb60fdf58440 req-374e8fa3-7455-4a23-bb5f-8ed59673caef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a654276b-6122-453d-9d3e-373f2d3f2c83", "tag": "b0f50a7f-d72a-4eb8-ad38-b1e1402751c2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:21.026907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-031e7bb0-06c4-453c-94af-eb60fdf58440 req-374e8fa3-7455-4a23-bb5f-8ed59673caef service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:21.027401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-031e7bb0-06c4-453c-94af-eb60fdf58440 req-374e8fa3-7455-4a23-bb5f-8ed59673caef service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:21.027856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-031e7bb0-06c4-453c-94af-eb60fdf58440 req-374e8fa3-7455-4a23-bb5f-8ed59673caef service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:21.039632 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-031e7bb0-06c4-453c-94af-eb60fdf58440 req-374e8fa3-7455-4a23-bb5f-8ed59673caef service nova] Creating event network-changed:b0f50a7f-d72a-4eb8-ad38-b1e1402751c2 for instance a654276b-6122-453d-9d3e-373f2d3f2c83 on n-h2-854653-7 Nov 03 05:03:21.044798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-031e7bb0-06c4-453c-94af-eb60fdf58440 req-374e8fa3-7455-4a23-bb5f-8ed59673caef service nova] Instance a654276b-6122-453d-9d3e-373f2d3f2c83 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:03:21.056273 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-031e7bb0-06c4-453c-94af-eb60fdf58440 req-374e8fa3-7455-4a23-bb5f-8ed59673caef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043513 Nov 03 05:03:21.056876 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3671/7233] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:21.470743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:21.472039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:21.481981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:21.482866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:21.483814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:21.485123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:21.486156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:21.486985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:21.745536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:21.756082 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e83fd85c-fd92-4ea6-ab78-0d9b1f86dbbb tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1515 microversion: 2.1 time: 0.289299 Nov 03 05:03:21.756779 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3563/7234] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:21 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1515 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:03:22.783473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:22.784198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:22.790425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:22.790929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:22.791391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:22.792098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:22.792573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:22.793037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:22.926292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:22.934611 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b9d2d6d-b83d-4c98-aac2-03d037f77506 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1512 microversion: 2.1 time: 0.156311 Nov 03 05:03:22.935175 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3672/7235] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:22 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:22.957472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:22.958049 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:22.964076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:22.964566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:22.965041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:22.965755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:22.966220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:22.966653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:23.149030 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5627b77b-3959-4fc7-9e1d-16c73caf9729 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "POST /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83/action" status: 204 len: 0 microversion: 2.1 time: 0.195093 Nov 03 05:03:23.149661 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3564/7236] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:03:22 2022] POST /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83/action => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:03:23.157881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:23.158517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:23.165061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:23.168784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:23.168784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:23.168784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:23.168784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:23.168784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:23.297709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:23.306339 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f1308d2-ad36-4e7d-9213-a9d243de6b8f tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1512 microversion: 2.1 time: 0.152442 Nov 03 05:03:23.306914 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3673/7237] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:23 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:23.581298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-71ac9b63-c437-468c-90f0-3044558055af req-9e5994af-7693-4fed-8c4b-b333fce8c148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a654276b-6122-453d-9d3e-373f2d3f2c83", "name": "network-vif-plugged", "status": "completed", "tag": "b0f50a7f-d72a-4eb8-ad38-b1e1402751c2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:23.592195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-71ac9b63-c437-468c-90f0-3044558055af req-9e5994af-7693-4fed-8c4b-b333fce8c148 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:23.592757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-71ac9b63-c437-468c-90f0-3044558055af req-9e5994af-7693-4fed-8c4b-b333fce8c148 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:23.593293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-71ac9b63-c437-468c-90f0-3044558055af req-9e5994af-7693-4fed-8c4b-b333fce8c148 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:23.605783 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-71ac9b63-c437-468c-90f0-3044558055af req-9e5994af-7693-4fed-8c4b-b333fce8c148 service nova] Creating event network-vif-plugged:b0f50a7f-d72a-4eb8-ad38-b1e1402751c2 for instance a654276b-6122-453d-9d3e-373f2d3f2c83 on n-h2-854653-7 Nov 03 05:03:23.611334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-71ac9b63-c437-468c-90f0-3044558055af req-9e5994af-7693-4fed-8c4b-b333fce8c148 service nova] Instance a654276b-6122-453d-9d3e-373f2d3f2c83 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:03:23.622104 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-71ac9b63-c437-468c-90f0-3044558055af req-9e5994af-7693-4fed-8c4b-b333fce8c148 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045616 Nov 03 05:03:23.622723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3565/7238] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:24.329604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:24.330261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:24.337127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:24.337627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:24.338079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:24.338775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:24.339246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:24.339683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:24.470109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:24.478108 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bee765b8-b60e-4b65-81ba-a1effdf644a5 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1512 microversion: 2.1 time: 0.152469 Nov 03 05:03:24.479018 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3674/7239] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:24 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:25.503386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:25.504126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:25.510270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:25.510762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:25.511202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:25.511896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:25.512352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:25.512781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:25.644398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:25.652650 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be433112-05e0-496d-aa65-3f6e18f7311a tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1504 microversion: 2.1 time: 0.154445 Nov 03 05:03:25.653259 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3566/7240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:25 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:25.674898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:25.675541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:25.682952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:25.683464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:25.683926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:25.684645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:25.685161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:25.685613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:25.814211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:25.822003 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-380f2e0f-85eb-40bc-acc7-808376e799a9 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1504 microversion: 2.1 time: 0.151002 Nov 03 05:03:25.822603 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3675/7241] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:25 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:25.844304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:25.844917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:25.851625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:25.852112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:25.852551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:25.853298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:25.853785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:25.854216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:25.985396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:25.993103 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-17ca234d-aefd-4384-9913-e996aaef57e6 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1504 microversion: 2.1 time: 0.152646 Nov 03 05:03:25.993681 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3567/7242] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:25 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:26.015258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:26.015720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:26.022251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:26.022756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:26.023218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:26.024189 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:26.024663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:26.025148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:26.049729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:03:26.315277 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ce20912-9533-4b82-86b7-d950b540087b tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 204 len: 0 microversion: 2.1 time: 0.303545 Nov 03 05:03:26.315808 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3676/7243] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:03:26 2022] DELETE /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:03:26.334378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:26.334880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:26.341186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:26.342210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:26.342210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:26.342819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:26.343279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:26.343709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:26.368167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:03:26.412583 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.compute.api [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Instance is already in deleting state, ignoring this request Nov 03 05:03:26.413444 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3889009c-7246-4d41-ae3c-13d0fc86206d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 204 len: 0 microversion: 2.1 time: 0.084308 Nov 03 05:03:26.414005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3568/7244] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:03:26 2022] DELETE /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:03:26.422531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:26.423250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:26.429165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:26.429666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:26.430120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:26.430823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:26.431291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:26.431735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:26.566994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:26.575283 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-29c2cd17-1015-47f1-9227-8956eaa39332 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1510 microversion: 2.1 time: 0.156953 Nov 03 05:03:26.575858 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3677/7245] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:26 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:27.598405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:27.599060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:27.606031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:27.606523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:27.606964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:27.607658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:27.608121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:27.608551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:27.740002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:27.747870 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aa23aa5b-0945-4aa1-83fd-2830451a027c tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1510 microversion: 2.1 time: 0.153506 Nov 03 05:03:27.748443 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3569/7246] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:27 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:28.292702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-74f297b7-2490-4712-9a8e-228a40aa706f req-4e298e43-234b-4ae4-bdac-bf3b1699aea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a654276b-6122-453d-9d3e-373f2d3f2c83", "name": "network-vif-deleted", "tag": "b0f50a7f-d72a-4eb8-ad38-b1e1402751c2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:28.304172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-74f297b7-2490-4712-9a8e-228a40aa706f req-4e298e43-234b-4ae4-bdac-bf3b1699aea8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:28.304673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-74f297b7-2490-4712-9a8e-228a40aa706f req-4e298e43-234b-4ae4-bdac-bf3b1699aea8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:28.305159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-74f297b7-2490-4712-9a8e-228a40aa706f req-4e298e43-234b-4ae4-bdac-bf3b1699aea8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:28.317608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-74f297b7-2490-4712-9a8e-228a40aa706f req-4e298e43-234b-4ae4-bdac-bf3b1699aea8 service nova] Creating event network-vif-deleted:b0f50a7f-d72a-4eb8-ad38-b1e1402751c2 for instance a654276b-6122-453d-9d3e-373f2d3f2c83 on n-h2-854653-7 Nov 03 05:03:28.322707 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-74f297b7-2490-4712-9a8e-228a40aa706f req-4e298e43-234b-4ae4-bdac-bf3b1699aea8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Nov 03 05:03:28.323325 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3678/7247] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:28.772232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:28.772855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:28.780293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:28.780790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:28.781374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:28.782086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:28.782551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:28.782982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:28.818000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:28.818491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:28.818940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:28.819399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lazy-loading 'fault' on Instance uuid a654276b-6122-453d-9d3e-373f2d3f2c83 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:03:28.859909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cbaf5194954c048d0b33b4e4549ac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf89f9597e5641b48e620a498eb50f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:28.868363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6eee4bc5-b573-4086-acb9-b672c59df6ac tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 200 len: 1305 microversion: 2.1 time: 0.100453 Nov 03 05:03:28.868953 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3570/7248] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:28 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:29.893639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:29.894355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: a654276b-6122-453d-9d3e-373f2d3f2c83] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:29.901996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:29.902495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:29.902942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:29.903651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:29.904154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:29.904582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:29.918407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] HTTP exception thrown: Instance a654276b-6122-453d-9d3e-373f2d3f2c83 could not be found. Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Request method failure captured: Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 HTTP/1.1 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0szU7Q3KdTGMOMaE9bm4zSw3MgGWRYNqo9bR5la0oDAXwn7XpqfcxLbzgieQsAgSA8JdDW_Gth_mhN2qZDRy5cF-qAaDrWWcJaPxhvAdj-RXmfRHBog1SsdIkDmAI8jRJnfXVl-jSApMfRXSsIGf8QL2yo_eMKyxv8Cb9Czup2Kdi0 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cf89f9597e5641b48e620a498eb50f6b Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf89f9597e5641b48e620a498eb50f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cf89f9597e5641b48e620a498eb50f6b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf89f9597e5641b48e620a498eb50f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cf89f9597e5641b48e620a498eb50f6b"}]}] Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cf89f9597e5641b48e620a498eb50f6b Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerDiskConfigTestJSON-2115654245-project Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b3cbaf5194954c048d0b33b4e4549ac5 Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerDiskConfigTestJSON-2115654245-project Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a654276b-6122-453d-9d3e-373f2d3f2c83 could not be found. Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a654276b-6122-453d-9d3e-373f2d3f2c83'} Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a654276b-6122-453d-9d3e-373f2d3f2c83 could not be found. Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a654276b-6122-453d-9d3e-373f2d3f2c83 could not be found. Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:03:29.920108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a654276b-6122-453d-9d3e-373f2d3f2c83 could not be found. Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Returning 404 to user: Instance a654276b-6122-453d-9d3e-373f2d3f2c83 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ca57365-e83c-41a2-b159-0bcb6d49992d tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83" status: 404 len: 111 microversion: 2.1 time: 0.033207 Nov 03 05:03:29.924466 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3679/7249] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:29 2022] GET /compute/v2.1/servers/a654276b-6122-453d-9d3e-373f2d3f2c83 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:03:29.930335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a52e4bf9-9439-46c8-953d-0c72497512fd tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '.version_select at 0x7ff7f3f9e9d0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:30.035572 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a52e4bf9-9439-46c8-953d-0c72497512fd tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214992690" status: 202 len: 0 microversion: 2.1 time: 0.109008 Nov 03 05:03:30.036146 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3571/7250] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Nov 3 05:03:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214992690 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:03:30.766229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:30.766752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:30.772680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:30.774324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:30.774324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:30.774603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:30.775068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:30.775503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:30.789369 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] HTTP exception thrown: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Request method failure captured: Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 HTTP/1.1 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0szU7Q3KdTGMOMaE9bm4zSw3MgGWRYNqo9bR5la0oDAXwn7XpqfcxLbzgieQsAgSA8JdDW_Gth_mhN2qZDRy5cF-qAaDrWWcJaPxhvAdj-RXmfRHBog1SsdIkDmAI8jRJnfXVl-jSApMfRXSsIGf8QL2yo_eMKyxv8Cb9Czup2Kdi0 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: cf89f9597e5641b48e620a498eb50f6b Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf89f9597e5641b48e620a498eb50f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cf89f9597e5641b48e620a498eb50f6b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf89f9597e5641b48e620a498eb50f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cf89f9597e5641b48e620a498eb50f6b"}]}] Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: cf89f9597e5641b48e620a498eb50f6b Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerDiskConfigTestJSON-2115654245-project Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: b3cbaf5194954c048d0b33b4e4549ac5 Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerDiskConfigTestJSON-2115654245-project Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'd0b61896-54c2-40e8-b395-de3b00264422'} Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:03:30.790920 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Returning 404 to user: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40c7ac6c-00a1-489c-bb21-2ceda8849048 tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 404 len: 111 microversion: 2.1 time: 0.030025 Nov 03 05:03:30.798604 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3680/7251] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:03:30 2022] DELETE /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:03:30.805843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:30.806551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] [instance: d0b61896-54c2-40e8-b395-de3b00264422] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:30.813061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:30.813556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:30.814000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:30.814697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:30.815158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:30.815592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:30.828744 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] HTTP exception thrown: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Request method failure captured: Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 HTTP/1.1 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0szU7Q3KdTGMOMaE9bm4zSw3MgGWRYNqo9bR5la0oDAXwn7XpqfcxLbzgieQsAgSA8JdDW_Gth_mhN2qZDRy5cF-qAaDrWWcJaPxhvAdj-RXmfRHBog1SsdIkDmAI8jRJnfXVl-jSApMfRXSsIGf8QL2yo_eMKyxv8Cb9Czup2Kdi0 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: cf89f9597e5641b48e620a498eb50f6b Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf89f9597e5641b48e620a498eb50f6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_cf89f9597e5641b48e620a498eb50f6b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/cf89f9597e5641b48e620a498eb50f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/cf89f9597e5641b48e620a498eb50f6b"}]}] Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: cf89f9597e5641b48e620a498eb50f6b Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2115654245 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerDiskConfigTestJSON-2115654245-project Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: b3cbaf5194954c048d0b33b4e4549ac5 Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerDiskConfigTestJSON-2115654245-project Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'd0b61896-54c2-40e8-b395-de3b00264422'} Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:03:30.835623 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] Returning 404 to user: Instance d0b61896-54c2-40e8-b395-de3b00264422 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-440f9472-d872-4aef-acb0-1b9ffab39bee tempest-ServerDiskConfigTestJSON-2115654245 tempest-ServerDiskConfigTestJSON-2115654245-project] 10.222.0.30 "GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422" status: 404 len: 111 microversion: 2.1 time: 0.030583 Nov 03 05:03:30.840393 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3572/7252] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:30 2022] GET /compute/v2.1/servers/d0b61896-54c2-40e8-b395-de3b00264422 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:03:42.059619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:42.060628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:42.175499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-347a42d8-fb0c-4c40-81ee-c15dedeff2d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'create', calling method: .version_select at 0x7ff7f9165e50>, body: {"keypair": {"name": "tempest-keypair-583107862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJmxi6btQaMyA/4jPFaCmPuFkV5kKDygMbEozCVsn0cQxieI2x0Jmh7Gbo4ippCYtCyT8NDXQicznbf+Rdz8i7KVhWJylvwWW119WcpnKysGfNXgfF+doAZwkY+h8Bm3A=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:42.204413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-347a42d8-fb0c-4c40-81ee-c15dedeff2d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for project 945422a884ac43b7995e59a6a331f723. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:03:42.206361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-347a42d8-fb0c-4c40-81ee-c15dedeff2d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for user fefb1bf8c01c48efa41fd865ba4e06af and project 945422a884ac43b7995e59a6a331f723. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:03:42.299456 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-347a42d8-fb0c-4c40-81ee-c15dedeff2d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.245570 Nov 03 05:03:42.300078 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3681/7253] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:03:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:44.478380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1453418650", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f5a7638-ec3b-4181-87b6-5f84a98d6f7c"}], "security_groups": [{"name": "tempest-securitygroup--145544269"}], "key_name": "tempest-keypair-583107862", "user_data": "}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:44.488611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:44.489433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:44.587881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] validate_networks() for [('0f5a7638-ec3b-4181-87b6-5f84a98d6f7c', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:03:44.998550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:03:44.999055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:03:44.999640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:03:45.000052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:03:45.000465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:03:45.010503 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:45.014384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:45.014384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:45.014384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:45.014384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:45.014384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:45.031633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:03:45.037640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for user fefb1bf8c01c48efa41fd865ba4e06af and project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:03:45.051145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:03:45.053592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:03:45.186001 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cdd008ba-cfdd-4178-a87e-6ab2b1c78289 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.712047 Nov 03 05:03:45.187232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3573/7254] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:03:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:03:45.200546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b4f84131-2f71-4c85-ac2e-996f95cea3d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:45.201289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b4f84131-2f71-4c85-ac2e-996f95cea3d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:45.264932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b4f84131-2f71-4c85-ac2e-996f95cea3d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:45.275718 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b4f84131-2f71-4c85-ac2e-996f95cea3d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1238 microversion: 2.1 time: 0.077208 Nov 03 05:03:45.275718 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3682/7255] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:45 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:03:46.297041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:46.297709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:46.305506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:46.305995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:46.306448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:46.307164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:46.307631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:46.308069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:46.372184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:46.380067 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7841713b-31f9-4005-8cff-2a1bc0ef2bba tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1242 microversion: 2.1 time: 0.088046 Nov 03 05:03:46.380655 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3574/7256] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:46 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:03:47.403301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:47.403967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:47.411509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:47.412031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:47.412498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:47.413260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:47.413743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:47.414197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:47.503634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:47.513465 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c57fea7e-a116-45da-8153-d0a3f1894830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1298 microversion: 2.1 time: 0.114417 Nov 03 05:03:47.524301 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3683/7257] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:47 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:48.535975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:48.537163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:48.543929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:48.544413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:48.544913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:48.545643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:48.546100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:48.546550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:48.754724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:48.763243 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8ef0e74f-1040-4d32-9c92-49a2389e476a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1363 microversion: 2.1 time: 0.231303 Nov 03 05:03:48.763917 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3575/7258] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:48 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:49.205666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5aba1ad0-b3ac-4897-b1f0-58b92884d3a0 req-9a021f07-f5a9-4e54-ad75-d0b14ad07a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3b5ccf-de70-4131-9fcb-ce42f15e38dd", "tag": "70815f64-b8ca-4255-a0bf-4cfa0b4d38bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:49.216404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5aba1ad0-b3ac-4897-b1f0-58b92884d3a0 req-9a021f07-f5a9-4e54-ad75-d0b14ad07a69 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:49.217658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5aba1ad0-b3ac-4897-b1f0-58b92884d3a0 req-9a021f07-f5a9-4e54-ad75-d0b14ad07a69 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:49.217658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5aba1ad0-b3ac-4897-b1f0-58b92884d3a0 req-9a021f07-f5a9-4e54-ad75-d0b14ad07a69 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:49.229435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5aba1ad0-b3ac-4897-b1f0-58b92884d3a0 req-9a021f07-f5a9-4e54-ad75-d0b14ad07a69 service nova] Creating event network-changed:70815f64-b8ca-4255-a0bf-4cfa0b4d38bc for instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd on n-h2-854653-7 Nov 03 05:03:49.234555 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5aba1ad0-b3ac-4897-b1f0-58b92884d3a0 req-9a021f07-f5a9-4e54-ad75-d0b14ad07a69 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032732 Nov 03 05:03:49.235326 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3684/7259] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:49.791659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:49.792216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:49.799319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:49.799817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:49.800249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:49.800952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:49.801504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:49.801969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:50.006241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:50.014356 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d9eaf64-c516-426b-9053-5c8054f1cbad tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1363 microversion: 2.1 time: 0.226703 Nov 03 05:03:50.014994 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3576/7260] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:49 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:51.039923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:51.040655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:51.047026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:51.047468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:51.047927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:51.048634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:51.049149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:51.049596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:51.179138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:51.186788 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-761bcc40-5a86-41c9-b043-0bb5b0b8b40d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1363 microversion: 2.1 time: 0.152528 Nov 03 05:03:51.194784 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3685/7261] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:51 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:52.209789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:52.210342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:52.217457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:52.218438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:52.218887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:52.219598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:52.220061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:52.220490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:52.356003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:52.363689 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fa4de873-b8bf-401b-b7b6-d230086a4aa2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1363 microversion: 2.1 time: 0.157999 Nov 03 05:03:52.364883 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3577/7262] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:52 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:53.386267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:53.386899 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:53.393312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:53.393806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:53.394262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:53.394962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:53.395481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:53.395921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:53.525062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:53.533284 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b158820e-875b-405d-aa0a-c1bb43cf9fc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1363 microversion: 2.1 time: 0.150887 Nov 03 05:03:53.535583 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3686/7263] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:53 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:53.846060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a5f2fcac-11d2-4e54-8b7b-e3e2b0eef512 req-696f167e-5b3c-4d66-86cf-84e2c6275dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3b5ccf-de70-4131-9fcb-ce42f15e38dd", "name": "network-vif-plugged", "status": "completed", "tag": "70815f64-b8ca-4255-a0bf-4cfa0b4d38bc"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:53.856224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a5f2fcac-11d2-4e54-8b7b-e3e2b0eef512 req-696f167e-5b3c-4d66-86cf-84e2c6275dd7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:53.856702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a5f2fcac-11d2-4e54-8b7b-e3e2b0eef512 req-696f167e-5b3c-4d66-86cf-84e2c6275dd7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:53.857160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a5f2fcac-11d2-4e54-8b7b-e3e2b0eef512 req-696f167e-5b3c-4d66-86cf-84e2c6275dd7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:53.867901 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a5f2fcac-11d2-4e54-8b7b-e3e2b0eef512 req-696f167e-5b3c-4d66-86cf-84e2c6275dd7 service nova] Creating event network-vif-plugged:70815f64-b8ca-4255-a0bf-4cfa0b4d38bc for instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd on n-h2-854653-7 Nov 03 05:03:53.873160 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a5f2fcac-11d2-4e54-8b7b-e3e2b0eef512 req-696f167e-5b3c-4d66-86cf-84e2c6275dd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031283 Nov 03 05:03:53.873766 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3578/7264] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:54.555730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:54.556361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:54.563137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:54.563622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:54.564074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:54.564776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:54.565271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:54.565713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:54.699056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:54.706872 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7ab67993-b15c-4331-abdb-ce0c606e5bc9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1363 microversion: 2.1 time: 0.155014 Nov 03 05:03:54.707406 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3687/7265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:54 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:03:55.727949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:55.728649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:55.732785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:55.733524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:55.740066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:55.740554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:55.740995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:55.741708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:55.742168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:55.742602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:55.872537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:03:55.880881 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d111627a-84e1-420e-b5b7-a9ca447698a3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1549 microversion: 2.1 time: 0.154789 Nov 03 05:03:55.881572 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3579/7266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:03:55 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:03:55.903374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:03:55.903890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:03:55.905950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:03:55.911743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:55.912221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:55.912690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:55.913440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:55.913917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:55.914367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:55.995608 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abeb817b-2597-423e-9735-3bd64901f05d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096457 Nov 03 05:03:55.996206 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3688/7267] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 05:03:55 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:03:57.312078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-bd379103-9ae8-4284-b33a-0c27d039d58f req-e398ab54-2746-4260-bab9-0f3e9c42bb45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3b5ccf-de70-4131-9fcb-ce42f15e38dd", "tag": "70815f64-b8ca-4255-a0bf-4cfa0b4d38bc"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:03:57.323260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bd379103-9ae8-4284-b33a-0c27d039d58f req-e398ab54-2746-4260-bab9-0f3e9c42bb45 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:03:57.323745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bd379103-9ae8-4284-b33a-0c27d039d58f req-e398ab54-2746-4260-bab9-0f3e9c42bb45 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:03:57.324180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bd379103-9ae8-4284-b33a-0c27d039d58f req-e398ab54-2746-4260-bab9-0f3e9c42bb45 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:03:57.335699 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-bd379103-9ae8-4284-b33a-0c27d039d58f req-e398ab54-2746-4260-bab9-0f3e9c42bb45 service nova] Creating event network-changed:70815f64-b8ca-4255-a0bf-4cfa0b4d38bc for instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd on n-h2-854653-7 Nov 03 05:03:57.340802 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-bd379103-9ae8-4284-b33a-0c27d039d58f req-e398ab54-2746-4260-bab9-0f3e9c42bb45 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032400 Nov 03 05:03:57.341634 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3580/7268] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:04:33.377528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:04:33.378326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=30 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:04:33.382962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:33.389438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:33.392796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:33.393339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:33.393829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:33.394581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:33.395059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:33.395536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:33.594740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:33.602485 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-282be534-6592-429e-8764-fbddad952133 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1668 microversion: 2.1 time: 0.226797 Nov 03 05:04:33.603050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3689/7269] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:33 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1668 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:33.626500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:33.627282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:33.629749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:04:33.630343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=36 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:04:33.635768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:33.646386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:33.646386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:33.646386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:33.646386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:33.646386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:33.818990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:33.827330 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04da5f25-fb74-43fa-9fb8-1a56aaac779f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1668 microversion: 2.1 time: 0.205219 Nov 03 05:04:33.827897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3581/7270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:33 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:04:33.848949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:33.849721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:33.855711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:33.856221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:33.856693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:33.857434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:33.857919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:33.858368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:33.988384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:33.996928 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-be77b1d3-2b6f-444e-b9e6-343b220d03ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1668 microversion: 2.1 time: 0.151853 Nov 03 05:04:33.997519 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3690/7271] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:33 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:34.019463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:04:34.021747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:34.027826 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:34.028312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:34.028748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:34.029490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:34.029944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:34.030369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:34.057762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:34.063642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Old instance type m1.heat2, new instance type m1.heat {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:04:34.070123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:04:34.070540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:04:34.071059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:04:34.071489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:04:34.071880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:04:34.340748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ada59e7b-c2cc-4fea-902a-e725fdb391c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd/action" status: 202 len: 0 microversion: 2.1 time: 0.325093 Nov 03 05:04:34.341415 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3582/7272] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:04:34 2022] POST /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:04:34.349602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:34.350282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:34.357736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:34.358523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:34.359165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:34.359907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:34.360394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:34.361041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:34.521698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:34.521698 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16a6e0b6-a38d-4dad-88f1-b22e16687ba3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1677 microversion: 2.1 time: 0.163720 Nov 03 05:04:34.521698 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3691/7273] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:34 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:35.534328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:35.534959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:35.543723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:35.544223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:35.544669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:35.545406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:35.546053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:35.546490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:35.693988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:35.703098 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-360302cf-1955-4b66-977e-295d5991f362 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1677 microversion: 2.1 time: 0.173575 Nov 03 05:04:35.704276 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3583/7274] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:35 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:36.727271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:36.727943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:36.735088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:36.735592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:36.736058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:36.736774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:36.737305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:36.737753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:36.927664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:36.935491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-630e305c-2bb6-4708-8f7a-8067e306d5b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1677 microversion: 2.1 time: 0.212265 Nov 03 05:04:36.936059 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3692/7275] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:36 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:37.959012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:37.959632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:37.966930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:37.967414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:37.967852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:37.968540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:37.968992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:37.969441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:38.106642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:38.114316 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3da3fbee-8812-423f-92fa-7961df397081 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.159259 Nov 03 05:04:38.114887 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3584/7276] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:37 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:39.137434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:39.138067 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:39.145277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:39.145782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:39.146237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:39.146944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:39.147412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:39.147855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:39.275835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:39.283506 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-978744a5-72e5-4a42-81ac-11ca05d3b169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.150100 Nov 03 05:04:39.284076 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3693/7277] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:39 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:40.306731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:40.307350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:40.314795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:40.315278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:40.315715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:40.316412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:40.316866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:40.317320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:40.453330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:40.461817 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-06709775-58a2-48cc-9a75-8f3f0b2af0fa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.158908 Nov 03 05:04:40.462403 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3585/7278] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:40 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:41.485146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:41.485783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:41.492812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:41.493339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:41.493792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:41.494493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:41.494961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:41.495400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:41.626487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:41.634288 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5f720eeb-4ec6-4d39-9594-8f36e3aecce3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.153102 Nov 03 05:04:41.634867 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3694/7279] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:41 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:42.658759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:42.659379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:42.666127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:42.666609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:42.667050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:42.667746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:42.668204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:42.669295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:42.797191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:42.804918 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c20f020-ae7c-4b93-85f3-30c1649c710d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.150115 Nov 03 05:04:42.805525 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3586/7280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:42 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:43.827758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:43.828366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:43.835152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:43.835648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:43.836101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:43.836806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:43.837302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:43.837744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:43.972805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:43.981753 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad467b83-2d88-4963-913a-e6ede2d6f119 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.157284 Nov 03 05:04:43.982339 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3695/7281] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:43 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:04:45.004814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:45.005502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:45.012642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:45.013169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:45.013616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:45.014321 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:45.014783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:45.015225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:45.147643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:45.155608 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7314c0d1-a989-4e50-8e5e-f8a44886b98f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.154817 Nov 03 05:04:45.156210 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3587/7282] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:44 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:46.179014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:46.179644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:46.186971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:46.187501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:46.187958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:46.188667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:46.189172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:46.189616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:46.320997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:46.329410 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96eb7ad8-f759-415e-989a-e4d001e1b108 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.154310 Nov 03 05:04:46.329986 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3696/7283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:46 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:47.351845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:47.352599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:47.360696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:47.361219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:47.361659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:47.362354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:47.362810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:47.363235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:47.525784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:47.534227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-849559a4-37d9-4dfc-8594-ff3ed16317f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.186426 Nov 03 05:04:47.534803 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3588/7284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:47 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:48.557921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:48.558584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:48.565695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:48.566201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:48.566660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:48.567372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:48.567846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:48.568291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:48.700211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:48.707982 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dff26525-d01b-4e4f-be77-e1133f61818a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.154056 Nov 03 05:04:48.708559 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3697/7285] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:48 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:49.731723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:49.732345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:49.739347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:49.739839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:49.740282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:49.740982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:49.741480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:49.741909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:49.869377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:49.877598 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-062a6edb-dbc2-4765-994c-a5aff5bf093d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.149809 Nov 03 05:04:49.878172 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3589/7286] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:49 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:50.901420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:50.902055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:50.909513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:50.910020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:50.910480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:50.911195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:50.911672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:50.912118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:51.040422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:51.048272 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86aa84ea-1661-4efb-a8fe-60fb5a4dbd3d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.151039 Nov 03 05:04:51.048875 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3698/7287] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:50 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:52.071745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:52.072361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:52.079307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:52.079790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:52.080228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:52.080920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:52.081399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:52.081836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:52.216291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:52.223988 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e660d643-81d1-4f60-9e5b-e6eebc694d13 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.156189 Nov 03 05:04:52.224564 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3590/7288] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:52 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:53.248709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:53.249375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:53.255699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:53.256207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:53.256669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:53.257424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:53.257904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:53.258355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:53.386544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:53.394148 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-721b6bc2-2c60-484d-b0f7-23b8b20cc83c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.150131 Nov 03 05:04:53.394712 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3699/7289] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:53 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:54.418687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:54.419316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:54.425539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:54.426036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:54.426484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:54.427254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:54.427748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:54.428178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:54.566697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:54.574659 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a4a59301-f6e6-459f-800f-4a92e3d9af02 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1682 microversion: 2.1 time: 0.160897 Nov 03 05:04:54.575242 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3591/7290] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:54 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:55.368301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d1e58121-c352-4d3d-8d86-877aacccbc61 req-540435e5-356c-4bb5-9429-f7acc6cbf5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3b5ccf-de70-4131-9fcb-ce42f15e38dd", "name": "network-vif-unplugged", "status": "completed", "tag": "70815f64-b8ca-4255-a0bf-4cfa0b4d38bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:04:55.378252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1e58121-c352-4d3d-8d86-877aacccbc61 req-540435e5-356c-4bb5-9429-f7acc6cbf5d6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:55.381125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1e58121-c352-4d3d-8d86-877aacccbc61 req-540435e5-356c-4bb5-9429-f7acc6cbf5d6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:55.381125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1e58121-c352-4d3d-8d86-877aacccbc61 req-540435e5-356c-4bb5-9429-f7acc6cbf5d6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:55.391102 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d1e58121-c352-4d3d-8d86-877aacccbc61 req-540435e5-356c-4bb5-9429-f7acc6cbf5d6 service nova] Creating event network-vif-unplugged:70815f64-b8ca-4255-a0bf-4cfa0b4d38bc for instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd on n-h1-854653-7 Nov 03 05:04:55.396341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-d1e58121-c352-4d3d-8d86-877aacccbc61 req-540435e5-356c-4bb5-9429-f7acc6cbf5d6 service nova] Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:04:55.407967 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d1e58121-c352-4d3d-8d86-877aacccbc61 req-540435e5-356c-4bb5-9429-f7acc6cbf5d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097545 Nov 03 05:04:55.409865 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3700/7291] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:04:55.598779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:55.599409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:55.606966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:55.607450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:55.607929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:55.608631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:55.609126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:55.609560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:55.743412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:55.752584 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2f7e410-3817-485d-9168-63c02134d2a4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1681 microversion: 2.1 time: 0.157736 Nov 03 05:04:55.753295 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3592/7292] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:55 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:56.777270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:56.778023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:56.784103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:56.784602 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:56.785084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:56.785800 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:56.786274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:56.786789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:56.925045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:56.932924 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c4649427-1df5-4b88-870e-ae9cd7a85eac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1679 microversion: 2.1 time: 0.160993 Nov 03 05:04:56.933536 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3701/7293] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:56 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:57.423238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3e265b90-6e28-4e62-98fb-71352d61684a req-81ad7193-52e8-4550-8fe5-a37c080ad7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3b5ccf-de70-4131-9fcb-ce42f15e38dd", "tag": "70815f64-b8ca-4255-a0bf-4cfa0b4d38bc"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:04:57.433325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3e265b90-6e28-4e62-98fb-71352d61684a req-81ad7193-52e8-4550-8fe5-a37c080ad7a6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:57.433805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3e265b90-6e28-4e62-98fb-71352d61684a req-81ad7193-52e8-4550-8fe5-a37c080ad7a6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:57.434240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3e265b90-6e28-4e62-98fb-71352d61684a req-81ad7193-52e8-4550-8fe5-a37c080ad7a6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:57.446159 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3e265b90-6e28-4e62-98fb-71352d61684a req-81ad7193-52e8-4550-8fe5-a37c080ad7a6 service nova] Creating event network-changed:70815f64-b8ca-4255-a0bf-4cfa0b4d38bc for instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd on n-h1-854653-7 Nov 03 05:04:57.452149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-3e265b90-6e28-4e62-98fb-71352d61684a req-81ad7193-52e8-4550-8fe5-a37c080ad7a6 service nova] Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:04:57.463083 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3e265b90-6e28-4e62-98fb-71352d61684a req-81ad7193-52e8-4550-8fe5-a37c080ad7a6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043542 Nov 03 05:04:57.463667 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3593/7294] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:04:57.957112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:57.957659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:57.964529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:57.965045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:57.965512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:57.966253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:57.966729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:57.967169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:58.109603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:58.117419 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0db3d016-370b-45ab-9f3d-90f8b4a2c2dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1679 microversion: 2.1 time: 0.164324 Nov 03 05:04:58.118004 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3702/7295] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:57 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:04:59.141729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:04:59.142460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:04:59.149753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:59.150239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:59.150677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:59.151365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:04:59.151816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:04:59.152242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:04:59.285687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:04:59.293332 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec37e303-1129-41e3-81d3-7dda592032fd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1679 microversion: 2.1 time: 0.156474 Nov 03 05:04:59.293901 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3594/7296] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:04:59 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:00.316833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:00.317640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:00.324429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:00.324948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:00.326050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:00.326779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:00.327289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:00.327739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:00.459573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:00.468404 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9884d45-6d84-4b97-90b0-4facb9a49505 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1676 microversion: 2.1 time: 0.155265 Nov 03 05:05:00.469358 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3703/7297] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:00 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:00.495767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:05:00.496354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:00.503628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:00.504208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:00.504650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:00.505379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:00.505838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:00.506271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:00.546050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:05:00.729104 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f64ab39-361f-4e28-9740-6287f871446f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd/action" status: 204 len: 0 microversion: 2.1 time: 0.240220 Nov 03 05:05:00.729854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3595/7298] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:05:00 2022] POST /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd/action => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:05:00.739923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:00.740566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:00.746633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:00.747769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:00.748234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:00.748946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:00.749444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:00.749883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:00.888317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:00.904769 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-172819fe-9055-47ab-bece-fd7d808c4c68 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1676 microversion: 2.1 time: 0.170035 Nov 03 05:05:00.906130 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3704/7299] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:00 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:01.929725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:01.930431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:01.936704 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:01.937224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:01.937665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:01.938360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:01.938813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:01.939241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:02.069476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:02.077283 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5609c0ed-da31-425e-9e73-e2b2f4a1d29b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1676 microversion: 2.1 time: 0.153178 Nov 03 05:05:02.081157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3596/7300] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:01 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:02.445236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-7d9c4d81-5729-4af3-b3a6-4be094c3b730 req-bad3d8cc-55a9-4507-bdf1-28533b2feb3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3b5ccf-de70-4131-9fcb-ce42f15e38dd", "name": "network-vif-plugged", "status": "completed", "tag": "70815f64-b8ca-4255-a0bf-4cfa0b4d38bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:05:02.457193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7d9c4d81-5729-4af3-b3a6-4be094c3b730 req-bad3d8cc-55a9-4507-bdf1-28533b2feb3d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:02.457715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7d9c4d81-5729-4af3-b3a6-4be094c3b730 req-bad3d8cc-55a9-4507-bdf1-28533b2feb3d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:02.458161 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-7d9c4d81-5729-4af3-b3a6-4be094c3b730 req-bad3d8cc-55a9-4507-bdf1-28533b2feb3d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:02.470657 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-7d9c4d81-5729-4af3-b3a6-4be094c3b730 req-bad3d8cc-55a9-4507-bdf1-28533b2feb3d service nova] Creating event network-vif-plugged:70815f64-b8ca-4255-a0bf-4cfa0b4d38bc for instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd on n-h1-854653-7 Nov 03 05:05:02.476068 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-7d9c4d81-5729-4af3-b3a6-4be094c3b730 req-bad3d8cc-55a9-4507-bdf1-28533b2feb3d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034934 Nov 03 05:05:02.477084 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3705/7301] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:05:03.101355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:03.101987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:03.109502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.109996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.110446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.111149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.111616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.112155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.245653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:03.254197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da312af4-645a-4c13-96ef-50d6fd50839e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1668 microversion: 2.1 time: 0.156843 Nov 03 05:05:03.254788 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3597/7302] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:03 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:03.277138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:03.277891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:03.284042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.284541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.284993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.285711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.286182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.286620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.305529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:05:03.415472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:03.423685 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e2431b82-5a72-4bda-8a89-87abe1b32529 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1668 microversion: 2.1 time: 0.151069 Nov 03 05:05:03.424245 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3706/7303] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:03 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:03.445409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:03.446082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:03.451958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.452445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.452889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.453607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.454066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.454495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.587204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:03.595419 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4b8d7254-9b65-453a-b11c-5a7fabc40b45 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1668 microversion: 2.1 time: 0.153954 Nov 03 05:05:03.596086 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3598/7304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:03 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:03.618680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:03.619210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:03.621864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=37 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:05:03.626573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.627079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.627548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.628260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.628747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.629229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.655043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:05:03.914629 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-94459b01-f77d-4090-a3fe-c4ce8cbd2432 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 204 len: 0 microversion: 2.1 time: 0.299107 Nov 03 05:05:03.914748 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3707/7305] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:05:03 2022] DELETE /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:05:03.923095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:03.923711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:03.925756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=41 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:05:03.930471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.930961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.931401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:03.932088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:03.932539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:03.932965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:04.065896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:04.073598 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-747a6cc9-f21e-4c56-b1e5-f81253088e21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1674 microversion: 2.1 time: 0.154427 Nov 03 05:05:04.074173 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3599/7306] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:03 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:05.103918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:05.104825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:05.112318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:05.112824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:05.113337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:05.114048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:05.114527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:05.114973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:05.250152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:05.257904 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b28aad13-f2f2-4c87-84a9-c1e651043fcc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1674 microversion: 2.1 time: 0.158389 Nov 03 05:05:05.258472 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3708/7307] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:05 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:06.276062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-efcc8c8e-6333-46f0-b2ed-a85ec1fe1384 req-3fdb6eef-9ee7-4844-beef-38aa82ebdf99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3b5ccf-de70-4131-9fcb-ce42f15e38dd", "name": "network-vif-deleted", "tag": "70815f64-b8ca-4255-a0bf-4cfa0b4d38bc"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:05:06.281869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:06.282639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:06.284845 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-efcc8c8e-6333-46f0-b2ed-a85ec1fe1384 req-3fdb6eef-9ee7-4844-beef-38aa82ebdf99 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:06.285350 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-efcc8c8e-6333-46f0-b2ed-a85ec1fe1384 req-3fdb6eef-9ee7-4844-beef-38aa82ebdf99 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:06.290220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-efcc8c8e-6333-46f0-b2ed-a85ec1fe1384 req-3fdb6eef-9ee7-4844-beef-38aa82ebdf99 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:06.292322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:06.292943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:06.294369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:06.295225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:06.295922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:06.296595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:06.298389 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-efcc8c8e-6333-46f0-b2ed-a85ec1fe1384 req-3fdb6eef-9ee7-4844-beef-38aa82ebdf99 service nova] Creating event network-vif-deleted:70815f64-b8ca-4255-a0bf-4cfa0b4d38bc for instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd on n-h1-854653-7 Nov 03 05:05:06.304015 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-efcc8c8e-6333-46f0-b2ed-a85ec1fe1384 req-3fdb6eef-9ee7-4844-beef-38aa82ebdf99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Nov 03 05:05:06.304922 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3600/7308] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:05:06.369208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:06.377376 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e73f374-a06d-4b7d-894b-f1cc53f3243d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 200 len: 1607 microversion: 2.1 time: 0.099275 Nov 03 05:05:06.378037 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3709/7309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:06 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 1607 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:05:07.403293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:07.403919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:07.410462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:07.410962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:07.411410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:07.412121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:07.412617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:07.413072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:07.427495 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd HTTP/1.1 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '0b3b5ccf-de70-4131-9fcb-ce42f15e38dd'} Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:05:07.429234 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00b13e90-2e13-4e4d-a0e5-dbe20c5c86f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 404 len: 111 microversion: 2.1 time: 0.032976 Nov 03 05:05:07.441073 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3601/7310] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:07 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:05:07.447319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:07.447964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:07.455019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:07.456181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:07.456669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:07.457411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:07.457889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:07.458338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:07.472446 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd HTTP/1.1 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0b3b5ccf-de70-4131-9fcb-ce42f15e38dd'} Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:05:07.476861 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b5814ea0-0dbd-4f6d-be2b-5eb3665962d4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 404 len: 111 microversion: 2.1 time: 0.032220 Nov 03 05:05:07.482184 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3710/7311] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:07 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:05:07.530143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-419978148", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "0f5a7638-ec3b-4181-87b6-5f84a98d6f7c"}], "security_groups": [{"name": "tempest-securitygroup--145544269"}], "key_name": "tempest-keypair-583107862", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:05:07.638999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] validate_networks() for [('0f5a7638-ec3b-4181-87b6-5f84a98d6f7c', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:05:08.003032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:05:08.003456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:05:08.003957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:05:08.004456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:05:08.004875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:05:08.014133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:08.014616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:08.015054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:08.015778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:08.016236 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:08.016658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:08.033932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:05:08.039156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for user fefb1bf8c01c48efa41fd865ba4e06af and project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:05:08.052077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:05:08.054422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:05:08.142956 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7bbfe4bb-2ccb-47f6-809b-522ff03be2c9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.621317 Nov 03 05:05:08.143602 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3602/7312] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:05:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:05:08.155944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-505e2541-dee2-4345-a432-64a53c1ea21a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:08.156540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-505e2541-dee2-4345-a432-64a53c1ea21a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:08.210609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-505e2541-dee2-4345-a432-64a53c1ea21a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:08.218093 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-505e2541-dee2-4345-a432-64a53c1ea21a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1237 microversion: 2.1 time: 0.066598 Nov 03 05:05:08.218693 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3711/7313] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:08 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:09.241124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:09.241744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:09.249783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:09.250255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:09.250701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:09.251405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:09.251869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:09.252303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:09.315175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:09.322938 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23e81aa0-50f2-4936-864d-0db9d6b56834 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1233 microversion: 2.1 time: 0.085729 Nov 03 05:05:09.324388 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3603/7314] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:09 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:10.347913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:10.348559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:10.356815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:10.357512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:10.357972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:10.358695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:10.359201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:10.359663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:10.427172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:10.435282 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c78e8652-3d7e-408d-b932-d632b1fd6328 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1295 microversion: 2.1 time: 0.091337 Nov 03 05:05:10.443566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3712/7315] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:10 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:11.459478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:11.460105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:11.466921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:11.467395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:11.467839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:11.468538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:11.469002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:11.469458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:11.536106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f640c676-b650-40d7-8bad-45c4b626c9d3 req-4be3af71-a7a8-4107-ab51-e875dd00c53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae85383b-02c9-4dca-b294-e296fbd8465a", "tag": "c7b5f92f-22c2-4536-ba79-348fd1bfed39"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:05:11.547658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f640c676-b650-40d7-8bad-45c4b626c9d3 req-4be3af71-a7a8-4107-ab51-e875dd00c53d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:11.548154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f640c676-b650-40d7-8bad-45c4b626c9d3 req-4be3af71-a7a8-4107-ab51-e875dd00c53d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:11.548601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f640c676-b650-40d7-8bad-45c4b626c9d3 req-4be3af71-a7a8-4107-ab51-e875dd00c53d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:11.563362 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f640c676-b650-40d7-8bad-45c4b626c9d3 req-4be3af71-a7a8-4107-ab51-e875dd00c53d service nova] Creating event network-changed:c7b5f92f-22c2-4536-ba79-348fd1bfed39 for instance ae85383b-02c9-4dca-b294-e296fbd8465a on n-h1-854653-7 Nov 03 05:05:11.569114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f640c676-b650-40d7-8bad-45c4b626c9d3 req-4be3af71-a7a8-4107-ab51-e875dd00c53d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036256 Nov 03 05:05:11.570535 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3713/7316] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:05:11.616416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:11.625538 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-124d297c-97b7-4be8-8a2e-7b179d4292e0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.169735 Nov 03 05:05:11.641768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3604/7317] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:11 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:12.650777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:12.651503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:12.657749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:12.658252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:12.658709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:12.659419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:12.659895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:12.660341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:12.787300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:12.795475 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5148e2b2-d795-488c-91ad-06d9b9843205 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.150141 Nov 03 05:05:12.796054 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3714/7318] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:12 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:13.819765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:13.820405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:13.827259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:13.827738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:13.828177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:13.828865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:13.829353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:13.829778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:13.963364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:13.971514 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e70c8a6d-7f9f-4b60-99af-0a6fce9a318f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.155960 Nov 03 05:05:13.972122 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3605/7319] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:13 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:14.995401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:14.996065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:15.003479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:15.003978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:15.004490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:15.005232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:15.005707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:15.006155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:15.137639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:15.145256 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c393448a-57b1-4a6d-91d9-e582a36e9a64 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.153751 Nov 03 05:05:15.145834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3715/7320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:14 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:16.168074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:16.168711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:16.175497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:16.179129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:16.179129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:16.179129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:16.179129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:16.179129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:16.308739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:16.317063 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccdfdd9d-56e7-4de0-9622-a5552d0d2ccd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.153092 Nov 03 05:05:16.317854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3606/7321] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:16 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:17.341343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:17.341982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:17.348771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:17.349310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:17.349767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:17.350474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:17.350947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:17.351390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:17.479402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:17.487081 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18ff6c2b-04a0-45e8-bb86-4c689f43f536 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.150267 Nov 03 05:05:17.487648 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3716/7322] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:17 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:18.497211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b83a6675-2b95-4375-8831-e8d71b55cedc req-581034bb-28e0-42a7-9e23-37178b79e158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85383b-02c9-4dca-b294-e296fbd8465a", "name": "network-vif-plugged", "status": "completed", "tag": "c7b5f92f-22c2-4536-ba79-348fd1bfed39"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:05:18.503215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:05:18.507363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:05:18.509404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b83a6675-2b95-4375-8831-e8d71b55cedc req-581034bb-28e0-42a7-9e23-37178b79e158 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:18.509952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b83a6675-2b95-4375-8831-e8d71b55cedc req-581034bb-28e0-42a7-9e23-37178b79e158 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:18.510451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b83a6675-2b95-4375-8831-e8d71b55cedc req-581034bb-28e0-42a7-9e23-37178b79e158 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:18.510978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:18.511647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:18.514290 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:05:18.520469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:18.521032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:18.521490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:18.522276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:18.522749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:18.523200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:18.524804 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b83a6675-2b95-4375-8831-e8d71b55cedc req-581034bb-28e0-42a7-9e23-37178b79e158 service nova] Creating event network-vif-plugged:c7b5f92f-22c2-4536-ba79-348fd1bfed39 for instance ae85383b-02c9-4dca-b294-e296fbd8465a on n-h1-854653-7 Nov 03 05:05:18.531394 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b83a6675-2b95-4375-8831-e8d71b55cedc req-581034bb-28e0-42a7-9e23-37178b79e158 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038640 Nov 03 05:05:18.532285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3607/7323] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:05:18.670106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:18.678104 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e2be092f-3a39-44dd-b900-e32d4c9fa793 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.171214 Nov 03 05:05:18.678686 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3717/7324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:18 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:19.703202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:19.703823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:19.711715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:19.712201 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:19.712640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:19.713359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:19.713815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:19.714241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:19.847194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:19.854815 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c6e0e60-f435-4f3d-b7d9-8af5e7d5be7a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1362 microversion: 2.1 time: 0.156527 Nov 03 05:05:19.855389 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3608/7325] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:19 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:20.878990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:20.879632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:20.886518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:20.887626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:20.888097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:20.888835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:20.889346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:20.889859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:21.018051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:05:21.026150 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f1593f4f-436a-4ad6-b268-73ad33a65af5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1548 microversion: 2.1 time: 0.151495 Nov 03 05:05:21.026719 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3718/7326] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:05:20 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:05:21.052303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:05:21.052832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:05:21.060353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:21.060841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:21.061311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:21.062009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:21.062472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:21.062907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:21.142415 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80683012-d4de-4813-b339-a0667209e169 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093937 Nov 03 05:05:21.143016 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3609/7327] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 05:05:21 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:05:22.436344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1c9557fd-077d-47a7-93c5-210567ce8942 req-1082a6e1-3014-4489-8666-3652a4e61a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae85383b-02c9-4dca-b294-e296fbd8465a", "tag": "c7b5f92f-22c2-4536-ba79-348fd1bfed39"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:05:22.446230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1c9557fd-077d-47a7-93c5-210567ce8942 req-1082a6e1-3014-4489-8666-3652a4e61a2b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:05:22.446812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1c9557fd-077d-47a7-93c5-210567ce8942 req-1082a6e1-3014-4489-8666-3652a4e61a2b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:05:22.447337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1c9557fd-077d-47a7-93c5-210567ce8942 req-1082a6e1-3014-4489-8666-3652a4e61a2b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:05:22.458233 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1c9557fd-077d-47a7-93c5-210567ce8942 req-1082a6e1-3014-4489-8666-3652a4e61a2b service nova] Creating event network-changed:c7b5f92f-22c2-4536-ba79-348fd1bfed39 for instance ae85383b-02c9-4dca-b294-e296fbd8465a on n-h1-854653-7 Nov 03 05:05:22.463290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1c9557fd-077d-47a7-93c5-210567ce8942 req-1082a6e1-3014-4489-8666-3652a4e61a2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031418 Nov 03 05:05:22.463949 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3719/7328] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:06:34.771641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:06:34.772417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:06:34.773802 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:06:34.773941 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:06:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action (ip 10.222.0.30) !!! Nov 03 05:06:34.782379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e973dc41-1c32-402c-926d-8b39acabb5a7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:06:34.793673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e973dc41-1c32-402c-926d-8b39acabb5a7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:34.798342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e973dc41-1c32-402c-926d-8b39acabb5a7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:34.798342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e973dc41-1c32-402c-926d-8b39acabb5a7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:34.818807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e973dc41-1c32-402c-926d-8b39acabb5a7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Going to try to stop instance {{(pid=127593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 05:06:34.983078 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e973dc41-1c32-402c-926d-8b39acabb5a7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action" status: 202 len: 0 microversion: 2.1 time: 0.214158 Nov 03 05:06:34.983762 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3610/7329] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:06:34 2022] POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:06:34.992146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:06:34.999268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:06:35.000406 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:06:35.000555 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:06:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a (ip 10.222.0.30) !!! Nov 03 05:06:35.002630 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:06:35.002750 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:06:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a (ip 10.222.0.30) !!! Nov 03 05:06:35.010125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:35.015985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:35.026993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:35.027533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:35.027988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:35.028715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:35.029227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:35.029671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:35.176669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:35.185494 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d32db6f-3c88-45e5-89a3-3e58d960b846 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.196011 Nov 03 05:06:35.186173 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3720/7330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:34 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:36.211288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:36.212026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:36.218598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:36.219074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:36.219509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:36.220196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:36.220650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:36.221100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:36.352311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:36.360684 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a6ff51da-f892-4a3e-b2c9-164a375a0e63 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.154414 Nov 03 05:06:36.361294 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3611/7331] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:36 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:37.384502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:37.385586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:37.392886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:37.393400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:37.393857 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:37.394559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:37.395027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:37.395470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:37.528768 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:37.536677 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9961c06c-202d-4e1c-aaca-9dba6f3191e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.156878 Nov 03 05:06:37.537275 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3721/7332] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:37 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:38.560058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:38.560634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:38.567477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:38.567972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:38.568421 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:38.569214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:38.569680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:38.570117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:38.700604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:38.708400 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2aa381f4-dd2b-4c44-9a53-8e7a50138b81 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.152381 Nov 03 05:06:38.708985 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3612/7333] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:38 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:39.732493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:39.733183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:39.739952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:39.740454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:39.740914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:39.741649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:39.742125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:39.742572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:39.877301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:39.885160 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ff2f0dcd-c011-4f30-91ba-4cd3251cab12 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.157296 Nov 03 05:06:39.885734 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3722/7334] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:39 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:40.907821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:40.908565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:40.915569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:40.916067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:40.916547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:40.917291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:40.917759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:40.918195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:41.045185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:41.052826 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd120125-40e9-4823-bd8c-df46fd1a1dc1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.148916 Nov 03 05:06:41.053435 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3613/7335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:40 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:42.077200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:42.077811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:42.084649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:42.085175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:42.085624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:42.086329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:42.086795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:42.087234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:42.214649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:42.222499 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0fce351-0788-4dfa-b245-f8ce375fb57c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.149690 Nov 03 05:06:42.223116 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3723/7336] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:42 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:43.246098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:43.246727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:43.253692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:43.254187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:43.254633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:43.255339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:43.255801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:43.256234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:43.387970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:43.395735 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00d07700-2c67-41cb-8415-ee200fec3c6a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.154077 Nov 03 05:06:43.396303 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3614/7337] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:43 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:44.419592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:44.420229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:44.427090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:44.427595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:44.428044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:44.428755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:44.429257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:44.429701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:44.557824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:44.565534 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-109a5d2d-ce85-4b5d-89a8-597a6c774a1e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.149869 Nov 03 05:06:44.566112 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3724/7338] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:44 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:45.589152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:45.589775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:45.596731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:45.597259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:45.597706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:45.598407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:45.598868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:45.599300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:45.730484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:45.738248 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c52f977d-c891-4004-8c37-e57fab462f91 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1654 microversion: 2.1 time: 0.153711 Nov 03 05:06:45.738819 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3615/7339] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:45 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1654 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:45.761166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:06:45.763413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:45.770308 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:45.770803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:45.771253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:45.771957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:45.772425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:45.772864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:45.801383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:45.806788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Old instance type m1.heat2, new instance type m1.heat {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:06:45.813311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:06:45.813745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:06:45.814232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:06:45.814654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:06:45.815078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:06:46.017978 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-31c4cbbb-b313-4e34-a9a7-01228bc33ede tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action" status: 202 len: 0 microversion: 2.1 time: 0.261222 Nov 03 05:06:46.018599 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3725/7340] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:06:45 2022] POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 05:06:46.027536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:46.028153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:46.034108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:46.034605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:46.035052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:46.035754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:46.036212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:46.036640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:46.169514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:46.177436 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-773b6eda-b9d9-411f-9e9d-3e88624f0da9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.154633 Nov 03 05:06:46.178073 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3616/7341] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:46 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:47.203258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:47.203915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:47.211483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:47.212105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:47.213207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:47.213938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:47.214418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:47.214869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:47.346465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:47.354433 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a60cdaa-1004-420a-b9e4-0542087a03bf tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.156605 Nov 03 05:06:47.354983 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3726/7342] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:47 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:48.378238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:48.379080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:48.386159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:48.386648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:48.387089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:48.387783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:48.388237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:48.388753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:48.521891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:48.530570 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0b2c75ce-b94f-49df-83bb-cf6964e917c7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1677 microversion: 2.1 time: 0.156902 Nov 03 05:06:48.531156 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3617/7343] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:48 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:49.554288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:49.554837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:49.562172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:49.562678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:49.563132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:49.563881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:49.564356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:49.564796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:49.698276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:49.705936 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f22278ab-26e2-47a6-9f12-1118b26b1c9f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1682 microversion: 2.1 time: 0.155930 Nov 03 05:06:49.706501 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3727/7344] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:49 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:50.729388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:50.730014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:50.736863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:50.737385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:50.737833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:50.738535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:50.739002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:50.739436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:50.876030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:50.883891 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0ca916f8-084f-454e-a251-a68f9c9d9b0b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1682 microversion: 2.1 time: 0.158646 Nov 03 05:06:50.885091 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3618/7345] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:50 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:51.908027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:51.908661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:51.916864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:51.916864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:51.916864 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:51.917525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:51.918002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:51.918449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:52.128477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:52.136883 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0eab9e19-c3e7-4565-9282-b12478d9ff0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1681 microversion: 2.1 time: 0.233012 Nov 03 05:06:52.137487 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3728/7346] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:51 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:52.194266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-00d8cfd6-0f64-478c-95f9-d15e19e80c5b req-05011a92-a989-4b88-81ef-80f7e207c89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85383b-02c9-4dca-b294-e296fbd8465a", "name": "network-vif-unplugged", "status": "completed", "tag": "c7b5f92f-22c2-4536-ba79-348fd1bfed39"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:06:52.205417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-00d8cfd6-0f64-478c-95f9-d15e19e80c5b req-05011a92-a989-4b88-81ef-80f7e207c89d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:52.205907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-00d8cfd6-0f64-478c-95f9-d15e19e80c5b req-05011a92-a989-4b88-81ef-80f7e207c89d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:52.206346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-00d8cfd6-0f64-478c-95f9-d15e19e80c5b req-05011a92-a989-4b88-81ef-80f7e207c89d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:52.218077 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-00d8cfd6-0f64-478c-95f9-d15e19e80c5b req-05011a92-a989-4b88-81ef-80f7e207c89d service nova] Creating event network-vif-unplugged:c7b5f92f-22c2-4536-ba79-348fd1bfed39 for instance ae85383b-02c9-4dca-b294-e296fbd8465a on n-h2-854653-7 Nov 03 05:06:52.223279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-00d8cfd6-0f64-478c-95f9-d15e19e80c5b req-05011a92-a989-4b88-81ef-80f7e207c89d service nova] Instance ae85383b-02c9-4dca-b294-e296fbd8465a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:06:52.234191 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-00d8cfd6-0f64-478c-95f9-d15e19e80c5b req-05011a92-a989-4b88-81ef-80f7e207c89d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043699 Nov 03 05:06:52.234790 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3619/7347] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:06:53.160789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:53.161464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:53.168390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:53.168836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:53.169327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:53.170083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:53.170561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:53.171006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:53.383418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:53.391935 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-73b24200-3362-4f64-b736-2b2b7f585ac0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1681 microversion: 2.1 time: 0.235020 Nov 03 05:06:53.392517 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3729/7348] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:53 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:54.251351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-99cc128c-feee-40fc-9a16-964a5b15fdee req-773834b9-7d51-421d-8adc-1ce2765990a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae85383b-02c9-4dca-b294-e296fbd8465a", "tag": "c7b5f92f-22c2-4536-ba79-348fd1bfed39"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:06:54.260865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-99cc128c-feee-40fc-9a16-964a5b15fdee req-773834b9-7d51-421d-8adc-1ce2765990a8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:54.261382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-99cc128c-feee-40fc-9a16-964a5b15fdee req-773834b9-7d51-421d-8adc-1ce2765990a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:54.261819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-99cc128c-feee-40fc-9a16-964a5b15fdee req-773834b9-7d51-421d-8adc-1ce2765990a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:54.273236 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-99cc128c-feee-40fc-9a16-964a5b15fdee req-773834b9-7d51-421d-8adc-1ce2765990a8 service nova] Creating event network-changed:c7b5f92f-22c2-4536-ba79-348fd1bfed39 for instance ae85383b-02c9-4dca-b294-e296fbd8465a on n-h2-854653-7 Nov 03 05:06:54.279272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-99cc128c-feee-40fc-9a16-964a5b15fdee req-773834b9-7d51-421d-8adc-1ce2765990a8 service nova] Instance ae85383b-02c9-4dca-b294-e296fbd8465a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:06:54.290260 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-99cc128c-feee-40fc-9a16-964a5b15fdee req-773834b9-7d51-421d-8adc-1ce2765990a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043977 Nov 03 05:06:54.290861 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3620/7349] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:06:54.415974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:54.416741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:54.424135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:54.424633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:54.425134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:54.425846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:54.426318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:54.426756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:54.557608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:54.565620 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3551b146-da3c-4e90-a62f-b5d5ad86965a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1679 microversion: 2.1 time: 0.153528 Nov 03 05:06:54.566233 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3730/7350] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:54 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:55.590968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:55.591672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:55.597903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:55.598336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:55.598779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:55.599471 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:55.599930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:55.600359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:55.729477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:55.737825 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31d53b83-11f8-4e5e-82f5-c4b696f09fa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1675 microversion: 2.1 time: 0.152060 Nov 03 05:06:55.738399 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3621/7351] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:55 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:55.760089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:06:55.760654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:55.767598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:55.768104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:55.768562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:55.769294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:55.769770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:55.770246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:55.939297 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f335687d-2771-466f-a84b-3330367135f9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action" status: 204 len: 0 microversion: 2.1 time: 0.182906 Nov 03 05:06:55.939945 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3731/7352] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:06:55 2022] POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:06:55.947987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:55.951665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:55.955071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:55.955563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:55.956000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:55.956751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:55.957270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:55.957691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:56.095452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:56.103405 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-adb3983b-58b2-4fde-afb6-4134c11a6eab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1675 microversion: 2.1 time: 0.159205 Nov 03 05:06:56.103996 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3622/7353] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:55 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:57.128578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:57.129409 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:57.135769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:57.136271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:57.136725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:57.137580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:57.138051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:57.138494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:57.271555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:57.280171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-868e94b3-7f17-4250-a815-41a815935da8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1675 microversion: 2.1 time: 0.156737 Nov 03 05:06:57.280752 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3732/7354] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:57 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:58.303851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:58.304477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:58.311762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.312304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.312703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:58.313450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.315961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.315961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:58.435140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-502ffb5c-d24a-40b2-b718-b09d50f941b8 req-b01709dd-46c5-46d2-ad5b-a41394354709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85383b-02c9-4dca-b294-e296fbd8465a", "name": "network-vif-plugged", "status": "completed", "tag": "c7b5f92f-22c2-4536-ba79-348fd1bfed39"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:06:58.446274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-502ffb5c-d24a-40b2-b718-b09d50f941b8 req-b01709dd-46c5-46d2-ad5b-a41394354709 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.446770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-502ffb5c-d24a-40b2-b718-b09d50f941b8 req-b01709dd-46c5-46d2-ad5b-a41394354709 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.447215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-502ffb5c-d24a-40b2-b718-b09d50f941b8 req-b01709dd-46c5-46d2-ad5b-a41394354709 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:58.451731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:58.458425 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-502ffb5c-d24a-40b2-b718-b09d50f941b8 req-b01709dd-46c5-46d2-ad5b-a41394354709 service nova] Creating event network-vif-plugged:c7b5f92f-22c2-4536-ba79-348fd1bfed39 for instance ae85383b-02c9-4dca-b294-e296fbd8465a on n-h2-854653-7 Nov 03 05:06:58.460766 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1d24e990-ed0d-4a94-958d-51e6581a095a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1654 microversion: 2.1 time: 0.159607 Nov 03 05:06:58.460766 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3623/7355] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:58 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1654 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:58.463500 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-502ffb5c-d24a-40b2-b718-b09d50f941b8 req-b01709dd-46c5-46d2-ad5b-a41394354709 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032785 Nov 03 05:06:58.464097 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3733/7356] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:06:58.482341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:58.482891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:58.488799 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.489571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.489914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:58.490624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.491089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.491526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:58.638469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:58.647764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71f0f66d-dff7-4bd2-a19f-f88ebf40dd99 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1654 microversion: 2.1 time: 0.169597 Nov 03 05:06:58.648485 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3624/7357] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:58 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1654 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:06:58.672935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c2c6462-bbd6-4c91-a79c-4e122af63785 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:06:58.680272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2c6462-bbd6-4c91-a79c-4e122af63785 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.680796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2c6462-bbd6-4c91-a79c-4e122af63785 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.681304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2c6462-bbd6-4c91-a79c-4e122af63785 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:58.707518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c2c6462-bbd6-4c91-a79c-4e122af63785 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Going to try to start instance {{(pid=127594) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 03 05:06:58.711335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:06:58.862125 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c2c6462-bbd6-4c91-a79c-4e122af63785 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action" status: 202 len: 0 microversion: 2.1 time: 0.194187 Nov 03 05:06:58.862757 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3734/7358] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:06:58 2022] POST /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:06:58.871222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:06:58.872301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:06:58.880916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.881455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.882095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:58.882942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:06:58.883450 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:06:58.883894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:06:59.025097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:06:59.033650 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0b987f3b-c015-41c9-8525-ee12c6cfb486 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1663 microversion: 2.1 time: 0.166542 Nov 03 05:06:59.034242 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3625/7359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:06:58 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:00.060197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:00.061174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:00.068112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:00.068681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:00.069089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:00.069808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:00.070549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:00.070996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:00.208133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:00.216408 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82221007-b557-417a-93d1-2a13ecc6932d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1663 microversion: 2.1 time: 0.162178 Nov 03 05:07:00.216972 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3735/7360] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:00 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:01.239970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:01.240610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:01.247448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:01.247935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:01.248378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:01.249106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:01.249565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:01.249994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:01.254051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:07:01.378087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:01.385645 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd5b187d-1763-4e11-9b18-4b9f4f4e4764 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1667 microversion: 2.1 time: 0.149638 Nov 03 05:07:01.386222 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3626/7361] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:01 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1667 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:01.409336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:01.409835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:01.416593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:01.417172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:01.417628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:01.418336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:01.418809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:01.419247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:01.443666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:07:01.738216 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fed941c5-1c01-405f-9305-ddba8036aa56 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 204 len: 0 microversion: 2.1 time: 0.332557 Nov 03 05:07:01.738850 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3736/7362] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:07:01 2022] DELETE /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:07:01.747622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:01.748273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:01.754889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:01.755383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:01.755834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:01.756535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:01.757004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:01.757465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:01.890759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:01.898696 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e26f4565-eaf7-427e-94c9-521032abd8e6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1673 microversion: 2.1 time: 0.155484 Nov 03 05:07:01.899575 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3627/7363] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:01 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:02.922775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:02.923501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:02.930255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:02.930761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:02.931234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:02.931924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:02.932398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:02.932845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:03.064346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:03.072274 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-be6db700-7d31-490b-b17b-003851344e1b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1673 microversion: 2.1 time: 0.153837 Nov 03 05:07:03.072852 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3737/7364] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:02 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:04.096501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:04.097155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:04.103905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:04.104414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:04.104865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:04.106218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:04.106681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:04.107117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:04.349872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:04.359149 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dfd1b957-97e6-4ee8-bd8c-4417efa8d284 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 200 len: 1673 microversion: 2.1 time: 0.266591 Nov 03 05:07:04.359727 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3628/7365] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:04 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 1673 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:04.540626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d257ea5e-be16-4b69-be33-53b6adab087e req-93df6595-09f3-4097-977d-bc5a4efbdd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae85383b-02c9-4dca-b294-e296fbd8465a", "name": "network-vif-deleted", "tag": "c7b5f92f-22c2-4536-ba79-348fd1bfed39"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:07:04.551218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d257ea5e-be16-4b69-be33-53b6adab087e req-93df6595-09f3-4097-977d-bc5a4efbdd27 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:04.551738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d257ea5e-be16-4b69-be33-53b6adab087e req-93df6595-09f3-4097-977d-bc5a4efbdd27 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:04.552187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d257ea5e-be16-4b69-be33-53b6adab087e req-93df6595-09f3-4097-977d-bc5a4efbdd27 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:04.563562 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d257ea5e-be16-4b69-be33-53b6adab087e req-93df6595-09f3-4097-977d-bc5a4efbdd27 service nova] Creating event network-vif-deleted:c7b5f92f-22c2-4536-ba79-348fd1bfed39 for instance ae85383b-02c9-4dca-b294-e296fbd8465a on n-h2-854653-7 Nov 03 05:07:04.568785 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d257ea5e-be16-4b69-be33-53b6adab087e req-93df6595-09f3-4097-977d-bc5a4efbdd27 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031876 Nov 03 05:07:04.569835 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3738/7366] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:07:05.383606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:05.384460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:05.387465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=39 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:07:05.392622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:05.393370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:05.393811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:05.394522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:05.395190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:05.395620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:05.410508 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a HTTP/1.1 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ae85383b-02c9-4dca-b294-e296fbd8465a'} Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:07:05.412347 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a8e10ebd-c431-4c3a-b09b-d8471dd455f5 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 404 len: 111 microversion: 2.1 time: 0.034210 Nov 03 05:07:05.422097 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3629/7367] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:05 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:07:05.432567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:05.434051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:05.440334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:05.440837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:05.441316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:05.442032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:05.442534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:05.442973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:05.456621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a HTTP/1.1 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ae85383b-02c9-4dca-b294-e296fbd8465a'} Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:07:05.458399 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2606ca88-b50c-4139-813f-cb737a06896f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 404 len: 111 microversion: 2.1 time: 0.031636 Nov 03 05:07:05.462945 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3739/7368] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:05 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:07:05.509857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-387482591", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "0f5a7638-ec3b-4181-87b6-5f84a98d6f7c"}], "security_groups": [{"name": "tempest-securitygroup--145544269"}], "key_name": "tempest-keypair-583107862", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:07:05.615740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] validate_networks() for [('0f5a7638-ec3b-4181-87b6-5f84a98d6f7c', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:07:05.987145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:07:05.987570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:07:05.988047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:07:05.988457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:07:05.988866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:07:05.997619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:05.998099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:05.998537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:05.999291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:05.999752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:06.000176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:06.017111 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:07:06.022664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for user fefb1bf8c01c48efa41fd865ba4e06af and project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:07:06.035996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:07:06.038325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:07:06.158984 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c003620-3f43-4dd7-a686-d21866a4ede0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653521 Nov 03 05:07:06.159639 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3630/7369] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:07:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:07:06.171054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f521817-bdd4-449c-aa1f-2cbcbbc827e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:06.171879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f521817-bdd4-449c-aa1f-2cbcbbc827e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:06.228901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f521817-bdd4-449c-aa1f-2cbcbbc827e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:06.237076 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f521817-bdd4-449c-aa1f-2cbcbbc827e7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1237 microversion: 2.1 time: 0.069889 Nov 03 05:07:06.237646 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3740/7370] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:06 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:07.261740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:07.262364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:07.269129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:07.269613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:07.270052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:07.270740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:07.271196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:07.271621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:07.338809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:07.348187 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce89b5c9-ca90-4465-9610-317df7766b79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1241 microversion: 2.1 time: 0.091170 Nov 03 05:07:07.355366 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3631/7371] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:07 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:08.372587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:08.373395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:08.377329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:07:08.380854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:08.381422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:08.381886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:08.382614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:08.383092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:08.383767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:08.450636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:08.458857 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c20b1e02-ca28-4766-859a-24fac93d8616 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1295 microversion: 2.1 time: 0.090796 Nov 03 05:07:08.459451 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3741/7372] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:08 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:09.483151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:09.483778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:09.490786 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:09.491288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:09.491737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:09.492443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:09.492914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:09.493374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:09.696520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:09.704445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9e858369-494f-4132-9bb8-bce57f8d02a8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.225547 Nov 03 05:07:09.705112 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3632/7373] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:09 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:09.875622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2fa7d7ab-70d1-495f-9379-90f8bf064357 req-eb05ca7a-36dd-4e06-8288-7b7acec69a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:07:09.885978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2fa7d7ab-70d1-495f-9379-90f8bf064357 req-eb05ca7a-36dd-4e06-8288-7b7acec69a31 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:09.886579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2fa7d7ab-70d1-495f-9379-90f8bf064357 req-eb05ca7a-36dd-4e06-8288-7b7acec69a31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:09.887121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2fa7d7ab-70d1-495f-9379-90f8bf064357 req-eb05ca7a-36dd-4e06-8288-7b7acec69a31 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:09.898208 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2fa7d7ab-70d1-495f-9379-90f8bf064357 req-eb05ca7a-36dd-4e06-8288-7b7acec69a31 service nova] Creating event network-changed:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h2-854653-7 Nov 03 05:07:09.903576 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2fa7d7ab-70d1-495f-9379-90f8bf064357 req-eb05ca7a-36dd-4e06-8288-7b7acec69a31 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032391 Nov 03 05:07:09.904503 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3742/7374] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:07:10.727877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:10.728496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:10.735086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:10.735578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:10.736022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:10.736719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:10.737259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:10.737642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:10.866948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:10.875367 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83d164b0-bcac-45ef-a98c-4e76abd2c0b7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.151427 Nov 03 05:07:10.875947 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3633/7375] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:10 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:11.900312 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:11.901074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:11.908954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:11.909516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:11.909981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:11.910713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:11.911188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:11.911637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:12.046808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:12.054626 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a6677116-35a5-4b1a-a7fb-0e92233e0be4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.158936 Nov 03 05:07:12.055200 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3743/7376] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:11 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:13.078492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:13.079114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:13.085964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:13.086451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:13.086893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:13.087587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:13.088048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:13.088477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:13.217894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:13.225651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b09660de-bdd6-45fd-b716-d529e6a15268 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.151027 Nov 03 05:07:13.226235 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3634/7377] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:13 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:14.249690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:14.250351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:14.257098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:14.257593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:14.264280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:14.264280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:14.264280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:14.264280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:14.393157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:14.401973 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ae0e54b-029f-45b2-beed-113143fea912 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.156379 Nov 03 05:07:14.402562 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3744/7378] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:14 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:15.426092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:15.426709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:15.434303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:15.434791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:15.435229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:15.435925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:15.436383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:15.436806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:15.574227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:15.582009 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e6a810d-91f5-44d0-a30b-76dbddf11caa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.159868 Nov 03 05:07:15.582580 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3635/7379] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:15 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:16.494305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-74539848-76be-48fc-83e3-2e4a20b90f64 req-236d9590-0e59-48b0-ac80-df402c518ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "name": "network-vif-plugged", "status": "completed", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:07:16.500052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:07:16.505449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-74539848-76be-48fc-83e3-2e4a20b90f64 req-236d9590-0e59-48b0-ac80-df402c518ed5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:16.505982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-74539848-76be-48fc-83e3-2e4a20b90f64 req-236d9590-0e59-48b0-ac80-df402c518ed5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:16.506442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-74539848-76be-48fc-83e3-2e4a20b90f64 req-236d9590-0e59-48b0-ac80-df402c518ed5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:16.517800 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-74539848-76be-48fc-83e3-2e4a20b90f64 req-236d9590-0e59-48b0-ac80-df402c518ed5 service nova] Creating event network-vif-plugged:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h2-854653-7 Nov 03 05:07:16.522694 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-74539848-76be-48fc-83e3-2e4a20b90f64 req-236d9590-0e59-48b0-ac80-df402c518ed5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032130 Nov 03 05:07:16.523275 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3745/7380] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:07:16.607572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:16.608176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:16.610217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:07:16.611218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:07:16.616770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:16.618985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:16.618985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:16.618985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:16.618985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:16.619345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:16.777829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:16.785467 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e05570e3-17e4-43e5-96a5-d984aaaa0675 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.182100 Nov 03 05:07:16.785989 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3636/7381] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:16 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:17.809455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:17.810197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:17.816647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:17.817183 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:17.817637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:17.818342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:17.818807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:17.819248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:17.950401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:17.958666 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7f83f036-2591-46fd-b0ba-a02cc71c2cd4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1362 microversion: 2.1 time: 0.154675 Nov 03 05:07:17.959226 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3746/7382] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:17 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:18.982054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:18.987361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:18.989620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:18.990120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:18.990571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:18.991277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:18.991744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:18.992180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:19.123370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:07:19.131238 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6dfc346a-ff05-4856-a370-137c1ef266b1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1549 microversion: 2.1 time: 0.153793 Nov 03 05:07:19.131818 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3637/7383] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:07:18 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:07:19.154513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:07:19.155068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:07:19.161759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:19.162257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:19.162709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:19.163413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:19.163883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:19.164375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:19.241435 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a0e5ef8-6272-4f3c-9d4b-f9669b594d3e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091079 Nov 03 05:07:19.242039 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3747/7384] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 05:07:19 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:07:20.327648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ac191c96-b4cc-4633-b977-c9ca0dc9a0ba req-c1169cfb-35b2-4f85-9116-66e1c9c865e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:07:20.338041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac191c96-b4cc-4633-b977-c9ca0dc9a0ba req-c1169cfb-35b2-4f85-9116-66e1c9c865e0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:07:20.338592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac191c96-b4cc-4633-b977-c9ca0dc9a0ba req-c1169cfb-35b2-4f85-9116-66e1c9c865e0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:07:20.339718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac191c96-b4cc-4633-b977-c9ca0dc9a0ba req-c1169cfb-35b2-4f85-9116-66e1c9c865e0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:07:20.350781 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ac191c96-b4cc-4633-b977-c9ca0dc9a0ba req-c1169cfb-35b2-4f85-9116-66e1c9c865e0 service nova] Creating event network-changed:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h2-854653-7 Nov 03 05:07:20.356105 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ac191c96-b4cc-4633-b977-c9ca0dc9a0ba req-c1169cfb-35b2-4f85-9116-66e1c9c865e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Nov 03 05:07:20.356817 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3638/7385] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:01.094764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=13 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:01.095559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:01.099542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:01.101788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:01.107606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:01.108111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:01.108564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:01.109289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:01.109759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:01.110198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:01.138896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:01.144269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Old instance type m1.heat2, new instance type m1.heat {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:08:01.150988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:08:01.151422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:08:01.151907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:08:01.152350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:08:01.152772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:08:01.357945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-092efaf8-7ea4-4ef3-90a1-1be7901ff038 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a/action" status: 202 len: 0 microversion: 2.1 time: 0.265274 Nov 03 05:08:01.358644 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3748/7386] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:08:01 2022] POST /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:08:01.365963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:01.367105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=64 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:01.371930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:01.372641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:01.378618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:01.379103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:01.379553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:01.380252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:01.380714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:01.381179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:01.510768 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:01.518845 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71a5762b-a2c3-45d6-8383-42cdff902129 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1677 microversion: 2.1 time: 0.155692 Nov 03 05:08:01.519418 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3639/7387] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:01 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:02.544549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:02.545333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:02.551314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:02.551759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:02.552210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:02.552913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:02.553413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:02.553856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:02.685890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:02.693684 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ed38148-8f44-44f0-b9fc-4ba934b58b11 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1677 microversion: 2.1 time: 0.153854 Nov 03 05:08:02.694255 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3749/7388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:02 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:03.718899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:03.719522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:03.726270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:03.726766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:03.727207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:03.727909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:03.728363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:03.728791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:03.927718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:03.936154 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-94fa66a2-0257-40a0-9ee1-42c9c143c6eb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1677 microversion: 2.1 time: 0.221619 Nov 03 05:08:03.937044 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3640/7389] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:03 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:04.960163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:04.960732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:04.967504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:04.968001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:04.968453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:04.969211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:04.969677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:04.970121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:05.106560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:05.114304 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa7ba379-3f9d-4804-86ee-11eb5119564d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.158160 Nov 03 05:08:05.114903 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3750/7390] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:04 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:06.138604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:06.139296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:06.146017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:06.146496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:06.146932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:06.147624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:06.148081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:06.148506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:06.282280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:06.289968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8c1d9e7a-20a3-481f-8fac-3de98d171ba0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.155304 Nov 03 05:08:06.290552 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3641/7391] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:06 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:07.314351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:07.314981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:07.321766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:07.322262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:07.322790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:07.323507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:07.323975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:07.324414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:07.452679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:07.460333 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-26ecd726-7a05-449f-b378-b340a47b27f0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.149894 Nov 03 05:08:07.460901 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3751/7392] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:07 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:08.483701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:08.484339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:08.491066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:08.491545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:08.491979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:08.492666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:08.493143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:08.493569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:08.620850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:08.628591 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a96ea664-8ca6-4cfd-bc43-c529739fb2db tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.149287 Nov 03 05:08:08.629185 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3642/7393] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:08 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:09.651940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:09.652577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:09.659517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:09.660022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:09.660482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:09.661234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:09.661715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:09.662163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:09.794013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:09.801746 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a85f2bd4-3f39-4869-bd49-c4e5f574beab tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.154060 Nov 03 05:08:09.802325 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3752/7394] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:09 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:10.826250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:10.826882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:10.833759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:10.834254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:10.834702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:10.835400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:10.835868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:10.836303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:10.964941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:10.972761 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a08c361f-ab72-47c4-857f-3e3b40d2f43c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.150986 Nov 03 05:08:10.973386 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3643/7395] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:10 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:11.995764 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:11.996432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:12.003291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:12.003793 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:12.004275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:12.004991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:12.005488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:12.005935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:12.481927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:12.490030 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-626ce1a0-c14e-4940-805c-5780770447da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.498100 Nov 03 05:08:12.494989 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3753/7396] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:11 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:13.513443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:13.514093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:13.521086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:13.521582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:13.522025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:13.522719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:13.523178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:13.523610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:13.650206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:13.658614 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6027b347-4d4f-42fc-a6b8-fbbb72f65fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.149088 Nov 03 05:08:13.659183 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3644/7397] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:13 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:14.683007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:14.683566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:14.690417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:14.690923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:14.691382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:14.692098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:14.692571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:14.693034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:14.824143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:14.831943 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-20a6eeff-6018-419b-b2b9-ba0eb12da5b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.153521 Nov 03 05:08:14.835838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3754/7398] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:14 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:15.856021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:15.856647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:15.864190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:15.864684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:15.865154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:15.865865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:15.866329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:15.866765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:15.997655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:16.005340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60ba555b-7593-4da4-b875-ff02d711c699 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1682 microversion: 2.1 time: 0.153871 Nov 03 05:08:16.005916 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3645/7399] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:15 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:17.028049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:17.028687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:17.036122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:17.036623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:17.037108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:17.037823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:17.038297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:17.038735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:17.174902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:17.183278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97de8048-205b-42b5-892e-94cbc76019b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1681 microversion: 2.1 time: 0.159413 Nov 03 05:08:17.183842 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3755/7400] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:17 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:17.924251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-41c28582-617b-42eb-b95f-06660eed3184 req-4422ee53-4fed-4921-828d-94c114fc41f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "name": "network-vif-unplugged", "status": "completed", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:17.934153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-41c28582-617b-42eb-b95f-06660eed3184 req-4422ee53-4fed-4921-828d-94c114fc41f2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:17.934637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-41c28582-617b-42eb-b95f-06660eed3184 req-4422ee53-4fed-4921-828d-94c114fc41f2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:17.935071 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-41c28582-617b-42eb-b95f-06660eed3184 req-4422ee53-4fed-4921-828d-94c114fc41f2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:17.946949 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-41c28582-617b-42eb-b95f-06660eed3184 req-4422ee53-4fed-4921-828d-94c114fc41f2 service nova] Creating event network-vif-unplugged:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h1-854653-7 Nov 03 05:08:17.952892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-41c28582-617b-42eb-b95f-06660eed3184 req-4422ee53-4fed-4921-828d-94c114fc41f2 service nova] Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:08:17.964227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-41c28582-617b-42eb-b95f-06660eed3184 req-4422ee53-4fed-4921-828d-94c114fc41f2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043801 Nov 03 05:08:17.964835 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3646/7401] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:18.206816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:18.207451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:18.214050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:18.214548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:18.215000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:18.215709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:18.216179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:18.216618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:18.347226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:18.355756 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a85f845d-03d8-4c66-936a-5324540a671c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1681 microversion: 2.1 time: 0.152791 Nov 03 05:08:18.356303 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3756/7402] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:18 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:19.381315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:19.382013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:19.388977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:19.389484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:19.389919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:19.390606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:19.391059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:19.391482 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:19.522853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:19.531477 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f367606b-74c0-48b7-8b01-44079cc79447 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1679 microversion: 2.1 time: 0.155397 Nov 03 05:08:19.532058 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3647/7403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:19 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:19.979007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d1f953aa-b74a-4a17-9fa8-822714d896f9 req-7a9b60f6-c5c8-4a76-8cac-37fb57a93850 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:19.988970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1f953aa-b74a-4a17-9fa8-822714d896f9 req-7a9b60f6-c5c8-4a76-8cac-37fb57a93850 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:19.989484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1f953aa-b74a-4a17-9fa8-822714d896f9 req-7a9b60f6-c5c8-4a76-8cac-37fb57a93850 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:19.989928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1f953aa-b74a-4a17-9fa8-822714d896f9 req-7a9b60f6-c5c8-4a76-8cac-37fb57a93850 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:20.001940 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d1f953aa-b74a-4a17-9fa8-822714d896f9 req-7a9b60f6-c5c8-4a76-8cac-37fb57a93850 service nova] Creating event network-changed:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h1-854653-7 Nov 03 05:08:20.007120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-d1f953aa-b74a-4a17-9fa8-822714d896f9 req-7a9b60f6-c5c8-4a76-8cac-37fb57a93850 service nova] Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:08:20.018550 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d1f953aa-b74a-4a17-9fa8-822714d896f9 req-7a9b60f6-c5c8-4a76-8cac-37fb57a93850 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043280 Nov 03 05:08:20.019134 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3757/7404] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:20.553850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:20.554468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:20.562517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:20.563003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:20.563443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:20.564134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:20.564590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:20.565040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:20.702179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:20.710055 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1afc472e-cd48-46af-9fae-4f78d826f30f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1679 microversion: 2.1 time: 0.159984 Nov 03 05:08:20.710555 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3648/7405] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:20 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:21.734855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:21.735697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:21.742191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:21.742686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:21.743148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:21.743833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:21.744301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:21.745372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:21.877558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:21.885785 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d867f7da-2409-4c0e-9073-b66279af5cc8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1679 microversion: 2.1 time: 0.154711 Nov 03 05:08:21.886361 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3758/7406] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:21 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:22.910568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:22.911207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:22.918068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:22.918562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:22.919007 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:22.919709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:22.920171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:22.920604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:23.051733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:23.059759 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac617814-4279-429d-9318-643c6c8d0763 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1676 microversion: 2.1 time: 0.153357 Nov 03 05:08:23.060348 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3649/7407] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:22 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:23.082398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:23.082954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:23.090416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:23.090923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:23.091392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:23.092083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:23.092549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:23.092993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:23.131334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:23.131832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:23.132289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:23.133056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:23.133528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:23.133968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:23.157692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for project 945422a884ac43b7995e59a6a331f723. Resources: {'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:08:23.163381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for user fefb1bf8c01c48efa41fd865ba4e06af and project 945422a884ac43b7995e59a6a331f723. Resources: {'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:08:23.530691 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a7007871-0c3d-47a0-bb1d-d88da168fa52 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a/action" status: 202 len: 0 microversion: 2.1 time: 0.451942 Nov 03 05:08:23.531310 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3759/7408] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:08:23 2022] POST /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:08:23.540346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:23.540969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:23.547240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:23.547728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:23.548171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:23.548867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:23.549353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:23.549782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:23.682947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:23.690845 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aed20326-4771-4753-8c46-9147fbe45059 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1675 microversion: 2.1 time: 0.155247 Nov 03 05:08:23.691875 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3650/7409] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:23 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:24.715669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:24.716306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:24.723288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:24.723788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:24.724238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:24.724937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:24.725434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:24.725874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:24.748819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:24.860018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:24.867671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d5465dd-5a44-4b2c-98af-3d63ddfce3c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1675 microversion: 2.1 time: 0.157213 Nov 03 05:08:24.868245 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3760/7410] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:24 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:25.355250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c1282635-63c7-4bfe-a144-3a101cc481e8 req-577e9e6a-b2f0-48c3-b732-e2be0c5af8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "name": "network-vif-plugged", "status": "completed", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:25.365066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c1282635-63c7-4bfe-a144-3a101cc481e8 req-577e9e6a-b2f0-48c3-b732-e2be0c5af8e3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:25.365550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c1282635-63c7-4bfe-a144-3a101cc481e8 req-577e9e6a-b2f0-48c3-b732-e2be0c5af8e3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:25.365979 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c1282635-63c7-4bfe-a144-3a101cc481e8 req-577e9e6a-b2f0-48c3-b732-e2be0c5af8e3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:25.377969 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c1282635-63c7-4bfe-a144-3a101cc481e8 req-577e9e6a-b2f0-48c3-b732-e2be0c5af8e3 service nova] Creating event network-vif-plugged:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h1-854653-7 Nov 03 05:08:25.383656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-c1282635-63c7-4bfe-a144-3a101cc481e8 req-577e9e6a-b2f0-48c3-b732-e2be0c5af8e3 service nova] Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:08:25.395454 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c1282635-63c7-4bfe-a144-3a101cc481e8 req-577e9e6a-b2f0-48c3-b732-e2be0c5af8e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111772 Nov 03 05:08:25.396069 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3651/7411] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:25.891535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:25.892230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:25.899170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:25.904343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:25.904343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:25.904343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:25.904343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:25.904343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:26.040013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:26.048789 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dec77857-466d-4812-976d-070ef735c2c6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1675 microversion: 2.1 time: 0.161145 Nov 03 05:08:26.049399 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3761/7412] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:25 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:27.075508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:27.076222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:27.082384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:27.082878 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:27.083326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:27.084025 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:27.084485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:27.084945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:27.330002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:27.338248 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-732f6d02-048c-42ea-a1f6-343b1c50a737 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1675 microversion: 2.1 time: 0.268621 Nov 03 05:08:27.338831 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3652/7413] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:27 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1675 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:27.554750 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-bb01bbea-ebb6-4994-8048-1b542a1eb371 req-36d83ba4-8aa8-4ee3-9def-65e754a9abd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "name": "network-vif-unplugged", "status": "completed", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:27.564814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bb01bbea-ebb6-4994-8048-1b542a1eb371 req-36d83ba4-8aa8-4ee3-9def-65e754a9abd2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:27.565348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bb01bbea-ebb6-4994-8048-1b542a1eb371 req-36d83ba4-8aa8-4ee3-9def-65e754a9abd2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:27.565802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bb01bbea-ebb6-4994-8048-1b542a1eb371 req-36d83ba4-8aa8-4ee3-9def-65e754a9abd2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:27.577545 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-bb01bbea-ebb6-4994-8048-1b542a1eb371 req-36d83ba4-8aa8-4ee3-9def-65e754a9abd2 service nova] Creating event network-vif-unplugged:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h2-854653-7 Nov 03 05:08:27.583248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-bb01bbea-ebb6-4994-8048-1b542a1eb371 req-36d83ba4-8aa8-4ee3-9def-65e754a9abd2 service nova] Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:08:27.594277 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-bb01bbea-ebb6-4994-8048-1b542a1eb371 req-36d83ba4-8aa8-4ee3-9def-65e754a9abd2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097830 Nov 03 05:08:27.594930 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3762/7414] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:28.361407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:28.362034 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:28.368962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:28.369510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:28.370035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:28.370651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:28.371114 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:28.371546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:28.579061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:28.587457 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5f584814-0ec9-4a57-93cf-1a4b64c5a7e3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1675 microversion: 2.1 time: 0.230028 Nov 03 05:08:28.588625 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3653/7415] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:28 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1675 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:29.616089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:29.617228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:29.623723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:29.624230 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:29.624690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:29.625441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:29.625943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:29.626390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:29.626593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-56676557-0b70-4241-8372-00283c5967b7 req-dd637beb-e1e2-4f45-9644-bbdc024f40d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:29.637285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-56676557-0b70-4241-8372-00283c5967b7 req-dd637beb-e1e2-4f45-9644-bbdc024f40d7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:29.637764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-56676557-0b70-4241-8372-00283c5967b7 req-dd637beb-e1e2-4f45-9644-bbdc024f40d7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:29.638192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-56676557-0b70-4241-8372-00283c5967b7 req-dd637beb-e1e2-4f45-9644-bbdc024f40d7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:29.650971 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-56676557-0b70-4241-8372-00283c5967b7 req-dd637beb-e1e2-4f45-9644-bbdc024f40d7 service nova] Creating event network-changed:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h2-854653-7 Nov 03 05:08:29.656243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-56676557-0b70-4241-8372-00283c5967b7 req-dd637beb-e1e2-4f45-9644-bbdc024f40d7 service nova] Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:08:29.667068 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-56676557-0b70-4241-8372-00283c5967b7 req-dd637beb-e1e2-4f45-9644-bbdc024f40d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044057 Nov 03 05:08:29.667680 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3654/7416] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:08:29.762967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:29.770829 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98a8f24f-f3f3-495a-9a9f-0786be89c706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1675 microversion: 2.1 time: 0.159796 Nov 03 05:08:29.785291 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3763/7417] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:29 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:30.796663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:30.797402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:30.803573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:30.804159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:30.804607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:30.805342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:30.805807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:30.806240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:30.948621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:30.956717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e79ab36-ce2f-4cc1-a207-1fefa91b87ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1675 microversion: 2.1 time: 0.165313 Nov 03 05:08:30.958219 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3655/7418] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:30 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:31.980732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:31.981399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:31.984242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:31.988987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:31.989520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:31.989977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:31.990691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:31.991243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:31.991668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.122018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:32.129839 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9c97ed3c-58c1-4ef3-9942-c9c90cdc17f4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1668 microversion: 2.1 time: 0.153076 Nov 03 05:08:32.130407 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3764/7419] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:31 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:32.152197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:32.152801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:32.159652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.161417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.161417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.161417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.161722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.162101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.164787 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:32.294557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:32.302289 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87b3f85d-2563-4b15-bd98-72edead01519 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1668 microversion: 2.1 time: 0.154269 Nov 03 05:08:32.302879 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3656/7420] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:32 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:32.324978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:32.325619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:32.331662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.332168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.332636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.333397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.333878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.334324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.460313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:32.468685 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c73573b-1041-4d4c-b665-57bbfbcc1e0a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1668 microversion: 2.1 time: 0.147590 Nov 03 05:08:32.469286 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3765/7421] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:32 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:32.491116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:32.491624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:32.497682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.498169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.498609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.499303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.499762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.500195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.524441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:08:32.823734 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-43540948-c883-4a79-8320-3801d7f91fe3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 204 len: 0 microversion: 2.1 time: 0.335989 Nov 03 05:08:32.824384 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3657/7422] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:08:32 2022] DELETE /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:08:32.832681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:32.833502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:32.840077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.840586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.841082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.841808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.842486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.842722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.876925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b2a5e185-35b4-4f57-9650-14da7bcc73ef req-314cdc73-c83e-45fd-9ed1-8de84c81f2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "name": "network-vif-plugged", "status": "completed", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:32.887493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2a5e185-35b4-4f57-9650-14da7bcc73ef req-314cdc73-c83e-45fd-9ed1-8de84c81f2a0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:32.888243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2a5e185-35b4-4f57-9650-14da7bcc73ef req-314cdc73-c83e-45fd-9ed1-8de84c81f2a0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:32.888750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2a5e185-35b4-4f57-9650-14da7bcc73ef req-314cdc73-c83e-45fd-9ed1-8de84c81f2a0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:32.902291 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b2a5e185-35b4-4f57-9650-14da7bcc73ef req-314cdc73-c83e-45fd-9ed1-8de84c81f2a0 service nova] Creating event network-vif-plugged:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h2-854653-7 Nov 03 05:08:32.907627 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b2a5e185-35b4-4f57-9650-14da7bcc73ef req-314cdc73-c83e-45fd-9ed1-8de84c81f2a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Nov 03 05:08:32.908403 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3658/7423] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:32.981314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:32.989684 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2ee4b58a-a4ea-463d-80a0-2b53d61e0ae7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1674 microversion: 2.1 time: 0.160882 Nov 03 05:08:32.990944 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3766/7424] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:32 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:34.014405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:34.015135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:34.019308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:34.024430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:34.025215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:34.031833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:34.031833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:34.031833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:34.031833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:34.159250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:34.166867 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2eb7a41-ce4b-4e1d-acd1-7025b47b2f20 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1674 microversion: 2.1 time: 0.157494 Nov 03 05:08:34.167369 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3659/7425] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:34 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:35.138464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-bcfce85e-75e2-4a4a-ab30-e17f8867ea6d req-e4e3136c-fb01-4789-a3a7-e909f8136fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a", "name": "network-vif-deleted", "tag": "03456c5e-7789-45f5-9f3a-25f56c9552d7"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:35.144367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:35.152081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bcfce85e-75e2-4a4a-ab30-e17f8867ea6d req-e4e3136c-fb01-4789-a3a7-e909f8136fa0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:35.152779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bcfce85e-75e2-4a4a-ab30-e17f8867ea6d req-e4e3136c-fb01-4789-a3a7-e909f8136fa0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:35.153434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-bcfce85e-75e2-4a4a-ab30-e17f8867ea6d req-e4e3136c-fb01-4789-a3a7-e909f8136fa0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:35.166555 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-bcfce85e-75e2-4a4a-ab30-e17f8867ea6d req-e4e3136c-fb01-4789-a3a7-e909f8136fa0 service nova] Creating event network-vif-deleted:03456c5e-7789-45f5-9f3a-25f56c9552d7 for instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a on n-h2-854653-7 Nov 03 05:08:35.172308 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-bcfce85e-75e2-4a4a-ab30-e17f8867ea6d req-e4e3136c-fb01-4789-a3a7-e909f8136fa0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038185 Nov 03 05:08:35.173132 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3767/7426] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:35.190390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:35.191009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:35.206269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:35.206269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:35.206269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:35.206971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:35.207431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:35.207858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:35.295353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:35.303329 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b98a1d4d-6f43-4946-8462-2eb11fd91510 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 200 len: 1607 microversion: 2.1 time: 0.116766 Nov 03 05:08:35.304128 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3660/7427] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:35 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 1607 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:36.327505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:36.328437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:36.335035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:36.335543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:36.336025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:36.336746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:36.337266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:36.338228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:36.351694 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a HTTP/1.1 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a'} Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:08:36.353967 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6889e665-d45c-4efd-890a-66b228301385 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 404 len: 111 microversion: 2.1 time: 0.033111 Nov 03 05:08:36.358959 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3768/7428] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:36 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:08:36.372319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:36.372936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:36.379757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:36.380241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:36.380683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:36.381398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:36.381853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:36.382276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:36.395372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a HTTP/1.1 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a'} Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:08:36.397052 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6a906ca2-244c-46ce-b174-fe9de796d2fe tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 404 len: 111 microversion: 2.1 time: 0.030036 Nov 03 05:08:36.402538 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3661/7429] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:36 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:08:36.447549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-974976894", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "0f5a7638-ec3b-4181-87b6-5f84a98d6f7c"}], "security_groups": [{"name": "tempest-securitygroup--145544269"}], "key_name": "tempest-keypair-583107862", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:36.553194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] validate_networks() for [('0f5a7638-ec3b-4181-87b6-5f84a98d6f7c', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:08:36.966245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:08:36.966684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:08:36.969498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:08:36.969498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:08:36.969498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:08:36.976810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:36.977331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:36.977784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:36.978524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:36.978988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:36.979429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:36.996306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:08:37.001679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for user fefb1bf8c01c48efa41fd865ba4e06af and project 945422a884ac43b7995e59a6a331f723. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:08:37.014443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:08:37.016782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:08:37.128395 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6af725b6-f130-47a8-92e1-321ec52143d7 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.684867 Nov 03 05:08:37.129070 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3769/7430] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:08:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:08:37.140906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eac0b427-9c54-42f6-a609-3b9097ba1c6e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:37.141550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eac0b427-9c54-42f6-a609-3b9097ba1c6e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:37.199913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eac0b427-9c54-42f6-a609-3b9097ba1c6e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:37.207159 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eac0b427-9c54-42f6-a609-3b9097ba1c6e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1237 microversion: 2.1 time: 0.070068 Nov 03 05:08:37.207803 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3662/7431] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:37 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:38.231057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:38.231714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:38.238662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:38.239169 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:38.239626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:38.240340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:38.240817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:38.241292 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:38.303257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:38.311729 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4c3536f9-cc73-478e-a203-7106d0bf5613 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1241 microversion: 2.1 time: 0.086018 Nov 03 05:08:38.312296 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3770/7432] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:38 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:39.334080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:39.334701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:39.342882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:39.343376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:39.343816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:39.344518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:39.344975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:39.345458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:39.438841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:39.446539 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e88b7c3e-4878-43b8-828d-be93d9fc2ea9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1307 microversion: 2.1 time: 0.116454 Nov 03 05:08:39.447112 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3663/7433] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:39 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1307 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:08:40.471434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:40.472079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:40.479690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:40.480200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:40.480705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:40.481440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:40.481914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:40.482359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:40.701464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:40.709393 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a3d3b401-e578-46be-a441-bd30d2ec8a49 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1362 microversion: 2.1 time: 0.241953 Nov 03 05:08:40.709969 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3771/7434] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:40 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:40.935976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c187c0e7-57fa-4e25-b9d2-8cb14c215f94 req-09a05c7b-ef8a-4e25-be1e-e98a5c22d7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:40.946805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c187c0e7-57fa-4e25-b9d2-8cb14c215f94 req-09a05c7b-ef8a-4e25-be1e-e98a5c22d7a8 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:40.947308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c187c0e7-57fa-4e25-b9d2-8cb14c215f94 req-09a05c7b-ef8a-4e25-be1e-e98a5c22d7a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:40.947859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c187c0e7-57fa-4e25-b9d2-8cb14c215f94 req-09a05c7b-ef8a-4e25-be1e-e98a5c22d7a8 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:40.958938 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c187c0e7-57fa-4e25-b9d2-8cb14c215f94 req-09a05c7b-ef8a-4e25-be1e-e98a5c22d7a8 service nova] Creating event network-changed:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h2-854653-7 Nov 03 05:08:40.964497 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c187c0e7-57fa-4e25-b9d2-8cb14c215f94 req-09a05c7b-ef8a-4e25-be1e-e98a5c22d7a8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032713 Nov 03 05:08:40.965124 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3664/7435] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:41.733682 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:41.734313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:41.741070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:41.741574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:41.742027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:41.742732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:41.743201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:41.744220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:41.876205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:41.884205 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c76860c3-21a6-4f06-868c-8d68166def67 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1362 microversion: 2.1 time: 0.154556 Nov 03 05:08:41.884823 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3772/7436] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:41 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:42.955331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:42.956037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:42.962233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:42.962716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:42.963155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:42.963838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:42.964294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:42.964721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:43.095286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:43.102933 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1865227-b8e1-4552-82f7-6e136dfc71ac tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1362 microversion: 2.1 time: 0.198656 Nov 03 05:08:43.103502 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3665/7437] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:42 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:44.126422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:44.127084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:44.134137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:44.135757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:44.135757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:44.135943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:44.136239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:44.136678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:44.263967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:44.272646 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-119efc02-bc4c-4e86-af10-5a34a3960a01 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1362 microversion: 2.1 time: 0.150079 Nov 03 05:08:44.275102 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3773/7438] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:44 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:45.296825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:45.297408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:45.304378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:45.304976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:45.305459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:45.306165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:45.306630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:45.307062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:45.767233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:45.777444 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f515cc4b-e183-4457-be89-232d8052c528 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1362 microversion: 2.1 time: 0.484685 Nov 03 05:08:45.778036 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3666/7439] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:45 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:46.800921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:46.801516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:46.808319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:46.808822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:46.809311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:46.810026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:46.810503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:46.810948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:46.944678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:46.953027 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-82fc5531-77d9-45d7-982c-5d3af7f1c674 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1362 microversion: 2.1 time: 0.156043 Nov 03 05:08:46.953608 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3774/7440] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:46 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:46.981336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3f5ef0ed-8630-417d-ba75-f01b3a3f098d req-9bae63e1-24a3-4208-a933-df2794bb7966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "name": "network-vif-plugged", "status": "completed", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:46.991814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3f5ef0ed-8630-417d-ba75-f01b3a3f098d req-9bae63e1-24a3-4208-a933-df2794bb7966 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:46.992287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3f5ef0ed-8630-417d-ba75-f01b3a3f098d req-9bae63e1-24a3-4208-a933-df2794bb7966 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:46.992714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3f5ef0ed-8630-417d-ba75-f01b3a3f098d req-9bae63e1-24a3-4208-a933-df2794bb7966 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:47.004092 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3f5ef0ed-8630-417d-ba75-f01b3a3f098d req-9bae63e1-24a3-4208-a933-df2794bb7966 service nova] Creating event network-vif-plugged:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h2-854653-7 Nov 03 05:08:47.009266 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3f5ef0ed-8630-417d-ba75-f01b3a3f098d req-9bae63e1-24a3-4208-a933-df2794bb7966 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 Nov 03 05:08:47.009846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3667/7441] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:47.977284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:47.977854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:47.980079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:47.980904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:47.986369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:47.986881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:47.987346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:47.988065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:47.988542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:47.988990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:48.122617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:48.130474 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a7fef67e-da28-414a-9b18-094ba4508653 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1362 microversion: 2.1 time: 0.157261 Nov 03 05:08:48.131069 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3775/7442] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:47 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:49.155403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:49.156154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:49.158192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:08:49.164009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:49.164498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:49.164942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:49.165669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:49.166130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:49.167224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:49.299940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:08:49.307785 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5cd080fb-dde5-44d8-8138-0a22b6aa3b33 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1548 microversion: 2.1 time: 0.157149 Nov 03 05:08:49.308405 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3668/7443] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:08:49 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:08:49.331057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:08:49.331595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:08:49.339208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:49.339721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:49.340182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:49.340906 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:49.341427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:49.341879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:49.424474 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c0a6c38a-0ac0-4fd9-ae50-07e99bbc9356 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097335 Nov 03 05:08:49.425099 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3776/7444] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 05:08:49 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:08:50.710248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-640ee4d1-f656-42e6-be9d-195e01aec9f8 req-ced2f679-846f-4177-a5cd-50fe78e5822e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:08:50.720854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-640ee4d1-f656-42e6-be9d-195e01aec9f8 req-ced2f679-846f-4177-a5cd-50fe78e5822e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:08:50.721384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-640ee4d1-f656-42e6-be9d-195e01aec9f8 req-ced2f679-846f-4177-a5cd-50fe78e5822e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:08:50.721823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-640ee4d1-f656-42e6-be9d-195e01aec9f8 req-ced2f679-846f-4177-a5cd-50fe78e5822e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:08:50.734265 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-640ee4d1-f656-42e6-be9d-195e01aec9f8 req-ced2f679-846f-4177-a5cd-50fe78e5822e service nova] Creating event network-changed:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h2-854653-7 Nov 03 05:08:50.739347 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-640ee4d1-f656-42e6-be9d-195e01aec9f8 req-ced2f679-846f-4177-a5cd-50fe78e5822e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032741 Nov 03 05:08:50.740036 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3669/7445] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:09:28.532580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:28.533376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=82 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:28.537228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:28.537854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:28.544095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:28.548509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:28.548509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:28.548509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:28.548509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:28.548509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:28.682133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:28.690007 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8eee2feb-418f-4b2d-9862-c0733f40c3d8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1667 microversion: 2.1 time: 0.159443 Nov 03 05:09:28.690574 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3777/7446] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:28 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:28.710395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=23 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:28.711162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:28.715963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "780e254a-61a9-48f7-bd55-b71b05f4ae52"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:09:28.720295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:28.724392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:28.724880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:28.725358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:28.726057 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:28.726519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:28.726953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:29.401303 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1670e394-3a96-446c-8618-061fa026049b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692858 Nov 03 05:09:29.401961 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3670/7447] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 05:09:28 2022] POST /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:09:41.161179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:09:41.163542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:41.166329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:41.167159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:41.172180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:41.172686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:41.173195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:41.173904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:41.174373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:41.174816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:41.203003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:41.208996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Old instance type m1.heat2, new instance type m1.heat {{(pid=127594) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:09:41.215975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:09:41.216407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:09:41.216889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:09:41.217464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:09:41.217896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:09:41.413402 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e08f7114-0a9d-454e-86ad-36752ea0f106 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.255621 Nov 03 05:09:41.413942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3778/7448] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:09:41 2022] POST /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:09:41.421232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:41.421999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:09:41.426098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:41.426702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:41.432711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:41.433268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:41.433710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:41.434404 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:41.434891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:41.435317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:41.611555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:41.620391 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dc873ce7-ca13-4c64-9a86-0e18b574944e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1722 microversion: 2.1 time: 0.201071 Nov 03 05:09:41.625157 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3671/7449] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:41 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:09:42.643901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:42.644449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:42.652340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:42.654489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:42.654489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:42.654489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:42.654489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:42.654908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:42.832033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:42.841279 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-414946b8-0820-411a-ad9c-60f8524b9e0c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1722 microversion: 2.1 time: 0.201406 Nov 03 05:09:42.841855 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3779/7450] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:42 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:43.864401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:43.865131 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:43.872304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:43.872788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:43.873254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:43.873951 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:43.874409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:43.874832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:44.076908 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:44.085363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-69f2d992-c192-4fd8-835e-e6255dbde789 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1722 microversion: 2.1 time: 0.224846 Nov 03 05:09:44.086310 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3672/7451] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:43 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:45.110237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:45.110880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:45.117770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:45.118277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:45.118734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:45.119446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:45.119927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:45.120392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:45.250798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:45.259152 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-472ff9c2-5d18-47df-9598-a52eb0fbd1c0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.152786 Nov 03 05:09:45.259718 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3780/7452] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:45 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:46.283672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:46.284289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:46.291077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:46.291562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:46.292021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:46.292715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:46.293202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:46.293630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:46.419956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:46.428352 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b937ab1f-cb75-432a-a53e-f118135132ca tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.148564 Nov 03 05:09:46.433771 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3673/7453] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:46 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:47.451903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:47.452529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:47.459341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:47.460176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:47.460322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:47.461048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:47.461506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:47.461943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:47.597705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:47.606501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef4c7ef9-c2fe-4466-91b7-6f32b50b9f2a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.158569 Nov 03 05:09:47.607071 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3781/7454] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:47 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:48.629337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:48.629875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:48.636687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:48.637205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:48.637647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:48.638335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:48.638790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:48.639215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:48.765273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:48.773412 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-801ae840-a2ab-429c-9a47-7e544b17a123 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.148076 Nov 03 05:09:48.773982 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3674/7455] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:48 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:49.797842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:49.798391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:49.805077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:49.805580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:49.806032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:49.806729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:49.807213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:49.807635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:49.939887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:49.948277 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58d2bf7a-d576-4b30-aa96-6b1c4f383360 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.154420 Nov 03 05:09:49.948841 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3782/7456] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:49 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:50.972166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:50.972782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:50.979370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:50.980361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:50.980820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:50.981522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:50.981974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:50.982401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:51.111188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:51.119409 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a40ed353-cd8f-4758-9c4b-c66a1445a830 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.151087 Nov 03 05:09:51.119987 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3675/7457] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:50 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:52.143180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:52.143814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:52.150411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:52.150965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:52.151422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:52.152129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:52.152604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:52.153094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:52.280667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:52.289259 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-743b0032-bd5d-46a2-a2af-2423ea7a8d84 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.150017 Nov 03 05:09:52.289849 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3783/7458] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:52 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:53.313640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:53.314247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:53.320861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:53.321379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:53.321824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:53.322521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:53.322982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:53.324062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:53.462191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:53.470960 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7af8b4cb-eab8-4bcd-a0ad-56ac0346ac97 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.161292 Nov 03 05:09:53.471537 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3676/7459] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:53 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:54.493790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:54.494424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:54.501350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:54.501852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:54.502309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:54.503028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:54.503504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:54.503950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:54.631466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:54.640309 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-67185ba9-9f44-4268-ab09-dcc50e34bc8c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.150442 Nov 03 05:09:54.640880 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3784/7460] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:54 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:55.664338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:55.664897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:55.672367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:55.672855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:55.673331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:55.674058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:55.674518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:55.674948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:55.809040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:55.813512 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b22e6fab-6bf7-4a25-801a-ecef368d91c8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.153123 Nov 03 05:09:55.814087 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3677/7461] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:55 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:56.836873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:56.837542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:56.845482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:56.845992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:56.846449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:56.847163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:56.847641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:56.848088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:57.034261 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:09:57.034504 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 (ip 10.222.0.30) !!! Nov 03 05:09:57.300977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:57.309153 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-049c23f1-a4e9-47f1-bb05-e2843db9eb79 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.476170 Nov 03 05:09:57.309727 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3785/7462] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:56 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:58.332242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:58.332865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:58.335028 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:09:58.335175 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 (ip 10.222.0.30) !!! Nov 03 05:09:58.336327 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:09:58.336529 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 (ip 10.222.0.30) !!! Nov 03 05:09:58.347699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:58.348197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:58.348645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:58.349381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:58.349849 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:58.350282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:58.480127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:58.488667 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c65151a-54ee-4e72-89a0-c637385adab2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.160405 Nov 03 05:09:58.492787 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3678/7463] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:58 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:09:59.512506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:09:59.513155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:09:59.519981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:59.520486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:59.520946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:59.521714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:09:59.522196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:09:59.522643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:09:59.652718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:09:59.660952 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7548380e-dd72-499e-8226-45a687c1f3dd tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.153221 Nov 03 05:09:59.661553 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3786/7464] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:09:59 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:00.738553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:00.739171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:00.745902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:00.746960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:00.746960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:00.747491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:00.747978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:00.748402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:00.876510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:00.884737 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-292a8642-c591-4e65-a113-3630fc193d86 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.150060 Nov 03 05:10:00.885341 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3679/7465] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:00 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:01.908152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:01.908887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:01.916086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:01.917110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:01.921194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:01.921194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:01.921194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:01.921194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:02.053686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:02.062827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-322a8fdb-38b5-4aa0-84e0-a12e390f4e3f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.158567 Nov 03 05:10:02.063408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3787/7466] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:01 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:03.086258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:03.086879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:03.094205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:03.094689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:03.095125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:03.095815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:03.096267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:03.096691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:03.225505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:03.234588 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-23355183-4968-4d25-af9a-1dc35686c0ae tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1727 microversion: 2.1 time: 0.152303 Nov 03 05:10:03.235163 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3680/7467] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:03 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:04.258154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:04.258854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:04.266405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:04.266909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:04.267363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:04.268138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:04.268612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:04.269074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:04.408645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:04.417134 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3effd110-fc9c-4f42-8084-4d09021dbbb6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1726 microversion: 2.1 time: 0.162880 Nov 03 05:10:04.417732 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3788/7468] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:04 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:04.838679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6a867394-494a-4add-8f2f-07e49d9a1139 req-fbb954fd-76e0-42e6-b83e-d929a46a850b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "name": "network-vif-unplugged", "status": "completed", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:04.848174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6a867394-494a-4add-8f2f-07e49d9a1139 req-fbb954fd-76e0-42e6-b83e-d929a46a850b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:04.848646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6a867394-494a-4add-8f2f-07e49d9a1139 req-fbb954fd-76e0-42e6-b83e-d929a46a850b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:04.849226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6a867394-494a-4add-8f2f-07e49d9a1139 req-fbb954fd-76e0-42e6-b83e-d929a46a850b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:04.860519 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6a867394-494a-4add-8f2f-07e49d9a1139 req-fbb954fd-76e0-42e6-b83e-d929a46a850b service nova] Creating event network-vif-unplugged:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h1-854653-7 Nov 03 05:10:04.865807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-6a867394-494a-4add-8f2f-07e49d9a1139 req-fbb954fd-76e0-42e6-b83e-d929a46a850b service nova] Instance 40d93636-9741-473c-aa6a-d41785bde5c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:10:04.877663 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6a867394-494a-4add-8f2f-07e49d9a1139 req-fbb954fd-76e0-42e6-b83e-d929a46a850b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090904 Nov 03 05:10:04.878349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3681/7469] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:10:05.441518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:05.442125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:05.448960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:05.450013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:05.450013 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:05.450649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:05.451186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:05.451632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:05.585091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:05.593989 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-10604830-5a9e-4d0c-b39e-b180cb998591 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1726 microversion: 2.1 time: 0.156706 Nov 03 05:10:05.594596 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3789/7470] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:05 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:06.619809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:06.620546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:06.626828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:06.627306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:06.627742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:06.628430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:06.628881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:06.629340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:06.766893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:06.775450 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-209a5913-a4ed-46c4-90ef-19d4f3c9faf8 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.160616 Nov 03 05:10:06.776022 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3682/7471] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:06 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:06.932411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ca2dbfc5-1629-47c9-ba7a-2e000691dab9 req-a90e8ff8-be4a-41ef-a6cb-cb130e54ad2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:06.943235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ca2dbfc5-1629-47c9-ba7a-2e000691dab9 req-a90e8ff8-be4a-41ef-a6cb-cb130e54ad2d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:06.943754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ca2dbfc5-1629-47c9-ba7a-2e000691dab9 req-a90e8ff8-be4a-41ef-a6cb-cb130e54ad2d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:06.944196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ca2dbfc5-1629-47c9-ba7a-2e000691dab9 req-a90e8ff8-be4a-41ef-a6cb-cb130e54ad2d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:06.956355 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ca2dbfc5-1629-47c9-ba7a-2e000691dab9 req-a90e8ff8-be4a-41ef-a6cb-cb130e54ad2d service nova] Creating event network-changed:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h1-854653-7 Nov 03 05:10:06.961748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-ca2dbfc5-1629-47c9-ba7a-2e000691dab9 req-a90e8ff8-be4a-41ef-a6cb-cb130e54ad2d service nova] Instance 40d93636-9741-473c-aa6a-d41785bde5c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:10:06.973246 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ca2dbfc5-1629-47c9-ba7a-2e000691dab9 req-a90e8ff8-be4a-41ef-a6cb-cb130e54ad2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044434 Nov 03 05:10:06.973857 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3790/7472] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:10:07.802223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:07.802846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:07.809702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:07.810197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:07.810649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:07.811353 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:07.811834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:07.812250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:07.955728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:07.964959 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e5f02efa-794a-42f9-90e7-8c16a4020426 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.166051 Nov 03 05:10:07.965599 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3683/7473] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:07 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:08.989959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:08.990691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:08.997454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:08.997958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:08.998419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:08.999138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:08.999620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:09.000070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:09.130477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:09.139488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f9193d85-eb49-42f3-be86-00aa11328947 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.154813 Nov 03 05:10:09.140069 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3791/7474] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:08 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:10.163293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:10.163957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:10.170800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:10.171283 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:10.171719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:10.172411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:10.172867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:10.173330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:10.310793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:10.320028 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8718ebb3-230c-4edf-b279-bb4d08413727 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.160491 Nov 03 05:10:10.320678 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3684/7475] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:10 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:11.344357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:11.345036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:11.347961 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=33 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:11.352658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:11.360440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:11.360440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:11.360440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:11.360440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:11.360440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:11.360440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:11.494599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:11.502965 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf532d5d-fb9c-401c-ab6a-c6804e531bfc tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.162491 Nov 03 05:10:11.503543 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3792/7476] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:11 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:12.526709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:12.527329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:12.530186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=29 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:12.534923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:12.535412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:12.535855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:12.536563 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:12.537085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:12.537521 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:12.671055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:12.679362 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ff89b59e-80c5-4e8d-9590-80a683458733 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.156845 Nov 03 05:10:12.679940 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3685/7477] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:12 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:13.703738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:13.704433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:13.711948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:13.712449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:13.712903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:13.713651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:13.714122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:13.714568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:13.844056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:13.852242 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f92c05ae-c81d-4eba-ab09-0683365bd75e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.152431 Nov 03 05:10:13.852838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3793/7478] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:13 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:14.875647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:14.876263 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:14.883346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:14.883830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:14.884264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:14.884958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:14.885437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:14.886415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:14.888938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=89 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:15.018143 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:15.026617 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2233ef39-e229-4924-b142-53adcae3ede6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.154802 Nov 03 05:10:15.027188 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3686/7479] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:14 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:16.049466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:16.050032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:16.056829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:16.057365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:16.057823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:16.058533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:16.059006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:16.059449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:16.196535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:16.205525 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-809d5508-8525-4f4b-9309-9828ff4bca21 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.160113 Nov 03 05:10:16.206114 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3794/7480] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:16 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:10:17.230195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:17.230806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:17.237574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:17.238060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:17.238502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:17.239199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:17.239656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:17.240083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:17.369797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:17.378084 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2bd0d8ee-fed7-4482-877e-4999eeaa0f77 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.152337 Nov 03 05:10:17.378659 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3687/7481] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:17 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:18.401783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:18.402422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:18.409278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:18.409789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:18.410251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:18.410973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:18.411451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:18.411901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:18.546658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:18.554941 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05515b8f-ef45-42de-a5bd-dd340763cead tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.157476 Nov 03 05:10:18.555752 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3795/7482] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:18 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:19.579617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:19.580245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:19.586995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:19.590755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:19.590755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:19.590755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:19.590755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:19.590755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:19.722019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:19.730370 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0f8f6cf-8088-4e26-a6d6-9a69b632c7de tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1724 microversion: 2.1 time: 0.154714 Nov 03 05:10:19.730949 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3688/7483] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:19 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:20.754009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:20.754639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:20.761963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:20.762463 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:20.762914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:20.763619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:20.764088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:20.764529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:20.895594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:20.905143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-597a5dd9-fb43-41c8-ad2d-6ee05dd392b3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1721 microversion: 2.1 time: 0.155079 Nov 03 05:10:20.905715 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3796/7484] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:20 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:20.927537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:20.928089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:20.935028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:20.935519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:20.935967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:20.936662 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:20.937159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:20.937592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:20.977076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:20.977562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:20.978003 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:20.978730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:20.979190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:20.979665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:20.999898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for project 945422a884ac43b7995e59a6a331f723. Resources: {'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:10:21.005069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Getting quotas for user fefb1bf8c01c48efa41fd865ba4e06af and project 945422a884ac43b7995e59a6a331f723. Resources: {'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:10:21.339310 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-780cc120-3759-42ae-b449-51adea11d8d3 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "POST /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.415514 Nov 03 05:10:21.339854 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3689/7485] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:10:20 2022] POST /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:10:21.349332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:21.349976 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:21.356004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:21.356513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:21.356980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:21.357728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:21.358210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:21.358677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:21.493538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:21.502936 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-abe36369-ea73-4ca8-b5f9-ee63bfc36dbb tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.158684 Nov 03 05:10:21.503513 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3797/7486] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:21 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:21.654989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9f836ded-38fa-477e-97f7-2cb3314f8e00 req-aa28a42e-ed38-432d-b0e8-6bad252da77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "name": "network-vif-plugged", "status": "completed", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:21.664988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9f836ded-38fa-477e-97f7-2cb3314f8e00 req-aa28a42e-ed38-432d-b0e8-6bad252da77c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:21.665507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9f836ded-38fa-477e-97f7-2cb3314f8e00 req-aa28a42e-ed38-432d-b0e8-6bad252da77c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:21.665943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9f836ded-38fa-477e-97f7-2cb3314f8e00 req-aa28a42e-ed38-432d-b0e8-6bad252da77c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:21.678622 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9f836ded-38fa-477e-97f7-2cb3314f8e00 req-aa28a42e-ed38-432d-b0e8-6bad252da77c service nova] Creating event network-vif-plugged:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h1-854653-7 Nov 03 05:10:21.684599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-9f836ded-38fa-477e-97f7-2cb3314f8e00 req-aa28a42e-ed38-432d-b0e8-6bad252da77c service nova] Instance 40d93636-9741-473c-aa6a-d41785bde5c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:10:21.695262 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9f836ded-38fa-477e-97f7-2cb3314f8e00 req-aa28a42e-ed38-432d-b0e8-6bad252da77c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044939 Nov 03 05:10:21.695868 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3690/7487] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:10:22.527346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:22.528467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:22.534354 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:22.534850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:22.535300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:22.536004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:22.536471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:22.536909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:22.670072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:22.678376 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a45d8eb2-4da5-467a-b655-4343a5c5b0b9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.155831 Nov 03 05:10:22.678948 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3798/7488] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:22 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:23.703833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:23.704532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:23.710665 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:23.711152 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:23.711594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:23.712286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:23.712746 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:23.713227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:23.848279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:23.856469 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4a2d41a-3ba8-46ad-b403-88cb36adf5ed tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.158334 Nov 03 05:10:23.857061 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3691/7489] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:23 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:24.879993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:24.880629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:24.887772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:24.888275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:24.888727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:24.889471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:24.889940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:24.890380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:25.033079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:25.041650 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1c104135-4a67-49bf-8ac7-4a82c2c2cae4 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.165675 Nov 03 05:10:25.042212 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3799/7490] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:24 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:26.065966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:26.066513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:26.073234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:26.073724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:26.074166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:26.074863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:26.075323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:26.075754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:26.221125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:26.222839 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-da5e2b24-cef4-4c4d-bfe4-583ab7588b23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.160915 Nov 03 05:10:26.223419 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3692/7491] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:26 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:27.246896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:27.247605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:27.254231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:27.254714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:27.255167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:27.255874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:27.256341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:27.256780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:27.464947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:27.474890 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e866184e-0828-4d53-99ca-606ffc87602b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.231775 Nov 03 05:10:27.475838 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3800/7492] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:27 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:27.723950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b0780f3f-de7e-4e82-ba68-01947240e353 req-8b43c936-68c1-44e3-ba4c-eb2d60e63d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "name": "network-vif-unplugged", "status": "completed", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:27.734271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b0780f3f-de7e-4e82-ba68-01947240e353 req-8b43c936-68c1-44e3-ba4c-eb2d60e63d27 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:27.734813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b0780f3f-de7e-4e82-ba68-01947240e353 req-8b43c936-68c1-44e3-ba4c-eb2d60e63d27 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:27.735241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b0780f3f-de7e-4e82-ba68-01947240e353 req-8b43c936-68c1-44e3-ba4c-eb2d60e63d27 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:27.747203 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b0780f3f-de7e-4e82-ba68-01947240e353 req-8b43c936-68c1-44e3-ba4c-eb2d60e63d27 service nova] Creating event network-vif-unplugged:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h2-854653-7 Nov 03 05:10:27.752594 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-b0780f3f-de7e-4e82-ba68-01947240e353 req-8b43c936-68c1-44e3-ba4c-eb2d60e63d27 service nova] Instance 40d93636-9741-473c-aa6a-d41785bde5c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:10:27.763991 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b0780f3f-de7e-4e82-ba68-01947240e353 req-8b43c936-68c1-44e3-ba4c-eb2d60e63d27 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043885 Nov 03 05:10:27.774907 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3693/7493] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:10:28.499057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:28.499813 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:28.506394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:28.507125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:28.507586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:28.508302 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:28.508777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:28.509252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:28.726573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:28.735643 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05d072aa-5517-4a10-a146-020bb3110daa tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.240556 Nov 03 05:10:28.736221 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3801/7494] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:28 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:29.760133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:29.760839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:29.767089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:29.767582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:29.768033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:29.769169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:29.772855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:29.773345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:29.779418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-3d4f391f-a082-4dbc-ae16-033bde544936 req-4b6a7a0f-657c-4aa5-b307-cbad13e9485e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:29.789858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3d4f391f-a082-4dbc-ae16-033bde544936 req-4b6a7a0f-657c-4aa5-b307-cbad13e9485e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:29.790433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3d4f391f-a082-4dbc-ae16-033bde544936 req-4b6a7a0f-657c-4aa5-b307-cbad13e9485e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:29.790980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-3d4f391f-a082-4dbc-ae16-033bde544936 req-4b6a7a0f-657c-4aa5-b307-cbad13e9485e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:29.803806 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-3d4f391f-a082-4dbc-ae16-033bde544936 req-4b6a7a0f-657c-4aa5-b307-cbad13e9485e service nova] Creating event network-changed:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h2-854653-7 Nov 03 05:10:29.810009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-3d4f391f-a082-4dbc-ae16-033bde544936 req-4b6a7a0f-657c-4aa5-b307-cbad13e9485e service nova] Instance 40d93636-9741-473c-aa6a-d41785bde5c6 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:10:29.821264 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-3d4f391f-a082-4dbc-ae16-033bde544936 req-4b6a7a0f-657c-4aa5-b307-cbad13e9485e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045564 Nov 03 05:10:29.822042 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3802/7495] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:10:30.018166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:30.031600 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a75d04e0-dd28-4f0f-a54f-c5efba7f298e tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.276642 Nov 03 05:10:30.033653 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3694/7496] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:29 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:31.057511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:31.058236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:31.066952 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:31.067454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:31.067905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:31.068783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:31.069277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:31.069718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:31.220624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:31.229381 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99ba0484-aa3c-4256-bc57-6b615ae9906d tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.177194 Nov 03 05:10:31.229979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3803/7497] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:31 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:32.252985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:32.253626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:32.256435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:32.261626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:32.262117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:32.262559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:32.263301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:32.263762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:32.264220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:32.398952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:32.408155 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72f89777-9074-4afc-8db4-121f69a846b2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.159096 Nov 03 05:10:32.408757 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3695/7498] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:32 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:33.431790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:33.432418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:33.439923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:33.440422 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:33.440874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:33.441624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:33.442094 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:33.442591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:33.578838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:33.587488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d93b40aa-7e55-441b-b77e-6fbba421087a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.159642 Nov 03 05:10:33.588052 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3804/7499] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:33 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:34.610508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:34.611190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:34.618005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:34.618487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:34.618922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:34.619620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:34.620079 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:34.620502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:34.754673 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:34.764227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-32325ce3-ef62-4dcc-944f-64dd26c2e275 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.157560 Nov 03 05:10:34.768848 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3696/7500] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:34 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:35.789244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:35.789902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:35.797320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:35.797818 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:35.798267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:35.798971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:35.799439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:35.799879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:35.930985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:35.939672 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3ea3c3c2-1255-4e78-9167-d2797ebe0d35 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.154378 Nov 03 05:10:35.940240 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3805/7501] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:35 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:36.963233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:36.963846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:36.971286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:36.971771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:36.972460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:36.973181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:36.973638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:36.974063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:37.107118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:37.115225 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ec451d86-1b4d-46ee-8a56-ef84f920f8e1 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.155890 Nov 03 05:10:37.115804 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3697/7502] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:36 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:38.138890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:38.139521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:38.146341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:38.146836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:38.147286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:38.147992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:38.148460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:38.148898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:38.276356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:38.285063 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c457a68e-d416-453a-ad5a-f82473941455 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.150122 Nov 03 05:10:38.285634 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3806/7503] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:38 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:39.308698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:39.309838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:39.316797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:39.317327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:39.317773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:39.318476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:39.318976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:39.319445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:39.448785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:39.457035 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70c288b9-5db9-4f6a-89ce-6b057cec376b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.152196 Nov 03 05:10:39.457607 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3698/7504] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:39 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:40.480021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:40.481330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:40.488257 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:40.488753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:40.489234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:40.490037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:40.490497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:40.490939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:40.625806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:40.634037 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-490a51a3-11b0-4b2f-a865-1b7da52e86c2 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.158104 Nov 03 05:10:40.634607 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3807/7505] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:40 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:41.656851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:41.657506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:41.664270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:41.671419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:41.671419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:41.671419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:41.671419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:41.671419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:41.800221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:41.808516 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8a3cb99e-5803-481d-a37f-a24bdc976ad0 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1720 microversion: 2.1 time: 0.155635 Nov 03 05:10:41.809746 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3699/7506] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:41 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:42.831803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:42.832470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:42.836121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=32 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:42.841403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:42.841907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:42.842368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:42.843073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:42.843653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:42.844096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:42.978780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:42.987551 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7fe5ca16-e4be-423c-b38f-831469ff9286 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1713 microversion: 2.1 time: 0.159654 Nov 03 05:10:42.988144 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3808/7507] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:42 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:43.010018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:43.010669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:43.013520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:43.018197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.018694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.019142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.019835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.020291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.020725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.036051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:43.151454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:43.160653 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cef5a3cb-f6c3-41a6-b0cf-b4443e4b426c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1713 microversion: 2.1 time: 0.154453 Nov 03 05:10:43.161264 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3700/7508] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:43 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:43.183374 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:43.184045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:43.190076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.190574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.194132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.194132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.194132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.194132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.195242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=100 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:10:43.323301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:43.332041 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3499d207-d9a3-4b01-8129-05f0d2588e57 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1713 microversion: 2.1 time: 0.152572 Nov 03 05:10:43.332611 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3809/7509] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:43 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:43.354631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:43.355086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:43.361269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.361767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.362204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.362905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.363366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.363802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.392352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:10:43.586396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dc175660-a28d-4fd7-b3e1-2e5ea395b881 req-cfe29870-c94b-436a-b61d-068454874a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "name": "network-vif-plugged", "status": "completed", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:43.596005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc175660-a28d-4fd7-b3e1-2e5ea395b881 req-cfe29870-c94b-436a-b61d-068454874a3b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.596599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc175660-a28d-4fd7-b3e1-2e5ea395b881 req-cfe29870-c94b-436a-b61d-068454874a3b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.597072 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dc175660-a28d-4fd7-b3e1-2e5ea395b881 req-cfe29870-c94b-436a-b61d-068454874a3b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.609351 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dc175660-a28d-4fd7-b3e1-2e5ea395b881 req-cfe29870-c94b-436a-b61d-068454874a3b service nova] Creating event network-vif-plugged:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h2-854653-7 Nov 03 05:10:43.614348 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dc175660-a28d-4fd7-b3e1-2e5ea395b881 req-cfe29870-c94b-436a-b61d-068454874a3b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Nov 03 05:10:43.618300 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3810/7510] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:10:43.702291 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87ff1713-d9bd-40a6-a9d4-e3ed422cd72a tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 204 len: 0 microversion: 2.1 time: 0.351430 Nov 03 05:10:43.702915 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3701/7511] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:10:43 2022] DELETE /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:10:43.712029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:43.712752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:43.718992 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.719495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.719981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.720694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:43.721205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:43.721652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:43.852022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:43.860992 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f71291f-5c22-4e94-abc5-9f468d9ae366 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1719 microversion: 2.1 time: 0.153199 Nov 03 05:10:43.861547 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3811/7512] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:43 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:10:44.885587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:44.886291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:44.893571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:44.894070 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:44.894498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:44.899575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:44.899575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:44.899575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:45.026362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:45.034574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-73e7e6a8-bbf3-4842-acb7-69fd5ec07de9 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1719 microversion: 2.1 time: 0.153322 Nov 03 05:10:45.035142 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3702/7513] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:44 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:46.058297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:46.059452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:46.067410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:46.067921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:46.068387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:46.069139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:46.069619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:46.070096 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:46.163054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:46.172118 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-954cd0f2-3546-4360-9119-aefc2de76f93 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1652 microversion: 2.1 time: 0.117979 Nov 03 05:10:46.172801 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3812/7514] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:46 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1652 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:46.348133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-21296406-269a-4d39-85cd-16ac6f07ae75 req-655b48d7-1b81-4857-8cdc-043028806b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d93636-9741-473c-aa6a-d41785bde5c6", "name": "network-vif-deleted", "tag": "241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:10:46.359904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-21296406-269a-4d39-85cd-16ac6f07ae75 req-655b48d7-1b81-4857-8cdc-043028806b9a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:46.360473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-21296406-269a-4d39-85cd-16ac6f07ae75 req-655b48d7-1b81-4857-8cdc-043028806b9a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:46.361026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-21296406-269a-4d39-85cd-16ac6f07ae75 req-655b48d7-1b81-4857-8cdc-043028806b9a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:46.373193 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-21296406-269a-4d39-85cd-16ac6f07ae75 req-655b48d7-1b81-4857-8cdc-043028806b9a service nova] Creating event network-vif-deleted:241e3723-8b9a-4cdc-bebb-9c33b4f9bf2b for instance 40d93636-9741-473c-aa6a-d41785bde5c6 on n-h2-854653-7 Nov 03 05:10:46.378489 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-21296406-269a-4d39-85cd-16ac6f07ae75 req-655b48d7-1b81-4857-8cdc-043028806b9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Nov 03 05:10:46.379184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3703/7515] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:10:47.195863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:47.196501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:47.204535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:47.205058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:47.205792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:47.206514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:47.206978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:47.207592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:47.279294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:47.288130 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95e88f28-6206-4ae6-8bae-2884f4c8ab85 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1368 microversion: 2.1 time: 0.096124 Nov 03 05:10:47.288737 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3813/7516] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:47 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:48.311844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:48.312681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:48.319857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:48.320349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:48.320797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:48.321539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:48.322008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:48.322443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:48.389084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:48.397461 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3a2e55ae-11d3-45e5-bab7-2f160b375e23 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1368 microversion: 2.1 time: 0.089876 Nov 03 05:10:48.398228 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3704/7517] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:48 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:49.421967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:49.422798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:49.430167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:49.441629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:49.441629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:49.441629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:49.441629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:49.441629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:49.496769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:49.505187 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3116cc9-fc8d-4c32-b535-4cd423f94706 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1368 microversion: 2.1 time: 0.087740 Nov 03 05:10:49.505761 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3814/7518] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:49 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:50.527921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:50.528540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:50.535552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:50.536038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:50.536481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:50.537211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:50.537670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:50.538094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:50.600145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:50.608921 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-92ca5dde-d6b0-474e-9f75-627386b3cf09 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1368 microversion: 2.1 time: 0.085132 Nov 03 05:10:50.609515 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3705/7519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:50 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:51.631954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:51.632603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:51.639201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:51.639695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:51.640330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:51.641052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:51.641526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:51.641966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:51.674504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:51.674995 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:51.675445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:51.675900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lazy-loading 'fault' on Instance uuid 40d93636-9741-473c-aa6a-d41785bde5c6 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:10:51.716874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fefb1bf8c01c48efa41fd865ba4e06af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945422a884ac43b7995e59a6a331f723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:10:51.725084 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b360fd4a-c09b-471c-8ec1-27b08bfde7da tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 200 len: 1373 microversion: 2.1 time: 0.097233 Nov 03 05:10:51.725646 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3815/7520] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:51 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:10:52.747904 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:52.748519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:52.754636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:52.755113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:52.755546 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:52.756230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:52.756684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:52.757155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:52.770103 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 HTTP/1.1 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '40d93636-9741-473c-aa6a-d41785bde5c6'} Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:52.771719 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-52d6a8a8-a5d1-4067-83af-8475a8e4150b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 404 len: 111 microversion: 2.1 time: 0.029288 Nov 03 05:10:52.777632 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3706/7521] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:52 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:52.835029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:52.837205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:52.844445 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:52.844941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:52.845419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:52.846117 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:52.846582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:52.847035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:52.859555 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/os-volume_attachments HTTP/1.1 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': '40d93636-9741-473c-aa6a-d41785bde5c6'} Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:52.861259 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-adeec13d-68f6-4d5f-9db5-3d106f49e407 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031627 Nov 03 05:10:52.865950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3816/7522] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:10:52 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.352545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.353101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.360016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.360510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.360953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.361683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.362141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.362570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.376717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 HTTP/1.1 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '40d93636-9741-473c-aa6a-d41785bde5c6'} Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.378330 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7f05750-092f-4503-abd1-2073cf7b33ce tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 404 len: 111 microversion: 2.1 time: 0.031275 Nov 03 05:10:56.383795 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3707/7523] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:10:56 2022] DELETE /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.388869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.389554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 40d93636-9741-473c-aa6a-d41785bde5c6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.396619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.397163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.397646 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.398370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.398848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.399300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.413784 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 HTTP/1.1 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '40d93636-9741-473c-aa6a-d41785bde5c6'} Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.415353 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 40d93636-9741-473c-aa6a-d41785bde5c6 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-05ff3114-f7b0-400f-bd8f-1241d9dcfa6b tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6" status: 404 len: 111 microversion: 2.1 time: 0.032588 Nov 03 05:10:56.419998 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3817/7524] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:56 2022] GET /compute/v2.1/servers/40d93636-9741-473c-aa6a-d41785bde5c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.425669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.426175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.432477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.433481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.433959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.434669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.435137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.435575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.449900 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a HTTP/1.1 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a'} Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.451465 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9ad6caa6-33f7-4e2d-9f10-0cda3b952eec tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 404 len: 111 microversion: 2.1 time: 0.031046 Nov 03 05:10:56.455802 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3708/7525] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:10:56 2022] DELETE /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.462545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.463193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.469391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.469905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.470368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.471089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.471570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.472023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.485883 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a HTTP/1.1 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a'} Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.487433 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4b5ad32f-2f24-4682-bfa2-cf2bdc2eb077 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a" status: 404 len: 111 microversion: 2.1 time: 0.030507 Nov 03 05:10:56.491787 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3818/7526] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:56 2022] GET /compute/v2.1/servers/2e8f40bf-d8e4-4b3c-a212-d5ce93e7630a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.498509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.499019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.505295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.505719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.506186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.506894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.507358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.507790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.524701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a HTTP/1.1 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'ae85383b-02c9-4dca-b294-e296fbd8465a'} Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.526557 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bab2796e-eda3-468e-8c40-fb62067d7c4f tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 404 len: 111 microversion: 2.1 time: 0.033882 Nov 03 05:10:56.531167 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3709/7527] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:10:56 2022] DELETE /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.536562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.537243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: ae85383b-02c9-4dca-b294-e296fbd8465a] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.543237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.543746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.544314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.545049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.545524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.545983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.560111 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a HTTP/1.1 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'ae85383b-02c9-4dca-b294-e296fbd8465a'} Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.561695 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance ae85383b-02c9-4dca-b294-e296fbd8465a could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ecb53d17-0877-456a-be71-f8b854147aa6 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a" status: 404 len: 111 microversion: 2.1 time: 0.030414 Nov 03 05:10:56.566902 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3819/7528] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:56 2022] GET /compute/v2.1/servers/ae85383b-02c9-4dca-b294-e296fbd8465a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.573319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.574440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.580464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.580900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.581375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.582074 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.582566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.583027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.596337 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd HTTP/1.1 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '0b3b5ccf-de70-4131-9fcb-ce42f15e38dd'} Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.597909 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-67076c1c-bbf2-4c79-9404-2a9f70eb043c tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 404 len: 111 microversion: 2.1 time: 0.029884 Nov 03 05:10:56.603285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3710/7529] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:10:56 2022] DELETE /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.608637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.609305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] [instance: 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:10:56.615273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.615779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.616240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.616953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:10:56.617569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:10:56.618018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:10:56.632093 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] HTTP exception thrown: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Request method failure captured: Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd HTTP/1.1 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY0utaadTxEk1AzMVlFf9-RkczY0_NH0wcEF9gyRjqsRzEkkMIviihnsBjNw_TEuCpJNiwiVKTelBAqkRB0Qy73CVoT2OjvQdXpL1shbxUQKpu9ShrnvUoizjIW3zSeLycOoLevVEPY2ELPJtrj0g-beQX3Z2-gL9kdyMhKMy3aAeBTI Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_945422a884ac43b7995e59a6a331f723", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/945422a884ac43b7995e59a6a331f723"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/945422a884ac43b7995e59a6a331f723"}]}] Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 945422a884ac43b7995e59a6a331f723 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServerActionsTestJSON-344305496 Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: fefb1bf8c01c48efa41fd865ba4e06af Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServerActionsTestJSON-344305496-project Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '0b3b5ccf-de70-4131-9fcb-ce42f15e38dd'} Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:10:56.633694 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Returning 404 to user: Instance 0b3b5ccf-de70-4131-9fcb-ce42f15e38dd could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30b9e981-2d35-4a7b-b8b1-4b86ae47f925 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd" status: 404 len: 111 microversion: 2.1 time: 0.030999 Nov 03 05:10:56.638942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3820/7530] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:10:56 2022] GET /compute/v2.1/servers/0b3b5ccf-de70-4131-9fcb-ce42f15e38dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:10:56.643772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-91e68bf2-27fd-43ab-9854-9305b7af2288 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] Calling method '.version_select at 0x7ff7f9bcff70>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:10:56.725141 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-91e68bf2-27fd-43ab-9854-9305b7af2288 tempest-ServerActionsTestJSON-344305496 tempest-ServerActionsTestJSON-344305496-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-583107862" status: 202 len: 0 microversion: 2.1 time: 0.085077 Nov 03 05:10:56.725768 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3711/7531] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Nov 3 05:10:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-583107862 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:11:08.621036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=27 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:08.622996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=49 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:08.759452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1637457458", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "8875f027-4ea5-41f2-9e1f-9ead47de711b"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:08.815031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] validate_networks() for [('8875f027-4ea5-41f2-9e1f-9ead47de711b', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:11:09.195142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:11:09.195613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:11:09.196149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:11:09.196597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:11:09.197038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:11:09.205883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:09.206380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:09.206826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:09.207561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:09.208027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:09.208472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:09.225799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Getting quotas for project 87eb35bc5f5942b680ccb496165aa8ed. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:11:09.231907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Getting quotas for user 96aee2f5c00648f1b06de82748322a37 and project 87eb35bc5f5942b680ccb496165aa8ed. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:11:09.245253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:11:09.247618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:11:09.376873 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-563c78d1-25a9-4c1e-8276-4fd068078a39 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761523 Nov 03 05:11:09.377607 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3821/7532] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:11:09.387389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:09.388443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:09.393191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41233973-cac7-46e0-a67e-a731780b0511 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:09.394022 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41233973-cac7-46e0-a67e-a731780b0511 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:09.459274 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-41233973-cac7-46e0-a67e-a731780b0511 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:09.462896 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41233973-cac7-46e0-a67e-a731780b0511 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1217 microversion: 2.1 time: 0.077816 Nov 03 05:11:09.463478 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3712/7533] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:09 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:10.490472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:10.491642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:10.499919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:10.500460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:10.500881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:10.501635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:10.502106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:10.502575 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:10.924673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:10.932516 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f566a682-564a-4d06-8706-25f2a77d947a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1221 microversion: 2.1 time: 0.448101 Nov 03 05:11:10.933415 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3822/7534] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:10 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1221 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:11.956329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:11.957944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:11.966941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:11.970794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:11.970794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:11.970794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:11.970794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:11.970794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:12.049481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:12.057708 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d2fce026-698a-4f60-bfad-b4249915135a tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1287 microversion: 2.1 time: 0.105638 Nov 03 05:11:12.058300 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3713/7535] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:11 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:13.081281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:13.082675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:13.089931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:13.090644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:13.091297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:13.092039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:13.092520 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:13.092967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:13.292083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:13.300943 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-265d7f55-c586-421c-be1e-5d9606bf8fe0 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1317 microversion: 2.1 time: 0.223556 Nov 03 05:11:13.305223 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3823/7536] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:13 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:13.437179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-09a73e42-ac51-437b-97fa-2eff77c5932b req-cafc1c6e-54a9-4028-b6dc-0308879fc0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37969b3c-f164-450e-8ca6-711864177ff8", "tag": "e5503417-1a49-4403-8b35-b9b5b77fc773"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:13.447723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-09a73e42-ac51-437b-97fa-2eff77c5932b req-cafc1c6e-54a9-4028-b6dc-0308879fc0d4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:13.448204 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-09a73e42-ac51-437b-97fa-2eff77c5932b req-cafc1c6e-54a9-4028-b6dc-0308879fc0d4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:13.448639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-09a73e42-ac51-437b-97fa-2eff77c5932b req-cafc1c6e-54a9-4028-b6dc-0308879fc0d4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:13.460757 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-09a73e42-ac51-437b-97fa-2eff77c5932b req-cafc1c6e-54a9-4028-b6dc-0308879fc0d4 service nova] Creating event network-changed:e5503417-1a49-4403-8b35-b9b5b77fc773 for instance 37969b3c-f164-450e-8ca6-711864177ff8 on n-h2-854653-7 Nov 03 05:11:13.466729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-09a73e42-ac51-437b-97fa-2eff77c5932b req-cafc1c6e-54a9-4028-b6dc-0308879fc0d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035852 Nov 03 05:11:13.467144 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3714/7537] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:11:14.325939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:14.326523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:14.333432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:14.333932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:14.334389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:14.335095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:14.335631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:14.336121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:14.472335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:14.480498 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2115f4d3-656a-449e-8c81-714855bae043 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1317 microversion: 2.1 time: 0.159110 Nov 03 05:11:14.481541 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3824/7538] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:14 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:15.504728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:15.505867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:15.511905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:15.512386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:15.512821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:15.514994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:15.514994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:15.514994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:15.659696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:15.668498 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-99751e5c-5ec4-4a30-a498-48c3832ca66e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1317 microversion: 2.1 time: 0.168252 Nov 03 05:11:15.670626 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3715/7539] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:15 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:16.691772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:16.692322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:16.699716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:16.700212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:16.700660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:16.701387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:16.701852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:16.702289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:17.087108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:17.094702 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ee77c25-87b7-4cff-97ec-b98f2dbb5ae1 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1317 microversion: 2.1 time: 0.406890 Nov 03 05:11:17.095267 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3825/7540] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:16 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:17.757343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-41863a82-284d-429c-ac11-150c03fe8421 req-79736d06-8765-4805-83d7-edc13f8d6d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37969b3c-f164-450e-8ca6-711864177ff8", "name": "network-vif-plugged", "status": "completed", "tag": "e5503417-1a49-4403-8b35-b9b5b77fc773"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:17.768191 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-41863a82-284d-429c-ac11-150c03fe8421 req-79736d06-8765-4805-83d7-edc13f8d6d22 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:17.768692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-41863a82-284d-429c-ac11-150c03fe8421 req-79736d06-8765-4805-83d7-edc13f8d6d22 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:17.769159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-41863a82-284d-429c-ac11-150c03fe8421 req-79736d06-8765-4805-83d7-edc13f8d6d22 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:17.781091 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-41863a82-284d-429c-ac11-150c03fe8421 req-79736d06-8765-4805-83d7-edc13f8d6d22 service nova] Creating event network-vif-plugged:e5503417-1a49-4403-8b35-b9b5b77fc773 for instance 37969b3c-f164-450e-8ca6-711864177ff8 on n-h2-854653-7 Nov 03 05:11:17.785884 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-41863a82-284d-429c-ac11-150c03fe8421 req-79736d06-8765-4805-83d7-edc13f8d6d22 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032493 Nov 03 05:11:17.786481 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3716/7541] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:11:18.117628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:18.118284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:18.125796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:18.126301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:18.126759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:18.127504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:18.127980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:18.128424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:18.258126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:18.266439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-97b7d14b-f9a6-4e78-92e7-1b1e5f2d1780 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1317 microversion: 2.1 time: 0.152714 Nov 03 05:11:18.267043 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3826/7542] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:18 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:19.290972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:19.291682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:19.298337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:19.298819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:19.299262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:19.299954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:19.300414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:19.300873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:19.434672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:19.442492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ce640d23-4663-47e1-9455-bb6ed6540a01 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1506 microversion: 2.1 time: 0.156690 Nov 03 05:11:19.443055 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3717/7543] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:19 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:19.505594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1101528926", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "8875f027-4ea5-41f2-9e1f-9ead47de711b"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:19.514660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:19.515383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:19.560103 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] validate_networks() for [('8875f027-4ea5-41f2-9e1f-9ead47de711b', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:11:19.924846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:11:19.925318 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:11:19.925839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:11:19.926260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:11:19.926683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:11:19.935267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:19.935758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:19.936206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:19.936941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:19.937439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:19.937878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:19.954798 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Getting quotas for project 87eb35bc5f5942b680ccb496165aa8ed. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:11:19.959830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Getting quotas for user 96aee2f5c00648f1b06de82748322a37 and project 87eb35bc5f5942b680ccb496165aa8ed. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:11:19.972327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:11:19.974465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:11:20.108144 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-203c20af-3747-4fb5-ac9d-a2ba7f3de85d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606546 Nov 03 05:11:20.108715 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3827/7544] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:11:20.121288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c324068f-0253-4c91-8e91-432030557173 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:20.121288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c324068f-0253-4c91-8e91-432030557173 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:20.122710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:20.179123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c324068f-0253-4c91-8e91-432030557173 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:20.186596 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c324068f-0253-4c91-8e91-432030557173 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1217 microversion: 2.1 time: 0.070795 Nov 03 05:11:20.187167 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3718/7545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:20 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:21.209926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:21.210569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:21.218147 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:21.218652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:21.219108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:21.219835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:21.220309 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:21.220759 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:21.282173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:21.289794 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cdef7e34-d749-4e17-abf2-c7b787ef8ca3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1221 microversion: 2.1 time: 0.084792 Nov 03 05:11:21.290359 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3828/7546] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:21 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:22.312663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:22.313403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:22.320999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:22.321513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:22.321952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:22.322659 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:22.323120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:22.323553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:22.388035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:22.395977 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-74bdf061-6328-4158-a621-6c5656228490 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1287 microversion: 2.1 time: 0.088158 Nov 03 05:11:22.396763 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3719/7547] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:22 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:23.419785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:23.420427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:23.426925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:23.427439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:23.430028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:23.430028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:23.430028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:23.430028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:23.568691 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:23.576576 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0273c1bd-1dea-472a-9095-6bb76652763b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1317 microversion: 2.1 time: 0.160872 Nov 03 05:11:23.577171 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3829/7548] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:23 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:23.669543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1c99f338-fe4a-4389-ae7a-5b59233f21d7 req-b953d9f6-ed80-49a8-b292-712c61d2dca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89c5b3b4-5682-451f-99b9-03446292a017", "tag": "66c01365-35e2-4145-b052-6541b21401e5"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:23.683865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1c99f338-fe4a-4389-ae7a-5b59233f21d7 req-b953d9f6-ed80-49a8-b292-712c61d2dca2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:23.684385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1c99f338-fe4a-4389-ae7a-5b59233f21d7 req-b953d9f6-ed80-49a8-b292-712c61d2dca2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:23.685373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1c99f338-fe4a-4389-ae7a-5b59233f21d7 req-b953d9f6-ed80-49a8-b292-712c61d2dca2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:23.966441 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1c99f338-fe4a-4389-ae7a-5b59233f21d7 req-b953d9f6-ed80-49a8-b292-712c61d2dca2 service nova] Creating event network-changed:66c01365-35e2-4145-b052-6541b21401e5 for instance 89c5b3b4-5682-451f-99b9-03446292a017 on n-h1-854653-7 Nov 03 05:11:23.971390 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1c99f338-fe4a-4389-ae7a-5b59233f21d7 req-b953d9f6-ed80-49a8-b292-712c61d2dca2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.306297 Nov 03 05:11:23.972109 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3720/7549] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:11:24.599650 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:24.600285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:24.607136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:24.607638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:24.608097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:24.608805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:24.609313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:24.609758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:24.744989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:24.753353 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8c7a062f-b4e3-41bb-8e12-6e36cf17350c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1317 microversion: 2.1 time: 0.157669 Nov 03 05:11:24.753918 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3830/7550] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:24 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:25.777568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:25.778299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:25.784481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:25.784973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:25.785447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:25.786148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:25.786611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:25.787046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:25.920345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:25.927916 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d42d6fad-a7bb-4e68-b64c-be774fe0645d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1317 microversion: 2.1 time: 0.155821 Nov 03 05:11:25.928468 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3721/7551] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:25 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:11:26.950858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:26.952032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:26.958935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:26.959433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:26.959888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:26.960593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:26.961088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:26.961532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:27.091913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:27.100184 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e7644b78-8ae6-4a02-8e3b-d0f034b256ed tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1317 microversion: 2.1 time: 0.153513 Nov 03 05:11:27.100751 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3831/7552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:26 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:28.122887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:28.123511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:28.130370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:28.130865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:28.131308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:28.132011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:28.132472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:28.132905 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:28.263612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:28.271409 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6fb67bf4-06df-445b-bd7a-64aca893a39d tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1317 microversion: 2.1 time: 0.152451 Nov 03 05:11:28.272095 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3722/7553] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:28 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:29.295700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:29.296337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:29.303255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:29.303772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:29.304231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:29.304942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:29.305441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:29.305892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:29.439618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:29.445604 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-04e9d635-5fab-4312-bedb-2adebe77f3cd tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1317 microversion: 2.1 time: 0.154339 Nov 03 05:11:29.446177 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3832/7554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:29 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:29.895702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b86456b0-1f38-4c3a-af99-d8ba05e0ad35 req-76bda267-5108-4830-a2fb-99d995202cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c5b3b4-5682-451f-99b9-03446292a017", "name": "network-vif-plugged", "status": "completed", "tag": "66c01365-35e2-4145-b052-6541b21401e5"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:29.906985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b86456b0-1f38-4c3a-af99-d8ba05e0ad35 req-76bda267-5108-4830-a2fb-99d995202cd3 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:29.907558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b86456b0-1f38-4c3a-af99-d8ba05e0ad35 req-76bda267-5108-4830-a2fb-99d995202cd3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:29.908002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b86456b0-1f38-4c3a-af99-d8ba05e0ad35 req-76bda267-5108-4830-a2fb-99d995202cd3 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:29.919292 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b86456b0-1f38-4c3a-af99-d8ba05e0ad35 req-76bda267-5108-4830-a2fb-99d995202cd3 service nova] Creating event network-vif-plugged:66c01365-35e2-4145-b052-6541b21401e5 for instance 89c5b3b4-5682-451f-99b9-03446292a017 on n-h1-854653-7 Nov 03 05:11:29.924582 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b86456b0-1f38-4c3a-af99-d8ba05e0ad35 req-76bda267-5108-4830-a2fb-99d995202cd3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032704 Nov 03 05:11:29.925225 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3723/7555] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:11:30.468258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:30.468917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:30.470978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:30.471633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:30.477261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:30.477760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:30.478218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:30.478925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:30.479424 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:30.479873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:30.609325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:30.617114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ff8d866-b8cf-4f95-a426-64997eaede69 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1317 microversion: 2.1 time: 0.153264 Nov 03 05:11:30.617676 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3833/7556] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:30 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:31.640138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:31.640844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:31.647900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:31.648381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:31.648816 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:31.649550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:31.650005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:31.654349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:31.788531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:31.796414 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4df211c3-586c-4748-8336-9887056843d8 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1506 microversion: 2.1 time: 0.161018 Nov 03 05:11:31.796974 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3724/7557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:31 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:31.820799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:31.821399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:31.828960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:31.829479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:31.829931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:31.830686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:31.831155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:31.831614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:31.859777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:11:32.192224 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9629e73d-6c7e-4ed6-bb48-d20fca3801a4 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 204 len: 0 microversion: 2.1 time: 0.374895 Nov 03 05:11:32.192774 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3834/7558] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:11:31 2022] DELETE /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:11:32.201052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:32.201748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:32.208296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:32.208792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:32.209267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:32.211907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:32.211907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:32.211907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:32.321085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:32.342961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:32.350845 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3776a3aa-0ae8-4e92-8b9d-dec3c1ef1574 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1512 microversion: 2.1 time: 0.153800 Nov 03 05:11:32.351421 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3725/7559] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:32 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:33.376001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:33.376730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:33.383811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:33.384317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:33.384778 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:33.385590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:33.386063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:33.386510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:33.523263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:33.531261 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f0c9caed-d359-48f4-b38e-0170f03afb00 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1512 microversion: 2.1 time: 0.160283 Nov 03 05:11:33.531819 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3835/7560] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:33 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:34.155686 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-06d69fe6-57b5-4655-8c8b-076ce81fc7bc req-a1df26c3-667f-4f89-a81c-40b6865db508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89c5b3b4-5682-451f-99b9-03446292a017", "name": "network-vif-deleted", "tag": "66c01365-35e2-4145-b052-6541b21401e5"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:34.166657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-06d69fe6-57b5-4655-8c8b-076ce81fc7bc req-a1df26c3-667f-4f89-a81c-40b6865db508 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:34.167056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-06d69fe6-57b5-4655-8c8b-076ce81fc7bc req-a1df26c3-667f-4f89-a81c-40b6865db508 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:34.167487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-06d69fe6-57b5-4655-8c8b-076ce81fc7bc req-a1df26c3-667f-4f89-a81c-40b6865db508 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:34.184073 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-06d69fe6-57b5-4655-8c8b-076ce81fc7bc req-a1df26c3-667f-4f89-a81c-40b6865db508 service nova] Creating event network-vif-deleted:66c01365-35e2-4145-b052-6541b21401e5 for instance 89c5b3b4-5682-451f-99b9-03446292a017 on n-h1-854653-7 Nov 03 05:11:34.190036 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-06d69fe6-57b5-4655-8c8b-076ce81fc7bc req-a1df26c3-667f-4f89-a81c-40b6865db508 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038017 Nov 03 05:11:34.190605 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3726/7561] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:11:34.553396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:34.554104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:34.561968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:34.562655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:34.563018 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:34.563742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:34.564224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:34.564674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:34.598970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:34.599477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:34.599937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:34.600406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lazy-loading 'fault' on Instance uuid 89c5b3b4-5682-451f-99b9-03446292a017 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:11:34.642647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:34.646300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:34.651243 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d354053-499d-4a6b-9142-40acf9fdf77b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 200 len: 1307 microversion: 2.1 time: 0.101964 Nov 03 05:11:34.651820 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3836/7562] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:34 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:35.676258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:35.676817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:35.683461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:35.683966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:35.684407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:35.685142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:35.686198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:35.686853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:35.702954 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] HTTP exception thrown: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Request method failure captured: Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 HTTP/1.1 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY01sJNkFG5V7Ciu04GelBdGygq9_iVuNf1wnz-P5p1P__cjRkOeNIzLcHBr65fYElvEPboDJNVz_zmF7cHmr-0o_2G5I108YdF34uOlo0kkrbepK6MCbGd_p1oVvLART4RcyDwq_rfH83k3AnE6XTwWx_c_PCU8btnY7U0ab0T6QN8g Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_87eb35bc5f5942b680ccb496165aa8ed", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/87eb35bc5f5942b680ccb496165aa8ed"}]}] Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 96aee2f5c00648f1b06de82748322a37 Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '89c5b3b4-5682-451f-99b9-03446292a017'} Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:35.704900 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Returning 404 to user: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e834c5ac-bf6c-4e40-a41b-aa0b11de5e63 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 404 len: 111 microversion: 2.1 time: 0.035934 Nov 03 05:11:35.713231 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3727/7563] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:35 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:11:35.717126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:35.717763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:35.725077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:35.725586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:35.726046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:35.726763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:35.727240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:35.727689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:35.856289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:35.864827 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-559079f4-30a2-4c7d-9f83-be6c457fd863 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1506 microversion: 2.1 time: 0.152258 Nov 03 05:11:35.865430 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3837/7564] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:35 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:35.886874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a91b095d-7ba2-40fa-a31f-bcdfc06e2cdf tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:35.889670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a91b095d-7ba2-40fa-a31f-bcdfc06e2cdf tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 5d71d04f-ca74-4c50-91a1-36fd75e00dc5] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:35.895144 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-a91b095d-7ba2-40fa-a31f-bcdfc06e2cdf tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] HTTP exception thrown: Instance 5d71d04f-ca74-4c50-91a1-36fd75e00dc5 could not be found. Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a91b095d-7ba2-40fa-a31f-bcdfc06e2cdf tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Request method failure captured: Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/5d71d04f-ca74-4c50-91a1-36fd75e00dc5/action HTTP/1.1 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 32 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY01sJNkFG5V7Ciu04GelBdGygq9_iVuNf1wnz-P5p1P__cjRkOeNIzLcHBr65fYElvEPboDJNVz_zmF7cHmr-0o_2G5I108YdF34uOlo0kkrbepK6MCbGd_p1oVvLART4RcyDwq_rfH83k3AnE6XTwWx_c_PCU8btnY7U0ab0T6QN8g Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_87eb35bc5f5942b680ccb496165aa8ed", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/87eb35bc5f5942b680ccb496165aa8ed"}]}] Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 96aee2f5c00648f1b06de82748322a37 Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: {"resize": {"flavorRef": "452"}} Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 5d71d04f-ca74-4c50-91a1-36fd75e00dc5 could not be found. Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '5d71d04f-ca74-4c50-91a1-36fd75e00dc5', 'body': {'resize': {'flavorRef': '452'}}} Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d71d04f-ca74-4c50-91a1-36fd75e00dc5 could not be found. Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:11:35.896723 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d71d04f-ca74-4c50-91a1-36fd75e00dc5 could not be found. Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d71d04f-ca74-4c50-91a1-36fd75e00dc5 could not be found. Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a91b095d-7ba2-40fa-a31f-bcdfc06e2cdf tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Returning 404 to user: Instance 5d71d04f-ca74-4c50-91a1-36fd75e00dc5 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a91b095d-7ba2-40fa-a31f-bcdfc06e2cdf tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "POST /compute/v2.1/servers/5d71d04f-ca74-4c50-91a1-36fd75e00dc5/action" status: 404 len: 111 microversion: 2.1 time: 0.015306 Nov 03 05:11:35.902112 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3728/7565] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:11:35 2022] POST /compute/v2.1/servers/5d71d04f-ca74-4c50-91a1-36fd75e00dc5/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:11:35.907693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:35.908336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:35.914990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:35.914990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:35.915393 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:35.916116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:35.916597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:35.917121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.047734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:36.055591 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2ed6005a-5987-4dc3-9e70-3d801b60490b tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1506 microversion: 2.1 time: 0.152439 Nov 03 05:11:36.056180 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3838/7566] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:35 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:36.078763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:36.079383 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.086230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.086718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.087160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.087854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.088316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.088748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.217433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:36.225327 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f81df868-a0b6-47eb-8f39-135a112d7033 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1506 microversion: 2.1 time: 0.150914 Nov 03 05:11:36.225909 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3729/7567] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:36 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:36.248681 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "665a689c-87d9-4135-b3ec-5e32524add87"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:36.251041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.256944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.257472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.257924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.258629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.259098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.259542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.299104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:36.304083 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] HTTP exception thrown: Flavor 665a689c-87d9-4135-b3ec-5e32524add87 could not be found. Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Request method failure captured: Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: request: POST /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8/action HTTP/1.1 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 65 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY01sJNkFG5V7Ciu04GelBdGygq9_iVuNf1wnz-P5p1P__cjRkOeNIzLcHBr65fYElvEPboDJNVz_zmF7cHmr-0o_2G5I108YdF34uOlo0kkrbepK6MCbGd_p1oVvLART4RcyDwq_rfH83k3AnE6XTwWx_c_PCU8btnY7U0ab0T6QN8g Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_87eb35bc5f5942b680ccb496165aa8ed", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/87eb35bc5f5942b680ccb496165aa8ed"}]}] Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 96aee2f5c00648f1b06de82748322a37 Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: {"resize": {"flavorRef": "665a689c-87d9-4135-b3ec-5e32524add87"}} Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: exception: Flavor 665a689c-87d9-4135-b3ec-5e32524add87 could not be found. Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '37969b3c-f164-450e-8ca6-711864177ff8', 'body': {'resize': {'flavorRef': '665a689c-87d9-4135-b3ec-5e32524add87'}}} Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:36.312625 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 665a689c-87d9-4135-b3ec-5e32524add87 could not be found. Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 665a689c-87d9-4135-b3ec-5e32524add87 could not be found. Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 665a689c-87d9-4135-b3ec-5e32524add87 could not be found. Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Returning 400 to user: Flavor 665a689c-87d9-4135-b3ec-5e32524add87 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e299d0d-3c93-4693-882a-1655c6829948 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "POST /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8/action" status: 400 len: 107 microversion: 2.1 time: 0.070150 Nov 03 05:11:36.317594 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3839/7568] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:11:36 2022] POST /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8/action => generated 107 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 05:11:36.322741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:36.323380 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.329827 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.330310 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.330747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.331433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.331885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.332309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.459769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:36.467440 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eda767d3-bd70-40d0-b945-6f989c674a94 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1506 microversion: 2.1 time: 0.148489 Nov 03 05:11:36.469131 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3730/7569] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:36 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:36.490736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:36.491420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.497401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.498486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.498994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.499655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.500130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.500577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.634842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:36.642625 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3a2dfe8-3bdf-4469-82b7-a0bf90ffb9ef tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1506 microversion: 2.1 time: 0.155809 Nov 03 05:11:36.643202 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3840/7570] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:36 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:36.664812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32ea932c-d44d-4ed8-8f05-701e240165fa tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32ea932c-d44d-4ed8-8f05-701e240165fa tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Request method failure captured: Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: request: POST /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8/action HTTP/1.1 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 29 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY01sJNkFG5V7Ciu04GelBdGygq9_iVuNf1wnz-P5p1P__cjRkOeNIzLcHBr65fYElvEPboDJNVz_zmF7cHmr-0o_2G5I108YdF34uOlo0kkrbepK6MCbGd_p1oVvLART4RcyDwq_rfH83k3AnE6XTwWx_c_PCU8btnY7U0ab0T6QN8g Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_87eb35bc5f5942b680ccb496165aa8ed", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/87eb35bc5f5942b680ccb496165aa8ed"}]}] Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 96aee2f5c00648f1b06de82748322a37 Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: {"resize": {"flavorRef": ""}} Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '37969b3c-f164-450e-8ca6-711864177ff8', 'body': {'resize': {'flavorRef': ''}}} Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise error Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi On instance['resize']: Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi '' Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.668424 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-32ea932c-d44d-4ed8-8f05-701e240165fa tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-32ea932c-d44d-4ed8-8f05-701e240165fa tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "POST /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8/action" status: 400 len: 113 microversion: 2.1 time: 0.009060 Nov 03 05:11:36.674611 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3731/7571] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:11:36 2022] POST /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 03 05:11:36.678875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:36.679524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.685670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.686170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.686618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.687321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.687792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.688237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.815525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:36.823200 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d6364abe-269b-4f17-b37d-2c8ef781087c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1506 microversion: 2.1 time: 0.148141 Nov 03 05:11:36.823763 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3841/7572] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:36 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:36.850269 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:36.850790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.858019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.858508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.858953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.859648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.860109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.860589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.873639 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] HTTP exception thrown: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Request method failure captured: Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 HTTP/1.1 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY01sJNkFG5V7Ciu04GelBdGygq9_iVuNf1wnz-P5p1P__cjRkOeNIzLcHBr65fYElvEPboDJNVz_zmF7cHmr-0o_2G5I108YdF34uOlo0kkrbepK6MCbGd_p1oVvLART4RcyDwq_rfH83k3AnE6XTwWx_c_PCU8btnY7U0ab0T6QN8g Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_87eb35bc5f5942b680ccb496165aa8ed", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/87eb35bc5f5942b680ccb496165aa8ed"}]}] Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 96aee2f5c00648f1b06de82748322a37 Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '89c5b3b4-5682-451f-99b9-03446292a017'} Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:11:36.875210 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Returning 404 to user: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1080104-989a-4023-83b2-28d1ac61a36e tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "DELETE /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 404 len: 111 microversion: 2.1 time: 0.031177 Nov 03 05:11:36.879158 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3732/7573] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:11:36 2022] DELETE /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:11:36.885288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:36.885924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 89c5b3b4-5682-451f-99b9-03446292a017] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.892337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.895006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.895006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.895006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.895006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.895006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.909556 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] HTTP exception thrown: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Request method failure captured: Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 HTTP/1.1 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY01sJNkFG5V7Ciu04GelBdGygq9_iVuNf1wnz-P5p1P__cjRkOeNIzLcHBr65fYElvEPboDJNVz_zmF7cHmr-0o_2G5I108YdF34uOlo0kkrbepK6MCbGd_p1oVvLART4RcyDwq_rfH83k3AnE6XTwWx_c_PCU8btnY7U0ab0T6QN8g Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_87eb35bc5f5942b680ccb496165aa8ed", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/87eb35bc5f5942b680ccb496165aa8ed"}]}] Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 96aee2f5c00648f1b06de82748322a37 Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '89c5b3b4-5682-451f-99b9-03446292a017'} Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:36.911125 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Returning 404 to user: Instance 89c5b3b4-5682-451f-99b9-03446292a017 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5661f7dc-9e41-4813-a5e7-fcc935f9d305 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017" status: 404 len: 111 microversion: 2.1 time: 0.031244 Nov 03 05:11:36.915551 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3842/7574] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:36 2022] GET /compute/v2.1/servers/89c5b3b4-5682-451f-99b9-03446292a017 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:11:36.921141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:36.921646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:36.927631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.928113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.928548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.929261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:36.929718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:36.930144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:36.954875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:11:37.205992 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-135c8db4-a75e-413d-8647-e25b0ab4b52c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "DELETE /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 204 len: 0 microversion: 2.1 time: 0.288355 Nov 03 05:11:37.206501 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3733/7575] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:11:36 2022] DELETE /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:11:37.214647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:37.215291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:37.222265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:37.222771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:37.223241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:37.224083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:37.224567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:37.225043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:37.355470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:37.363747 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90a01663-e80a-4d97-89d2-6087b47a8651 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1512 microversion: 2.1 time: 0.153076 Nov 03 05:11:37.364308 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3843/7576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:37 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:38.388046 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:38.390171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:38.397385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:38.397879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:38.398319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:38.399014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:38.399472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:38.399921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:38.530681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:38.538576 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6d4494dd-f6a8-4325-910d-5f6b2113ff9c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1512 microversion: 2.1 time: 0.154855 Nov 03 05:11:38.539147 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3734/7577] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:38 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:39.179488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-76b7ba84-5041-4488-b55b-a2b4c3a04701 req-de792e6b-23ea-477b-92af-e5e420ff3eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37969b3c-f164-450e-8ca6-711864177ff8", "name": "network-vif-deleted", "tag": "e5503417-1a49-4403-8b35-b9b5b77fc773"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:11:39.186848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:39.192511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-76b7ba84-5041-4488-b55b-a2b4c3a04701 req-de792e6b-23ea-477b-92af-e5e420ff3eed service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:39.193064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-76b7ba84-5041-4488-b55b-a2b4c3a04701 req-de792e6b-23ea-477b-92af-e5e420ff3eed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:39.193579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-76b7ba84-5041-4488-b55b-a2b4c3a04701 req-de792e6b-23ea-477b-92af-e5e420ff3eed service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:39.208360 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-76b7ba84-5041-4488-b55b-a2b4c3a04701 req-de792e6b-23ea-477b-92af-e5e420ff3eed service nova] Creating event network-vif-deleted:e5503417-1a49-4403-8b35-b9b5b77fc773 for instance 37969b3c-f164-450e-8ca6-711864177ff8 on n-h2-854653-7 Nov 03 05:11:39.214599 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-76b7ba84-5041-4488-b55b-a2b4c3a04701 req-de792e6b-23ea-477b-92af-e5e420ff3eed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038908 Nov 03 05:11:39.215205 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3844/7578] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:11:39.560927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:39.561627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:39.568436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:39.571388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:39.571388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:39.571388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:39.571388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:39.571388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:39.593553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:11:39.605431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:39.605964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:39.606411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:39.606872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lazy-loading 'fault' on Instance uuid 37969b3c-f164-450e-8ca6-711864177ff8 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:11:39.649346 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96aee2f5c00648f1b06de82748322a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87eb35bc5f5942b680ccb496165aa8ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:11:39.659244 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7efb77d8-f205-4bb8-a46a-51568b3acc4c tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 200 len: 1307 microversion: 2.1 time: 0.101807 Nov 03 05:11:39.659814 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3735/7579] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:39 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:11:40.684796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:11:40.685532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] [instance: 37969b3c-f164-450e-8ca6-711864177ff8] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:11:40.691911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:40.692454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:40.692897 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:40.693632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:11:40.694100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:11:40.694541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:11:40.708327 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] HTTP exception thrown: Instance 37969b3c-f164-450e-8ca6-711864177ff8 could not be found. Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Request method failure captured: Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 HTTP/1.1 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY01sJNkFG5V7Ciu04GelBdGygq9_iVuNf1wnz-P5p1P__cjRkOeNIzLcHBr65fYElvEPboDJNVz_zmF7cHmr-0o_2G5I108YdF34uOlo0kkrbepK6MCbGd_p1oVvLART4RcyDwq_rfH83k3AnE6XTwWx_c_PCU8btnY7U0ab0T6QN8g Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_87eb35bc5f5942b680ccb496165aa8ed", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/87eb35bc5f5942b680ccb496165aa8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/87eb35bc5f5942b680ccb496165aa8ed"}]}] Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 87eb35bc5f5942b680ccb496165aa8ed Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-ServersNegativeTestJSON-580023041 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 96aee2f5c00648f1b06de82748322a37 Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-ServersNegativeTestJSON-580023041-project Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 37969b3c-f164-450e-8ca6-711864177ff8 could not be found. Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '37969b3c-f164-450e-8ca6-711864177ff8'} Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37969b3c-f164-450e-8ca6-711864177ff8 could not be found. Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37969b3c-f164-450e-8ca6-711864177ff8 could not be found. Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:11:40.710029 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37969b3c-f164-450e-8ca6-711864177ff8 could not be found. Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] Returning 404 to user: Instance 37969b3c-f164-450e-8ca6-711864177ff8 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3baf56d9-68a5-4db7-8578-ce979de9b4d3 tempest-ServersNegativeTestJSON-580023041 tempest-ServersNegativeTestJSON-580023041-project] 10.222.0.30 "GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8" status: 404 len: 111 microversion: 2.1 time: 0.033115 Nov 03 05:11:40.715221 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3845/7580] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:11:40 2022] GET /compute/v2.1/servers/37969b3c-f164-450e-8ca6-711864177ff8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:12:24.532892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:24.718441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d3a18c80-1948-4fce-9352-e89edaa02d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: .version_select at 0x7ff7fd488430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1365044487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtHstAA1luSlyGUxk2eWmoAgYBPGc8Z2yWKBLa0peHXmThmusiJAfVyVhZjupDE7uJ4dbILPaGheI0tV0nooCby7x4EzB2RyttMdb4oCCLtisHk1GCyQH4efMOdK2vM5w=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:12:24.735432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-d3a18c80-1948-4fce-9352-e89edaa02d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for project 919e08eb93f54139a2092b4859edb1e9. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:12:24.740713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-d3a18c80-1948-4fce-9352-e89edaa02d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for user d1a9e065576742a2befe840781ac8cb5 and project 919e08eb93f54139a2092b4859edb1e9. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:12:24.886365 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d3a18c80-1948-4fce-9352-e89edaa02d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.359696 Nov 03 05:12:24.886896 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3736/7581] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:12:24 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:12:24.939656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1431191034", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1365044487", "networks": [{"uuid": "cd065d03-22f2-4648-af85-0b60721ede8f"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:12:24.949432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=40 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:24.999795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] validate_networks() for [('cd065d03-22f2-4648-af85-0b60721ede8f', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:12:25.400983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:12:25.401358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:12:25.401858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:12:25.402346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:12:25.402779 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:12:25.412207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:25.412709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:25.413203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:25.413960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:25.414435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:25.414892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:25.435236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for project 919e08eb93f54139a2092b4859edb1e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:12:25.440689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for user d1a9e065576742a2befe840781ac8cb5 and project 919e08eb93f54139a2092b4859edb1e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:12:25.453181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:12:25.456104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:12:25.582641 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f08bdeb3-6609-42bd-99f9-f4da05fb4b68 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647040 Nov 03 05:12:25.583644 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3846/7582] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:12:25.595437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1c67324e-eb4c-407d-919a-541206df63be tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:25.596044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1c67324e-eb4c-407d-919a-541206df63be tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:25.650952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1c67324e-eb4c-407d-919a-541206df63be tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:25.659195 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1c67324e-eb4c-407d-919a-541206df63be tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1263 microversion: 2.1 time: 0.068655 Nov 03 05:12:25.659760 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3737/7583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:25 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1263 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:26.686907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7db57934-5bb3-4043-9d22-faf4afd4e61d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:26.688683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7db57934-5bb3-4043-9d22-faf4afd4e61d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:26.760231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7db57934-5bb3-4043-9d22-faf4afd4e61d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:26.770366 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7db57934-5bb3-4043-9d22-faf4afd4e61d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1263 microversion: 2.1 time: 0.091009 Nov 03 05:12:26.771122 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3847/7584] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:26 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1263 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:27.794247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:27.794863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:27.802376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:27.802800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:27.803273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:27.803991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:27.804453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:27.804884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:27.869432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:27.877616 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ac7a6d6d-6b9d-4e50-9ca4-8685476f22a2 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1315 microversion: 2.1 time: 0.087446 Nov 03 05:12:27.878202 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3738/7585] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:27 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1315 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:28.906050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:28.906662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:28.913923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:28.914430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:28.914884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:28.915601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:28.916070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:28.916615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:29.143337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:29.152011 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-690871fd-2aa6-4dcb-a108-6f0db2b98f38 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1363 microversion: 2.1 time: 0.250494 Nov 03 05:12:29.165342 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3848/7586] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:28 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:29.799973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-31e1722d-9465-4c20-bb23-ba6719e77ebd req-f84f8577-2830-4eb7-81f3-f30cd901912f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50aff98-f2c5-42d7-b7bf-437a6309d78c", "tag": "20cda802-2838-4bfa-b300-b5cdd988f6bc"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:12:29.819328 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-31e1722d-9465-4c20-bb23-ba6719e77ebd req-f84f8577-2830-4eb7-81f3-f30cd901912f service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:29.819919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-31e1722d-9465-4c20-bb23-ba6719e77ebd req-f84f8577-2830-4eb7-81f3-f30cd901912f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:29.820362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-31e1722d-9465-4c20-bb23-ba6719e77ebd req-f84f8577-2830-4eb7-81f3-f30cd901912f service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:29.832384 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-31e1722d-9465-4c20-bb23-ba6719e77ebd req-f84f8577-2830-4eb7-81f3-f30cd901912f service nova] Creating event network-changed:20cda802-2838-4bfa-b300-b5cdd988f6bc for instance a50aff98-f2c5-42d7-b7bf-437a6309d78c on n-h2-854653-7 Nov 03 05:12:29.837928 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-31e1722d-9465-4c20-bb23-ba6719e77ebd req-f84f8577-2830-4eb7-81f3-f30cd901912f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041720 Nov 03 05:12:29.838525 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3739/7587] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:12:30.176057 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:30.176799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:30.183938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:30.185055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:30.185597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:30.186436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:30.186917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:30.187370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:30.409898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:30.417955 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a8c77e21-5f0e-4d12-91e2-62d8535808c6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1363 microversion: 2.1 time: 0.245964 Nov 03 05:12:30.419100 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3849/7588] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:30 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:31.441963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:31.442656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:31.450454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:31.450937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:31.451371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:31.452058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:31.452512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:31.452933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:31.586757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:31.595114 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cb984dc2-9876-4db6-90e0-51e6954e67d3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1363 microversion: 2.1 time: 0.157467 Nov 03 05:12:31.595675 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3740/7589] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:31 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:32.618199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:32.618839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:32.626322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:32.626832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:32.627293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:32.628040 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:32.628517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:32.628968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:32.756254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:32.764600 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-953d14aa-18c9-4326-8d24-302b8fbd61ae tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1363 microversion: 2.1 time: 0.150428 Nov 03 05:12:32.765365 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3850/7590] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:32 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:33.788355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:33.789394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:33.797122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:33.798615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:33.799410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:33.800528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:33.800635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:33.800976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:33.944186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:33.952446 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c3416fe4-d2eb-429f-92a4-03db253b313c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1363 microversion: 2.1 time: 0.167967 Nov 03 05:12:33.953108 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3741/7591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:33 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:34.064749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-ce69f697-bb36-4cda-99a9-048301241902 req-4bd39fe3-a7c4-4813-80f4-78b97800d65c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50aff98-f2c5-42d7-b7bf-437a6309d78c", "name": "network-vif-plugged", "status": "completed", "tag": "20cda802-2838-4bfa-b300-b5cdd988f6bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:12:34.076340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ce69f697-bb36-4cda-99a9-048301241902 req-4bd39fe3-a7c4-4813-80f4-78b97800d65c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:34.076841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ce69f697-bb36-4cda-99a9-048301241902 req-4bd39fe3-a7c4-4813-80f4-78b97800d65c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:34.077432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-ce69f697-bb36-4cda-99a9-048301241902 req-4bd39fe3-a7c4-4813-80f4-78b97800d65c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:34.088651 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-ce69f697-bb36-4cda-99a9-048301241902 req-4bd39fe3-a7c4-4813-80f4-78b97800d65c service nova] Creating event network-vif-plugged:20cda802-2838-4bfa-b300-b5cdd988f6bc for instance a50aff98-f2c5-42d7-b7bf-437a6309d78c on n-h2-854653-7 Nov 03 05:12:34.095340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-ce69f697-bb36-4cda-99a9-048301241902 req-4bd39fe3-a7c4-4813-80f4-78b97800d65c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034495 Nov 03 05:12:34.096011 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3851/7592] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:12:34.975794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:34.976306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:34.983205 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:34.983751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:34.984188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:34.984889 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:34.985387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:34.991472 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:35.122772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:35.130904 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be531da2-94ab-44ea-93d8-a94222231070 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1363 microversion: 2.1 time: 0.159141 Nov 03 05:12:35.131482 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3742/7593] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:34 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:36.153392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:36.157731 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:36.158451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:36.164475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:36.168704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:36.168704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:36.168704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:36.168704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:36.168704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:36.300903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:36.309162 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b036afc4-6d6b-43ac-8dfe-e61bf62e43da tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1555 microversion: 2.1 time: 0.157984 Nov 03 05:12:36.309749 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3852/7594] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:36 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:36.331731 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:36.332358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:36.334375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:36.340125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:36.340615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:36.341084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:36.345997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:36.345997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:36.345997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:36.473313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:12:36.481348 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f331f1ef-84da-48a2-972c-049eec4c0365 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1555 microversion: 2.1 time: 0.153419 Nov 03 05:12:36.481936 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3743/7595] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:12:36 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:12:39.720314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e26ff091-f647-4413-8871-585924234a43"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:12:39.722819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:39.724717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:39.730394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:39.731473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:39.731943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:39.732640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:39.733137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:39.733586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:40.500231 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9f57aae4-b035-4de9-9306-5973e1c965f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783776 Nov 03 05:12:40.500858 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3853/7596] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 05:12:39 2022] POST /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments => generated 194 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:12:52.258366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:52.258855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:52.261689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:52.262415 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=36 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:52.267150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:52.267658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:52.268100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:52.268794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:52.269614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:52.270048 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:52.349868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lazy-loading 'services' on Instance uuid a50aff98-f2c5-42d7-b7bf-437a6309d78c {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:12:52.545646 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-60ed1c0a-3e25-472d-8c7e-252c74e95d55 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments/e26ff091-f647-4413-8871-585924234a43" status: 202 len: 0 microversion: 2.1 time: 0.290969 Nov 03 05:12:52.546243 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3744/7597] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:12:52 2022] DELETE /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments/e26ff091-f647-4413-8871-585924234a43 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:12:52.552842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:52.556935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:12:52.558212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:52.560605 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:52.566705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:52.567243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:52.567728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:52.568447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:52.568923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:52.569399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:52.600127 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-313ae7a1-1a36-40d4-8959-a91516379cfa tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049174 Nov 03 05:12:52.600683 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3854/7598] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:12:52 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:12:53.613952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:53.616384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:53.623344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:53.623773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:53.624219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:53.624927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:53.625416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:53.625847 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:53.656547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9764af9c-aff9-44f8-8a72-749bbb335ba3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047798 Nov 03 05:12:53.657142 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3745/7599] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:12:53 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:12:54.669914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:54.672142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:54.680861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:54.681392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:54.681852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:54.682583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:54.683054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:54.683496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:54.716834 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d9d9bba-8fab-455b-93e5-5f2782a0f083 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051295 Nov 03 05:12:54.717434 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3855/7600] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:12:54 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:12:55.729585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:55.731874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:55.738832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:55.739326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:55.739772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:55.740476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:55.740934 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:55.741406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:55.771878 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-790e9beb-5df1-45cf-9ff5-019e842f4485 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046201 Nov 03 05:12:55.772349 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3746/7601] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:12:55 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:12:56.784929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:56.788008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:56.797052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:56.797792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:56.798317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:56.799146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:56.800392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:56.800921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:56.839387 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d1863cc-d5c3-494c-a7c1-8bc23eeb7372 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058457 Nov 03 05:12:56.842044 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3856/7602] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:12:56 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:12:57.853564 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:57.855715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:57.862447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:57.862929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:57.863366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:57.864058 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:57.864519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:57.864942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:57.893632 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e0887500-b134-4960-90ec-e5f9b1f8ba66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044143 Nov 03 05:12:57.894186 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3747/7603] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:12:57 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 05:12:57.905934 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:12:57.906459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:12:57.913380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:57.913871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:57.914428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:57.915044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:12:57.915515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:12:57.915962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:12:57.996300 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] HTTP exception thrown: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c is not attached to volume e26ff091-f647-4413-8871-585924234a43 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Request method failure captured: Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments/e26ff091-f647-4413-8871-585924234a43 HTTP/1.1 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY02xdoSdMKdKqFtdmYeZyc3JvbWGvMei65QAieppicwoDtn-7x0H3iOd5HXZBLI_663w2dTw-748J0WbP6AB-FtYgtL3YQcqV2waKca3AJpOzCRomGtRzVLIi1Ow0szu23ujzVCCcC-XnC8sEg_TTTkAR321-qm6pfuAy1MM2KM8hqY Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_919e08eb93f54139a2092b4859edb1e9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/919e08eb93f54139a2092b4859edb1e9"}]}] Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d1a9e065576742a2befe840781ac8cb5 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c is not attached to volume e26ff091-f647-4413-8871-585924234a43 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': 'a50aff98-f2c5-42d7-b7bf-437a6309d78c', 'id': 'e26ff091-f647-4413-8871-585924234a43'} Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e26ff091-f647-4413-8871-585924234a43. Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c is not attached to volume e26ff091-f647-4413-8871-585924234a43 Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:12:58.003517 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:12:58.008194 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:12:58.008194 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:12:58.008194 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c is not attached to volume e26ff091-f647-4413-8871-585924234a43 Nov 03 05:12:58.008194 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:12:58.008194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Returning 404 to user: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c is not attached to volume e26ff091-f647-4413-8871-585924234a43 {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:12:58.008194 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b237ce7b-04be-4fce-a66f-5ee98fb33b0a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments/e26ff091-f647-4413-8871-585924234a43" status: 404 len: 154 microversion: 2.1 time: 0.104187 Nov 03 05:12:58.008194 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3857/7604] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:12:57 2022] DELETE /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c/os-volume_attachments/e26ff091-f647-4413-8871-585924234a43 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:13:01.543181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:01.543681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:01.551156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:01.551649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:01.552095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:01.552797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:01.553295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:01.553726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:01.580578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:13:01.892972 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8fad68e4-bcb3-4b34-92a9-cbabcbd311fb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 204 len: 0 microversion: 2.1 time: 0.353386 Nov 03 05:13:01.893622 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3748/7605] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:13:01 2022] DELETE /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:13:01.902377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:01.905307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:01.916670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:01.917224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:01.917898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:01.918641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:01.919123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:01.919574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:02.057294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:02.065330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e99f8a29-4ef3-45b7-b5e8-5f23f33579bd tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1561 microversion: 2.1 time: 0.167107 Nov 03 05:13:02.065964 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3858/7606] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:01 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:03.089437 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:03.090172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:03.096867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:03.097376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:03.097815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:03.098509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:03.098967 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:03.099388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:03.227920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:03.236305 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c72b2761-274a-4c97-bc50-ffb60053e381 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1561 microversion: 2.1 time: 0.151562 Nov 03 05:13:03.236875 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3749/7607] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:03 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:04.088871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-386336a2-bb57-483e-b5e1-379e281703f4 req-46bfcbd8-5b1f-4c3f-bf94-d0f839ede764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50aff98-f2c5-42d7-b7bf-437a6309d78c", "name": "network-vif-deleted", "tag": "20cda802-2838-4bfa-b300-b5cdd988f6bc"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:04.099596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-386336a2-bb57-483e-b5e1-379e281703f4 req-46bfcbd8-5b1f-4c3f-bf94-d0f839ede764 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:04.100116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-386336a2-bb57-483e-b5e1-379e281703f4 req-46bfcbd8-5b1f-4c3f-bf94-d0f839ede764 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:04.100551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-386336a2-bb57-483e-b5e1-379e281703f4 req-46bfcbd8-5b1f-4c3f-bf94-d0f839ede764 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:04.112342 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-386336a2-bb57-483e-b5e1-379e281703f4 req-46bfcbd8-5b1f-4c3f-bf94-d0f839ede764 service nova] Creating event network-vif-deleted:20cda802-2838-4bfa-b300-b5cdd988f6bc for instance a50aff98-f2c5-42d7-b7bf-437a6309d78c on n-h2-854653-7 Nov 03 05:13:04.117263 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-386336a2-bb57-483e-b5e1-379e281703f4 req-46bfcbd8-5b1f-4c3f-bf94-d0f839ede764 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Nov 03 05:13:04.118311 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3859/7608] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:04.259708 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:04.260362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:04.267931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:04.268428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:04.268868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:04.269608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:04.270076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:04.270506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:04.333902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:04.341855 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3494e509-99e8-42a9-b47b-11309e05d23b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 200 len: 1348 microversion: 2.1 time: 0.086302 Nov 03 05:13:04.342657 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3750/7609] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:04 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 1348 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:05.366446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:05.371153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: a50aff98-f2c5-42d7-b7bf-437a6309d78c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:05.373236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:05.373733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:05.374186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:05.375538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:05.376020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:05.376461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:05.389791 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] HTTP exception thrown: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c could not be found. Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Request method failure captured: Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c HTTP/1.1 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY02xdoSdMKdKqFtdmYeZyc3JvbWGvMei65QAieppicwoDtn-7x0H3iOd5HXZBLI_663w2dTw-748J0WbP6AB-FtYgtL3YQcqV2waKca3AJpOzCRomGtRzVLIi1Ow0szu23ujzVCCcC-XnC8sEg_TTTkAR321-qm6pfuAy1MM2KM8hqY Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_919e08eb93f54139a2092b4859edb1e9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/919e08eb93f54139a2092b4859edb1e9"}]}] Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d1a9e065576742a2befe840781ac8cb5 Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c could not be found. Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'a50aff98-f2c5-42d7-b7bf-437a6309d78c'} Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c could not be found. Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c could not be found. Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:13:05.392068 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c could not be found. Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Returning 404 to user: Instance a50aff98-f2c5-42d7-b7bf-437a6309d78c could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58a8e79c-741a-45ac-829b-aae6898e466e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c" status: 404 len: 111 microversion: 2.1 time: 0.032257 Nov 03 05:13:05.400066 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3860/7610] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:05 2022] GET /compute/v2.1/servers/a50aff98-f2c5-42d7-b7bf-437a6309d78c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:13:05.402660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27c86adb-8c72-422c-aaf8-9877bcb78d82 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '.version_select at 0x7ff7fd5318b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:05.482524 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27c86adb-8c72-422c-aaf8-9877bcb78d82 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1365044487" status: 202 len: 0 microversion: 2.1 time: 0.083961 Nov 03 05:13:05.483142 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3751/7611] 10.222.0.30 () {58 vars in 1278 bytes} [Thu Nov 3 05:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1365044487 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:13:05.501346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa75e48b-6b3a-4739-acf3-47219ba39d93 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: .version_select at 0x7ff7f9129940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-708039503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1DyZRweFNja1uDgnIiVTsyNJeLryRrKx/Kk3funFnXlG7pwDZ+wo6korCAgQIVftBsd9u7kBX7c2rFxKyuioR1IkE/WXqfofCu/IruyPhIRRrciHmjsonwUVRqI8I3yg=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:05.517593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-fa75e48b-6b3a-4739-acf3-47219ba39d93 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for project 919e08eb93f54139a2092b4859edb1e9. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:13:05.522847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-fa75e48b-6b3a-4739-acf3-47219ba39d93 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for user d1a9e065576742a2befe840781ac8cb5 and project 919e08eb93f54139a2092b4859edb1e9. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:13:05.536212 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fa75e48b-6b3a-4739-acf3-47219ba39d93 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:13:06.544138 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [None req-fa75e48b-6b3a-4739-acf3-47219ba39d93 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60832. Nov 03 05:13:06.625292 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fa75e48b-6b3a-4739-acf3-47219ba39d93 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 1.128430 Nov 03 05:13:06.625905 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3861/7612] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:13:05 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:06.678009 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1128836059", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-708039503", "networks": [{"uuid": "cd065d03-22f2-4648-af85-0b60721ede8f"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:06.731019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] validate_networks() for [('cd065d03-22f2-4648-af85-0b60721ede8f', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:13:07.201933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:13:07.202975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:13:07.203465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:13:07.203886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:13:07.204331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:13:07.213459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:07.213946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:07.214386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:07.215118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:07.215578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:07.216010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:07.234359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for project 919e08eb93f54139a2092b4859edb1e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:13:07.239595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for user d1a9e065576742a2befe840781ac8cb5 and project 919e08eb93f54139a2092b4859edb1e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:13:07.252763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:13:07.255107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:13:07.395225 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [65eb331d-fcf1-45cb-945e-67f6ecd03c79] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:13:08.402460 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [65eb331d-fcf1-45cb-945e-67f6ecd03c79] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60848. Nov 03 05:13:08.406831 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48538973-10e7-4031-b09f-22eeb68fedb6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733998 Nov 03 05:13:08.407479 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3752/7613] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:13:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:13:08.419564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7747b2bc-276e-42c0-b894-c8179ff72aa4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:08.420192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7747b2bc-276e-42c0-b894-c8179ff72aa4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:08.478614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7747b2bc-276e-42c0-b894-c8179ff72aa4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:08.486532 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7747b2bc-276e-42c0-b894-c8179ff72aa4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1262 microversion: 2.1 time: 0.071693 Nov 03 05:13:08.487104 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3862/7614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:08 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1262 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:09.510410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:09.511065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:09.518023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:09.518522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:09.519024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:09.519732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:09.520197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:09.520628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:09.585409 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:09.593270 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f74f7bb1-ba23-4854-a42e-052a9a10b78d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1266 microversion: 2.1 time: 0.087543 Nov 03 05:13:09.593846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3753/7615] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:09 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:10.617671 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:10.618333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:10.626772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:10.627287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:10.627739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:10.628454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:10.628920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:10.629610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:10.692420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:10.700396 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96a39296-f7ed-4655-a272-52d9b32d551d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1332 microversion: 2.1 time: 0.087020 Nov 03 05:13:10.700972 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3863/7616] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:10 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:11.724291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:11.724844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:11.731626 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:11.732115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:11.732554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:11.733282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:11.733735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:11.734159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:11.942811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:11.950607 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e5b88d6-90ef-425b-a596-77147aa423f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1362 microversion: 2.1 time: 0.230865 Nov 03 05:13:11.951188 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3754/7617] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:11 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:12.470868 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d68066ab-4678-4559-a26f-c68d3ecb2a9b req-8ea347ba-b310-43d4-9745-176ba6a2cfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15998ec-4037-4b19-8581-d07cb8196350", "tag": "848740f5-e650-46dc-ab6d-2e3fbe1e1143"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:12.497449 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d68066ab-4678-4559-a26f-c68d3ecb2a9b req-8ea347ba-b310-43d4-9745-176ba6a2cfe0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:12.497954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d68066ab-4678-4559-a26f-c68d3ecb2a9b req-8ea347ba-b310-43d4-9745-176ba6a2cfe0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:12.498414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d68066ab-4678-4559-a26f-c68d3ecb2a9b req-8ea347ba-b310-43d4-9745-176ba6a2cfe0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:12.510683 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d68066ab-4678-4559-a26f-c68d3ecb2a9b req-8ea347ba-b310-43d4-9745-176ba6a2cfe0 service nova] Creating event network-changed:848740f5-e650-46dc-ab6d-2e3fbe1e1143 for instance e15998ec-4037-4b19-8581-d07cb8196350 on n-h2-854653-7 Nov 03 05:13:12.516860 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d68066ab-4678-4559-a26f-c68d3ecb2a9b req-8ea347ba-b310-43d4-9745-176ba6a2cfe0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049878 Nov 03 05:13:12.517558 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3864/7618] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:13:12.974857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:12.975607 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:12.982378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:12.982863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:12.983303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:12.983999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:12.984451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:12.984916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:13.185407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:13.193367 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d073e685-f61f-46ef-a3a9-4a895901726a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1362 microversion: 2.1 time: 0.222284 Nov 03 05:13:13.194323 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3755/7619] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:12 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:14.218044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:14.218690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:14.225785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:14.226299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:14.226760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:14.227478 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:14.227956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:14.228404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:14.358301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:14.366754 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77d02e29-3100-4333-89d4-f1ce2e795f66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1362 microversion: 2.1 time: 0.153144 Nov 03 05:13:14.367322 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3865/7620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:14 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:15.389726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:15.390338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:15.397810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:15.398297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:15.398737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:15.399428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:15.399975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:15.400408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:15.537522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:15.545314 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc3ad2b0-a3fe-4c93-9528-5c5f82a3ce66 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1362 microversion: 2.1 time: 0.159559 Nov 03 05:13:15.545887 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3756/7621] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:15 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:16.568328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:16.568962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:16.575911 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:16.576419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:16.576888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:16.577680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:16.578160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:16.579276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:16.707900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:16.715654 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3e2a824-09ef-4b99-b38c-edbe101467ce tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1362 microversion: 2.1 time: 0.151287 Nov 03 05:13:16.716232 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3866/7622] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:16 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:13:17.738394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:17.739024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:17.741836 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:13:17.742515 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:13:17.747291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:17.747778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:17.748223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:17.748922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:17.749422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:17.751333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:17.877576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:17.885229 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-889c6858-72a8-4933-afbd-252fe7b22d5a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1362 microversion: 2.1 time: 0.150797 Nov 03 05:13:17.885806 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3757/7623] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:17 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:18.178690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-83990634-6f6b-4d31-ac16-50a9880cb612 req-0c506e52-ce39-4717-a327-37f7a44b0636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15998ec-4037-4b19-8581-d07cb8196350", "name": "network-vif-plugged", "status": "completed", "tag": "848740f5-e650-46dc-ab6d-2e3fbe1e1143"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:18.193484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-83990634-6f6b-4d31-ac16-50a9880cb612 req-0c506e52-ce39-4717-a327-37f7a44b0636 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:18.193981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-83990634-6f6b-4d31-ac16-50a9880cb612 req-0c506e52-ce39-4717-a327-37f7a44b0636 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:18.194432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-83990634-6f6b-4d31-ac16-50a9880cb612 req-0c506e52-ce39-4717-a327-37f7a44b0636 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:18.205181 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-83990634-6f6b-4d31-ac16-50a9880cb612 req-0c506e52-ce39-4717-a327-37f7a44b0636 service nova] Creating event network-vif-plugged:848740f5-e650-46dc-ab6d-2e3fbe1e1143 for instance e15998ec-4037-4b19-8581-d07cb8196350 on n-h2-854653-7 Nov 03 05:13:18.210095 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-83990634-6f6b-4d31-ac16-50a9880cb612 req-0c506e52-ce39-4717-a327-37f7a44b0636 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 Nov 03 05:13:18.210699 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3867/7624] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:18.909683 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:18.910233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:18.917586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:18.918078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:18.918526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:18.919231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:18.919693 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:18.920136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:19.049272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:19.056991 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8e8b3f32-4565-4a17-a10a-593b0db3072a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1362 microversion: 2.1 time: 0.151954 Nov 03 05:13:19.057587 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3758/7625] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:18 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:20.077228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:13:20.082303 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:20.083035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:20.089232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:20.089744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:20.090210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:20.090932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:20.091412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:20.091866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:20.223533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:20.231378 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f5f3e43-6a2a-4c7f-af37-7c1d3d86e410 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1554 microversion: 2.1 time: 0.155141 Nov 03 05:13:20.231955 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3868/7626] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:20 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:20.254513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:20.255133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:20.261941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:20.262426 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:20.262867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:20.263582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:20.264035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:20.264460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:20.392576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:20.396039 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:13:20.400845 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-192aac23-68f5-421b-bd30-e1c2ab1844a8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1554 microversion: 2.1 time: 0.150547 Nov 03 05:13:20.401460 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3759/7627] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:20 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:23.352089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9429a5c-f855-44a4-bec8-7813fb303b8d"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:23.357163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:23.360709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:23.361806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:23.362270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:23.362987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:23.363468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:23.364045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:24.068841 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1b2270de-1e2a-48ef-86b5-7f195d8e0eab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.720777 Nov 03 05:13:24.069819 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3869/7628] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 05:13:23 2022] POST /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:35.841998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:35.842611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:35.845359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:13:35.851109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:35.851631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:35.852080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:35.852784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:35.853280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:35.853719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:35.933611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lazy-loading 'services' on Instance uuid e15998ec-4037-4b19-8581-d07cb8196350 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:13:36.150611 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-492e716e-fe20-4b16-9206-fb8fcf4e46d9 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments/f9429a5c-f855-44a4-bec8-7813fb303b8d" status: 202 len: 0 microversion: 2.1 time: 0.312435 Nov 03 05:13:36.151486 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3760/7629] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:13:35 2022] DELETE /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments/f9429a5c-f855-44a4-bec8-7813fb303b8d => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:13:36.158129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:13:36.159090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:13:36.163356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:36.165843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:36.171999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:36.172505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:36.172969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:36.173719 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:36.174200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:36.174655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:36.205653 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99f00b22-d4f2-4442-98fd-a2a7970a34b6 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049358 Nov 03 05:13:36.206213 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3870/7630] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:13:36 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:37.220442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:37.223312 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:37.229986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:37.230476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:37.230919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:37.231650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:37.232104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:37.232529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:37.266096 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2d58c28b-849a-42e3-bdb1-f3cd0a4bc535 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051021 Nov 03 05:13:37.266665 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3761/7631] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:13:37 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:38.279951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:38.282179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:38.290953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:38.291455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:38.291908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:38.292628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:38.293122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:38.296064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:38.327413 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0f19b8ec-2059-4b11-8863-dce73d51a487 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052151 Nov 03 05:13:38.328022 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3871/7632] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:13:38 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:39.340203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:39.342478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:39.349429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:39.349925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:39.350376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:39.351084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:39.351551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:39.351991 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:39.382428 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e369b7c4-5498-4625-88f0-420d3c0158ef tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046233 Nov 03 05:13:39.382932 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3762/7633] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:13:39 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:40.396110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:40.398379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:40.406248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:40.406745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:40.407198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:40.407909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:40.408384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:40.408822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:40.441171 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c063dddd-07c5-4be5-b882-bf33b4981cea tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050021 Nov 03 05:13:40.441736 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3872/7634] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:13:40 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:41.453793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:41.455989 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:41.462893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:41.463385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:41.463835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:41.464541 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:41.464999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:41.465465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:41.495018 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f9b17fb-18c8-452e-8ee3-b91ed87d470e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045216 Nov 03 05:13:41.495570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3763/7635] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:13:41 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 05:13:41.506487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:41.507105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:41.513990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:41.515855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:41.515855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:41.515855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:41.516148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:41.516559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:41.591559 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] HTTP exception thrown: Instance e15998ec-4037-4b19-8581-d07cb8196350 is not attached to volume f9429a5c-f855-44a4-bec8-7813fb303b8d Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Request method failure captured: Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments/f9429a5c-f855-44a4-bec8-7813fb303b8d HTTP/1.1 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY02xdoSdMKdKqFtdmYeZyc3JvbWGvMei65QAieppicwoDtn-7x0H3iOd5HXZBLI_663w2dTw-748J0WbP6AB-FtYgtL3YQcqV2waKca3AJpOzCRomGtRzVLIi1Ow0szu23ujzVCCcC-XnC8sEg_TTTkAR321-qm6pfuAy1MM2KM8hqY Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_919e08eb93f54139a2092b4859edb1e9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/919e08eb93f54139a2092b4859edb1e9"}]}] Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d1a9e065576742a2befe840781ac8cb5 Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e15998ec-4037-4b19-8581-d07cb8196350 is not attached to volume f9429a5c-f855-44a4-bec8-7813fb303b8d Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': 'e15998ec-4037-4b19-8581-d07cb8196350', 'id': 'f9429a5c-f855-44a4-bec8-7813fb303b8d'} Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f9429a5c-f855-44a4-bec8-7813fb303b8d. Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15998ec-4037-4b19-8581-d07cb8196350 is not attached to volume f9429a5c-f855-44a4-bec8-7813fb303b8d Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:13:41.593345 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:13:41.599139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:13:41.599139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:13:41.599139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15998ec-4037-4b19-8581-d07cb8196350 is not attached to volume f9429a5c-f855-44a4-bec8-7813fb303b8d Nov 03 05:13:41.599139 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:41.599139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Returning 404 to user: Instance e15998ec-4037-4b19-8581-d07cb8196350 is not attached to volume f9429a5c-f855-44a4-bec8-7813fb303b8d {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:13:41.599139 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4715d031-cb5b-4458-b10b-0fbefd178d76 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments/f9429a5c-f855-44a4-bec8-7813fb303b8d" status: 404 len: 154 microversion: 2.1 time: 0.092566 Nov 03 05:13:41.599139 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3873/7636] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:13:41 2022] DELETE /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350/os-volume_attachments/f9429a5c-f855-44a4-bec8-7813fb303b8d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:13:45.142405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:45.147916 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:45.150498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:45.151240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:45.151679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:45.152385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:45.152829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:45.153277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:45.178993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:13:45.475323 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38a4a476-0338-420f-ba4a-3dec4d6c9e7e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 204 len: 0 microversion: 2.1 time: 0.336609 Nov 03 05:13:45.475956 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3764/7637] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:13:45 2022] DELETE /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:13:45.484396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:45.493185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:45.496078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:45.496587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:45.497074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:45.497830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:45.498323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:45.498774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:45.632614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:45.640412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-90bcea26-5e83-49f7-92ed-94bcf39f5311 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1560 microversion: 2.1 time: 0.160048 Nov 03 05:13:45.640991 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3874/7638] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:45 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:46.664759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:46.665494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:46.672119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:46.672633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:46.673103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:46.673813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:46.674272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:46.674701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:46.808444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:46.816980 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d3f83965-c603-489c-b4d3-5fd76ff1cb43 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1560 microversion: 2.1 time: 0.156040 Nov 03 05:13:46.817574 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3765/7639] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:46 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:47.755966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-45c121c1-0aed-4432-9ae4-8d29600aed7b req-942d0c12-b178-4f33-98bf-667a6d1ad726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15998ec-4037-4b19-8581-d07cb8196350", "name": "network-vif-deleted", "tag": "848740f5-e650-46dc-ab6d-2e3fbe1e1143"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:47.765619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-45c121c1-0aed-4432-9ae4-8d29600aed7b req-942d0c12-b178-4f33-98bf-667a6d1ad726 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:47.766050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-45c121c1-0aed-4432-9ae4-8d29600aed7b req-942d0c12-b178-4f33-98bf-667a6d1ad726 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:47.766496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-45c121c1-0aed-4432-9ae4-8d29600aed7b req-942d0c12-b178-4f33-98bf-667a6d1ad726 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:47.778725 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-45c121c1-0aed-4432-9ae4-8d29600aed7b req-942d0c12-b178-4f33-98bf-667a6d1ad726 service nova] Creating event network-vif-deleted:848740f5-e650-46dc-ab6d-2e3fbe1e1143 for instance e15998ec-4037-4b19-8581-d07cb8196350 on n-h2-854653-7 Nov 03 05:13:47.783854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-45c121c1-0aed-4432-9ae4-8d29600aed7b req-942d0c12-b178-4f33-98bf-667a6d1ad726 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091410 Nov 03 05:13:47.784449 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3875/7640] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:47.840723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:47.841362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:47.848817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:47.850658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:47.850658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:47.850658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:47.850928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:47.851339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:47.921334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:47.929725 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b8444405-76ef-4ea0-a29c-b1547db7fd18 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 200 len: 1518 microversion: 2.1 time: 0.093012 Nov 03 05:13:47.930632 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3766/7641] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:47 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 1518 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:48.954687 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:48.955408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: e15998ec-4037-4b19-8581-d07cb8196350] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:48.961610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:48.962109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:48.962560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:48.963268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:48.963738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:48.964179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:48.977997 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] HTTP exception thrown: Instance e15998ec-4037-4b19-8581-d07cb8196350 could not be found. Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Request method failure captured: Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 HTTP/1.1 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY02xdoSdMKdKqFtdmYeZyc3JvbWGvMei65QAieppicwoDtn-7x0H3iOd5HXZBLI_663w2dTw-748J0WbP6AB-FtYgtL3YQcqV2waKca3AJpOzCRomGtRzVLIi1Ow0szu23ujzVCCcC-XnC8sEg_TTTkAR321-qm6pfuAy1MM2KM8hqY Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_919e08eb93f54139a2092b4859edb1e9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/919e08eb93f54139a2092b4859edb1e9"}]}] Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: d1a9e065576742a2befe840781ac8cb5 Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance e15998ec-4037-4b19-8581-d07cb8196350 could not be found. Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'e15998ec-4037-4b19-8581-d07cb8196350'} Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15998ec-4037-4b19-8581-d07cb8196350 could not be found. Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15998ec-4037-4b19-8581-d07cb8196350 could not be found. Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:13:48.979736 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15998ec-4037-4b19-8581-d07cb8196350 could not be found. Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Returning 404 to user: Instance e15998ec-4037-4b19-8581-d07cb8196350 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3c0ee3e9-2324-49a5-9682-f3d1b0ef59a4 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350" status: 404 len: 111 microversion: 2.1 time: 0.031776 Nov 03 05:13:48.985110 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3876/7642] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:48 2022] GET /compute/v2.1/servers/e15998ec-4037-4b19-8581-d07cb8196350 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:13:48.990410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7d37bd2b-6b15-4caa-bbe8-d9873f3c6d6c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '.version_select at 0x7ff7f3e83820>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:49.061107 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7d37bd2b-6b15-4caa-bbe8-d9873f3c6d6c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-708039503" status: 202 len: 0 microversion: 2.1 time: 0.075144 Nov 03 05:13:49.061684 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3767/7643] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Nov 3 05:13:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-708039503 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 05:13:49.078916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d581c654-0a1d-41a2-b9d4-8492996afe65 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: .version_select at 0x7ff7fd5b9820>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1004964603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7h7Hb0Im0s+Ss/mTBaiLwzdQtgRXlXQ32pLmiIHj2mOsYDI7HEB7xkHfiREvI5syicS9tBXDWl7P9BDIjOsxZWgraxUNMm35s3DQAcsVRHtSFyqp10I5s7s/7qjNpSrg=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:49.094815 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d581c654-0a1d-41a2-b9d4-8492996afe65 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for project 919e08eb93f54139a2092b4859edb1e9. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:13:49.100583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d581c654-0a1d-41a2-b9d4-8492996afe65 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for user d1a9e065576742a2befe840781ac8cb5 and project 919e08eb93f54139a2092b4859edb1e9. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:13:49.181071 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d581c654-0a1d-41a2-b9d4-8492996afe65 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.106001 Nov 03 05:13:49.181615 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3877/7644] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:13:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:49.232076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1504708907", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1004964603", "networks": [{"uuid": "cd065d03-22f2-4648-af85-0b60721ede8f"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:49.283774 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] validate_networks() for [('cd065d03-22f2-4648-af85-0b60721ede8f', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:13:49.654728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:13:49.655156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:13:49.655636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:13:49.656052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:13:49.656496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:13:49.665400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:49.665884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:49.666325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:49.667063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:49.667518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:49.667948 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:49.685168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for project 919e08eb93f54139a2092b4859edb1e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:13:49.690469 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Getting quotas for user d1a9e065576742a2befe840781ac8cb5 and project 919e08eb93f54139a2092b4859edb1e9. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:13:49.703402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:13:49.705736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:13:49.827114 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2c32e788-5058-4039-a340-e4290cb102f1 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598810 Nov 03 05:13:49.827765 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3768/7645] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:13:49.839758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1766c1bd-5ebf-4e6c-8ceb-fd1a95de46a3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:49.840630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1766c1bd-5ebf-4e6c-8ceb-fd1a95de46a3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:49.901269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1766c1bd-5ebf-4e6c-8ceb-fd1a95de46a3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:49.909262 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1766c1bd-5ebf-4e6c-8ceb-fd1a95de46a3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1263 microversion: 2.1 time: 0.073500 Nov 03 05:13:49.916530 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3878/7646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:49 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:50.932304 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:50.932927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:50.944319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:50.944810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:50.945278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:50.945982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:50.946496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:50.952306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:51.012699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:51.015015 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bb387a57-2f5c-47da-b310-fc786088314b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1267 microversion: 2.1 time: 0.086649 Nov 03 05:13:51.015650 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3769/7647] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:50 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:52.039233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:52.039862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:52.046622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:52.047442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:52.051633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:52.051633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:52.051633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:52.051633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:52.118280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:52.126596 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c9034865-2d9d-44fc-b9fd-8873d44cbf95 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1323 microversion: 2.1 time: 0.092100 Nov 03 05:13:52.127638 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3879/7648] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:52 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1323 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:53.150294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:53.151133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:53.157119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:53.157844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:53.158296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:53.159031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:53.159493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:53.159928 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:53.349238 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:53.357138 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7e4fde14-bdd1-442e-bcea-30c15939276f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.211384 Nov 03 05:13:53.357716 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3770/7649] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:53 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:53.672375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-8e6a73f3-1314-42b7-95ee-0fec367b2a5b req-20c6bae4-8d50-477f-9af9-eb813d606d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a035c3-3075-448c-95ba-52995678412e", "tag": "17d05e8c-d415-443c-b3de-5982e0170ff2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:13:53.683499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e6a73f3-1314-42b7-95ee-0fec367b2a5b req-20c6bae4-8d50-477f-9af9-eb813d606d27 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:53.683998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e6a73f3-1314-42b7-95ee-0fec367b2a5b req-20c6bae4-8d50-477f-9af9-eb813d606d27 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:53.684454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-8e6a73f3-1314-42b7-95ee-0fec367b2a5b req-20c6bae4-8d50-477f-9af9-eb813d606d27 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:53.695818 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-8e6a73f3-1314-42b7-95ee-0fec367b2a5b req-20c6bae4-8d50-477f-9af9-eb813d606d27 service nova] Creating event network-changed:17d05e8c-d415-443c-b3de-5982e0170ff2 for instance 28a035c3-3075-448c-95ba-52995678412e on n-h2-854653-7 Nov 03 05:13:53.700621 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-8e6a73f3-1314-42b7-95ee-0fec367b2a5b req-20c6bae4-8d50-477f-9af9-eb813d606d27 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033106 Nov 03 05:13:53.701250 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3880/7650] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:13:54.380501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:54.381166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:54.388150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:54.388666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:54.389136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:54.389841 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:54.390300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:54.390733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:54.527987 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:54.535938 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba24f5d0-daf1-407e-a6b1-6f304e4de23e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.160058 Nov 03 05:13:54.536513 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3771/7651] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:54 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:55.560774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:55.561565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:55.568253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:55.568753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:55.569251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:55.569978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:55.570458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:55.570910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:55.699321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:55.707027 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb2e18dd-dbcc-4446-9844-8106ac7f906e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.151537 Nov 03 05:13:55.708195 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3881/7652] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:55 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:56.731030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:56.731654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:56.738748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:56.739240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:56.739685 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:56.740419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:56.740882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:56.741344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:56.879169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:56.887127 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e749eb78-79da-4436-a468-fc4a3a6f6a74 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.159998 Nov 03 05:13:56.887698 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3772/7653] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:56 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:57.910078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:57.910739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:57.917781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:57.918282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:57.918744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:57.919454 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:57.919926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:57.920366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:58.048568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:58.056701 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-399aa526-39a4-44ca-9ef2-3a826a4655cb tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.150604 Nov 03 05:13:58.057288 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3882/7654] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:57 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:13:59.079578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:13:59.080222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:13:59.087968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:59.088455 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:59.088894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:59.089609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:13:59.090065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:13:59.090490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:13:59.218242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:13:59.226101 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-583c1462-dec4-43ae-b5e6-5df6cc13c46d tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.150416 Nov 03 05:13:59.226682 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3773/7655] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:13:59 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:00.249214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:00.250045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:00.252727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:00.257649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:00.259068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:00.259068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:00.259391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:00.259869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:00.260313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:00.399254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:14:00.407609 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cd0f53a3-6410-42dc-99c1-da41e91c815c tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.162328 Nov 03 05:14:00.412718 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3883/7656] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:00 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:00.454758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:00.455587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:00.511110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-bb72134c-100f-4746-b745-07cc20eec359 req-c182d08c-545e-4e28-92b3-514dae7c4766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a035c3-3075-448c-95ba-52995678412e", "name": "network-vif-plugged", "status": "completed", "tag": "17d05e8c-d415-443c-b3de-5982e0170ff2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:14:00.521464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bb72134c-100f-4746-b745-07cc20eec359 req-c182d08c-545e-4e28-92b3-514dae7c4766 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:00.521954 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bb72134c-100f-4746-b745-07cc20eec359 req-c182d08c-545e-4e28-92b3-514dae7c4766 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:00.522393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-bb72134c-100f-4746-b745-07cc20eec359 req-c182d08c-545e-4e28-92b3-514dae7c4766 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:00.533686 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-bb72134c-100f-4746-b745-07cc20eec359 req-c182d08c-545e-4e28-92b3-514dae7c4766 service nova] Creating event network-vif-plugged:17d05e8c-d415-443c-b3de-5982e0170ff2 for instance 28a035c3-3075-448c-95ba-52995678412e on n-h2-854653-7 Nov 03 05:14:00.539313 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-bb72134c-100f-4746-b745-07cc20eec359 req-c182d08c-545e-4e28-92b3-514dae7c4766 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089304 Nov 03 05:14:00.539897 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3774/7657] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:14:01.431985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:01.432553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:01.439360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:01.439860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:01.440319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:01.441042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:01.441514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:01.441964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:01.572726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:14:01.580527 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-53d08038-4027-46e2-aff3-5a69e60a265b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1363 microversion: 2.1 time: 0.152611 Nov 03 05:14:01.581111 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3884/7658] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:01 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:02.604637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:02.605443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:02.611870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:02.612357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:02.612802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:02.613527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:02.614496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:02.614931 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:02.743534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:14:02.751397 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3f84377f-0be2-46be-9b65-b2518993b5ab tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1555 microversion: 2.1 time: 0.152220 Nov 03 05:14:02.751918 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3775/7659] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:02 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:02.773873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:02.774516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:02.781638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:02.782146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:02.782613 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:02.783337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:02.783819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:02.784272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:02.914973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:14:02.922859 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9dc25ebe-9b99-4d40-a89d-a606b29262c3 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1555 microversion: 2.1 time: 0.152845 Nov 03 05:14:02.923456 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3885/7660] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:02 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:05.887433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f23bfb73-96e2-4e71-93c8-c7a5fff785b1"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:14:05.889832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:05.896714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:05.897256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:05.897707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:05.898411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:05.898873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:05.899306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:05.921418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:06.787114 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a92051c1-b82e-4c3c-8ccb-c4ffe52c653e tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "POST /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903696 Nov 03 05:14:06.787670 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3776/7661] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 05:14:05 2022] POST /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:14:18.567348 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:18.567885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:18.570830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:18.571556 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=72 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:18.576479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:18.577179 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:18.577649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:18.578380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:18.578866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:18.579320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:18.667491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lazy-loading 'services' on Instance uuid 28a035c3-3075-448c-95ba-52995678412e {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:14:18.886761 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-35405759-d1e9-4448-87a8-045eac1711f7 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments/f23bfb73-96e2-4e71-93c8-c7a5fff785b1" status: 202 len: 0 microversion: 2.1 time: 0.323300 Nov 03 05:14:18.887369 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3886/7662] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:14:18 2022] DELETE /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments/f23bfb73-96e2-4e71-93c8-c7a5fff785b1 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:14:18.897149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:18.900379 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:18.903864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:18.904559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:14:18.909938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:18.910436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:18.910885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:18.911602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:18.912067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:18.912497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:18.944729 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-87576a1d-2a33-4799-865c-da3d74acd5fe tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052632 Nov 03 05:14:18.945346 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3777/7663] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:14:18 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:14:19.963994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:19.966380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:19.973122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:19.973626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:19.974083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:19.975369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:19.975840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:19.976288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:20.005795 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b2deabb0-7e02-44ac-8962-b84ea1f68d80 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Nov 03 05:14:20.006348 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3887/7664] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:14:19 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:14:21.018506 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:21.020776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:21.029030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:21.029532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:21.029974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:21.030694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:21.031151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:21.031576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:21.064906 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cead5def-65b4-4163-bc6b-f70063765f7b tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051134 Nov 03 05:14:21.065532 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3778/7665] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:14:21 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:14:22.078198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:22.080364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:22.086757 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:22.087265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:22.087727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:22.088439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:22.088915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:22.089389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:22.118765 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-98335efc-2214-4118-9090-29d445d7aad8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Nov 03 05:14:22.119337 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3888/7666] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:14:22 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:14:23.132698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:23.135023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:23.142439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:23.142932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:23.143373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:23.144076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:23.144532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:23.144963 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:23.175569 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a2fef746-b795-4fd9-9b76-a8dac8aeb66f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048078 Nov 03 05:14:23.176064 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3779/7667] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:14:23 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:14:24.188085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:24.190248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:24.197121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:24.197622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:24.198079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:24.198781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:24.199251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:24.199695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:24.230695 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1d897ebc-95dd-4884-ac29-ca4101a9520f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046780 Nov 03 05:14:24.231250 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3889/7668] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:14:24 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 05:14:24.242748 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:24.243288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:24.251024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:24.251513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:24.251960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:24.252657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:24.253155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:24.253588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:24.329556 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] HTTP exception thrown: Instance 28a035c3-3075-448c-95ba-52995678412e is not attached to volume f23bfb73-96e2-4e71-93c8-c7a5fff785b1 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Request method failure captured: Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments/f23bfb73-96e2-4e71-93c8-c7a5fff785b1 HTTP/1.1 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY02xdoSdMKdKqFtdmYeZyc3JvbWGvMei65QAieppicwoDtn-7x0H3iOd5HXZBLI_663w2dTw-748J0WbP6AB-FtYgtL3YQcqV2waKca3AJpOzCRomGtRzVLIi1Ow0szu23ujzVCCcC-XnC8sEg_TTTkAR321-qm6pfuAy1MM2KM8hqY Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_919e08eb93f54139a2092b4859edb1e9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/919e08eb93f54139a2092b4859edb1e9"}]}] Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d1a9e065576742a2befe840781ac8cb5 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 28a035c3-3075-448c-95ba-52995678412e is not attached to volume f23bfb73-96e2-4e71-93c8-c7a5fff785b1 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '28a035c3-3075-448c-95ba-52995678412e', 'id': 'f23bfb73-96e2-4e71-93c8-c7a5fff785b1'} Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f23bfb73-96e2-4e71-93c8-c7a5fff785b1. Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a035c3-3075-448c-95ba-52995678412e is not attached to volume f23bfb73-96e2-4e71-93c8-c7a5fff785b1 Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:14:24.331531 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:14:24.337647 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:14:24.337647 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:14:24.337647 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a035c3-3075-448c-95ba-52995678412e is not attached to volume f23bfb73-96e2-4e71-93c8-c7a5fff785b1 Nov 03 05:14:24.337647 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:24.337647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Returning 404 to user: Instance 28a035c3-3075-448c-95ba-52995678412e is not attached to volume f23bfb73-96e2-4e71-93c8-c7a5fff785b1 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:14:24.337647 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-31257102-a052-4833-857c-74701c866433 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments/f23bfb73-96e2-4e71-93c8-c7a5fff785b1" status: 404 len: 154 microversion: 2.1 time: 0.094980 Nov 03 05:14:24.337647 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3780/7669] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:14:24 2022] DELETE /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e/os-volume_attachments/f23bfb73-96e2-4e71-93c8-c7a5fff785b1 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:14:27.968481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:27.973660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:27.976389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:27.976889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:27.977372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:27.978083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:27.978557 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:27.978998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:28.004973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:14:28.292052 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1cdb2784-a676-4d7d-8e44-ee858cb235f0 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 204 len: 0 microversion: 2.1 time: 0.327132 Nov 03 05:14:28.292656 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3890/7670] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:14:27 2022] DELETE /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 03 05:14:28.301320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:28.302033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:28.310272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:28.310772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:28.311250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:28.312097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:28.312561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:28.312998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:28.450030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:14:28.458038 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ce6fadc-ef5c-4924-bf5c-29cc308ef91f tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1561 microversion: 2.1 time: 0.161075 Nov 03 05:14:28.458604 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3781/7671] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:28 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:29.482156 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:29.482917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:29.490295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:29.491401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:29.491905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:29.492618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:29.493123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:29.493629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:29.624862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:14:29.633343 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18265753-79eb-425b-a627-cd2708bad484 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1561 microversion: 2.1 time: 0.155937 Nov 03 05:14:29.633916 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3891/7672] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:29 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:30.516573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-61e27c8f-736e-4f8f-8cfc-65f26b7239f2 req-75592768-3a66-4c71-8965-e253c511be13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a035c3-3075-448c-95ba-52995678412e", "name": "network-vif-deleted", "tag": "17d05e8c-d415-443c-b3de-5982e0170ff2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:14:30.527296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-61e27c8f-736e-4f8f-8cfc-65f26b7239f2 req-75592768-3a66-4c71-8965-e253c511be13 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:30.527779 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-61e27c8f-736e-4f8f-8cfc-65f26b7239f2 req-75592768-3a66-4c71-8965-e253c511be13 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:30.528221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-61e27c8f-736e-4f8f-8cfc-65f26b7239f2 req-75592768-3a66-4c71-8965-e253c511be13 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:30.539247 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-61e27c8f-736e-4f8f-8cfc-65f26b7239f2 req-75592768-3a66-4c71-8965-e253c511be13 service nova] Creating event network-vif-deleted:17d05e8c-d415-443c-b3de-5982e0170ff2 for instance 28a035c3-3075-448c-95ba-52995678412e on n-h2-854653-7 Nov 03 05:14:30.544773 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-61e27c8f-736e-4f8f-8cfc-65f26b7239f2 req-75592768-3a66-4c71-8965-e253c511be13 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032545 Nov 03 05:14:30.545386 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3782/7673] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:14:30.656140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:30.656834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:30.663983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:30.665181 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:30.666280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:30.666280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:30.666721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:30.667165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:30.731781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1a9e065576742a2befe840781ac8cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919e08eb93f54139a2092b4859edb1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:14:30.739751 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-596a6afe-553a-4f8d-97f6-76cc8ea7228a tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 200 len: 1348 microversion: 2.1 time: 0.087595 Nov 03 05:14:30.740311 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3892/7674] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:30 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 1348 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:14:31.764870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:31.765654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] [instance: 28a035c3-3075-448c-95ba-52995678412e] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:14:31.771830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:31.772307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:31.772750 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:31.773474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:14:31.773965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:14:31.774398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:14:31.787887 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] HTTP exception thrown: Instance 28a035c3-3075-448c-95ba-52995678412e could not be found. Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Request method failure captured: Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e HTTP/1.1 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY02xdoSdMKdKqFtdmYeZyc3JvbWGvMei65QAieppicwoDtn-7x0H3iOd5HXZBLI_663w2dTw-748J0WbP6AB-FtYgtL3YQcqV2waKca3AJpOzCRomGtRzVLIi1Ow0szu23ujzVCCcC-XnC8sEg_TTTkAR321-qm6pfuAy1MM2KM8hqY Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_919e08eb93f54139a2092b4859edb1e9", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/919e08eb93f54139a2092b4859edb1e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/919e08eb93f54139a2092b4859edb1e9"}]}] Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 919e08eb93f54139a2092b4859edb1e9 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-352809857 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: d1a9e065576742a2befe840781ac8cb5 Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestEncryptedCinderVolumes-352809857-project Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 28a035c3-3075-448c-95ba-52995678412e could not be found. Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '28a035c3-3075-448c-95ba-52995678412e'} Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a035c3-3075-448c-95ba-52995678412e could not be found. Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a035c3-3075-448c-95ba-52995678412e could not be found. Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:14:31.789555 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a035c3-3075-448c-95ba-52995678412e could not be found. Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Returning 404 to user: Instance 28a035c3-3075-448c-95ba-52995678412e could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e881bd8b-cfdd-4190-8871-1511eb772fd5 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e" status: 404 len: 111 microversion: 2.1 time: 0.031223 Nov 03 05:14:31.795072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3783/7675] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:14:31 2022] GET /compute/v2.1/servers/28a035c3-3075-448c-95ba-52995678412e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:14:31.799735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e8a4046-d1da-4e20-b948-2662756525d8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] Calling method '.version_select at 0x7ff7f80b45e0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:14:31.886816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e8a4046-d1da-4e20-b948-2662756525d8 tempest-TestEncryptedCinderVolumes-352809857 tempest-TestEncryptedCinderVolumes-352809857-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1004964603" status: 202 len: 0 microversion: 2.1 time: 0.090842 Nov 03 05:14:31.887392 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3893/7676] 10.222.0.30 () {58 vars in 1278 bytes} [Thu Nov 3 05:14:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1004964603 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:15:04.969990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bfec34a5-a6cd-41bb-ba5f-dfc742fb99b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'create', calling method: .version_select at 0x7ff7fd4229d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-887325727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtCb8NIosDWAkc8W9DWATCRJI171I57a0D/yvQaF8T0oXY3YTdGZl2wWJ8yOcGIsNHAPlC0Zi6OBnXfz0ZiCXafh6gJ4fsQ7HVDA+izkljUbquvtq+wjgPKTSGdw3FrUg=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:04.976336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=14 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:04.976999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=34 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:04.993073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-bfec34a5-a6cd-41bb-ba5f-dfc742fb99b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:15:04.998416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-bfec34a5-a6cd-41bb-ba5f-dfc742fb99b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for user 4f427b3646f54546986ee0a606c404b9 and project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:15:05.109395 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bfec34a5-a6cd-41bb-ba5f-dfc742fb99b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.143153 Nov 03 05:15:05.109954 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3784/7677] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:15:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:15:05.157626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:05.158413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:05.159396 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:15:05.159537 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:15:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Nov 03 05:15:05.166663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-582899549", "imageRef": "948fe577-ad1a-458b-b615-ae268bff3616", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-887325727", "networks": [{"uuid": "db73e6f7-aa30-45ed-8965-41d4160b64b4"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:05.330238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] validate_networks() for [('db73e6f7-aa30-45ed-8965-41d4160b64b4', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:15:05.796446 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:15:05.796893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:15:05.797412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:15:05.797843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:15:05.798273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:15:05.807341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:05.807853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:05.808294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:05.809058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:05.809644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:05.810090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:05.827015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:15:05.832364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for user 4f427b3646f54546986ee0a606c404b9 and project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:15:05.845191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:15:05.847411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='948fe577-ad1a-458b-b615-ae268bff3616',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:15:05.974754 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e88fa078-f315-4b7b-b0a6-51e7499e2566 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819010 Nov 03 05:15:05.975614 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3894/7678] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:15:05.986539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d866a8b1-5196-434e-9540-d18dc5ccbf7c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:05.987723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d866a8b1-5196-434e-9540-d18dc5ccbf7c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:06.100316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d866a8b1-5196-434e-9540-d18dc5ccbf7c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:06.108131 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d866a8b1-5196-434e-9540-d18dc5ccbf7c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1257 microversion: 2.1 time: 0.125470 Nov 03 05:15:06.108739 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3785/7679] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:05 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1257 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:15:07.131683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:07.132852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:07.139848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:07.140360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:07.140825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:07.141645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:07.142112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:07.142562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:07.205295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:07.213852 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b7f92d34-fb02-4c7e-9354-77e358ed77d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1261 microversion: 2.1 time: 0.087109 Nov 03 05:15:07.214459 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3895/7680] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:07 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:08.237560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:08.238536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:08.246245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:08.246741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:08.247187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:08.247896 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:08.248362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:08.248798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:08.333933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:08.342421 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ab7c3f54-6514-460e-8380-2ef21f9f933d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1317 microversion: 2.1 time: 0.109491 Nov 03 05:15:08.343006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3786/7681] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:08 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1317 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:09.366019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:09.366715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:09.396649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:09.400606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:09.400606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:09.400606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:09.400606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:09.400606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:09.649142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:09.666122 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6dfaf50c-3725-4ea8-b6e5-b5bcdf5caf6e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.303898 Nov 03 05:15:09.666982 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3896/7682] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:09 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:10.691574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:10.692115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:10.699835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:10.700339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:10.700814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:10.701754 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:10.702229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:10.707061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:10.848324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:10.857548 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cfbfc745-8b63-471c-a412-99fde936d446 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.170057 Nov 03 05:15:10.858456 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3787/7683] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:10 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:11.881895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:11.883153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:11.890333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:11.891250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:11.891723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:11.892527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:11.893008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:11.893482 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:12.037483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:12.046175 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0f0432e6-5271-4869-9e15-f3b56bdcf2b2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.167951 Nov 03 05:15:12.047090 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3897/7684] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:11 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:13.071885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:13.072692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:13.079542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:13.080367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:13.081045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:13.082076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:13.082621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:13.083257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:13.229147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:13.238462 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9058fa0c-d915-43b0-854c-ea9701c3ad74 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.172087 Nov 03 05:15:13.239312 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3788/7685] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:13 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:14.261069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:14.261729 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:14.269104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:14.270002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:14.270714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:14.271693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:14.272421 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:14.273667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:14.458641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:14.468754 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16e0a45f-a42a-4cd9-b34b-7fa0a61eb55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.211551 Nov 03 05:15:14.469376 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3898/7686] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:14 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:15.492174 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:15.492824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:15.505288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:15.505288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:15.505288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:15.505288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:15.505288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:15.505288 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:15.672516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:15.681077 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9196288e-0172-425b-8586-1aaef6eb0235 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.193123 Nov 03 05:15:15.697047 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3789/7687] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:15 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:16.705413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:16.706047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:16.708852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:16.709580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:16.715146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:16.715655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:16.716112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:16.716830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:16.717336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:16.717786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:16.938597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:16.939826 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-935f3ba0-9d45-494d-9ef2-a0a9520cb41e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.238291 Nov 03 05:15:16.940411 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3899/7688] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:16 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:17.439249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e8a739a7-cac6-45b5-b8e9-d55d049a86b4 req-30b7ba93-9a9d-432a-b757-16b00225e91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639cbf49-52d5-4e06-8c31-e99282af9dbd", "tag": "2eb406d7-a91c-4f95-8109-fc513d8f40f3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:17.444066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:17.453307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e8a739a7-cac6-45b5-b8e9-d55d049a86b4 req-30b7ba93-9a9d-432a-b757-16b00225e91a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:17.453823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e8a739a7-cac6-45b5-b8e9-d55d049a86b4 req-30b7ba93-9a9d-432a-b757-16b00225e91a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:17.454259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e8a739a7-cac6-45b5-b8e9-d55d049a86b4 req-30b7ba93-9a9d-432a-b757-16b00225e91a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:17.465185 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e8a739a7-cac6-45b5-b8e9-d55d049a86b4 req-30b7ba93-9a9d-432a-b757-16b00225e91a service nova] Creating event network-changed:2eb406d7-a91c-4f95-8109-fc513d8f40f3 for instance 639cbf49-52d5-4e06-8c31-e99282af9dbd on n-h2-854653-7 Nov 03 05:15:17.470138 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e8a739a7-cac6-45b5-b8e9-d55d049a86b4 req-30b7ba93-9a9d-432a-b757-16b00225e91a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034709 Nov 03 05:15:17.472510 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3790/7689] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:15:17.964182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:17.964831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:17.971972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:17.972480 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:17.972945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:17.973699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:17.974178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:17.974629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:18.175071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:18.183782 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7046b987-c850-4a98-ba2b-8ec3939bcfe8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.224019 Nov 03 05:15:18.184373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3900/7690] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:17 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:19.208810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:19.209465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:19.216655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:19.217185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:19.217633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:19.218330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:19.218793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:19.219225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:19.350273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:19.358160 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41440d60-650b-4088-bd0c-50ee2b0b350c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.154667 Nov 03 05:15:19.358734 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3791/7691] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:19 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:20.381588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:20.382269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:20.389250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:20.389762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:20.390229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:20.390951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:20.391429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:20.391881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:20.523247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:20.531155 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3cad18c1-a00d-442d-a67b-519d264e2f1f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.153546 Nov 03 05:15:20.531722 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3901/7692] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:20 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:21.555453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:21.556073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:21.563008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:21.563477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:21.563917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:21.564611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:21.565091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:21.565520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:21.696941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:21.704611 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-157bfd65-14a8-4387-b509-b85fcd0f4d7f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.153765 Nov 03 05:15:21.705225 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3792/7693] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:21 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:22.728577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:22.729450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:22.735689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:22.736196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:22.736655 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:22.737395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:22.737872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:22.738322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:22.832661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-e23c127e-be96-42fb-b770-cfcd70c6a571 req-ef08f5a0-3244-473f-90a9-6a969ede0790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639cbf49-52d5-4e06-8c31-e99282af9dbd", "name": "network-vif-plugged", "status": "completed", "tag": "2eb406d7-a91c-4f95-8109-fc513d8f40f3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:22.843006 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e23c127e-be96-42fb-b770-cfcd70c6a571 req-ef08f5a0-3244-473f-90a9-6a969ede0790 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:22.849219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e23c127e-be96-42fb-b770-cfcd70c6a571 req-ef08f5a0-3244-473f-90a9-6a969ede0790 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:22.849219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-e23c127e-be96-42fb-b770-cfcd70c6a571 req-ef08f5a0-3244-473f-90a9-6a969ede0790 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:22.855477 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-e23c127e-be96-42fb-b770-cfcd70c6a571 req-ef08f5a0-3244-473f-90a9-6a969ede0790 service nova] Creating event network-vif-plugged:2eb406d7-a91c-4f95-8109-fc513d8f40f3 for instance 639cbf49-52d5-4e06-8c31-e99282af9dbd on n-h2-854653-7 Nov 03 05:15:22.860492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-e23c127e-be96-42fb-b770-cfcd70c6a571 req-ef08f5a0-3244-473f-90a9-6a969ede0790 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031684 Nov 03 05:15:22.861129 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3793/7694] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:15:22.874152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:22.882258 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-eb843f77-2438-4bb4-a561-9e41fbafa1e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.158304 Nov 03 05:15:22.882834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3902/7695] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:22 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:23.906598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:23.907345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:23.914385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:23.914882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:23.915427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:23.916035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:23.916498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:23.916939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:24.049887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:24.057679 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19fb1434-2e89-4458-aed8-b588bcfd618a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1357 microversion: 2.1 time: 0.156547 Nov 03 05:15:24.058368 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3794/7696] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:23 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:15:25.080423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:25.081122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:25.088005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.088509 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.088970 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.089709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.090187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.090636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.221214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:25.229671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5503b85b-ea1d-4578-b619-896fcc6f677f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1547 microversion: 2.1 time: 0.153272 Nov 03 05:15:25.230264 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3903/7697] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:25 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:25.252157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:25.252781 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:25.259596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.260082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.260526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.261253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.261715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.262146 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.393810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:25.405539 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b4653d87-3b1c-4980-be1d-ed73b06ce8ac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1547 microversion: 2.1 time: 0.157275 Nov 03 05:15:25.406123 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3795/7698] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:25 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:25.427784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:25.432563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:25.433385 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Searching by: {'deleted': False, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36'} {{(pid=127594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 05:15:25.438668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.439196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.439653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.440401 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.440876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.441364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.466453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.multi_cell_list [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 05:15:25.494340 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4d20d1d8-080f-47d5-bf71-2dbe27648661 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.070452 Nov 03 05:15:25.494933 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3904/7699] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 05:15:25 2022] GET /compute/v2.1/servers => generated 342 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:15:25.506652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:25.507279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:25.513384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.513880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.514324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.515030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:25.515692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:25.516127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:25.649649 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:25.657635 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6fc8e684-4376-41be-aa27-24759874b7e9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1547 microversion: 2.1 time: 0.154957 Nov 03 05:15:25.658204 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3796/7700] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:25 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:15:28.639638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "111663f5-078d-4158-a523-bce1e37964d3"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:28.642162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:28.649867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:28.650370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:28.650829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:28.651795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:28.652267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:28.652714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:29.272880 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6292057-4d76-434a-a92c-86d1fef837e1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637183 Nov 03 05:15:29.273530 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3905/7701] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 05:15:28 2022] POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:15:43.705473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:43.706225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:43.709285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:43.710634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=58 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:43.715531 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:43.716027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:43.716470 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:43.717207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:43.717687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:43.718161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:43.885144 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:43.893745 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7c005b3e-5779-4002-b19e-d1c377c5a372 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1593 microversion: 2.1 time: 0.192612 Nov 03 05:15:43.894352 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3797/7702] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:43 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1593 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:15:46.307514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:46.308607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:46.309266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:15:46.381175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-16199846-9af2-4636-b9fa-fcc8ce42f66e req-07882500-dc62-427d-9338-36cdef5cb7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639cbf49-52d5-4e06-8c31-e99282af9dbd", "tag": "2eb406d7-a91c-4f95-8109-fc513d8f40f3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:46.390904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-16199846-9af2-4636-b9fa-fcc8ce42f66e req-07882500-dc62-427d-9338-36cdef5cb7f0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:46.392430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-16199846-9af2-4636-b9fa-fcc8ce42f66e req-07882500-dc62-427d-9338-36cdef5cb7f0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:46.392430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-16199846-9af2-4636-b9fa-fcc8ce42f66e req-07882500-dc62-427d-9338-36cdef5cb7f0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:46.404658 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-16199846-9af2-4636-b9fa-fcc8ce42f66e req-07882500-dc62-427d-9338-36cdef5cb7f0 service nova] Creating event network-changed:2eb406d7-a91c-4f95-8109-fc513d8f40f3 for instance 639cbf49-52d5-4e06-8c31-e99282af9dbd on n-h2-854653-7 Nov 03 05:15:46.410052 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-16199846-9af2-4636-b9fa-fcc8ce42f66e req-07882500-dc62-427d-9338-36cdef5cb7f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104158 Nov 03 05:15:46.410678 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3906/7703] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:15:48.633567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-506438275"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:48.634155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:48.641833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:48.642307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:48.642751 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:48.643449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:48.643912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:48.644337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:48.769626 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.network.security_group_api [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Adding security group 7bb8c577-1c54-4dd2-88cb-7126cb2a05f7 to port 2eb406d7-a91c-4f95-8109-fc513d8f40f3 Nov 03 05:15:49.134295 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-24b6e34b-3d8e-4480-befe-9f1d2c9498c5 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.500843 Nov 03 05:15:49.134295 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3798/7704] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:15:48 2022] POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:15:49.143112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-555f6aa3-25a0-47d5-8bf2-3543b7989b4f req-040455e9-41b2-484c-a15b-20710f3c0531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639cbf49-52d5-4e06-8c31-e99282af9dbd", "tag": "2eb406d7-a91c-4f95-8109-fc513d8f40f3"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:15:49.150156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:15:49.151588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:15:49.157653 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:49.158677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:49.159362 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:49.160333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:49.160982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:49.161638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:49.162405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-555f6aa3-25a0-47d5-8bf2-3543b7989b4f req-040455e9-41b2-484c-a15b-20710f3c0531 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:15:49.162922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-555f6aa3-25a0-47d5-8bf2-3543b7989b4f req-040455e9-41b2-484c-a15b-20710f3c0531 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:15:49.163888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-555f6aa3-25a0-47d5-8bf2-3543b7989b4f req-040455e9-41b2-484c-a15b-20710f3c0531 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:15:49.177362 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-555f6aa3-25a0-47d5-8bf2-3543b7989b4f req-040455e9-41b2-484c-a15b-20710f3c0531 service nova] Creating event network-changed:2eb406d7-a91c-4f95-8109-fc513d8f40f3 for instance 639cbf49-52d5-4e06-8c31-e99282af9dbd on n-h2-854653-7 Nov 03 05:15:49.184099 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-555f6aa3-25a0-47d5-8bf2-3543b7989b4f req-040455e9-41b2-484c-a15b-20710f3c0531 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048479 Nov 03 05:15:49.185099 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3907/7705] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:15:49.427175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:15:49.436410 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1d0db66-f3d6-46cc-ae74-e28911ecd9d2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1758 microversion: 2.1 time: 0.297426 Nov 03 05:15:49.436999 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3799/7706] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:15:49 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1758 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:17:27.501611 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:17:27.502479 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:17:27.502618 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:17:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/action (ip 10.222.0.30) !!! Nov 03 05:17:27.516278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:17:27.518672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:17:27.525502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:27.532340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:27.532340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:27.532340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:27.532340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:27.532340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:27.726552 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a9996093-0f10-49d6-9123-c3d69f266e73 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.227461 Nov 03 05:17:27.727193 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3908/7707] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:17:27 2022] POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:17:27.736342 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:17:27.736342 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:17:27.736342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:17:27.736342 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:17:27.737184 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:17:27.737184 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:17:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd (ip 10.222.0.30) !!! Nov 03 05:17:27.741351 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:17:27.741964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:17:27.749625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:27.750127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:27.750549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:27.751251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:27.751707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:27.752135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:27.937603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:17:27.946230 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8b988dd1-5c77-488f-9eb3-034246667e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1760 microversion: 2.1 time: 0.214820 Nov 03 05:17:27.946831 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3800/7708] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:17:27 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1760 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:17:28.971408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:17:28.972125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:17:28.982246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:28.982693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:28.983166 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:28.983926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:28.984407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:28.984856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:28.991907 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33300. Nov 03 05:17:29.139221 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:17:29.147705 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2e55bff2-bd71-4129-b20c-6194df85044f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1765 microversion: 2.1 time: 0.181276 Nov 03 05:17:29.148285 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3909/7709] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:17:28 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1765 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:17:30.171923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:17:30.172476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:17:30.183586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:30.184084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:30.184566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:30.185371 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:17:30.185833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:17:30.186271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:17:30.192459 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33306. Nov 03 05:17:30.193273 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33304. Nov 03 05:17:30.328855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:17:30.337030 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb6c1c3b-6eb7-4b60-91b2-17cb1392f0e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1758 microversion: 2.1 time: 0.169122 Nov 03 05:17:30.337606 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3801/7710] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:17:30 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:18:44.929775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:18:44.930688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:18:44.934765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-506438275"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:18:44.935363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:44.941252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:44.951669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:44.951669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:44.951669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:44.951669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:44.951669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:45.413285 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.security_group_api [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Removing security group 7bb8c577-1c54-4dd2-88cb-7126cb2a05f7 from port 2eb406d7-a91c-4f95-8109-fc513d8f40f3 Nov 03 05:18:45.767792 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf2fee3c-34ae-427b-b283-e0068c771363 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.836157 Nov 03 05:18:45.767792 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3910/7711] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:18:44 2022] POST /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/action => generated 0 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:18:45.773221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:18:45.774501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=12 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:18:45.783602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639cbf49-52d5-4e06-8c31-e99282af9dbd", "tag": "2eb406d7-a91c-4f95-8109-fc513d8f40f3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:18:45.805052 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:45.805528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:45.806512 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:45.820769 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] Creating event network-changed:2eb406d7-a91c-4f95-8109-fc513d8f40f3 for instance 639cbf49-52d5-4e06-8c31-e99282af9dbd on n-h2-854653-7 Nov 03 05:18:45.825364 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] [34dd9edd-c4e7-4963-9ea3-0ef8024d8f70] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:18:46.833452 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] [34dd9edd-c4e7-4963-9ea3-0ef8024d8f70] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33350. Nov 03 05:18:46.837313 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-56fb1a90-4354-4c2e-a5e7-87d87f29bab9 req-13427136-5bc0-4c35-b22d-c75584f1019e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.066046 Nov 03 05:18:46.838161 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3802/7712] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:18:47.095607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:47.096198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:47.103733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:47.104470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:47.105304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:47.110456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:47.110456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:47.110456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:47.197947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lazy-loading 'services' on Instance uuid 639cbf49-52d5-4e06-8c31-e99282af9dbd {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:18:47.372253 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fa6f981a-8f32-488d-b458-27bd3aff4568 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments/111663f5-078d-4158-a523-bce1e37964d3" status: 202 len: 0 microversion: 2.1 time: 0.282270 Nov 03 05:18:47.374353 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3911/7713] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:18:47 2022] DELETE /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments/111663f5-078d-4158-a523-bce1e37964d3 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:18:47.384438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:47.387330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:47.395375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:47.397344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:47.398091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:47.399008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:47.399917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:47.400544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:47.433623 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d1883119-b58d-4999-a867-ff19c9664b05 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054829 Nov 03 05:18:47.438973 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3803/7714] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:18:47 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:18:48.448327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:48.450796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:48.457142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:48.457645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:48.458090 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:48.458794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:48.459294 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:48.459733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:48.489929 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-915ea580-49eb-4bb2-9fd1-d73fd7aae947 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046893 Nov 03 05:18:48.490491 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3912/7715] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:18:48 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:18:48.934741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6b51e19d-642b-4cf1-a697-f409a9273e6f req-a4608e5a-13b3-4096-9396-377c701a7cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639cbf49-52d5-4e06-8c31-e99282af9dbd", "tag": "2eb406d7-a91c-4f95-8109-fc513d8f40f3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:18:48.944162 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6b51e19d-642b-4cf1-a697-f409a9273e6f req-a4608e5a-13b3-4096-9396-377c701a7cf7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:48.944644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6b51e19d-642b-4cf1-a697-f409a9273e6f req-a4608e5a-13b3-4096-9396-377c701a7cf7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:48.945113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6b51e19d-642b-4cf1-a697-f409a9273e6f req-a4608e5a-13b3-4096-9396-377c701a7cf7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:48.956823 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6b51e19d-642b-4cf1-a697-f409a9273e6f req-a4608e5a-13b3-4096-9396-377c701a7cf7 service nova] Creating event network-changed:2eb406d7-a91c-4f95-8109-fc513d8f40f3 for instance 639cbf49-52d5-4e06-8c31-e99282af9dbd on n-h2-854653-7 Nov 03 05:18:48.961927 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6b51e19d-642b-4cf1-a697-f409a9273e6f req-a4608e5a-13b3-4096-9396-377c701a7cf7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101163 Nov 03 05:18:48.962528 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3804/7716] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:18:49.502145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:49.504450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:49.511693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:49.512284 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:49.512835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:49.514204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:49.514744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:49.515270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:49.546532 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0f0d11bf-f0f8-4a75-9d31-63a2f08ea3bb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 Nov 03 05:18:49.547092 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3913/7717] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:18:49 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:18:50.560668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:50.563026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:50.569439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:50.569938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:50.570390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:50.571099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:50.571565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:50.572001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:50.602302 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-491a3b48-d0e3-4b44-98ff-d8d5209ab69d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046919 Nov 03 05:18:50.602878 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3805/7718] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:18:50 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:18:51.615140 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:51.617488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:51.624164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:51.624665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:51.625155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:51.625876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:51.626355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:51.626831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:51.657421 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7a9f40c-6c73-417f-a948-8172597cf0fa tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Nov 03 05:18:51.657996 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3914/7719] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:18:51 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:18:52.670011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:52.672208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:52.679038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:52.679530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:52.679975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:52.680680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:52.681179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:52.681611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:52.710929 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c3b889b9-5156-4004-b4cf-ae5a4a9f77dc tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044918 Nov 03 05:18:52.711518 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3806/7720] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:18:52 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 05:18:52.722875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:52.723386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:52.730209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:52.730715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:52.731176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:52.731891 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:52.732363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:52.732811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:52.806807 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] HTTP exception thrown: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd is not attached to volume 111663f5-078d-4158-a523-bce1e37964d3 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Request method failure captured: Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: request: DELETE /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments/111663f5-078d-4158-a523-bce1e37964d3 HTTP/1.1 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY05HcGfBVo0VAptFkbTzISgTBPyi54jTw3k_vCClK6jtkDWZQ27Xo3HpKhDnJvi-OytyQeRDUub8Au79dRXLpkSMH2zZC4F8wi9JXRU90IHv-OwJ1FrqqvbIb1jH7FoXwZtWQPZckZS2I6C25CS3Orw_MSVTVk--YQxGv_7cjye5vGE Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_387cc504e8a3452d98b110ea4d2a8a36", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/387cc504e8a3452d98b110ea4d2a8a36"}]}] Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 4f427b3646f54546986ee0a606c404b9 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd is not attached to volume 111663f5-078d-4158-a523-bce1e37964d3 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'server_id': '639cbf49-52d5-4e06-8c31-e99282af9dbd', 'id': '111663f5-078d-4158-a523-bce1e37964d3'} Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 111663f5-078d-4158-a523-bce1e37964d3. Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd is not attached to volume 111663f5-078d-4158-a523-bce1e37964d3 Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:18:52.808441 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:18:52.814108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:18:52.814108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:18:52.814108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd is not attached to volume 111663f5-078d-4158-a523-bce1e37964d3 Nov 03 05:18:52.814108 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:52.814108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Returning 404 to user: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd is not attached to volume 111663f5-078d-4158-a523-bce1e37964d3 {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:18:52.814108 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1467a94a-095c-42be-95ba-662596b9c67a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments/111663f5-078d-4158-a523-bce1e37964d3" status: 404 len: 154 microversion: 2.1 time: 0.091152 Nov 03 05:18:52.814108 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3915/7721] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:18:52 2022] DELETE /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd/os-volume_attachments/111663f5-078d-4158-a523-bce1e37964d3 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:18:56.198200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:56.198732 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:56.205856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:56.206435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:56.206871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:56.207570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:56.208029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:56.208461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:56.233352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:18:56.447850 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-dd765cc0-355e-411f-81bd-7540de5fe3eb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 204 len: 0 microversion: 2.1 time: 0.253193 Nov 03 05:18:56.448395 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3807/7722] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:18:56 2022] DELETE /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:18:56.457191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:56.457851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:56.468291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:56.470975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:56.470975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:56.470975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:56.470975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:56.471540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:56.609192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:18:56.617053 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c828cdb4-b119-44c8-b69a-30124b7a3f4e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1553 microversion: 2.1 time: 0.164298 Nov 03 05:18:56.617616 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3916/7723] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:18:56 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:18:57.640966 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:57.658551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:57.658551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:57.658551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:57.658551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:57.658551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:57.658551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:57.658551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:57.779614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:18:57.787374 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27a52c2e-6589-4641-8a5f-08d088a50bec tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1553 microversion: 2.1 time: 0.150741 Nov 03 05:18:57.787952 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3808/7724] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:18:57 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:18:58.811674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:58.812404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:58.819912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:58.821198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:58.821198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:58.821649 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:58.822132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:58.822585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:58.910475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:18:58.918760 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c80fc648-3361-4b8c-b6bc-05b41e252e0b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 200 len: 1511 microversion: 2.1 time: 0.111719 Nov 03 05:18:58.920164 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3917/7725] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:18:58 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 1511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:18:58.925181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a5a17c85-94a7-4a62-bab9-7c4456ac4de5 req-3287e794-846c-4d87-9221-10228a75096a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639cbf49-52d5-4e06-8c31-e99282af9dbd", "name": "network-vif-deleted", "tag": "2eb406d7-a91c-4f95-8109-fc513d8f40f3"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:18:58.939663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a5a17c85-94a7-4a62-bab9-7c4456ac4de5 req-3287e794-846c-4d87-9221-10228a75096a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:58.939663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a5a17c85-94a7-4a62-bab9-7c4456ac4de5 req-3287e794-846c-4d87-9221-10228a75096a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:58.939663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a5a17c85-94a7-4a62-bab9-7c4456ac4de5 req-3287e794-846c-4d87-9221-10228a75096a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:58.947957 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a5a17c85-94a7-4a62-bab9-7c4456ac4de5 req-3287e794-846c-4d87-9221-10228a75096a service nova] Creating event network-vif-deleted:2eb406d7-a91c-4f95-8109-fc513d8f40f3 for instance 639cbf49-52d5-4e06-8c31-e99282af9dbd on n-h2-854653-7 Nov 03 05:18:58.953159 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a5a17c85-94a7-4a62-bab9-7c4456ac4de5 req-3287e794-846c-4d87-9221-10228a75096a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031945 Nov 03 05:18:58.953935 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3809/7726] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:18:59.942245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:59.942917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 639cbf49-52d5-4e06-8c31-e99282af9dbd] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:18:59.949636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:59.951060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:59.951227 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:59.951945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:18:59.952420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:18:59.952889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:18:59.967117 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] HTTP exception thrown: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd could not be found. Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Request method failure captured: Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd HTTP/1.1 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY05HcGfBVo0VAptFkbTzISgTBPyi54jTw3k_vCClK6jtkDWZQ27Xo3HpKhDnJvi-OytyQeRDUub8Au79dRXLpkSMH2zZC4F8wi9JXRU90IHv-OwJ1FrqqvbIb1jH7FoXwZtWQPZckZS2I6C25CS3Orw_MSVTVk--YQxGv_7cjye5vGE Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_387cc504e8a3452d98b110ea4d2a8a36", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/387cc504e8a3452d98b110ea4d2a8a36"}]}] Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 4f427b3646f54546986ee0a606c404b9 Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd could not be found. Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '639cbf49-52d5-4e06-8c31-e99282af9dbd'} Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd could not be found. Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd could not be found. Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:18:59.968668 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd could not be found. Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Returning 404 to user: Instance 639cbf49-52d5-4e06-8c31-e99282af9dbd could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef2ed4da-34e5-4416-8be8-bf38416c8b94 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd" status: 404 len: 111 microversion: 2.1 time: 0.031883 Nov 03 05:18:59.973889 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3918/7727] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:18:59 2022] GET /compute/v2.1/servers/639cbf49-52d5-4e06-8c31-e99282af9dbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 05:18:59.980572 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-37c68f6d-13b9-4bb8-904c-f36a124228ed tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '.version_select at 0x7ff7fd535790>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:18:59.985063 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37c68f6d-13b9-4bb8-904c-f36a124228ed tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:19:00.991973 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [None req-37c68f6d-13b9-4bb8-904c-f36a124228ed tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 33410. Nov 03 05:19:01.070592 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-37c68f6d-13b9-4bb8-904c-f36a124228ed tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-887325727" status: 202 len: 0 microversion: 2.1 time: 1.095263 Nov 03 05:19:01.071267 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3810/7728] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 05:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-887325727 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:19:12.525047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9f704b9-4828-41fa-8e18-0fadb4c4bff9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'create', calling method: .version_select at 0x7ff7f92f7dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-453335426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAdxf7i+wfw2RfHvs3DzEkTDRPCWlR0wRhKYShPjM77HhVNqYpaG/6uF3MQ4tmkaFV+1LLJAzKXFZsN9NkycsKpNUIoP16nrbcJmcYajqrEQPyc+WamMwRzULtR296cbg=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:12.532832 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:19:12.534084 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.30) !!! Nov 03 05:19:12.534794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=18 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:12.535523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:12.550039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d9f704b9-4828-41fa-8e18-0fadb4c4bff9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:19:12.555199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d9f704b9-4828-41fa-8e18-0fadb4c4bff9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for user 4f427b3646f54546986ee0a606c404b9 and project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:19:12.670692 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9f704b9-4828-41fa-8e18-0fadb4c4bff9 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.149554 Nov 03 05:19:12.671310 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3919/7729] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:19:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:19:12.719711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:12.720500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:12.725183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1100591167", "imageRef": "2d31d034-7e2d-40e9-8ab9-c18b81870fcb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-453335426", "networks": [{"uuid": "db73e6f7-aa30-45ed-8965-41d4160b64b4"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:12.776822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] validate_networks() for [('db73e6f7-aa30-45ed-8965-41d4160b64b4', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:19:13.193155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:19:13.193589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:19:13.194073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:19:13.194487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:19:13.194902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:19:13.203884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:13.204397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:13.204839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:13.205612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:13.206072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:13.206501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:13.223377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:19:13.228611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Getting quotas for user 4f427b3646f54546986ee0a606c404b9 and project 387cc504e8a3452d98b110ea4d2a8a36. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:19:13.241354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:19:13.243757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d31d034-7e2d-40e9-8ab9-c18b81870fcb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:19:13.370717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a1548797-f6d9-403d-8710-5554cf81cfe6 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653337 Nov 03 05:19:13.371300 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3811/7730] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:19:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:19:13.382569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7a26c721-3ab1-49ab-b77c-6803eeb43a66 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:13.383245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7a26c721-3ab1-49ab-b77c-6803eeb43a66 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:13.442886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7a26c721-3ab1-49ab-b77c-6803eeb43a66 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:13.449972 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7a26c721-3ab1-49ab-b77c-6803eeb43a66 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1258 microversion: 2.1 time: 0.071547 Nov 03 05:19:13.450544 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3920/7731] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:13 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:14.472534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2800c532-7ee5-4c14-9f28-62347eaa6ba3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:14.473179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2800c532-7ee5-4c14-9f28-62347eaa6ba3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:14.526589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2800c532-7ee5-4c14-9f28-62347eaa6ba3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:14.533684 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2800c532-7ee5-4c14-9f28-62347eaa6ba3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1258 microversion: 2.1 time: 0.065949 Nov 03 05:19:14.534252 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3812/7732] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:14 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:15.556840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-99899588-f6b7-4379-87f3-eebf9bc4115b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:15.557544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-99899588-f6b7-4379-87f3-eebf9bc4115b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:15.611812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-99899588-f6b7-4379-87f3-eebf9bc4115b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:15.619746 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-99899588-f6b7-4379-87f3-eebf9bc4115b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1258 microversion: 2.1 time: 0.067254 Nov 03 05:19:15.620315 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3921/7733] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:15 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:16.642942 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a5175f3d-1d49-4d5c-874a-721f311c9bc8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:16.643565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a5175f3d-1d49-4d5c-874a-721f311c9bc8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:16.697180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a5175f3d-1d49-4d5c-874a-721f311c9bc8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:16.704204 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a5175f3d-1d49-4d5c-874a-721f311c9bc8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1258 microversion: 2.1 time: 0.065844 Nov 03 05:19:16.704773 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3813/7734] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:16 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:17.726777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:17.727314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:17.734210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:17.734704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:17.735165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:17.735861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:17.736332 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:17.736772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:17.799580 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:17.807230 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb956ec4-740a-423d-8a47-63fdc3566179 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1262 microversion: 2.1 time: 0.084491 Nov 03 05:19:17.807792 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3922/7735] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:17 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:18.830502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:18.831120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:18.838839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:18.839330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:18.839773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:18.840473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:18.840930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:18.841392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:18.903919 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:18.912505 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f98ad2af-4ada-4abf-85e0-861670610b88 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1310 microversion: 2.1 time: 0.085813 Nov 03 05:19:18.913114 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3814/7736] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:18 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:19.935717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:19.936352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:19.943849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:19.948408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:19.948408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:19.948408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:19.948408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:19.948408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:20.017442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:20.023178 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4ab79118-31d9-4517-85a2-6a0f6a7dae5c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1316 microversion: 2.1 time: 0.091298 Nov 03 05:19:20.023662 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3923/7737] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:19 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:21.047666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:21.048268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:21.055145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:21.055630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:21.056072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:21.056764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:21.057249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:21.057676 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:21.201672 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:21.210209 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-245c83af-7a06-42d6-bd44-0156e6782a69 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.166999 Nov 03 05:19:21.210923 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3815/7738] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:21 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:22.235484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:22.236434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:22.243397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:22.243912 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:22.244377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:22.245133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:22.245612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:22.246603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:22.382674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:22.391119 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-91bd1140-ee6d-4370-86da-d948488d006d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.160715 Nov 03 05:19:22.391712 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3924/7739] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:22 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:23.417004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:23.417643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:23.420463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:23.427099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:23.427608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:23.428056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:23.428782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:23.429279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:23.429753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:23.595347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:23.604882 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-65cdab5b-0f68-4c2f-b3ad-4eab11b1a51d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.191811 Nov 03 05:19:23.621596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3816/7740] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:23 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:24.628892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:24.629577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:24.637145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:24.637660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:24.638127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:24.638896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:24.639377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:24.640437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:24.777735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:24.785770 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-757a42e8-9f39-4542-adfd-a58783292137 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.161576 Nov 03 05:19:24.786345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3925/7741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:24 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:25.808348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:25.808983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:25.816390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:25.816885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:25.817356 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:25.818320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:25.818789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:25.819217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:25.965952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:25.974798 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6889d533-f85c-49eb-a5db-035cac455497 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.170669 Nov 03 05:19:25.975734 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3817/7742] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:25 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:26.998810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:26.999475 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:27.002736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:27.007643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:27.008253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:27.008786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:27.009618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:27.010172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:27.010713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:27.163715 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:27.172574 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3af62a2d-7170-4a24-b96b-5ec9ec0ea560 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.177847 Nov 03 05:19:27.173195 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3926/7743] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:26 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:28.195616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:28.196256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:28.198178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:28.204422 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:28.204914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:28.205392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:28.206101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:28.206597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:28.207031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:28.410056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:28.417731 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cff5bd7f-87ce-4ec3-8d74-31c0e20cd5e0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.226210 Nov 03 05:19:28.418313 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3818/7744] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:28 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:28.572053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d09572bd-0e72-48be-a58c-d2a46579d1b0 req-2f0e1a31-3fe8-4c2b-8e2a-cc74924b5c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00ec7-1211-418e-ab91-87f436201974", "tag": "16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:28.583896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d09572bd-0e72-48be-a58c-d2a46579d1b0 req-2f0e1a31-3fe8-4c2b-8e2a-cc74924b5c21 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:28.584390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d09572bd-0e72-48be-a58c-d2a46579d1b0 req-2f0e1a31-3fe8-4c2b-8e2a-cc74924b5c21 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:28.584858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d09572bd-0e72-48be-a58c-d2a46579d1b0 req-2f0e1a31-3fe8-4c2b-8e2a-cc74924b5c21 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:28.596690 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d09572bd-0e72-48be-a58c-d2a46579d1b0 req-2f0e1a31-3fe8-4c2b-8e2a-cc74924b5c21 service nova] Creating event network-changed:16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae for instance 64c00ec7-1211-418e-ab91-87f436201974 on n-h2-854653-7 Nov 03 05:19:28.602447 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d09572bd-0e72-48be-a58c-d2a46579d1b0 req-2f0e1a31-3fe8-4c2b-8e2a-cc74924b5c21 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033900 Nov 03 05:19:28.605504 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3927/7745] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:19:29.441994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:29.442628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:29.449882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:29.450382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:29.450833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:29.451537 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:29.452001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:29.452435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:29.646002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:29.653992 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-547fc9cd-11b1-4273-b182-8594ef29dd70 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.215932 Nov 03 05:19:29.654579 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3819/7746] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:29 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:30.677491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:30.678240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:30.685049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:30.685562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:30.686015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:30.687244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:30.687732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:30.688153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:30.820410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:30.828942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dbb027e8-4709-4ede-b5aa-cef0f838d4ff tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.155941 Nov 03 05:19:30.829550 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3928/7747] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:30 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:31.851791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:31.852418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:31.859276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:31.859771 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:31.860222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:31.860929 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:31.861418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:31.861865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:31.990832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:31.998547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-256e646e-433b-4ce8-a2bb-e71212c80d20 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.150872 Nov 03 05:19:31.999720 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3820/7748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:31 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:33.021706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:33.022343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:33.029561 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:33.030066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:33.030527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:33.031239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:33.031717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:33.032167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:33.165587 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:33.173802 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3d54c987-f9a9-4305-b5ae-2bfc5cc7903e tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.156052 Nov 03 05:19:33.174382 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3929/7749] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:33 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:33.836012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8bb62bc0-af32-4303-93db-4b513efb662d req-55b6c394-978b-4937-8e34-5a5b7d4ae554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c00ec7-1211-418e-ab91-87f436201974", "name": "network-vif-plugged", "status": "completed", "tag": "16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:33.846135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8bb62bc0-af32-4303-93db-4b513efb662d req-55b6c394-978b-4937-8e34-5a5b7d4ae554 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:33.846549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8bb62bc0-af32-4303-93db-4b513efb662d req-55b6c394-978b-4937-8e34-5a5b7d4ae554 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:33.846978 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8bb62bc0-af32-4303-93db-4b513efb662d req-55b6c394-978b-4937-8e34-5a5b7d4ae554 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:33.858594 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8bb62bc0-af32-4303-93db-4b513efb662d req-55b6c394-978b-4937-8e34-5a5b7d4ae554 service nova] Creating event network-vif-plugged:16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae for instance 64c00ec7-1211-418e-ab91-87f436201974 on n-h2-854653-7 Nov 03 05:19:33.863542 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8bb62bc0-af32-4303-93db-4b513efb662d req-55b6c394-978b-4937-8e34-5a5b7d4ae554 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086585 Nov 03 05:19:33.864138 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3821/7750] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:19:34.196842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:34.197502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:34.204825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:34.205367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:34.205826 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:34.206528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:34.206998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:34.207441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:34.338734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:34.346459 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4a42ee44-c71c-4ef9-a2ff-54777d7cf1d7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1358 microversion: 2.1 time: 0.153618 Nov 03 05:19:34.347035 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3930/7751] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:34 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:35.369915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:35.370640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:35.376995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.377517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.378687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.379398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.380169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.380599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.520667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:35.529278 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-801e7041-a3c9-4404-9456-304e6eabd55a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1547 microversion: 2.1 time: 0.164614 Nov 03 05:19:35.530435 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3822/7752] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:35 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:35.551737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:35.552458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:35.559639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.560209 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.560736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.561541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.562076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.562601 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.691974 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:35.699916 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3803ea3f-d088-493d-8bd9-60dd61ab874f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1547 microversion: 2.1 time: 0.152063 Nov 03 05:19:35.700499 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3931/7753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:35 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:35.723104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:35.728041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:35.728842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Searching by: {'deleted': False, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36'} {{(pid=127593) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 03 05:19:35.734639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.735138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.735586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.736339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.736807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.737270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.766897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.multi_cell_list [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127593) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 03 05:19:35.794411 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d46824aa-6d1f-4ecd-8b92-d5c25a74ab3c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.075328 Nov 03 05:19:35.795005 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3823/7754] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Nov 3 05:19:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:19:35.806763 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:35.807404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:35.813980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.814488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.814953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.815669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:35.816149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:35.816598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:35.956063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:35.963945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c2baa1b-c5f1-4d78-9977-37ba8c7c4cbf tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1547 microversion: 2.1 time: 0.161201 Nov 03 05:19:35.964518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3932/7755] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:35 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:38.712557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "349714fa-1b3c-4148-b3a8-84cf5ff6a021"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:38.714977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:38.721997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:38.722476 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:38.722914 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:38.723602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:38.724053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:38.724473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:39.341689 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-006d72aa-00ae-4792-aadf-dc40aef6cd39 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632871 Nov 03 05:19:39.342252 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3824/7756] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Nov 3 05:19:38 2022] POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:19:51.184652 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:51.185330 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:51.189273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:51.189975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=62 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:51.195148 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:51.195657 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:51.196118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:51.196842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:51.197351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:51.197810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:51.334946 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:51.343315 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9760b2c2-d8c6-4883-9476-f76ba35097b3 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1593 microversion: 2.1 time: 0.162639 Nov 03 05:19:51.343890 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3933/7757] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:51 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:19:53.219121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:53.220604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:53.221277 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:19:53.226894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ac6cc585-331c-42dd-a4e0-84a913b04e4d req-4abeb433-3ec7-4e55-a05f-c3530285e28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00ec7-1211-418e-ab91-87f436201974", "tag": "16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:53.236265 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac6cc585-331c-42dd-a4e0-84a913b04e4d req-4abeb433-3ec7-4e55-a05f-c3530285e28c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:53.239700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac6cc585-331c-42dd-a4e0-84a913b04e4d req-4abeb433-3ec7-4e55-a05f-c3530285e28c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:53.239700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac6cc585-331c-42dd-a4e0-84a913b04e4d req-4abeb433-3ec7-4e55-a05f-c3530285e28c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:53.249222 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-ac6cc585-331c-42dd-a4e0-84a913b04e4d req-4abeb433-3ec7-4e55-a05f-c3530285e28c service nova] Creating event network-changed:16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae for instance 64c00ec7-1211-418e-ab91-87f436201974 on n-h2-854653-7 Nov 03 05:19:53.255220 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ac6cc585-331c-42dd-a4e0-84a913b04e4d req-4abeb433-3ec7-4e55-a05f-c3530285e28c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038062 Nov 03 05:19:53.255837 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3825/7758] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:19:56.210434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-120736219"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:56.211020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:56.217663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:56.218174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:56.218635 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:56.219860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:56.220419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:56.220850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:56.352192 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.security_group_api [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Adding security group 0ea87684-c6bf-4df3-8fca-3e5e6cd5819e to port 16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae Nov 03 05:19:56.729422 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6778bc6d-6e69-4edd-8f76-26f0304aeb27 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/action" status: 202 len: 0 microversion: 2.1 time: 0.523131 Nov 03 05:19:56.730577 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3934/7759] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:19:56 2022] POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:19:56.742216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:19:56.742852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:19:56.747414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b1b99505-8637-4355-ad6e-3bbf26da3c38 req-0d58b198-d5ff-4e03-8118-2f1fb7473b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00ec7-1211-418e-ab91-87f436201974", "tag": "16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:19:56.759160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:56.759678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:56.760142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:56.760387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b1b99505-8637-4355-ad6e-3bbf26da3c38 req-0d58b198-d5ff-4e03-8118-2f1fb7473b72 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:56.760875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:19:56.761004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b1b99505-8637-4355-ad6e-3bbf26da3c38 req-0d58b198-d5ff-4e03-8118-2f1fb7473b72 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:56.761333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b1b99505-8637-4355-ad6e-3bbf26da3c38 req-0d58b198-d5ff-4e03-8118-2f1fb7473b72 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:56.761549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:19:56.762180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:19:56.776121 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b1b99505-8637-4355-ad6e-3bbf26da3c38 req-0d58b198-d5ff-4e03-8118-2f1fb7473b72 service nova] Creating event network-changed:16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae for instance 64c00ec7-1211-418e-ab91-87f436201974 on n-h2-854653-7 Nov 03 05:19:56.783345 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b1b99505-8637-4355-ad6e-3bbf26da3c38 req-0d58b198-d5ff-4e03-8118-2f1fb7473b72 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049364 Nov 03 05:19:56.784396 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3826/7760] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:19:57.030693 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:19:57.039585 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f5adfdb5-1c7f-4c30-90b5-a7815f73033c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1758 microversion: 2.1 time: 0.301204 Nov 03 05:19:57.042821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3935/7761] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:19:56 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1758 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:16.637428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:20:16.639765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:16.647585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:16.648078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:16.648528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:16.649273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:16.649734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:16.653217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:16.890130 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-71703277-b569-45d8-8c7f-63bbd90c92e7 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/action" status: 202 len: 0 microversion: 2.1 time: 0.258038 Nov 03 05:20:16.890744 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3827/7762] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:20:16 2022] POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:20:16.899978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:16.901333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:16.904335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:20:16.905243 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=16 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:20:16.910187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:16.910694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:16.911185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:16.912068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:16.912555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:16.913000 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:17.160583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:17.169293 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8e8287ee-2ff6-4420-bd7f-f45c310f8beb tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1750 microversion: 2.1 time: 0.274082 Nov 03 05:20:17.170093 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3936/7763] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:16 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1750 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:18.195616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:18.196240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:18.202571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:18.203102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:18.203552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:18.204256 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:18.204716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:18.205177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:18.395239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:18.404003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e6ee6c11-7f58-4347-a3e1-6bab92908605 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.213552 Nov 03 05:20:18.404814 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3828/7764] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:18 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:19.427801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:19.428481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:19.435506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:19.436015 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:19.436481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:19.437771 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:19.438251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:19.438710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:19.590725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:19.599078 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-109ba205-ddeb-413c-bec9-d700b507c230 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.175306 Nov 03 05:20:19.599657 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3937/7765] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:19 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:20.622359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:20.622994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:20.630615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:20.631107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:20.631552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:20.632258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:20.632718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:20.633177 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:20.781937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:20.790403 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6e5db438-2836-4189-ba05-5d0a109050c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.171967 Nov 03 05:20:20.790996 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3829/7766] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:20 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:21.813963 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:21.814607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:21.821514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:21.822048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:21.822490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:21.823217 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:21.823697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:21.824146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:21.972945 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:21.981316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1303c709-49ed-467d-bbcd-23da893b820c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.171519 Nov 03 05:20:21.981890 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3938/7767] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:21 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:23.004526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:23.005182 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:23.012044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:23.012540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:23.012990 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:23.013724 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:23.014186 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:23.014619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:23.158980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:23.167353 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-26d76dd1-1423-49cc-a805-8c83f48c38c2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.166831 Nov 03 05:20:23.167943 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3830/7768] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:22 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:24.191886 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:24.192444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:24.199366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:24.199900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:24.200356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:24.201158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:24.201631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:24.202075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:24.346508 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:24.355261 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-740b51b5-fffb-421a-ab04-6ee86452ec30 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.167088 Nov 03 05:20:24.355855 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3939/7769] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:24 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:25.379458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:25.380086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:25.387130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:25.388023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:25.388140 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:25.388756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:25.389253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:25.390343 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:25.539502 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:25.548090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d287b8d2-0ec2-4eec-bf7a-94a565cc24b0 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.172497 Nov 03 05:20:25.552767 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3831/7770] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:25 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:26.571852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:26.572518 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:26.580260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:26.580767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:26.581259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:26.581983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:26.582457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:26.582913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:26.728005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:26.736467 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-40efd288-06e5-40ef-9313-7efac680c513 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.168643 Nov 03 05:20:26.737068 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3940/7771] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:26 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:27.760294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:27.760920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:27.767851 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:27.768339 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:27.768776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:27.769505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:27.769961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:27.770386 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:27.919910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:27.928708 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-85f6c029-ca43-459e-9865-03ba8501ad2a tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.172465 Nov 03 05:20:27.929328 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3832/7772] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:27 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:28.952504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:28.953086 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:28.960036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:28.960537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:28.960988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:28.961718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:28.962190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:28.962630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:29.110222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:29.118626 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77298d42-e3ea-48d2-b978-fa1b62494126 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.170100 Nov 03 05:20:29.119217 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3941/7773] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:28 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:20:30.141733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:30.142358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:30.149333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:30.149817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:30.150257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:30.150949 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:30.151403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:30.151828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:30.301790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:30.310174 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcab5e46-b592-43cb-9ee2-49874c6eb1c8 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.173009 Nov 03 05:20:30.310758 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3833/7774] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:30 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:31.334264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:31.334910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:31.341932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:31.342441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:31.342905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:31.343630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:31.344110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:31.344560 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:31.487360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:31.495772 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-18c002d8-0f1d-466c-afb8-beb4b5e061e2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.165472 Nov 03 05:20:31.496359 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3942/7775] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:31 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:32.519604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:32.520241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:32.527793 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:32.528289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:32.528738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:32.529477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:32.529947 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:32.530387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:32.672681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:32.681428 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3d7f092-91ad-439a-bb20-233a0c58c96f tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.165675 Nov 03 05:20:32.682010 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3834/7776] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:32 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:33.705806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:33.706441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:33.713458 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:33.714044 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:33.714507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:33.715249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:33.715728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:33.716174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:33.871215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:33.879896 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84b4c1dd-8cd8-45a4-a7a4-c19ccd7c0aee tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1755 microversion: 2.1 time: 0.178561 Nov 03 05:20:33.883643 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3943/7777] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:33 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:20:34.904678 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:20:34.906113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:20:34.913375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:34.913913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:34.914349 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:34.915154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:20:34.915509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:20:34.915995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:20:35.069848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:20:35.079523 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-04c5575c-7df8-4a93-b8fb-fb1dd0b8bb78 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1758 microversion: 2.1 time: 0.179221 Nov 03 05:20:35.083731 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3835/7778] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:20:34 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:08.050614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-120736219"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:08.051197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:08.053499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=16 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:08.054168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=48 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:08.059637 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:08.060135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:08.060589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:08.061322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:08.061795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:08.062238 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:08.196278 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.network.security_group_api [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Removing security group 0ea87684-c6bf-4df3-8fca-3e5e6cd5819e from port 16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae Nov 03 05:21:08.595009 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ae36f4b1-c73c-458d-867b-44cf9f685729 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/action" status: 202 len: 0 microversion: 2.1 time: 0.548320 Nov 03 05:21:08.595629 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3944/7779] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:21:08 2022] POST /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:21:08.599539 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d68cc5c9-8003-493e-9d69-49e0750d5305 req-4e060633-ae4f-4e34-ac4f-a6bfe1e7bbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00ec7-1211-418e-ab91-87f436201974", "tag": "16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:08.610400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=22 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:08.611679 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:08.619718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d68cc5c9-8003-493e-9d69-49e0750d5305 req-4e060633-ae4f-4e34-ac4f-a6bfe1e7bbc6 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:08.620514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d68cc5c9-8003-493e-9d69-49e0750d5305 req-4e060633-ae4f-4e34-ac4f-a6bfe1e7bbc6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:08.621199 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d68cc5c9-8003-493e-9d69-49e0750d5305 req-4e060633-ae4f-4e34-ac4f-a6bfe1e7bbc6 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:08.635656 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d68cc5c9-8003-493e-9d69-49e0750d5305 req-4e060633-ae4f-4e34-ac4f-a6bfe1e7bbc6 service nova] Creating event network-changed:16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae for instance 64c00ec7-1211-418e-ab91-87f436201974 on n-h2-854653-7 Nov 03 05:21:08.642103 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d68cc5c9-8003-493e-9d69-49e0750d5305 req-4e060633-ae4f-4e34-ac4f-a6bfe1e7bbc6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047637 Nov 03 05:21:08.643532 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3836/7780] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:09.766459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:09.766989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:09.776403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:09.776987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:09.777819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:09.778617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:09.779237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:09.779746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:09.832428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1756d40b-ab26-4186-8465-5d9b7bafb01f req-f8532916-8a33-4dca-8764-6c0e5e3ec316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00ec7-1211-418e-ab91-87f436201974", "tag": "16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:09.842813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1756d40b-ab26-4186-8465-5d9b7bafb01f req-f8532916-8a33-4dca-8764-6c0e5e3ec316 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:09.843498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1756d40b-ab26-4186-8465-5d9b7bafb01f req-f8532916-8a33-4dca-8764-6c0e5e3ec316 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:09.844137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1756d40b-ab26-4186-8465-5d9b7bafb01f req-f8532916-8a33-4dca-8764-6c0e5e3ec316 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:09.856607 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1756d40b-ab26-4186-8465-5d9b7bafb01f req-f8532916-8a33-4dca-8764-6c0e5e3ec316 service nova] Creating event network-changed:16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae for instance 64c00ec7-1211-418e-ab91-87f436201974 on n-h2-854653-7 Nov 03 05:21:09.862476 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1756d40b-ab26-4186-8465-5d9b7bafb01f req-f8532916-8a33-4dca-8764-6c0e5e3ec316 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098910 Nov 03 05:21:09.863557 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3837/7781] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:09.869862 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lazy-loading 'services' on Instance uuid 64c00ec7-1211-418e-ab91-87f436201974 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:21:10.095393 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dbe333a4-8c9a-4fd7-b023-52f1c02a5bb4 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments/349714fa-1b3c-4148-b3a8-84cf5ff6a021" status: 202 len: 0 microversion: 2.1 time: 0.333586 Nov 03 05:21:10.098306 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3945/7782] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:21:09 2022] DELETE /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments/349714fa-1b3c-4148-b3a8-84cf5ff6a021 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:21:10.105318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:10.108276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:10.117115 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:10.117628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:10.118080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:10.118807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:10.119285 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:10.119714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:10.152113 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6366ba50-32fb-4ec4-8fe9-2a23004ad916 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051229 Nov 03 05:21:10.155725 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3838/7783] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:21:10 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:11.166923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:11.169281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:11.175644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:11.176137 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:11.176604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:11.177361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:11.177847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:11.178297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:11.208334 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8cb32134-2952-4a5f-a83d-68fe47027f84 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Nov 03 05:21:11.208905 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3946/7784] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:21:11 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:12.221735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:12.224030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:12.231024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:12.231509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:12.231953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:12.232643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:12.233132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:12.233560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:12.263829 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d7ac9638-f2c8-465a-9455-b588d4e7da37 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Nov 03 05:21:12.264432 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3839/7785] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:21:12 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:13.277340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:13.279965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:13.287331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:13.287830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:13.288305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:13.289046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:13.289506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:13.289948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:13.319399 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-93ea408a-b02e-4efd-ae0c-aa0a9c5e83c1 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Nov 03 05:21:13.319962 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3947/7786] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:21:13 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:14.332569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:14.335095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:14.341976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:14.342461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:14.342906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:14.343688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:14.344147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:14.344658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:14.376090 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a0b648b9-0d26-4c14-bcf0-cb9c9fa6542c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048174 Nov 03 05:21:14.376680 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3840/7787] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:21:14 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:15.388858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:15.391808 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:15.398905 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:15.399404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:15.399861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:15.400568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:15.401062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:15.401510 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:15.434569 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-46770bfb-8d61-40d4-b9c4-f14e189a55f2 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049922 Nov 03 05:21:15.435134 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3948/7788] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Nov 3 05:21:15 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 03 05:21:15.445906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:15.446466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:15.453728 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:15.454215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:15.454661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:15.455368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:15.455830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:15.456261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:15.531884 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] HTTP exception thrown: Instance 64c00ec7-1211-418e-ab91-87f436201974 is not attached to volume 349714fa-1b3c-4148-b3a8-84cf5ff6a021 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Request method failure captured: Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: request: DELETE /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments/349714fa-1b3c-4148-b3a8-84cf5ff6a021 HTTP/1.1 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY05HcGfBVo0VAptFkbTzISgTBPyi54jTw3k_vCClK6jtkDWZQ27Xo3HpKhDnJvi-OytyQeRDUub8Au79dRXLpkSMH2zZC4F8wi9JXRU90IHv-OwJ1FrqqvbIb1jH7FoXwZtWQPZckZS2I6C25CS3Orw_MSVTVk--YQxGv_7cjye5vGE Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_387cc504e8a3452d98b110ea4d2a8a36", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/387cc504e8a3452d98b110ea4d2a8a36"}]}] Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 4f427b3646f54546986ee0a606c404b9 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 64c00ec7-1211-418e-ab91-87f436201974 is not attached to volume 349714fa-1b3c-4148-b3a8-84cf5ff6a021 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'server_id': '64c00ec7-1211-418e-ab91-87f436201974', 'id': '349714fa-1b3c-4148-b3a8-84cf5ff6a021'} Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 349714fa-1b3c-4148-b3a8-84cf5ff6a021. Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c00ec7-1211-418e-ab91-87f436201974 is not attached to volume 349714fa-1b3c-4148-b3a8-84cf5ff6a021 Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:21:15.533666 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:21:15.538613 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:21:15.538613 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:21:15.538613 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c00ec7-1211-418e-ab91-87f436201974 is not attached to volume 349714fa-1b3c-4148-b3a8-84cf5ff6a021 Nov 03 05:21:15.538613 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:15.538613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Returning 404 to user: Instance 64c00ec7-1211-418e-ab91-87f436201974 is not attached to volume 349714fa-1b3c-4148-b3a8-84cf5ff6a021 {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:21:15.538613 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c7537cf2-23f7-4cde-becd-8f0325861cac tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments/349714fa-1b3c-4148-b3a8-84cf5ff6a021" status: 404 len: 154 microversion: 2.1 time: 0.093306 Nov 03 05:21:15.538613 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3841/7789] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Nov 3 05:21:15 2022] DELETE /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974/os-volume_attachments/349714fa-1b3c-4148-b3a8-84cf5ff6a021 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:21:18.918633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:18.919224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:18.927172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:18.927762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:18.928329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:18.929070 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:18.929544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:18.929985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:18.955722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:21:19.181268 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-89e37afb-22a3-438a-afa5-e96dc964179c tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 204 len: 0 microversion: 2.1 time: 0.266166 Nov 03 05:21:19.181979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3949/7790] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:21:18 2022] DELETE /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:21:19.190971 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:19.192147 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:19.199832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:19.200358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:19.200801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:19.201532 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:19.201995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:19.202431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:19.337237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:19.345888 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c352ed8c-5e98-40ed-9585-b56eb25ed373 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1553 microversion: 2.1 time: 0.159516 Nov 03 05:21:19.346476 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3842/7791] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:19 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:20.370251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:20.370921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:20.378372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:20.378878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:20.379335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:20.380043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:20.380517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:20.380962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:20.508531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:20.516524 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bf0e4b24-d564-4f03-8c90-7b6a728ddd8b tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1553 microversion: 2.1 time: 0.150620 Nov 03 05:21:20.517130 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3950/7792] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:20 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:21.540600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:21.541258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:21.548864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:21.549394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:21.549843 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:21.550620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:21.551089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:21.551529 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:21.647821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f427b3646f54546986ee0a606c404b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387cc504e8a3452d98b110ea4d2a8a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:21.656795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-be3e885d-4ea1-4865-8b1b-cd6736bdb46d tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 200 len: 1511 microversion: 2.1 time: 0.120195 Nov 03 05:21:21.658038 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3843/7793] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:21 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 1511 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:21.700293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-a9cc5ded-e99f-40eb-81ab-f3be2378b095 req-839c86d9-1085-47cf-a11c-9bd597ced538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c00ec7-1211-418e-ab91-87f436201974", "name": "network-vif-deleted", "tag": "16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:21.710918 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a9cc5ded-e99f-40eb-81ab-f3be2378b095 req-839c86d9-1085-47cf-a11c-9bd597ced538 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:21.711699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a9cc5ded-e99f-40eb-81ab-f3be2378b095 req-839c86d9-1085-47cf-a11c-9bd597ced538 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:21.711831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-a9cc5ded-e99f-40eb-81ab-f3be2378b095 req-839c86d9-1085-47cf-a11c-9bd597ced538 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:21.722808 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-a9cc5ded-e99f-40eb-81ab-f3be2378b095 req-839c86d9-1085-47cf-a11c-9bd597ced538 service nova] Creating event network-vif-deleted:16b33ccc-74fe-4ea2-b7f5-d3213e5af1ae for instance 64c00ec7-1211-418e-ab91-87f436201974 on n-h2-854653-7 Nov 03 05:21:21.727762 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-a9cc5ded-e99f-40eb-81ab-f3be2378b095 req-839c86d9-1085-47cf-a11c-9bd597ced538 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Nov 03 05:21:21.728345 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3951/7794] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:22.682276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:22.682832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] [instance: 64c00ec7-1211-418e-ab91-87f436201974] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:22.689911 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:22.690403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:22.690848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:22.691553 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:22.692018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:22.692449 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:22.708697 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] HTTP exception thrown: Instance 64c00ec7-1211-418e-ab91-87f436201974 could not be found. Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Request method failure captured: Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 HTTP/1.1 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY05HcGfBVo0VAptFkbTzISgTBPyi54jTw3k_vCClK6jtkDWZQ27Xo3HpKhDnJvi-OytyQeRDUub8Au79dRXLpkSMH2zZC4F8wi9JXRU90IHv-OwJ1FrqqvbIb1jH7FoXwZtWQPZckZS2I6C25CS3Orw_MSVTVk--YQxGv_7cjye5vGE Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_387cc504e8a3452d98b110ea4d2a8a36", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/387cc504e8a3452d98b110ea4d2a8a36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/387cc504e8a3452d98b110ea4d2a8a36"}]}] Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: 387cc504e8a3452d98b110ea4d2a8a36 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestMinimumBasicScenario-184465724 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 4f427b3646f54546986ee0a606c404b9 Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestMinimumBasicScenario-184465724-project Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 64c00ec7-1211-418e-ab91-87f436201974 could not be found. Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '64c00ec7-1211-418e-ab91-87f436201974'} Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c00ec7-1211-418e-ab91-87f436201974 could not be found. Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c00ec7-1211-418e-ab91-87f436201974 could not be found. Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:21:22.710278 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c00ec7-1211-418e-ab91-87f436201974 could not be found. Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Returning 404 to user: Instance 64c00ec7-1211-418e-ab91-87f436201974 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-546cae2c-39fb-457d-bd50-8332b573ba65 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974" status: 404 len: 111 microversion: 2.1 time: 0.033629 Nov 03 05:21:22.715792 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3844/7795] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:22 2022] GET /compute/v2.1/servers/64c00ec7-1211-418e-ab91-87f436201974 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:21:22.722716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e87949b-1024-475e-bfd9-dca18e514a06 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] Calling method '.version_select at 0x7ff7f80ed1f0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:22.798933 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e87949b-1024-475e-bfd9-dca18e514a06 tempest-TestMinimumBasicScenario-184465724 tempest-TestMinimumBasicScenario-184465724-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-453335426" status: 202 len: 0 microversion: 2.1 time: 0.082013 Nov 03 05:21:22.799590 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3952/7796] 10.222.0.30 () {58 vars in 1269 bytes} [Thu Nov 3 05:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-453335426 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:21:34.293813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=18 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:34.294583 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=42 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:34.461037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2cbf4a1f-006b-43ef-a4b3-694e04d696a8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: .version_select at 0x7ff7f9773280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-265467987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcUptl582adw3wwlqmwo+Mcvysyp4AN5a+O1UwKObGRS9L83N2RSAQ68sw2GyN6Ierdm4c+hMD0a8e8f1A8l2ziwbfmUMu32f4lbFC6l17jqebnbq5Iusk0CYqejbehnQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:34.476756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2cbf4a1f-006b-43ef-a4b3-694e04d696a8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:21:34.482340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2cbf4a1f-006b-43ef-a4b3-694e04d696a8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:21:34.553968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2cbf4a1f-006b-43ef-a4b3-694e04d696a8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.265364 Nov 03 05:21:34.554721 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3845/7797] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:21:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:42.381614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:42.382398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:42.386470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1539899929", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "d558ddee-8630-4f02-b61a-73ca00589ef7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-265467987", "security_groups": [{"name": "tempest-secgroup-smoke-786090350"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:42.519936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] validate_networks() for [('d558ddee-8630-4f02-b61a-73ca00589ef7', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:21:43.049850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:21:43.050298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:21:43.050828 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:21:43.051341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:21:43.051703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:21:43.060741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:43.062078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:43.062543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:43.063306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:43.063794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:43.064248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:43.084074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:21:43.090272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:21:43.104491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:21:43.107245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:21:43.213978 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e1ea39ae-c932-46f3-a2ca-8070fabc5626 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.834095 Nov 03 05:21:43.229611 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3953/7798] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:21:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:21:43.245507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-80d91b31-a458-4ba9-99d8-a3b43289dc39 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:43.248015 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-80d91b31-a458-4ba9-99d8-a3b43289dc39 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:43.320998 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-80d91b31-a458-4ba9-99d8-a3b43289dc39 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:43.344626 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-80d91b31-a458-4ba9-99d8-a3b43289dc39 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1266 microversion: 2.1 time: 0.113105 Nov 03 05:21:43.350729 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3846/7799] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:43 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:44.374634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bdbb4280-991c-4e28-bb7a-ea1bb05696e8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:44.375898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bdbb4280-991c-4e28-bb7a-ea1bb05696e8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:44.430930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bdbb4280-991c-4e28-bb7a-ea1bb05696e8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:44.438776 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bdbb4280-991c-4e28-bb7a-ea1bb05696e8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1266 microversion: 2.1 time: 0.069596 Nov 03 05:21:44.439404 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3954/7800] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:44 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:45.461520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:45.462083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:45.469727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:45.470217 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:45.474613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:45.474613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:45.474613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:45.474613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:45.542224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:45.550096 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd216c61-9fe3-4ebb-860c-38a17bb568b0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1326 microversion: 2.1 time: 0.092510 Nov 03 05:21:45.553809 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3847/7801] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:45 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:46.576616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:46.578121 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:46.585769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:46.586365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:46.586928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:46.587733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:46.588405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:46.589052 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:46.726823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:46.734822 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5f386add-874a-47ae-8efc-4773f0ec023f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.164714 Nov 03 05:21:46.735406 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3955/7802] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:46 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:47.323110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3db88cd2-c217-4ed8-825f-415bec04267f req-e1e4778e-5cf7-4bb6-87b9-74ab7b23fa1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34adece-5aea-4f05-81c4-08636ccca4b1", "tag": "686cf844-bfde-443a-a78e-fd29488cb7a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:47.334717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3db88cd2-c217-4ed8-825f-415bec04267f req-e1e4778e-5cf7-4bb6-87b9-74ab7b23fa1e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:47.335203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3db88cd2-c217-4ed8-825f-415bec04267f req-e1e4778e-5cf7-4bb6-87b9-74ab7b23fa1e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:47.335640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3db88cd2-c217-4ed8-825f-415bec04267f req-e1e4778e-5cf7-4bb6-87b9-74ab7b23fa1e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:47.346672 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3db88cd2-c217-4ed8-825f-415bec04267f req-e1e4778e-5cf7-4bb6-87b9-74ab7b23fa1e service nova] Creating event network-changed:686cf844-bfde-443a-a78e-fd29488cb7a0 for instance d34adece-5aea-4f05-81c4-08636ccca4b1 on n-h1-854653-7 Nov 03 05:21:47.351736 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3db88cd2-c217-4ed8-825f-415bec04267f req-e1e4778e-5cf7-4bb6-87b9-74ab7b23fa1e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032535 Nov 03 05:21:47.352319 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3848/7803] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:47.759908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:47.760555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:47.767459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:47.767966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:47.768447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:47.769203 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:47.769685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:47.770136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:47.911973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:47.922470 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6c34d507-575c-403a-982d-2bd993793d90 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.166122 Nov 03 05:21:47.923539 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3956/7804] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:47 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:48.949030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:48.949760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:48.956155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:48.956646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:48.957116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:48.957812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:48.958273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:48.958707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:49.092867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:49.100599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-295b3b7f-1181-40e0-9c65-531cd20d068f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.156770 Nov 03 05:21:49.101196 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3849/7805] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:48 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:50.124462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:50.125113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:50.131953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:50.132457 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:50.132919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:50.133653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:50.134132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:50.134579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:50.265718 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:50.273488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-319be625-ca32-4631-a7c8-3bfc7e6d0df9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.153517 Nov 03 05:21:50.274095 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3957/7806] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:50 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:51.296545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:51.297195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:51.304696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:51.305303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:51.305749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:51.306456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:51.306920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:51.307352 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:51.440388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:51.448131 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6c523a95-f79c-48d0-8f50-2ff9adee4e7e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.155575 Nov 03 05:21:51.448704 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3850/7807] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:51 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:52.472211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:52.472838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:52.479499 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:52.479999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:52.480453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:52.481188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:52.481662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:52.482105 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:52.612237 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:52.619900 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-431873ac-8537-476f-b2f6-a818c3630bb4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.151684 Nov 03 05:21:52.620479 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3958/7808] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:52 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:53.642550 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:53.643103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:53.645927 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:53.651017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:53.651514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:53.657473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:53.657473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:53.657473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:53.657473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:53.786716 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:53.794448 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2ec21563-a3cf-43e0-89f8-6e09dd58dc9a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.155960 Nov 03 05:21:53.795645 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3851/7809] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:53 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:54.817542 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:54.818170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:54.820125 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:54.821972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=8 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:21:54.827576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:54.828083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:54.828540 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:54.829383 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:54.829854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:54.830300 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:54.936993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c51ac0ca-0657-497f-bd0a-9eb94a86387c req-dbc084fc-89ba-49e3-aa21-3223bb06a60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34adece-5aea-4f05-81c4-08636ccca4b1", "name": "network-vif-plugged", "status": "completed", "tag": "686cf844-bfde-443a-a78e-fd29488cb7a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:54.950411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c51ac0ca-0657-497f-bd0a-9eb94a86387c req-dbc084fc-89ba-49e3-aa21-3223bb06a60e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:54.950808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c51ac0ca-0657-497f-bd0a-9eb94a86387c req-dbc084fc-89ba-49e3-aa21-3223bb06a60e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:54.951401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c51ac0ca-0657-497f-bd0a-9eb94a86387c req-dbc084fc-89ba-49e3-aa21-3223bb06a60e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:54.962881 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c51ac0ca-0657-497f-bd0a-9eb94a86387c req-dbc084fc-89ba-49e3-aa21-3223bb06a60e service nova] Creating event network-vif-plugged:686cf844-bfde-443a-a78e-fd29488cb7a0 for instance d34adece-5aea-4f05-81c4-08636ccca4b1 on n-h1-854653-7 Nov 03 05:21:54.968398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c51ac0ca-0657-497f-bd0a-9eb94a86387c req-dbc084fc-89ba-49e3-aa21-3223bb06a60e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035536 Nov 03 05:21:54.969072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3852/7810] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:21:54.975632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:54.984069 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9214f0a1-219e-49ab-b491-bd2d271c08f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.170458 Nov 03 05:21:54.984872 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3959/7811] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:54 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:56.009547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:56.010257 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:56.016554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:56.017069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:56.017517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:56.018221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:56.018684 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:56.019117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:56.151890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:56.160448 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d7b44b45-0776-4711-b9d8-094946c7e890 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1391 microversion: 2.1 time: 0.156318 Nov 03 05:21:56.161118 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3853/7812] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:56 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:57.183200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:57.183788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:57.191366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:57.191901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:57.192368 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:57.193116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:57.193599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:57.194055 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:57.326204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:57.333951 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-09c35934-0e87-4746-8c67-b9916f45776f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1562 microversion: 2.1 time: 0.154798 Nov 03 05:21:57.334533 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3960/7813] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:57 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:57.355844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:57.356879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:57.364326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:57.364812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:57.365279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:57.365968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:57.366430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:57.366858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:57.495939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:57.503947 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c14aeab1-22b4-4663-b377-165fb1991cff tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1562 microversion: 2.1 time: 0.152077 Nov 03 05:21:57.504570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3854/7814] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:57 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:21:59.519329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:21:59.520046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:21:59.532262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-f31e8e2a-c0be-4ac6-8691-87eae0ef4c1b req-7c460a74-a98c-4331-ab15-2386f5359eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34adece-5aea-4f05-81c4-08636ccca4b1", "tag": "686cf844-bfde-443a-a78e-fd29488cb7a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:21:59.540451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:59.540969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:59.541459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:59.542191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:59.542658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:59.543051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f31e8e2a-c0be-4ac6-8691-87eae0ef4c1b req-7c460a74-a98c-4331-ab15-2386f5359eab service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:21:59.543188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:59.543605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f31e8e2a-c0be-4ac6-8691-87eae0ef4c1b req-7c460a74-a98c-4331-ab15-2386f5359eab service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:21:59.544043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f31e8e2a-c0be-4ac6-8691-87eae0ef4c1b req-7c460a74-a98c-4331-ab15-2386f5359eab service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:21:59.557044 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-f31e8e2a-c0be-4ac6-8691-87eae0ef4c1b req-7c460a74-a98c-4331-ab15-2386f5359eab service nova] Creating event network-changed:686cf844-bfde-443a-a78e-fd29488cb7a0 for instance d34adece-5aea-4f05-81c4-08636ccca4b1 on n-h1-854653-7 Nov 03 05:21:59.563769 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-f31e8e2a-c0be-4ac6-8691-87eae0ef4c1b req-7c460a74-a98c-4331-ab15-2386f5359eab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035609 Nov 03 05:21:59.564404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3855/7815] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:21:59.688578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:21:59.697349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5d03a57f-7d24-4995-972c-0a55652b0f52 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1562 microversion: 2.1 time: 0.182076 Nov 03 05:21:59.698460 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3961/7816] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:21:59 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:22:30.990589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:22:30.992930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:22:30.995094 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:22:30.995747 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=42 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:22:31.000834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:22:31.006203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:22:31.006203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:22:31.006203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:22:31.006203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:22:31.006203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:22:31.056074 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f76979b-15a2-4e6b-bc3d-1dc890ef866a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action" status: 200 len: 24568 microversion: 2.1 time: 0.070628 Nov 03 05:22:31.056755 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3856/7817] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:22:30 2022] POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action => generated 24568 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:23:01.550863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:01.551647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=44 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:01.556452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:01.557062 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:01.563180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:01.564338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:01.564801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:01.565541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:01.566021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:01.566469 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:01.777541 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-23146eff-fbf8-4e67-aff6-dd36061d7efe tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action" status: 202 len: 0 microversion: 2.1 time: 0.228977 Nov 03 05:23:01.778456 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3962/7818] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:23:01 2022] POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:23:01.787488 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:01.788208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:01.791187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:01.792376 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:23:01.792550 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 (ip 10.222.0.30) !!! Nov 03 05:23:01.800327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:01.800814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:01.801336 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:01.801995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:01.802456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:01.802890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:01.942932 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:01.950768 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ccdd39f0-c0d4-416c-9d27-324e856bef89 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1686 microversion: 2.1 time: 0.167742 Nov 03 05:23:01.951343 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3857/7819] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:01 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:02.975489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:02.976207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:02.982372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:02.982869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:02.983326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:02.984030 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:02.984502 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:02.984941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:03.115959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:03.123798 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-49125741-3206-4a3a-bfc7-97d9e49e5ee9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1666 microversion: 2.1 time: 0.153641 Nov 03 05:23:03.124373 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3963/7820] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:02 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:04.220388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:04.222590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:04.230530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:04.231017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:04.231475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:04.232179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:04.232643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:04.233167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:04.282600 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cc468b9d-4fa2-41fd-b3fd-6c236a284b8c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action" status: 200 len: 32640 microversion: 2.1 time: 0.066161 Nov 03 05:23:04.283504 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3858/7821] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:23:04 2022] POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action => generated 32640 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:23:04.295088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:04.295656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:04.302604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:04.303113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:04.303579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:04.304299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:04.304787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:04.305265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:04.458037 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83e2e9a7-e113-4b02-8ecc-b0e7e964c17c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action" status: 202 len: 0 microversion: 2.1 time: 0.166656 Nov 03 05:23:04.458689 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3964/7822] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:23:04 2022] POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:23:04.467682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:04.468396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:04.475641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:04.476073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:04.476520 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:04.477259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:04.477721 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:04.478154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:04.612357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:04.620050 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7dfaed05-bdb6-40d3-94e9-c992b5cc18d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1673 microversion: 2.1 time: 0.156710 Nov 03 05:23:04.620625 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3859/7823] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:04 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:23:05.646060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:05.646792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:05.653362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:05.653869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:05.654335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:05.655051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:05.655528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:05.655978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:05.795273 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:05.803312 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0a567367-3a66-4b94-a32b-644adf7f4276 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1681 microversion: 2.1 time: 0.163098 Nov 03 05:23:05.803882 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3965/7824] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:05 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:05.901623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:05.904089 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:05.916137 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:05.916644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:05.917148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:05.917924 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:05.918433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:05.918870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:05.971315 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-50a5937b-252e-4a5c-a226-3abd7bcc5f6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action" status: 200 len: 36250 microversion: 2.1 time: 0.073718 Nov 03 05:23:05.971984 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3860/7825] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:23:05 2022] POST /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1/action => generated 36250 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 03 05:23:07.377173 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:07.379321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:07.383258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c8d099ed-92e0-476e-84cc-b0f9c1858ecb req-9055ffae-cba6-4e13-87f3-7aa58a7f0010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34adece-5aea-4f05-81c4-08636ccca4b1", "tag": "686cf844-bfde-443a-a78e-fd29488cb7a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:07.387193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:07.387716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:07.388176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:07.389082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:07.389416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:07.389863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:07.394742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8d099ed-92e0-476e-84cc-b0f9c1858ecb req-9055ffae-cba6-4e13-87f3-7aa58a7f0010 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:07.395228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8d099ed-92e0-476e-84cc-b0f9c1858ecb req-9055ffae-cba6-4e13-87f3-7aa58a7f0010 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:07.395906 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c8d099ed-92e0-476e-84cc-b0f9c1858ecb req-9055ffae-cba6-4e13-87f3-7aa58a7f0010 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:07.408292 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c8d099ed-92e0-476e-84cc-b0f9c1858ecb req-9055ffae-cba6-4e13-87f3-7aa58a7f0010 service nova] Creating event network-changed:686cf844-bfde-443a-a78e-fd29488cb7a0 for instance d34adece-5aea-4f05-81c4-08636ccca4b1 on n-h1-854653-7 Nov 03 05:23:07.413560 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c8d099ed-92e0-476e-84cc-b0f9c1858ecb req-9055ffae-cba6-4e13-87f3-7aa58a7f0010 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034406 Nov 03 05:23:07.414424 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3861/7826] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:23:07.418732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:23:07.699383 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f655f330-4155-43f8-b3d4-25b41127ebdd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 204 len: 0 microversion: 2.1 time: 0.326617 Nov 03 05:23:07.700421 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3966/7827] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:23:07 2022] DELETE /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:23:07.710209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:07.711073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:07.720153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:07.720738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:07.721479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:07.722195 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:07.722660 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:07.723096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:07.870096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:07.878092 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5686f7d8-2ef0-40f4-88f2-6ec28f40a9de tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1687 microversion: 2.1 time: 0.172831 Nov 03 05:23:07.878673 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3862/7828] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:07 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:08.903283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:08.904033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:08.911235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:08.911797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:08.912255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:08.913002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:08.913589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:08.914177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:09.050539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:09.058304 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3fe00c6d-25c7-49c9-a669-030542611400 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1687 microversion: 2.1 time: 0.159830 Nov 03 05:23:09.058870 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3967/7829] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:08 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:10.029959 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-555ffbe4-b06c-46cb-982f-4129e95137c5 req-4e920259-c694-471d-88bf-d42091123d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34adece-5aea-4f05-81c4-08636ccca4b1", "name": "network-vif-deleted", "tag": "686cf844-bfde-443a-a78e-fd29488cb7a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:10.041072 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-555ffbe4-b06c-46cb-982f-4129e95137c5 req-4e920259-c694-471d-88bf-d42091123d1a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:10.041560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-555ffbe4-b06c-46cb-982f-4129e95137c5 req-4e920259-c694-471d-88bf-d42091123d1a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:10.042002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-555ffbe4-b06c-46cb-982f-4129e95137c5 req-4e920259-c694-471d-88bf-d42091123d1a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:10.053003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-555ffbe4-b06c-46cb-982f-4129e95137c5 req-4e920259-c694-471d-88bf-d42091123d1a service nova] Creating event network-vif-deleted:686cf844-bfde-443a-a78e-fd29488cb7a0 for instance d34adece-5aea-4f05-81c4-08636ccca4b1 on n-h1-854653-7 Nov 03 05:23:10.058125 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-555ffbe4-b06c-46cb-982f-4129e95137c5 req-4e920259-c694-471d-88bf-d42091123d1a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032147 Nov 03 05:23:10.058729 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3863/7830] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:23:10.082084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:10.082723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:10.089600 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:10.091836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:10.091836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:10.091836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:10.091836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:10.092256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:10.160073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:10.168062 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6d7f152b-cedc-4dc2-bd5a-98a808dee109 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 200 len: 1501 microversion: 2.1 time: 0.090421 Nov 03 05:23:10.168572 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3968/7831] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:10 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 1501 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:11.196005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:11.196758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: d34adece-5aea-4f05-81c4-08636ccca4b1] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:11.203004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:11.203497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:11.203953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:11.204677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:11.205172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:11.205611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:11.219025 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] HTTP exception thrown: Instance d34adece-5aea-4f05-81c4-08636ccca4b1 could not be found. Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Request method failure captured: Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 HTTP/1.1 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0_dzUEqXCGMfjl2Nm1_zjjJUGvtN4CdLSbzLcws51Voz6SH5K-iaKq7w4Slra2ZxBNNbU3gFLnw8W1q0QQo7bomOczqJPu1MbTAbVcqGhsNnqvjsPQTRLM4PUZCvMld88wiXBf2J3HzTkQytXjU6T7YC7lECkYVrtJmEBWJRsnQdZI Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9ab73bd2a894b2ba81937894e033fd4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9ab73bd2a894b2ba81937894e033fd4"}]}] Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 062fa477611040718370f855e0832151 Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance d34adece-5aea-4f05-81c4-08636ccca4b1 could not be found. Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'd34adece-5aea-4f05-81c4-08636ccca4b1'} Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34adece-5aea-4f05-81c4-08636ccca4b1 could not be found. Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34adece-5aea-4f05-81c4-08636ccca4b1 could not be found. Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:23:11.221188 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34adece-5aea-4f05-81c4-08636ccca4b1 could not be found. Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Returning 404 to user: Instance d34adece-5aea-4f05-81c4-08636ccca4b1 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f419263-fb83-494d-9928-27814adc41ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1" status: 404 len: 111 microversion: 2.1 time: 0.031792 Nov 03 05:23:11.226815 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3864/7832] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:11 2022] GET /compute/v2.1/servers/d34adece-5aea-4f05-81c4-08636ccca4b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:23:15.007727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b054f15a-09ce-4e4c-9544-9cd84c331108 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '.version_select at 0x7ff7f98f7b80>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:15.083103 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b054f15a-09ce-4e4c-9544-9cd84c331108 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-265467987" status: 202 len: 0 microversion: 2.1 time: 0.079265 Nov 03 05:23:15.083696 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3969/7833] 10.222.0.30 () {58 vars in 1281 bytes} [Thu Nov 3 05:23:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-265467987 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:23:15.112525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00ab8fb2-78fb-4ed3-9f26-78b6cd5bc5a4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: .version_select at 0x7ff7f98a7670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1083551942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaMgZ2HtQ85suigP+7aPinEqI6ItlotZflISqE+tBKzvHEt03+cPb54oUBvBY4BywG/YoTceGvVLOgqHLAbURDVIzM5A0OjPbJGTYWrBIdYjUc0Xr3V0e1J1wahXQUgIQ=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:15.130294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-00ab8fb2-78fb-4ed3-9f26-78b6cd5bc5a4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:23:15.135434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-00ab8fb2-78fb-4ed3-9f26-78b6cd5bc5a4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:23:15.214426 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00ab8fb2-78fb-4ed3-9f26-78b6cd5bc5a4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.106451 Nov 03 05:23:15.214967 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3865/7834] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:23:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:23:23.146526 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:23.150777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-26187323", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "8c7e88c6-fcca-486c-8660-83d94ac9c675"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1083551942", "security_groups": [{"name": "tempest-secgroup-smoke-1703832886"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:23.260871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] validate_networks() for [('8c7e88c6-fcca-486c-8660-83d94ac9c675', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:23:23.656451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:23:23.656975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:23:23.658114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:23:23.658621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:23:23.659280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:23:23.668582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:23.669111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:23.669576 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:23.670337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:23.670825 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:23.671272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:23.689694 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:23:23.695376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:23:23.708570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:23:23.710985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:23:23.827183 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b54ea4df-d309-4490-850a-6802818cb476 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.682368 Nov 03 05:23:23.827846 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3970/7835] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:23:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 03 05:23:23.837139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=32 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:23.841176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b6445772-b258-4851-839d-b1d44594285b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:23.841805 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b6445772-b258-4851-839d-b1d44594285b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:23.901650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b6445772-b258-4851-839d-b1d44594285b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:23.910044 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b6445772-b258-4851-839d-b1d44594285b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1265 microversion: 2.1 time: 0.074078 Nov 03 05:23:23.910267 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3866/7836] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:23 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:23:24.935296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-17c6a058-56bf-4ee0-988c-0a61dd5a399e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:24.936036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-17c6a058-56bf-4ee0-988c-0a61dd5a399e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:24.999322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-17c6a058-56bf-4ee0-988c-0a61dd5a399e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:25.008019 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-17c6a058-56bf-4ee0-988c-0a61dd5a399e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1265 microversion: 2.1 time: 0.078537 Nov 03 05:23:25.009060 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3971/7837] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:24 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:26.031245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1075e3a0-8089-4dc1-a084-b94c1febf4ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:26.031796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1075e3a0-8089-4dc1-a084-b94c1febf4ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:26.087554 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1075e3a0-8089-4dc1-a084-b94c1febf4ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:26.094754 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1075e3a0-8089-4dc1-a084-b94c1febf4ec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1265 microversion: 2.1 time: 0.067747 Nov 03 05:23:26.095332 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3867/7838] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:26 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1265 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:27.117219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58ddcfe0-ca6c-497b-81fd-ae87bf29a6ab tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:27.117858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58ddcfe0-ca6c-497b-81fd-ae87bf29a6ab tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:27.172887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-58ddcfe0-ca6c-497b-81fd-ae87bf29a6ab tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:27.179954 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58ddcfe0-ca6c-497b-81fd-ae87bf29a6ab tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1265 microversion: 2.1 time: 0.066890 Nov 03 05:23:27.180518 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3972/7839] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:27 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1265 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:28.202681 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:28.203308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:28.210309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:28.210830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:28.211279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:28.211973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:28.212438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:28.212870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:28.279141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:28.288055 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2fd280ac-9df7-4b7b-9d08-cd97235c6ee0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1269 microversion: 2.1 time: 0.089254 Nov 03 05:23:28.288677 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3868/7840] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:28 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:29.310824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:29.311337 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:29.319118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:29.319621 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:29.320076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:29.320783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:29.321277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:29.321723 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:29.382817 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:29.390468 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c7e160ff-2919-4fab-b673-265ef2eeb45a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1317 microversion: 2.1 time: 0.083672 Nov 03 05:23:29.391030 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3973/7841] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:29 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1317 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:30.414467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:30.415091 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:30.421783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:30.426631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:30.426631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:30.426631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:30.426631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:30.426631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:30.493729 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:30.502054 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e70f9245-7e75-407b-a1fa-9564b934f76b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1323 microversion: 2.1 time: 0.091562 Nov 03 05:23:30.502855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3869/7842] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:30 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:31.526997 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:31.527658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:31.535391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:31.535835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:31.536299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:31.537039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:31.537548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:31.538002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:31.541595 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-778991ca-8ce4-4a87-b7fe-b3905bbbfe3e req-e1d0b0cc-98b5-4d37-8f7b-8bfb3f42ad03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd021867-9a8b-4572-b994-ed4731083cb6", "tag": "1fb0cc7a-a42e-4b24-afd4-24c92947446e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:31.552717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-778991ca-8ce4-4a87-b7fe-b3905bbbfe3e req-e1d0b0cc-98b5-4d37-8f7b-8bfb3f42ad03 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:31.553830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-778991ca-8ce4-4a87-b7fe-b3905bbbfe3e req-e1d0b0cc-98b5-4d37-8f7b-8bfb3f42ad03 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:31.554519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-778991ca-8ce4-4a87-b7fe-b3905bbbfe3e req-e1d0b0cc-98b5-4d37-8f7b-8bfb3f42ad03 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:31.569155 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-778991ca-8ce4-4a87-b7fe-b3905bbbfe3e req-e1d0b0cc-98b5-4d37-8f7b-8bfb3f42ad03 service nova] Creating event network-changed:1fb0cc7a-a42e-4b24-afd4-24c92947446e for instance fd021867-9a8b-4572-b994-ed4731083cb6 on n-h2-854653-7 Nov 03 05:23:31.574369 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-778991ca-8ce4-4a87-b7fe-b3905bbbfe3e req-e1d0b0cc-98b5-4d37-8f7b-8bfb3f42ad03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038652 Nov 03 05:23:31.574980 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3870/7843] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:23:31.783186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:31.790895 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-874ffb2d-b311-439f-be0d-351ccf9a0a40 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.268203 Nov 03 05:23:31.791399 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3974/7844] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:31 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:32.815481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:32.816244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:32.818220 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:32.823183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:32.823677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:32.824128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:32.824833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:32.825329 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:32.825770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:32.962794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:32.970712 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-11896025-c52d-40c4-8871-bba85268e7dc tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.160839 Nov 03 05:23:32.971285 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3871/7845] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:32 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:33.994392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:33.995027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:33.997758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:33.998488 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:34.003247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:34.003753 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:34.004213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:34.004925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:34.005427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:34.005876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:34.138578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:34.147509 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d66de708-68dd-4ce1-a397-c0e6d14f788c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.157081 Nov 03 05:23:34.148106 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3975/7846] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:33 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:23:35.170495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:35.171118 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:35.178692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:35.179187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:35.179636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:35.180340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:35.180802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:35.181267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:35.316000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:35.323817 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b84721f2-f6ed-48fc-a3bd-9ab40442b2bb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.157305 Nov 03 05:23:35.324392 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3872/7847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:35 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:36.347760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:36.348326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:36.355363 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:36.355867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:36.356325 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:36.357064 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:36.357539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:36.357983 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:36.495940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:36.503830 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9b8371b-fe2f-4534-b42d-a31ec6c1f116 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.161010 Nov 03 05:23:36.504413 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3976/7848] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:36 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:37.526821 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:37.527446 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:37.529893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:37.535646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:37.536136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:37.536627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:37.537360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:37.537817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:37.538245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:37.669108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:37.677498 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f3302241-03c3-4e08-a138-71ecdeeb2fc8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.154584 Nov 03 05:23:37.678073 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3873/7849] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:37 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:38.699802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:38.700434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:38.702387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=10 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:23:38.708797 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:38.709327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:38.709790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:38.710501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:38.710973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:38.711464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:38.846439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:38.854166 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1517c799-90fc-4f28-a9e5-01d9b8818b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.158344 Nov 03 05:23:38.854724 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3977/7850] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:38 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:39.097405 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4f019146-1858-4956-ad43-291fcfceca3c req-fc56ea1e-4e9d-43c2-b52d-ba6547f9ee63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd021867-9a8b-4572-b994-ed4731083cb6", "name": "network-vif-plugged", "status": "completed", "tag": "1fb0cc7a-a42e-4b24-afd4-24c92947446e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:39.107933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f019146-1858-4956-ad43-291fcfceca3c req-fc56ea1e-4e9d-43c2-b52d-ba6547f9ee63 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:39.108424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f019146-1858-4956-ad43-291fcfceca3c req-fc56ea1e-4e9d-43c2-b52d-ba6547f9ee63 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:39.108867 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f019146-1858-4956-ad43-291fcfceca3c req-fc56ea1e-4e9d-43c2-b52d-ba6547f9ee63 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:39.120165 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4f019146-1858-4956-ad43-291fcfceca3c req-fc56ea1e-4e9d-43c2-b52d-ba6547f9ee63 service nova] Creating event network-vif-plugged:1fb0cc7a-a42e-4b24-afd4-24c92947446e for instance fd021867-9a8b-4572-b994-ed4731083cb6 on n-h2-854653-7 Nov 03 05:23:39.125066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4f019146-1858-4956-ad43-291fcfceca3c req-fc56ea1e-4e9d-43c2-b52d-ba6547f9ee63 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Nov 03 05:23:39.125733 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3874/7851] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:23:39.876920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:39.877585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:39.884442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:39.884944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:39.885433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:39.886144 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:39.886617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:39.887063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:40.021331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:40.029363 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-428ba4a5-70af-47e0-9161-e79a73554ac7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1391 microversion: 2.1 time: 0.156378 Nov 03 05:23:40.029937 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3978/7852] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:39 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:41.053802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:41.054516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:41.060733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:41.061268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:41.061744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:41.062439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:41.062900 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:41.063334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:41.193663 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:41.201671 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fe57da02-4ccc-41af-9848-95b4485b5632 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1563 microversion: 2.1 time: 0.153077 Nov 03 05:23:41.202245 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3875/7853] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:41 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:41.224855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:41.225514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:41.232297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:41.232803 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:41.233298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:41.234017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:41.234492 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:41.234941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:41.368582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:41.376352 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a744b22b-1629-4c9e-aada-0af09fdfb35e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1563 microversion: 2.1 time: 0.155440 Nov 03 05:23:41.376921 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3979/7854] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:41 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:23:43.235494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:23:43.236166 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:23:43.241935 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1105fcdb-c42f-437b-b846-8f5a79dfe64c req-453983a3-991f-4dbe-b8a2-745a352f566a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd021867-9a8b-4572-b994-ed4731083cb6", "tag": "1fb0cc7a-a42e-4b24-afd4-24c92947446e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:23:43.255467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:43.255958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:43.256398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:43.256680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1105fcdb-c42f-437b-b846-8f5a79dfe64c req-453983a3-991f-4dbe-b8a2-745a352f566a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:43.257158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:23:43.257484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1105fcdb-c42f-437b-b846-8f5a79dfe64c req-453983a3-991f-4dbe-b8a2-745a352f566a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:43.257612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:23:43.257944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1105fcdb-c42f-437b-b846-8f5a79dfe64c req-453983a3-991f-4dbe-b8a2-745a352f566a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:43.258062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:23:43.270792 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1105fcdb-c42f-437b-b846-8f5a79dfe64c req-453983a3-991f-4dbe-b8a2-745a352f566a service nova] Creating event network-changed:1fb0cc7a-a42e-4b24-afd4-24c92947446e for instance fd021867-9a8b-4572-b994-ed4731083cb6 on n-h2-854653-7 Nov 03 05:23:43.275963 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1105fcdb-c42f-437b-b846-8f5a79dfe64c req-453983a3-991f-4dbe-b8a2-745a352f566a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037637 Nov 03 05:23:43.276773 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3980/7855] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:23:43.484156 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:23:43.492851 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b43280ec-888e-4f6e-a1f6-64b603a2b8a7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1563 microversion: 2.1 time: 0.261459 Nov 03 05:23:43.493611 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3876/7856] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:23:43 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:07.160572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=11 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:07.161366 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=46 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:07.165670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:24:07.167955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:07.174733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:07.175264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:07.175727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:07.176448 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:07.176924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:07.177402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:07.232731 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c92415ce-c822-449d-bcdc-ca9e5aea1204 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6/action" status: 200 len: 24568 microversion: 2.1 time: 0.074160 Nov 03 05:24:07.233423 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3981/7857] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:24:07 2022] POST /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6/action => generated 24568 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:24:18.199643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:24:18.201863 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:18.204121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=11 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:18.204772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=46 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:18.209486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:18.210020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:18.210458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:18.211155 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:18.211611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:18.212036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:18.387584 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a56e6bd2-fe7a-4702-85d3-9ecd34fd4514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6/action" status: 202 len: 0 microversion: 2.1 time: 0.191949 Nov 03 05:24:18.388253 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3877/7858] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:24:18 2022] POST /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:24:18.397321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:18.398159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:18.401075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:18.401740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:18.407938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:18.408437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:18.408916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:18.409688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:18.410167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:18.410608 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:18.607467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:18.616152 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9d0f80e9-409d-4f4d-958b-df6c3ea171eb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1673 microversion: 2.1 time: 0.223278 Nov 03 05:24:18.616937 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3982/7859] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:18 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:24:19.641641 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:19.642374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:19.648569 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:19.649080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:19.649526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:19.650208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:19.650661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:19.651083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:19.786650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:19.794372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4028afe4-dba1-4a67-8d8f-0e8f39fcefaa tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.158286 Nov 03 05:24:19.794936 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3878/7860] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:19 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:24:20.819053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:20.819688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:20.826614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:20.827139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:20.827596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:20.828940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:20.829439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:20.829884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:20.960755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:20.968671 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3a41bc6c-2d72-47b9-b9c1-2273b98c3053 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.153984 Nov 03 05:24:20.969286 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3983/7861] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:20 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:21.991960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:21.992582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:21.999490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:22.000560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:22.001037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:22.001734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:22.002198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:22.002633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:22.130168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:22.137929 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b5aaf92d-1d52-4de0-979f-f31034dc0ee3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.149950 Nov 03 05:24:22.138503 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3879/7862] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:21 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:23.161631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:23.162199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:23.169143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:23.169656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:23.170120 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:23.170837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:23.171319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:23.172099 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:23.305167 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:23.313618 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-490cf615-f908-44e1-a734-c37893235101 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.156018 Nov 03 05:24:23.314194 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3984/7863] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:23 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:24.337065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:24.337682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:24.344510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:24.344995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:24.345460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:24.346153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:24.346608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:24.347042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:24.587355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:24.587355 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6da06eeb-aefe-40ad-ab98-446662eb0bdb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.158275 Nov 03 05:24:24.587355 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3880/7864] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:24 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:25.516698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:25.517360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:25.524437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:25.524939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:25.525429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:25.526145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:25.526620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:25.527068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:25.662632 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:25.670532 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b9fdf523-2fe9-488b-b691-f4cc14ff042e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.158351 Nov 03 05:24:25.671149 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3985/7865] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:25 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:26.694625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:26.695252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:26.702176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:26.702667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:26.703749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:26.704477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:26.704941 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:26.705400 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:26.834981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:26.842748 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-412ae231-e0ff-47e8-b04f-44e010adb10c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.152086 Nov 03 05:24:26.843321 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3881/7866] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:26 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:27.865524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:27.866152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:27.872937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:27.873472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:27.873956 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:27.874663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:27.875235 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:27.875684 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:28.010041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:28.018288 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-241c8846-d16b-4a9a-9767-686508524672 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.156767 Nov 03 05:24:28.018863 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3986/7867] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:27 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:29.042271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:29.042895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:29.050533 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:29.051026 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:29.051474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:29.052173 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:29.052633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:29.053096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:29.186270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:29.194410 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f062d91d-cb6b-4c56-9856-d6d903ceb6d7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1678 microversion: 2.1 time: 0.156135 Nov 03 05:24:29.194996 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3882/7868] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:29 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:30.219083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:24:30.219712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:30.226562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:30.227078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:30.227539 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:30.228262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:30.228739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:30.229222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:30.358483 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:24:30.367125 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-794b0999-803d-43b9-8838-9a0a9c338a6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1681 microversion: 2.1 time: 0.153044 Nov 03 05:24:30.367704 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3987/7869] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:24:30 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:24:56.570874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:24:56.573106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:24:56.575467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=12 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:56.576299 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:24:56.581504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:56.581997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:56.582438 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:56.583138 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:24:56.583600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:24:56.584033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:24:56.644066 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-39c33b0a-3662-4ad8-aec1-d1f2a9c47d6d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6/action" status: 200 len: 69090 microversion: 2.1 time: 0.077204 Nov 03 05:24:56.644723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3883/7870] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:24:56 2022] POST /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6/action => generated 69090 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:25:08.620433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:08.621242 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:08.623749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:08.624570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=36 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:08.624764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:08.632286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:08.632953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:08.633467 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:08.634206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:08.634714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:08.635377 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:08.667049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:25:08.693382 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-10daff22-df03-44b7-ac17-fff488143f12 req-54d2a0c5-2107-4dce-9dda-e3bcbf9c0ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd021867-9a8b-4572-b994-ed4731083cb6", "tag": "1fb0cc7a-a42e-4b24-afd4-24c92947446e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:25:08.705778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-10daff22-df03-44b7-ac17-fff488143f12 req-54d2a0c5-2107-4dce-9dda-e3bcbf9c0ce4 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:08.706518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-10daff22-df03-44b7-ac17-fff488143f12 req-54d2a0c5-2107-4dce-9dda-e3bcbf9c0ce4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:08.707203 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-10daff22-df03-44b7-ac17-fff488143f12 req-54d2a0c5-2107-4dce-9dda-e3bcbf9c0ce4 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:08.718577 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-10daff22-df03-44b7-ac17-fff488143f12 req-54d2a0c5-2107-4dce-9dda-e3bcbf9c0ce4 service nova] Creating event network-changed:1fb0cc7a-a42e-4b24-afd4-24c92947446e for instance fd021867-9a8b-4572-b994-ed4731083cb6 on n-h2-854653-7 Nov 03 05:25:08.723862 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-10daff22-df03-44b7-ac17-fff488143f12 req-54d2a0c5-2107-4dce-9dda-e3bcbf9c0ce4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105252 Nov 03 05:25:08.726913 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3884/7871] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:25:08.995154 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-38e19e8a-7505-49c7-bce6-6cfcb03c0bcb tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 204 len: 0 microversion: 2.1 time: 0.378880 Nov 03 05:25:08.996776 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3988/7872] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:25:08 2022] DELETE /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:25:09.005287 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:09.006010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:09.015734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:09.016247 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:09.016682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:09.017435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:09.018033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:09.018474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:09.159078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:09.167038 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-35fa91da-efe9-428d-aade-40582d75a436 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1687 microversion: 2.1 time: 0.166274 Nov 03 05:25:09.167623 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3885/7873] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:08 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:25:10.192790 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:10.193477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:10.200382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:10.200885 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:10.201381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:10.202095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:10.202573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:10.203019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:10.332880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:10.340612 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2d639078-ffa3-4175-9c7d-6e9db4dd26c5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1687 microversion: 2.1 time: 0.152930 Nov 03 05:25:10.341207 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3989/7874] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:10 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:11.236337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-f46ce4cb-72f8-42ad-a0fa-b52cb7daab17 req-8d5c8cc8-5907-4293-acdc-a4d929c1c2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd021867-9a8b-4572-b994-ed4731083cb6", "name": "network-vif-deleted", "tag": "1fb0cc7a-a42e-4b24-afd4-24c92947446e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:25:11.246839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f46ce4cb-72f8-42ad-a0fa-b52cb7daab17 req-8d5c8cc8-5907-4293-acdc-a4d929c1c2e2 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:11.249315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f46ce4cb-72f8-42ad-a0fa-b52cb7daab17 req-8d5c8cc8-5907-4293-acdc-a4d929c1c2e2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:11.249315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-f46ce4cb-72f8-42ad-a0fa-b52cb7daab17 req-8d5c8cc8-5907-4293-acdc-a4d929c1c2e2 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:11.259717 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-f46ce4cb-72f8-42ad-a0fa-b52cb7daab17 req-8d5c8cc8-5907-4293-acdc-a4d929c1c2e2 service nova] Creating event network-vif-deleted:1fb0cc7a-a42e-4b24-afd4-24c92947446e for instance fd021867-9a8b-4572-b994-ed4731083cb6 on n-h2-854653-7 Nov 03 05:25:11.264822 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-f46ce4cb-72f8-42ad-a0fa-b52cb7daab17 req-8d5c8cc8-5907-4293-acdc-a4d929c1c2e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032328 Nov 03 05:25:11.265449 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3886/7875] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:25:11.363598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:11.364236 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:11.371211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:11.371712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:11.372172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:11.372887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:11.373403 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:11.373845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:11.440504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:11.448501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a3dbb71-e4f0-4c41-ab2c-27d124f6fc66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 200 len: 1350 microversion: 2.1 time: 0.088884 Nov 03 05:25:11.449036 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3990/7876] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:11 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 1350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:12.473655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:12.474271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: fd021867-9a8b-4572-b994-ed4731083cb6] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:12.480486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:12.480985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:12.481460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:12.482165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:12.482625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:12.483068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:12.496458 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] HTTP exception thrown: Instance fd021867-9a8b-4572-b994-ed4731083cb6 could not be found. Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Request method failure captured: Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 HTTP/1.1 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0_dzUEqXCGMfjl2Nm1_zjjJUGvtN4CdLSbzLcws51Voz6SH5K-iaKq7w4Slra2ZxBNNbU3gFLnw8W1q0QQo7bomOczqJPu1MbTAbVcqGhsNnqvjsPQTRLM4PUZCvMld88wiXBf2J3HzTkQytXjU6T7YC7lECkYVrtJmEBWJRsnQdZI Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9ab73bd2a894b2ba81937894e033fd4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9ab73bd2a894b2ba81937894e033fd4"}]}] Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 062fa477611040718370f855e0832151 Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance fd021867-9a8b-4572-b994-ed4731083cb6 could not be found. Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'fd021867-9a8b-4572-b994-ed4731083cb6'} Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd021867-9a8b-4572-b994-ed4731083cb6 could not be found. Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd021867-9a8b-4572-b994-ed4731083cb6 could not be found. Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:25:12.498150 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd021867-9a8b-4572-b994-ed4731083cb6 could not be found. Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Returning 404 to user: Instance fd021867-9a8b-4572-b994-ed4731083cb6 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42cd4702-d424-4c46-b20c-0e2be5738887 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6" status: 404 len: 111 microversion: 2.1 time: 0.031865 Nov 03 05:25:12.504069 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3887/7877] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:12 2022] GET /compute/v2.1/servers/fd021867-9a8b-4572-b994-ed4731083cb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:25:16.760035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-45af7556-40a8-49b7-a161-0f8906f72dab tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '.version_select at 0x7ff7fd60fdc0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:16.847015 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-45af7556-40a8-49b7-a161-0f8906f72dab tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1083551942" status: 202 len: 0 microversion: 2.1 time: 0.091123 Nov 03 05:25:16.847723 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3991/7878] 10.222.0.30 () {58 vars in 1284 bytes} [Thu Nov 3 05:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1083551942 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:25:16.884719 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-00995d1a-38ce-41ae-a931-a9ab14ca18b8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: .version_select at 0x7ff7f9183af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1427815466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMvEUHqNLcfwgQSZQLs/Cmglz3ruNzmioXbDwANVL8ugMD6lPhdKLGvx4dDsHQXAjIUHjBOvr47MsUlixL6ce/GYQkurdI+jodrZdfIPYPkjivQNwP9+K1ccYpeBkZkiw=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:25:16.900272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-00995d1a-38ce-41ae-a931-a9ab14ca18b8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:25:16.907457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-00995d1a-38ce-41ae-a931-a9ab14ca18b8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:25:16.984329 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-00995d1a-38ce-41ae-a931-a9ab14ca18b8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.109163 Nov 03 05:25:16.984988 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3888/7879] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:25:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:25:25.151804 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:25.156958 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2042255545", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "f4c98c9f-d9f6-479f-81e8-a7c53fbcde54"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1427815466", "security_groups": [{"name": "tempest-secgroup-smoke-1923976770"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:25:25.489842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] validate_networks() for [('f4c98c9f-d9f6-479f-81e8-a7c53fbcde54', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:25:25.895802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:25:25.896253 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:25:25.896774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:25:25.897369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:25:25.897809 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:25:25.907246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:25.907877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:25.908345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:25.909118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:25.909607 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:25.910061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:25.929066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:25:25.934398 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:25:25.946837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:25:25.949210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:25:26.072040 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8f129395-b06f-4107-a6aa-17cf5c8337e9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.922521 Nov 03 05:25:26.072715 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3992/7880] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:25:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:25:26.082605 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:26.087375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-246e27be-358a-427e-97db-e33e77aa5d72 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:26.088008 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-246e27be-358a-427e-97db-e33e77aa5d72 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:26.222697 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-246e27be-358a-427e-97db-e33e77aa5d72 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:26.230949 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-246e27be-358a-427e-97db-e33e77aa5d72 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1267 microversion: 2.1 time: 0.150347 Nov 03 05:25:26.232613 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3889/7881] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:26 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:27.256215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:27.257534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:27.265278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:27.265794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:27.266256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:27.266991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:27.267472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:27.267916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:27.340177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:27.351010 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e37b0add-c737-4462-8a43-d0ef4663c796 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1271 microversion: 2.1 time: 0.099604 Nov 03 05:25:27.352024 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3993/7882] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:27 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:28.374778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:28.375402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:28.383817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:28.384579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:28.385075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:28.385860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:28.386323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:28.386782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:28.454588 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:28.464700 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-79e805b6-37a5-4848-b731-4c82d68b2ab8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1325 microversion: 2.1 time: 0.093893 Nov 03 05:25:28.465589 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3890/7883] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:28 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1325 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:29.489194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:29.489840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:29.497135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:29.497663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:29.498106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:29.498833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:29.499710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:29.499859 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:29.632680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:29.640569 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0af24388-9a56-4af2-8421-44e2d5580d94 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1393 microversion: 2.1 time: 0.155903 Nov 03 05:25:29.641167 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3994/7884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:29 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:29.788406 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5e7b47c0-3b7a-464b-856e-70f053822e7b req-04d12a58-a9e5-49a9-a365-a0e98ba4db62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:25:29.798765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5e7b47c0-3b7a-464b-856e-70f053822e7b req-04d12a58-a9e5-49a9-a365-a0e98ba4db62 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:29.799252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5e7b47c0-3b7a-464b-856e-70f053822e7b req-04d12a58-a9e5-49a9-a365-a0e98ba4db62 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:29.799689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5e7b47c0-3b7a-464b-856e-70f053822e7b req-04d12a58-a9e5-49a9-a365-a0e98ba4db62 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:29.811629 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5e7b47c0-3b7a-464b-856e-70f053822e7b req-04d12a58-a9e5-49a9-a365-a0e98ba4db62 service nova] Creating event network-changed:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h1-854653-7 Nov 03 05:25:29.816576 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5e7b47c0-3b7a-464b-856e-70f053822e7b req-04d12a58-a9e5-49a9-a365-a0e98ba4db62 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032495 Nov 03 05:25:29.817226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3891/7885] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:25:30.664106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:30.664667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:30.671497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:30.671998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:30.672455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:30.673190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:30.673661 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:30.674100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:30.810008 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:30.818291 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cba740f0-e412-431e-a71b-3ded913942c8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1393 microversion: 2.1 time: 0.158238 Nov 03 05:25:30.822273 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3995/7886] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:30 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:31.843369 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:31.844086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:31.851122 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:31.851617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:31.852066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:31.852769 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:31.853264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:31.853702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:31.990886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:31.998705 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f36f8a66-c0a6-45ed-82c7-7efb0cc00282 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1393 microversion: 2.1 time: 0.160566 Nov 03 05:25:31.999294 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3892/7887] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:31 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:33.022283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:33.022924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:33.030089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:33.030599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:33.031065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:33.031783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:33.032263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:33.032717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:33.165066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:33.172806 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-055ca125-409e-46d5-bb73-2e4196d23ea9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1393 microversion: 2.1 time: 0.154646 Nov 03 05:25:33.173407 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3996/7888] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:33 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:34.196481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:34.197215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:34.203917 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:34.204399 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:34.204835 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:34.205560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:34.206016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:34.206442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:34.345225 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:34.353695 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c45256d4-2054-47dc-b4e8-434e08d46d02 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1393 microversion: 2.1 time: 0.161739 Nov 03 05:25:34.354372 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3893/7889] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:34 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:35.377651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:35.378711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:35.385783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:35.396855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:35.396855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:35.396855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:35.396855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:35.396855 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:35.523558 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:35.531870 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85531a33-c6b1-48ae-abce-df643db6853a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1393 microversion: 2.1 time: 0.158166 Nov 03 05:25:35.534217 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3997/7890] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:35 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:36.016558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6ca274f5-d6ea-4a63-a432-a4e90921ed2f req-64839c51-563f-4cf3-979b-d069cdac2eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "name": "network-vif-plugged", "status": "completed", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:25:36.026134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ca274f5-d6ea-4a63-a432-a4e90921ed2f req-64839c51-563f-4cf3-979b-d069cdac2eab service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:36.026615 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ca274f5-d6ea-4a63-a432-a4e90921ed2f req-64839c51-563f-4cf3-979b-d069cdac2eab service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:36.027055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6ca274f5-d6ea-4a63-a432-a4e90921ed2f req-64839c51-563f-4cf3-979b-d069cdac2eab service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:36.039040 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6ca274f5-d6ea-4a63-a432-a4e90921ed2f req-64839c51-563f-4cf3-979b-d069cdac2eab service nova] Creating event network-vif-plugged:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h1-854653-7 Nov 03 05:25:36.043947 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6ca274f5-d6ea-4a63-a432-a4e90921ed2f req-64839c51-563f-4cf3-979b-d069cdac2eab service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082770 Nov 03 05:25:36.045404 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3894/7891] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:25:36.555122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:36.555710 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:36.557617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:36.558324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:36.563928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:36.564427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:36.564881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:36.565616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:36.571186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:36.571186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:36.701578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:36.709854 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad615772-14d0-465b-a4cd-f3b774126023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1393 microversion: 2.1 time: 0.158757 Nov 03 05:25:36.710431 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3998/7892] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:36 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:37.730013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:37.735103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:37.735798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:37.741913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:37.742403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:37.742873 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:37.743580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:37.744042 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:37.744474 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:37.880496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:37.888439 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9cd968a8-35fb-4a85-ba34-a1569fbc8514 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1566 microversion: 2.1 time: 0.159489 Nov 03 05:25:37.889006 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3895/7893] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:37 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:37.912814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:37.916942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:37.920553 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:37.921275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:37.921738 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:37.922461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:37.922937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:37.923381 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:38.053365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:38.061154 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b100153-1004-4bf5-b370-80b8aa35f982 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1566 microversion: 2.1 time: 0.152884 Nov 03 05:25:38.061726 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 3999/7894] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:37 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:25:39.955198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:25:39.956059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:25:39.957571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-787859f6-4e79-4d29-9e6a-959ac746a4b1 req-97bb2d83-bed8-4e93-90a9-81e4d8fe45ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:25:39.960266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:39.964241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:39.964701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:25:39.964960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:39.965658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:39.966766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:39.967300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:39.968112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:39.969358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-787859f6-4e79-4d29-9e6a-959ac746a4b1 req-97bb2d83-bed8-4e93-90a9-81e4d8fe45ba service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:25:39.974799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-787859f6-4e79-4d29-9e6a-959ac746a4b1 req-97bb2d83-bed8-4e93-90a9-81e4d8fe45ba service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:25:39.974799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-787859f6-4e79-4d29-9e6a-959ac746a4b1 req-97bb2d83-bed8-4e93-90a9-81e4d8fe45ba service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:25:39.981966 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-787859f6-4e79-4d29-9e6a-959ac746a4b1 req-97bb2d83-bed8-4e93-90a9-81e4d8fe45ba service nova] Creating event network-changed:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h1-854653-7 Nov 03 05:25:39.987403 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-787859f6-4e79-4d29-9e6a-959ac746a4b1 req-97bb2d83-bed8-4e93-90a9-81e4d8fe45ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033572 Nov 03 05:25:39.988792 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4000/7895] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:25:40.118331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:25:40.126535 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-644c929a-0fe8-41a6-8e1b-97382831cfac tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1684 microversion: 2.1 time: 0.175514 Nov 03 05:25:40.127813 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3896/7896] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:25:39 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:13.410910 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=46 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:26:13.416399 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:26:13.418851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:13.425599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:13.425762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:13.426228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:13.426942 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:13.427418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:13.427866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:13.482387 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a0270d7a-2717-488c-a5ae-d8f43037056a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action" status: 200 len: 24573 microversion: 2.1 time: 0.073455 Nov 03 05:26:13.483051 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4001/7897] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:26:13 2022] POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:26:43.903454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:26:43.904692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=34 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:26:43.905957 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:26:43.906111 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:26:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action (ip 10.222.0.30) !!! Nov 03 05:26:43.957209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:26:43.959656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:43.965632 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:43.966117 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:43.966559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:43.967249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:43.967706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:43.968135 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:44.050522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:44.057233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Old instance type m1.heat2, new instance type m1.heat {{(pid=127593) resize /opt/stack/nova/nova/compute/api.py:4220}} Nov 03 05:26:44.063838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:26:44.064255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:26:44.064725 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:26:44.065164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:26:44.065579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:26:44.271227 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7996a7c9-3117-4ccb-8353-2f9d3fe8a4e5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action" status: 202 len: 0 microversion: 2.1 time: 0.369541 Nov 03 05:26:44.271844 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3897/7898] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:26:43 2022] POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:26:44.281638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:44.282364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:44.285940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:26:44.291231 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:44.295082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:44.295082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:44.295082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:44.295082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:44.295082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:44.431521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:44.439305 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b3b6cc07-80e5-45fa-8fbb-51a19453c324 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1693 microversion: 2.1 time: 0.162770 Nov 03 05:26:44.439924 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4002/7899] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:44 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:26:45.465297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:45.466019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:45.473576 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:45.474270 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:45.474807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:45.475452 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:45.476096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:45.476549 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:45.617395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:45.625241 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8f321c90-22f6-42e7-b0f2-d80f0692258e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1693 microversion: 2.1 time: 0.165811 Nov 03 05:26:45.625852 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3898/7900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:45 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:26:46.650132 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:46.650762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:46.658920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:46.659416 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:46.659869 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:46.660577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:46.661073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:46.661522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:46.792285 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:46.800050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72055515-4806-416d-9f8f-8b978fde6885 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1693 microversion: 2.1 time: 0.154206 Nov 03 05:26:46.800613 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4003/7901] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:46 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:47.823733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:47.824340 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:47.830996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:47.831519 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:47.831961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:47.833300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:47.833764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:47.834194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:47.974832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:47.983408 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b1bee750-1535-4760-ba43-84d5692aa14d tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1693 microversion: 2.1 time: 0.163622 Nov 03 05:26:47.984001 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3899/7902] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:47 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:49.007703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:49.008331 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:49.015822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:49.016322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:49.016777 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:49.017511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:49.017986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:49.018426 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:49.149168 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:49.157225 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-bb6abddb-febf-438e-aa70-5eab6555b493 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.154104 Nov 03 05:26:49.157797 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4004/7903] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:49 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:50.180898 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:50.181498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:50.188367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:50.188852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:50.189320 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:50.190023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:50.190480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:50.190907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:50.331796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:50.340273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b982d287-4d49-411e-8d51-6d7698f0bcec tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.163428 Nov 03 05:26:50.340851 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3900/7904] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:50 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:51.363895 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:51.364541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:51.371394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:51.371900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:51.372358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:51.373091 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:51.373567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:51.374016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:51.504328 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:51.512709 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b4d456b7-81ad-4bbb-bbe9-e059178a7f4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.152785 Nov 03 05:26:51.513325 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4005/7905] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:51 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:52.535892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:52.536522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:52.544045 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:52.544544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:52.544993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:52.545722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:52.546192 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:52.546629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:52.675393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:52.683137 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bc627cd4-f804-4d9d-ba2c-069f555a53a5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.151205 Nov 03 05:26:52.683723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3901/7906] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:52 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:53.706916 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:53.707548 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:53.714157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:53.714651 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:53.715102 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:53.715802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:53.716275 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:53.716716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:53.850668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:53.858501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f09a77d6-592a-471d-87a5-c8d27ffb478a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.155579 Nov 03 05:26:53.859068 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4006/7907] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:53 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:54.882784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:54.883857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:54.893730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:54.894652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:54.895148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:54.895883 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:54.896358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:54.897412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:55.028790 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:55.036976 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-537d0a7d-2750-4982-8157-ea4cfa51b70e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.158899 Nov 03 05:26:55.037636 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3902/7908] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:54 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:56.060579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:56.061259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:56.068220 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:56.068749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:56.069239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:56.069993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:56.070471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:56.070922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:56.208419 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:56.216956 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-55daa403-27b1-4f86-be86-a20032253408 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.160357 Nov 03 05:26:56.217582 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4007/7909] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:56 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:57.240912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:57.241568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:57.248451 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:57.248945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:57.249427 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:57.250133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:57.250597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:57.251033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:57.379829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:57.387701 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-090d24fa-0af7-4f45-a957-4483a10327f0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.151328 Nov 03 05:26:57.388280 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3903/7910] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:57 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:58.411043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:58.411611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:58.418429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:58.418927 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:58.419386 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:58.420114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:58.420586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:58.421050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:58.556451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:58.564316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-014ac9ee-93bd-4d77-86ca-47f91f1c5f87 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.157300 Nov 03 05:26:58.564890 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4008/7911] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:58 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:26:59.588332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:26:59.588961 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:26:59.595853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:59.596341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:59.596784 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:59.597508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:26:59.597969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:26:59.598401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:26:59.730791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:26:59.738593 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6cd7f9e6-b6d1-422a-958b-1acc3196f057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1698 microversion: 2.1 time: 0.154809 Nov 03 05:26:59.739185 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3904/7912] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:26:59 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:00.763609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:00.764296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:00.771835 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:00.772345 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:00.772838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:00.773628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:00.774100 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:00.774543 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:00.813413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-c5c298d6-4b69-47f4-b177-f700b6109db2 req-601ed184-f76b-4595-8c35-50117b89332c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "name": "network-vif-unplugged", "status": "completed", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:00.823809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c5c298d6-4b69-47f4-b177-f700b6109db2 req-601ed184-f76b-4595-8c35-50117b89332c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:00.832478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c5c298d6-4b69-47f4-b177-f700b6109db2 req-601ed184-f76b-4595-8c35-50117b89332c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:00.832478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-c5c298d6-4b69-47f4-b177-f700b6109db2 req-601ed184-f76b-4595-8c35-50117b89332c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:00.837914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-c5c298d6-4b69-47f4-b177-f700b6109db2 req-601ed184-f76b-4595-8c35-50117b89332c service nova] Creating event network-vif-unplugged:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h2-854653-7 Nov 03 05:27:00.843486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [req-c5c298d6-4b69-47f4-b177-f700b6109db2 req-601ed184-f76b-4595-8c35-50117b89332c service nova] Instance 0b952097-eda6-4710-a574-efc248ba5180 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127593) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:27:00.854807 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-c5c298d6-4b69-47f4-b177-f700b6109db2 req-601ed184-f76b-4595-8c35-50117b89332c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045331 Nov 03 05:27:00.859056 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3905/7913] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:27:00.930036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:00.938215 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6e5e1899-fad4-4fe5-8c7d-a289138bfaa9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1697 microversion: 2.1 time: 0.179673 Nov 03 05:27:00.938886 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4009/7914] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:00 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:01.966090 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:01.966810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:01.972985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:01.973518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:01.973965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:01.975239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:01.975703 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:01.976142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:02.109318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:02.117232 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-83a86aef-b401-4bcf-94f1-e06338f55ae2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1697 microversion: 2.1 time: 0.156341 Nov 03 05:27:02.117809 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3906/7915] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:01 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:27:02.871187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2e7f4255-668f-4b76-829d-4e958f3a0417 req-0147d78d-287a-4b6b-854e-725ccc5e614a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:02.882039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2e7f4255-668f-4b76-829d-4e958f3a0417 req-0147d78d-287a-4b6b-854e-725ccc5e614a service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:02.882536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2e7f4255-668f-4b76-829d-4e958f3a0417 req-0147d78d-287a-4b6b-854e-725ccc5e614a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:02.882989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2e7f4255-668f-4b76-829d-4e958f3a0417 req-0147d78d-287a-4b6b-854e-725ccc5e614a service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:02.894457 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2e7f4255-668f-4b76-829d-4e958f3a0417 req-0147d78d-287a-4b6b-854e-725ccc5e614a service nova] Creating event network-changed:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h2-854653-7 Nov 03 05:27:02.899894 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [req-2e7f4255-668f-4b76-829d-4e958f3a0417 req-0147d78d-287a-4b6b-854e-725ccc5e614a service nova] Instance 0b952097-eda6-4710-a574-efc248ba5180 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854653-7', 'n-h1-854653-7'} {{(pid=127594) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Nov 03 05:27:02.915466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2e7f4255-668f-4b76-829d-4e958f3a0417 req-0147d78d-287a-4b6b-854e-725ccc5e614a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047695 Nov 03 05:27:02.916470 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4010/7916] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:27:03.140530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:03.141183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:03.148023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:03.148511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:03.148953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:03.149671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:03.150132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:03.150559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:03.290688 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:03.298466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72697202-c022-4a14-95ab-5787c9478b6a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1695 microversion: 2.1 time: 0.161846 Nov 03 05:27:03.299043 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3907/7917] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:03 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:04.324247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:04.325003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:04.331299 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.331812 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.332802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:04.333007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.334362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.334915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:04.494861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:04.502613 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0ab1b09c-2f71-4256-91bd-addd68b39535 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1692 microversion: 2.1 time: 0.183602 Nov 03 05:27:04.503229 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4011/7918] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:04 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:04.525892 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:04.526447 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:04.533525 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.534017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.534462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:04.535165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.535625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.536060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:04.744273 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a8b40e96-77b7-4403-8181-a78e0b2b9c2e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action" status: 204 len: 0 microversion: 2.1 time: 0.222787 Nov 03 05:27:04.744943 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3908/7919] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:27:04 2022] POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:27:04.753334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:04.754278 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:04.760709 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.761396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.761875 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:04.762603 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.763085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.763573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:04.897541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:04.907394 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-81ae4f93-c480-48d3-88af-cd0c9025dd1b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1692 microversion: 2.1 time: 0.158172 Nov 03 05:27:04.908418 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4012/7920] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:04 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:04.937988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:04.938709 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:04.953664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.954164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.954638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:04.955345 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:04.956005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:04.956570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:05.096509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:05.104335 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f2f9b697-6319-4ca8-b892-4c0f87d9c905 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1692 microversion: 2.1 time: 0.173022 Nov 03 05:27:05.104914 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3909/7921] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:04 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:06.128364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:06.129006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:06.136010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:06.136511 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:06.136972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:06.137739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:06.138218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:06.138664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:06.281074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:06.289871 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f45e494c-48ad-443a-9feb-d947702ff517 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1692 microversion: 2.1 time: 0.165545 Nov 03 05:27:06.290480 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4013/7922] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:06 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:07.313319 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:07.313955 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:07.320789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:07.321314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:07.321767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:07.322473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:07.322958 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:07.323396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:07.456972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:07.465363 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9d5ff9f-56ee-4035-8b74-3c7afd578bbd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1684 microversion: 2.1 time: 0.156004 Nov 03 05:27:07.466077 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3910/7923] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:07 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:08.158351 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-083a4269-9c8f-4390-ac51-a4361f8f2c89 req-a012af25-5bdf-44cc-a171-2e766eeee379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "name": "network-vif-plugged", "status": "completed", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:08.168802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-083a4269-9c8f-4390-ac51-a4361f8f2c89 req-a012af25-5bdf-44cc-a171-2e766eeee379 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:08.169333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-083a4269-9c8f-4390-ac51-a4361f8f2c89 req-a012af25-5bdf-44cc-a171-2e766eeee379 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:08.169791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-083a4269-9c8f-4390-ac51-a4361f8f2c89 req-a012af25-5bdf-44cc-a171-2e766eeee379 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:08.181395 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-083a4269-9c8f-4390-ac51-a4361f8f2c89 req-a012af25-5bdf-44cc-a171-2e766eeee379 service nova] Creating event network-vif-plugged:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h2-854653-7 Nov 03 05:27:08.186565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-083a4269-9c8f-4390-ac51-a4361f8f2c89 req-a012af25-5bdf-44cc-a171-2e766eeee379 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032385 Nov 03 05:27:08.187198 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4014/7924] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:27:31.656222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:31.658832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:31.661363 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=32 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:27:31.662032 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:27:31.667254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:31.667780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:31.668223 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:31.668913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:31.669398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:31.678490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:31.728551 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7adae8fd-5f3f-45fb-b879-6093824e0bf9 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action" status: 200 len: 24580 microversion: 2.1 time: 0.076398 Nov 03 05:27:31.729214 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3911/7925] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:27:31 2022] POST /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180/action => generated 24580 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:27:38.818919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=29 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:27:38.819699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=72 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:27:38.824447 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:38.825357 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:38.832964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:38.833505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:38.835871 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:38.836648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:38.837190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:38.837645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:38.879728 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:27:38.895183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-64faeb3a-43a5-49c7-9631-da9a30f22318 req-f9bfe621-325d-4d66-83f8-baa00760d5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:38.908940 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-64faeb3a-43a5-49c7-9631-da9a30f22318 req-f9bfe621-325d-4d66-83f8-baa00760d5bb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:38.909465 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-64faeb3a-43a5-49c7-9631-da9a30f22318 req-f9bfe621-325d-4d66-83f8-baa00760d5bb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:38.909902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-64faeb3a-43a5-49c7-9631-da9a30f22318 req-f9bfe621-325d-4d66-83f8-baa00760d5bb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:38.921758 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-64faeb3a-43a5-49c7-9631-da9a30f22318 req-f9bfe621-325d-4d66-83f8-baa00760d5bb service nova] Creating event network-changed:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h2-854653-7 Nov 03 05:27:38.926764 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-64faeb3a-43a5-49c7-9631-da9a30f22318 req-f9bfe621-325d-4d66-83f8-baa00760d5bb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108397 Nov 03 05:27:38.927481 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3912/7926] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:27:39.180501 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-667edf03-9a4d-4913-bd36-9464602fb831 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 204 len: 0 microversion: 2.1 time: 0.364206 Nov 03 05:27:39.181312 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4015/7927] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:27:38 2022] DELETE /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:27:39.190542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:39.195861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:39.199234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:39.199736 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:39.200397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:39.201375 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:39.201842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:39.202280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:39.341264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:39.349253 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-734026e0-5a64-4f19-91b7-5a2ef41996dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1690 microversion: 2.1 time: 0.163387 Nov 03 05:27:39.349966 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3913/7928] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:39 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:40.374305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:40.375034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:40.381989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:40.382496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:40.382993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:40.383708 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:40.384187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:40.384631 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:40.590405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:40.598614 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4f782122-2c8e-41c2-b177-2ee4146b8a64 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1690 microversion: 2.1 time: 0.228678 Nov 03 05:27:40.599203 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4016/7929] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:40 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1690 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:41.220877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-72518093-2cb3-45ee-a526-dff02ff49e0a req-f68ab0ec-32a5-4ee0-84bf-5e4972ba8a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b952097-eda6-4710-a574-efc248ba5180", "name": "network-vif-deleted", "tag": "d7a4250c-f6a7-47a7-8b26-169d5298528e"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:41.231128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-72518093-2cb3-45ee-a526-dff02ff49e0a req-f68ab0ec-32a5-4ee0-84bf-5e4972ba8a89 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:41.231613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-72518093-2cb3-45ee-a526-dff02ff49e0a req-f68ab0ec-32a5-4ee0-84bf-5e4972ba8a89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:41.232054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-72518093-2cb3-45ee-a526-dff02ff49e0a req-f68ab0ec-32a5-4ee0-84bf-5e4972ba8a89 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:41.244814 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-72518093-2cb3-45ee-a526-dff02ff49e0a req-f68ab0ec-32a5-4ee0-84bf-5e4972ba8a89 service nova] Creating event network-vif-deleted:d7a4250c-f6a7-47a7-8b26-169d5298528e for instance 0b952097-eda6-4710-a574-efc248ba5180 on n-h2-854653-7 Nov 03 05:27:41.249648 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-72518093-2cb3-45ee-a526-dff02ff49e0a req-f68ab0ec-32a5-4ee0-84bf-5e4972ba8a89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032451 Nov 03 05:27:41.250226 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3914/7930] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:27:41.622321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:41.623146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:41.630680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:41.631198 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:41.631662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:41.632414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:41.632881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:41.633361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:41.667722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:41.668222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:41.668678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:41.669215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lazy-loading 'fault' on Instance uuid 0b952097-eda6-4710-a574-efc248ba5180 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:27:41.710770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:41.718613 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-61864504-1fa3-4360-ace0-74b0459dd6d0 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 200 len: 1357 microversion: 2.1 time: 0.100265 Nov 03 05:27:41.719182 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4017/7931] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:41 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:42.744047 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:42.744763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 0b952097-eda6-4710-a574-efc248ba5180] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:42.751038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:42.751535 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:42.751985 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:42.752687 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:42.753183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:42.753621 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:42.767960 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] HTTP exception thrown: Instance 0b952097-eda6-4710-a574-efc248ba5180 could not be found. Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Request method failure captured: Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 HTTP/1.1 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0_dzUEqXCGMfjl2Nm1_zjjJUGvtN4CdLSbzLcws51Voz6SH5K-iaKq7w4Slra2ZxBNNbU3gFLnw8W1q0QQo7bomOczqJPu1MbTAbVcqGhsNnqvjsPQTRLM4PUZCvMld88wiXBf2J3HzTkQytXjU6T7YC7lECkYVrtJmEBWJRsnQdZI Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9ab73bd2a894b2ba81937894e033fd4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9ab73bd2a894b2ba81937894e033fd4"}]}] Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 062fa477611040718370f855e0832151 Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 0b952097-eda6-4710-a574-efc248ba5180 could not be found. Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '0b952097-eda6-4710-a574-efc248ba5180'} Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b952097-eda6-4710-a574-efc248ba5180 could not be found. Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b952097-eda6-4710-a574-efc248ba5180 could not be found. Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:27:42.769610 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b952097-eda6-4710-a574-efc248ba5180 could not be found. Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Returning 404 to user: Instance 0b952097-eda6-4710-a574-efc248ba5180 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-64fc4521-e5c2-42a3-a537-cc818198311c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180" status: 404 len: 111 microversion: 2.1 time: 0.032863 Nov 03 05:27:42.775184 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3915/7932] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:42 2022] GET /compute/v2.1/servers/0b952097-eda6-4710-a574-efc248ba5180 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:27:46.532568 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5097a986-073f-41b3-afec-f92257e31a7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '.version_select at 0x7ff7f98f7d30>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:46.537394 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5097a986-073f-41b3-afec-f92257e31a7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:27:47.545426 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [None req-5097a986-073f-41b3-afec-f92257e31a7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [a24e7ebc-5642-471c-9a1d-0b80542dbb67] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34598. Nov 03 05:27:47.626391 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5097a986-073f-41b3-afec-f92257e31a7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1427815466" status: 202 len: 0 microversion: 2.1 time: 1.098055 Nov 03 05:27:47.626991 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4018/7933] 10.222.0.30 () {58 vars in 1284 bytes} [Thu Nov 3 05:27:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1427815466 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 03 05:27:47.654398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bc9c913a-464a-4d7e-be65-a2179aecb908 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: .version_select at 0x7ff7f98a7670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1585234255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSxe5yAC03CspWzHLAyQ0mzcetUjjCaTqWdX5mFrocWUX8ULJVzmB/Ev1ws/SW7sM7s4iK8x7CSQuFxZtxP5672ootJ87e+a/XDcXv/no0rGDmjlj0anbGc3YHagxnvXw=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:47.672028 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-bc9c913a-464a-4d7e-be65-a2179aecb908 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:27:47.677255 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-bc9c913a-464a-4d7e-be65-a2179aecb908 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:27:47.761828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bc9c913a-464a-4d7e-be65-a2179aecb908 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.111574 Nov 03 05:27:47.762424 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3916/7934] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:27:47 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:27:56.140133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:27:56.144258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1954783336", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "bdf9a8d5-b28a-4eb3-bf62-36cd5ed74ce0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1585234255", "security_groups": [{"name": "tempest-secgroup-smoke-892626059"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:27:56.256496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] validate_networks() for [('bdf9a8d5-b28a-4eb3-bf62-36cd5ed74ce0', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:27:56.679982 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:27:56.681653 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:27:56.682177 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:27:56.682609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:27:56.683159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:27:56.692133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:56.692630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:56.693158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:56.693908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:56.694589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:56.695239 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:56.712675 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:27:56.718921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:27:56.732130 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:27:56.734481 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:27:56.876921 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8012e9d8-657c-4773-b046-2548f806f557 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.738625 Nov 03 05:27:56.877932 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4019/7935] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:27:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:27:56.889295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c5eea1ab-7ae2-411b-a2e3-696daa52ed83 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:56.889930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c5eea1ab-7ae2-411b-a2e3-696daa52ed83 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:56.892988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:27:56.968652 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c5eea1ab-7ae2-411b-a2e3-696daa52ed83 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:56.976724 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c5eea1ab-7ae2-411b-a2e3-696daa52ed83 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1267 microversion: 2.1 time: 0.091449 Nov 03 05:27:56.977596 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3917/7936] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:56 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:27:58.001662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:58.002407 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:58.010081 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:58.010658 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:58.011341 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:58.012219 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:58.012702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:58.013190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:58.078001 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:58.087002 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9e5958cb-3fa7-42d5-b0c7-cf3913ab3671 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1271 microversion: 2.1 time: 0.090319 Nov 03 05:27:58.087605 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4020/7937] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:57 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:27:59.113374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:27:59.114858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:27:59.123938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:59.124718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:59.125376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:59.126298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:27:59.126937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:27:59.127548 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:27:59.196877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:27:59.205969 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fbc2287e-53d4-4105-af6b-1e1513130d99 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1337 microversion: 2.1 time: 0.098969 Nov 03 05:27:59.206551 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3918/7938] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:27:59 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:00.229591 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:00.230222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:00.236924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:00.240908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:00.240908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:00.240908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:00.240908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:00.240908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:00.376272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:00.384581 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5e4ae01f-f99a-4de1-9773-14dcdedf4886 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1392 microversion: 2.1 time: 0.158887 Nov 03 05:28:00.385171 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4021/7939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:00 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:00.568497 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8c70840a-bf64-412e-bdf6-9bb9656c5f6b req-bd25d9b8-6504-4421-9618-a510f008aa61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5d302-b9b4-4919-af62-c2b593c4838c", "tag": "1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:28:00.579215 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c70840a-bf64-412e-bdf6-9bb9656c5f6b req-bd25d9b8-6504-4421-9618-a510f008aa61 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:00.579791 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c70840a-bf64-412e-bdf6-9bb9656c5f6b req-bd25d9b8-6504-4421-9618-a510f008aa61 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:00.580227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8c70840a-bf64-412e-bdf6-9bb9656c5f6b req-bd25d9b8-6504-4421-9618-a510f008aa61 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:00.591191 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8c70840a-bf64-412e-bdf6-9bb9656c5f6b req-bd25d9b8-6504-4421-9618-a510f008aa61 service nova] Creating event network-changed:1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4 for instance 7be5d302-b9b4-4919-af62-c2b593c4838c on n-h1-854653-7 Nov 03 05:28:00.597690 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8c70840a-bf64-412e-bdf6-9bb9656c5f6b req-bd25d9b8-6504-4421-9618-a510f008aa61 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031626 Nov 03 05:28:00.597690 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3919/7940] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:28:01.408199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:01.408863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:01.416165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:01.416711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:01.417229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:01.417938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:01.418404 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:01.418845 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:01.547901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:01.556119 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85141efb-42ad-4571-a149-48145b124f78 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1392 microversion: 2.1 time: 0.152246 Nov 03 05:28:01.556686 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4022/7941] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:01 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:02.580178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:02.580888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:02.582876 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:28:02.588361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:02.588852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:02.589331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:02.594480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:02.594480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:02.594480 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:02.725448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:02.733179 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d9f77648-18a2-4213-86f2-c241a40727cf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1392 microversion: 2.1 time: 0.158069 Nov 03 05:28:02.733753 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3920/7942] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:02 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:03.755802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:03.756939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:03.764323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:03.764839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:03.765336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:03.766085 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:03.766564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:03.767010 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:03.900474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:03.906924 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ec5e4148-b45b-4cab-85e7-fb725fb98057 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1392 microversion: 2.1 time: 0.155119 Nov 03 05:28:03.907494 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4023/7943] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:03 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:04.930101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:04.930800 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:04.937861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:04.938341 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:04.938776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:04.939467 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:04.939923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:04.940347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:05.080544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:05.088881 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-42f87857-5680-4b83-bba1-b9dc1f481076 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1392 microversion: 2.1 time: 0.163000 Nov 03 05:28:05.093141 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3921/7944] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:04 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:06.111901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:06.112536 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:06.120045 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:06.120547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:06.121007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:06.121739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:06.122216 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:06.122664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:06.256973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:06.264786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0702bc3c-aed3-4d49-b546-c1502d752c07 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1392 microversion: 2.1 time: 0.156856 Nov 03 05:28:06.265403 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4024/7945] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:06 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:06.695235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-385f30f2-6ce8-434b-9a07-9142a310a963 req-b9fe1cf0-6c7f-4893-9c69-9c4b2cccac6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5d302-b9b4-4919-af62-c2b593c4838c", "name": "network-vif-plugged", "status": "completed", "tag": "1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:28:06.705809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-385f30f2-6ce8-434b-9a07-9142a310a963 req-b9fe1cf0-6c7f-4893-9c69-9c4b2cccac6d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:06.706300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-385f30f2-6ce8-434b-9a07-9142a310a963 req-b9fe1cf0-6c7f-4893-9c69-9c4b2cccac6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:06.706743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-385f30f2-6ce8-434b-9a07-9142a310a963 req-b9fe1cf0-6c7f-4893-9c69-9c4b2cccac6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:06.717759 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-385f30f2-6ce8-434b-9a07-9142a310a963 req-b9fe1cf0-6c7f-4893-9c69-9c4b2cccac6d service nova] Creating event network-vif-plugged:1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4 for instance 7be5d302-b9b4-4919-af62-c2b593c4838c on n-h1-854653-7 Nov 03 05:28:06.722853 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-385f30f2-6ce8-434b-9a07-9142a310a963 req-b9fe1cf0-6c7f-4893-9c69-9c4b2cccac6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032203 Nov 03 05:28:06.723427 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3922/7946] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:28:07.290989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:07.291625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:07.293517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:28:07.294293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:28:07.300027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:07.300529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:07.300981 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:07.301716 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:07.302187 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:07.302630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:07.437583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:07.445682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6f621547-eb38-4301-b623-df9a04f47598 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1392 microversion: 2.1 time: 0.159202 Nov 03 05:28:07.446256 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4025/7947] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:07 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:08.465645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:28:08.470723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:08.471440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:08.478093 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:08.478593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:08.479033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:08.480119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:08.480222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:08.480598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:08.611734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:08.620104 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-865b9ec8-aaca-42a4-b4ca-47ef23fee924 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1564 microversion: 2.1 time: 0.155520 Nov 03 05:28:08.620684 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3923/7948] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:08 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:08.642823 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:08.643453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:08.650820 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:08.651319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:08.651772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:08.652479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:08.652949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:08.653414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:08.789805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:08.797960 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-14700daa-e5b9-4d50-97aa-568490449b66 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1564 microversion: 2.1 time: 0.158947 Nov 03 05:28:08.798637 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4026/7949] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:08 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:28:11.074899 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:28:11.076246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:11.077255 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-644ff786-4af9-49bb-8cbb-850bfba99eba req-53096d63-dd39-4717-a956-102f5f692dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5d302-b9b4-4919-af62-c2b593c4838c", "tag": "1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:28:11.083286 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:28:11.084860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:11.086059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:11.086785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:11.087755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:11.088453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:11.088971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-644ff786-4af9-49bb-8cbb-850bfba99eba req-53096d63-dd39-4717-a956-102f5f692dfd service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:11.089402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:11.089538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-644ff786-4af9-49bb-8cbb-850bfba99eba req-53096d63-dd39-4717-a956-102f5f692dfd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:11.089924 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-644ff786-4af9-49bb-8cbb-850bfba99eba req-53096d63-dd39-4717-a956-102f5f692dfd service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:11.102830 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-644ff786-4af9-49bb-8cbb-850bfba99eba req-53096d63-dd39-4717-a956-102f5f692dfd service nova] Creating event network-changed:1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4 for instance 7be5d302-b9b4-4919-af62-c2b593c4838c on n-h1-854653-7 Nov 03 05:28:11.108369 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-644ff786-4af9-49bb-8cbb-850bfba99eba req-53096d63-dd39-4717-a956-102f5f692dfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034827 Nov 03 05:28:11.108985 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4027/7950] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:28:11.236110 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:28:11.244848 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d6cc37f1-118c-434c-a7ca-52f88a6c0a1c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1564 microversion: 2.1 time: 0.173931 Nov 03 05:28:11.254635 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3924/7951] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:28:11 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:28:42.531186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=46 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:28:42.538770 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:28:42.538936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:28:42.549225 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:42.549737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:42.550201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:42.550925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:28:42.551406 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:28:42.551858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:28:42.604264 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1d16de68-afae-4136-a68b-65c40611e2b7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action" status: 200 len: 24577 microversion: 2.1 time: 0.075238 Nov 03 05:28:42.604942 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4028/7952] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:28:42 2022] POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action => generated 24577 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:29:13.024056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=9 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:29:13.024806 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=34 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:29:13.029831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-df3ef737-4bf7-4be2-ba1b-671a02249636 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:29:13.036005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3ef737-4bf7-4be2-ba1b-671a02249636 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:13.036706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3ef737-4bf7-4be2-ba1b-671a02249636 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:13.037188 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-df3ef737-4bf7-4be2-ba1b-671a02249636 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:13.060523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-df3ef737-4bf7-4be2-ba1b-671a02249636 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Going to try to stop instance {{(pid=127593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 03 05:29:13.224745 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-df3ef737-4bf7-4be2-ba1b-671a02249636 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action" status: 202 len: 0 microversion: 2.1 time: 0.202688 Nov 03 05:29:13.225336 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3925/7953] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:29:13 2022] POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:29:13.234960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:13.235744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:13.244289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:13.244792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:13.245276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:13.245994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:13.246471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:13.246921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:13.391431 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:13.399152 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc4e9325-333a-4402-9d82-d9796b19c50c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.169125 Nov 03 05:29:13.399712 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4029/7954] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:13 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:14.426397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:14.427097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:14.433425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:14.433907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:14.434344 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:14.435029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:14.435484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:14.435909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:14.573584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:14.581299 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1b17c41b-a7e4-4aa6-b2b2-68289b0de07e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.160372 Nov 03 05:29:14.581875 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3926/7955] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:14 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:15.605336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:15.605917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:15.612988 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:15.613523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:15.613985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:15.614698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:15.615176 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:15.615622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:15.749314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:15.757723 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1770620b-deba-4b78-8fcf-602c271a09c7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.157217 Nov 03 05:29:15.758278 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4030/7956] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:15 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:16.782027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:16.782630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:16.789578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:16.790064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:16.790508 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:16.791202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:16.791664 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:16.792095 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:16.928041 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:16.936083 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-437c7b75-2f8c-447d-90bc-73b383db215f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.158214 Nov 03 05:29:16.936654 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3927/7957] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:16 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:17.959350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:17.963749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:17.967647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:17.968152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:17.968614 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:17.969356 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:17.969842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:17.970350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:18.102811 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:18.110591 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83d2b780-de2d-4c44-b188-41cdf538c41e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.155199 Nov 03 05:29:18.111168 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4031/7958] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:17 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:19.134809 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:19.135366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:19.142181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:19.142667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:19.143108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:19.143801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:19.144262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:19.144694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:19.278035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:19.285960 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ecb2e43b-9082-40a2-b18a-f4920c4ce2f8 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.155133 Nov 03 05:29:19.286526 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3928/7959] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:19 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:20.309515 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:20.310190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:20.317068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:20.317577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:20.318038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:20.319256 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:20.319733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:20.320184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:20.449342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:20.456995 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-107cd9ab-320a-4f5f-99a9-15dbd845bee7 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.151405 Nov 03 05:29:20.457609 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4032/7960] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:20 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:21.479822 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:21.480414 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:21.487209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:21.487689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:21.488125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:21.488812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:21.489314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:21.489744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:21.622794 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:21.630527 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e3a69e23-452a-420e-b398-93b42264cf93 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.154630 Nov 03 05:29:21.631105 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3929/7961] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:21 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:22.654769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:22.655425 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:22.661985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:22.663038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:22.663505 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:22.664222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:22.664706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:22.665195 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:22.795320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:22.803682 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d2fffbc9-e454-4869-9460-9c892bc7f83e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1693 microversion: 2.1 time: 0.152713 Nov 03 05:29:22.804304 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4033/7962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:22 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:23.827921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:23.828547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:23.835960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:23.836444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:23.836881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:23.837598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:23.838053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:23.838479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:23.970733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:23.978495 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6aceeabf-2d11-4ea6-9cb2-daeaf07bff6c tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1670 microversion: 2.1 time: 0.154586 Nov 03 05:29:23.979072 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3930/7963] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:23 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:25.076733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:29:25.079053 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:25.086429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:25.086944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:25.087408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:25.088170 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:25.088680 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:25.089163 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:25.143283 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1e9eb07c-352a-4e98-bbaf-cfcf48f00e26 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action" status: 200 len: 37883 microversion: 2.1 time: 0.070418 Nov 03 05:29:25.144250 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4034/7964] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:29:25 2022] POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action => generated 37883 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:29:25.156208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5d5ddb52-5e64-4f1f-9ea8-1d8ce4446ba3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:29:25.163123 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d5ddb52-5e64-4f1f-9ea8-1d8ce4446ba3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:25.163606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d5ddb52-5e64-4f1f-9ea8-1d8ce4446ba3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:25.164099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5d5ddb52-5e64-4f1f-9ea8-1d8ce4446ba3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:25.186298 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5d5ddb52-5e64-4f1f-9ea8-1d8ce4446ba3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Going to try to start instance {{(pid=127593) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 03 05:29:25.333002 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5d5ddb52-5e64-4f1f-9ea8-1d8ce4446ba3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action" status: 202 len: 0 microversion: 2.1 time: 0.180876 Nov 03 05:29:25.333637 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3931/7965] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:29:25 2022] POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:29:25.342559 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:25.346178 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:25.350739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:25.351250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:25.351711 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:25.352441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:25.352955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:25.353428 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:25.499106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:25.508290 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50166391-b05e-4d3d-a4e0-bcb018662777 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1679 microversion: 2.1 time: 0.169771 Nov 03 05:29:25.508915 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4035/7966] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:25 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:29:26.534518 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:26.535231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:26.541630 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:26.542121 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:26.542566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:26.543264 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:26.543722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:26.544184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:26.683803 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:26.691870 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b1314ca9-a213-44d4-9079-d18a16a8c023 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1679 microversion: 2.1 time: 0.162715 Nov 03 05:29:26.692483 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3932/7967] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:26 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:29:27.716494 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:29:27.717141 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:29:27.724034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:27.724531 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:27.724985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:27.725721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:29:27.726190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:29:27.726630 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:29:27.856496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:29:27.864466 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-28971298-af76-4161-a183-0b30ddada4dd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1683 microversion: 2.1 time: 0.151938 Nov 03 05:29:27.865074 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4036/7968] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:29:27 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:00.087053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:00.089326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:00.091830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:00.092496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:00.097249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:00.097743 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:00.098193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:00.099739 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:00.100206 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:00.100642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:00.153676 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-66a2b763-efaf-418f-9f95-a3f6c40df715 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action" status: 200 len: 62447 microversion: 2.1 time: 0.070431 Nov 03 05:30:00.154343 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3933/7969] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:30:00 2022] POST /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c/action => generated 62447 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:30:17.236354 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:17.239957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:17.241175 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:17.247660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=19 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:17.248400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=50 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:17.250329 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:17.255673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:17.255673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:17.255673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:17.255673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:17.255673 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:17.280786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:30:17.314778 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-70e513d5-9f56-44d2-80ab-54e932bed874 req-48df075e-aab0-4766-abab-9f385d53078e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5d302-b9b4-4919-af62-c2b593c4838c", "tag": "1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:17.330164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-70e513d5-9f56-44d2-80ab-54e932bed874 req-48df075e-aab0-4766-abab-9f385d53078e service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:17.330651 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-70e513d5-9f56-44d2-80ab-54e932bed874 req-48df075e-aab0-4766-abab-9f385d53078e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:17.331092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-70e513d5-9f56-44d2-80ab-54e932bed874 req-48df075e-aab0-4766-abab-9f385d53078e service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:17.341590 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-70e513d5-9f56-44d2-80ab-54e932bed874 req-48df075e-aab0-4766-abab-9f385d53078e service nova] Creating event network-changed:1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4 for instance 7be5d302-b9b4-4919-af62-c2b593c4838c on n-h1-854653-7 Nov 03 05:30:17.346504 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-70e513d5-9f56-44d2-80ab-54e932bed874 req-48df075e-aab0-4766-abab-9f385d53078e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115843 Nov 03 05:30:17.349171 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3934/7970] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:30:17.513330 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-110dccf9-51a4-4fa2-814b-0e5a7f44d9b4 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 204 len: 0 microversion: 2.1 time: 0.284743 Nov 03 05:30:17.513933 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4037/7971] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:30:17 2022] DELETE /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:30:17.523561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:17.525366 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:17.536639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:17.537171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:17.537648 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:17.538361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:17.538825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:17.539258 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:17.681242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:17.689219 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38384cab-85a7-41d7-9949-d4f56151cacd tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1689 microversion: 2.1 time: 0.170586 Nov 03 05:30:17.689801 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3935/7972] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:17 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:18.714957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:18.715685 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:18.722612 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:18.723122 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:18.723586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:18.724342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:18.725382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:18.725836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:18.860724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:18.869077 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9f2f306-c2eb-4580-84b6-38989add743a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1689 microversion: 2.1 time: 0.158452 Nov 03 05:30:18.869653 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4038/7973] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:18 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:19.845254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-8aaf4814-75e6-43a5-8797-71859fbdc786 req-61876163-859a-4900-b1cd-e8651298ca6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5d302-b9b4-4919-af62-c2b593c4838c", "name": "network-vif-deleted", "tag": "1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:19.856667 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8aaf4814-75e6-43a5-8797-71859fbdc786 req-61876163-859a-4900-b1cd-e8651298ca6d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:19.857179 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8aaf4814-75e6-43a5-8797-71859fbdc786 req-61876163-859a-4900-b1cd-e8651298ca6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:19.857619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-8aaf4814-75e6-43a5-8797-71859fbdc786 req-61876163-859a-4900-b1cd-e8651298ca6d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:19.868903 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-8aaf4814-75e6-43a5-8797-71859fbdc786 req-61876163-859a-4900-b1cd-e8651298ca6d service nova] Creating event network-vif-deleted:1bd3b4b0-bbcd-4d64-8f5d-875267dc0be4 for instance 7be5d302-b9b4-4919-af62-c2b593c4838c on n-h1-854653-7 Nov 03 05:30:19.873914 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-8aaf4814-75e6-43a5-8797-71859fbdc786 req-61876163-859a-4900-b1cd-e8651298ca6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032629 Nov 03 05:30:19.874503 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3936/7974] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:30:19.891853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:19.892489 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:19.899996 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:19.900638 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:19.901118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:19.901975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:19.902450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:19.902892 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:19.970372 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:19.980285 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5c153383-b02b-458e-83d4-95bfc6ed1100 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 200 len: 1503 microversion: 2.1 time: 0.092420 Nov 03 05:30:19.980904 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4039/7975] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:19 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 1503 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:21.004674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:21.005407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: 7be5d302-b9b4-4919-af62-c2b593c4838c] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:21.011635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:21.012175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:21.012617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:21.013347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:21.013814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:21.014249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:21.029197 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] HTTP exception thrown: Instance 7be5d302-b9b4-4919-af62-c2b593c4838c could not be found. Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Request method failure captured: Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c HTTP/1.1 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0_dzUEqXCGMfjl2Nm1_zjjJUGvtN4CdLSbzLcws51Voz6SH5K-iaKq7w4Slra2ZxBNNbU3gFLnw8W1q0QQo7bomOczqJPu1MbTAbVcqGhsNnqvjsPQTRLM4PUZCvMld88wiXBf2J3HzTkQytXjU6T7YC7lECkYVrtJmEBWJRsnQdZI Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9ab73bd2a894b2ba81937894e033fd4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9ab73bd2a894b2ba81937894e033fd4"}]}] Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 062fa477611040718370f855e0832151 Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance 7be5d302-b9b4-4919-af62-c2b593c4838c could not be found. Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': '7be5d302-b9b4-4919-af62-c2b593c4838c'} Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5d302-b9b4-4919-af62-c2b593c4838c could not be found. Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5d302-b9b4-4919-af62-c2b593c4838c could not be found. Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:30:21.029425 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5d302-b9b4-4919-af62-c2b593c4838c could not be found. Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Returning 404 to user: Instance 7be5d302-b9b4-4919-af62-c2b593c4838c could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-238db1ab-073d-4c1d-bd4c-60f69c9c230e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c" status: 404 len: 111 microversion: 2.1 time: 0.031671 Nov 03 05:30:21.035858 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3937/7976] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:20 2022] GET /compute/v2.1/servers/7be5d302-b9b4-4919-af62-c2b593c4838c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:30:24.919926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-495bb460-3c6c-4193-ad44-11410d924de2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '.version_select at 0x7ff7f87fcc10>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:24.925446 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:30:24.925642 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1585234255 (ip 10.222.0.30) !!! Nov 03 05:30:25.012779 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-495bb460-3c6c-4193-ad44-11410d924de2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1585234255" status: 202 len: 0 microversion: 2.1 time: 0.096923 Nov 03 05:30:25.013408 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4040/7977] 10.222.0.30 () {58 vars in 1284 bytes} [Thu Nov 3 05:30:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1585234255 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:30:25.048808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4a80672a-0870-447e-aa08-dd754b8bf533 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: .version_select at 0x7ff7f92f5430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-18295224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4008w2ngkUU4fJtSRsdyK/X87w2tlx8bGQrYFHlZaVaOPTEYnAZhlvEMDb54kj0hzQtobO9O/qygFDj+kFn9q3+KlX348jHzBxxlksfYDiMxU7F+xaSQQ/Z1y0PuIftg=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:25.066661 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4a80672a-0870-447e-aa08-dd754b8bf533 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:30:25.073511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4a80672a-0870-447e-aa08-dd754b8bf533 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:30:25.090023 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4a80672a-0870-447e-aa08-dd754b8bf533 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:30:26.096544 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [None req-4a80672a-0870-447e-aa08-dd754b8bf533 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [5d5ba138-e962-4104-8aea-dd849b8f8604] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34824. Nov 03 05:30:26.182454 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4a80672a-0870-447e-aa08-dd754b8bf533 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 1.137543 Nov 03 05:30:26.182986 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3938/7978] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:30:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:30:34.356732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:34.361805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-943668155", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "networks": [{"uuid": "b1281867-bf5d-4416-b268-e4d8b62a7006"}], "key_name": "tempest-TestNetworkAdvancedServerOps-18295224", "security_groups": [{"name": "tempest-secgroup-smoke-571313387"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:34.559279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] validate_networks() for [('b1281867-bf5d-4416-b268-e4d8b62a7006', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:30:35.131108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:30:35.131563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:30:35.132066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:30:35.133037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:30:35.134088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:30:35.146909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:35.147799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:35.151365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:35.151365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:35.151365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:35.151365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:35.199787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:30:35.215919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Getting quotas for user 062fa477611040718370f855e0832151 and project a9ab73bd2a894b2ba81937894e033fd4. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:30:35.239071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:30:35.243554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:30:35.381705 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-96cce29c-6512-4f2b-aa34-8a9986c06c22 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.025762 Nov 03 05:30:35.391312 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4041/7979] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:30:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:30:35.395002 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=16 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:35.397445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=4 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:35.404540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-41cb8106-f14f-46c5-a0c1-d9116ee15155 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:35.406434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-41cb8106-f14f-46c5-a0c1-d9116ee15155 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:35.584831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-41cb8106-f14f-46c5-a0c1-d9116ee15155 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:35.600186 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-41cb8106-f14f-46c5-a0c1-d9116ee15155 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1264 microversion: 2.1 time: 0.206273 Nov 03 05:30:35.618494 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3939/7980] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:35 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:36.624066 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:36.624744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:36.632199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:36.632732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:36.633267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:36.640007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:36.640007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:36.640007 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:36.702951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:36.710469 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dd6c3706-6ce3-487b-832f-5c08e1b15c2a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1268 microversion: 2.1 time: 0.090433 Nov 03 05:30:36.711129 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4042/7981] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:36 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1268 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:37.739013 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:37.740435 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:37.752014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:37.752513 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:37.752953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:37.753690 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:37.760235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:37.761316 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:37.873280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:37.893466 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aad1e789-8714-49e2-8af6-6f58be62b6ea tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1324 microversion: 2.1 time: 0.163120 Nov 03 05:30:37.905172 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3940/7982] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:37 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:38.917951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:38.918578 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:38.925951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:38.926410 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:38.926922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:38.928326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:38.928837 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:38.929326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:39.155151 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:39.164443 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-77908ce0-085a-4630-9eb2-3e9992b14cc2 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1389 microversion: 2.1 time: 0.250664 Nov 03 05:30:39.165046 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4043/7983] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:38 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1389 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:39.425920 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d8ab8f7b-54d6-4e0c-b929-c6111e26706c req-2560b5ee-ae1b-42ba-bfa3-c9b9f4efd317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1f9bdc-841f-4a80-af92-22c20588df14", "tag": "45c78c0b-f883-40e5-b89a-6f92eda889a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:39.436241 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8ab8f7b-54d6-4e0c-b929-c6111e26706c req-2560b5ee-ae1b-42ba-bfa3-c9b9f4efd317 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:39.436723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8ab8f7b-54d6-4e0c-b929-c6111e26706c req-2560b5ee-ae1b-42ba-bfa3-c9b9f4efd317 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:39.437200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d8ab8f7b-54d6-4e0c-b929-c6111e26706c req-2560b5ee-ae1b-42ba-bfa3-c9b9f4efd317 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:39.448379 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d8ab8f7b-54d6-4e0c-b929-c6111e26706c req-2560b5ee-ae1b-42ba-bfa3-c9b9f4efd317 service nova] Creating event network-changed:45c78c0b-f883-40e5-b89a-6f92eda889a0 for instance df1f9bdc-841f-4a80-af92-22c20588df14 on n-h2-854653-7 Nov 03 05:30:39.453265 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d8ab8f7b-54d6-4e0c-b929-c6111e26706c req-2560b5ee-ae1b-42ba-bfa3-c9b9f4efd317 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031135 Nov 03 05:30:39.453890 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3941/7984] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:30:40.189162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:40.194722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:40.196749 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:40.197281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:40.197740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:40.198443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:40.198954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:40.199405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:40.665751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:40.673385 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9cdf10b1-1a04-466f-a735-230d4822e259 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1389 microversion: 2.1 time: 0.488482 Nov 03 05:30:40.673966 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4044/7985] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:40 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1389 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:41.697598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:41.698881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:41.707125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:41.707624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:41.708596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:41.709327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:41.709785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:41.710210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:41.845930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:41.854225 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b0edc1ca-881a-4592-86a1-a8a5c7490309 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1389 microversion: 2.1 time: 0.161937 Nov 03 05:30:41.854823 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3942/7986] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:41 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:42.877038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:42.877832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:42.885282 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:42.885791 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:42.886259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:42.887622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:42.888101 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:42.888551 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:43.028854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:43.034504 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e8d5e20e-aae7-461d-a209-4edf291c7174 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1389 microversion: 2.1 time: 0.161260 Nov 03 05:30:43.035012 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4045/7987] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:42 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:44.057397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:44.058031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:44.064968 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:44.065432 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:44.065891 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:44.066593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:44.067063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:44.068018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:44.202226 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:44.210137 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f7f435cb-5705-4021-a202-4451aeb8438a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1389 microversion: 2.1 time: 0.156727 Nov 03 05:30:44.210723 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3943/7988] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:44 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:45.115476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-27b3d7c1-d3e5-459e-9f72-a8196ddfdcd4 req-13e2f3cb-8585-4275-908a-e4358cfb69b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1f9bdc-841f-4a80-af92-22c20588df14", "name": "network-vif-plugged", "status": "completed", "tag": "45c78c0b-f883-40e5-b89a-6f92eda889a0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:45.124955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-27b3d7c1-d3e5-459e-9f72-a8196ddfdcd4 req-13e2f3cb-8585-4275-908a-e4358cfb69b1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:45.125588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-27b3d7c1-d3e5-459e-9f72-a8196ddfdcd4 req-13e2f3cb-8585-4275-908a-e4358cfb69b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:45.126265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-27b3d7c1-d3e5-459e-9f72-a8196ddfdcd4 req-13e2f3cb-8585-4275-908a-e4358cfb69b1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:45.139562 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-27b3d7c1-d3e5-459e-9f72-a8196ddfdcd4 req-13e2f3cb-8585-4275-908a-e4358cfb69b1 service nova] Creating event network-vif-plugged:45c78c0b-f883-40e5-b89a-6f92eda889a0 for instance df1f9bdc-841f-4a80-af92-22c20588df14 on n-h2-854653-7 Nov 03 05:30:45.145096 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-27b3d7c1-d3e5-459e-9f72-a8196ddfdcd4 req-13e2f3cb-8585-4275-908a-e4358cfb69b1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086473 Nov 03 05:30:45.146267 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4046/7989] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:30:45.233723 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:45.234357 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:45.241884 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:45.242413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:45.242861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:45.243561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:45.244023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:45.244454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:45.400021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:45.408274 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-03fb6e7d-9c4a-4b5e-af2e-35b158016f38 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1389 microversion: 2.1 time: 0.178583 Nov 03 05:30:45.408853 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3944/7990] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:45 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1389 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:46.433623 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:46.434350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:46.436373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:46.437080 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:46.443625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:46.444139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:46.444599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:46.445350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:46.445829 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:46.446279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:46.585549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:46.593295 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-16fa60ed-3b39-4362-ac13-0d98b3b2f55e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1389 microversion: 2.1 time: 0.165184 Nov 03 05:30:46.601287 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4047/7991] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:46 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:47.615882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:47.616499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:47.618479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:47.619974 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:47.624612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:47.625196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:47.625640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:47.626361 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:47.626814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:47.627244 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:47.760670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:47.768492 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb925da7-8427-4464-b1fc-d4e43d55dd03 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1562 microversion: 2.1 time: 0.156693 Nov 03 05:30:47.769093 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3945/7992] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:47 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:47.792149 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:47.792842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:47.795968 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:30:47.800773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:47.801334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:47.801794 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:47.802506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:47.802986 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:47.803433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:47.938668 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:47.947353 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7e4fd6c9-7369-44a3-a43f-bbc71ffbe322 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1562 microversion: 2.1 time: 0.159138 Nov 03 05:30:47.947950 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4048/7993] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:47 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:30:49.859933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:30:49.860589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:30:49.867811 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:49.868394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:49.868962 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:49.869298 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-dbbde0f4-3abb-4fcf-86a1-58e148676c81 req-88489af1-0126-4483-b8c3-f8ecf4c23731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1f9bdc-841f-4a80-af92-22c20588df14", "tag": "45c78c0b-f883-40e5-b89a-6f92eda889a0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:30:49.869789 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:49.870301 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:49.871020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:49.879704 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbbde0f4-3abb-4fcf-86a1-58e148676c81 req-88489af1-0126-4483-b8c3-f8ecf4c23731 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:30:49.880208 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbbde0f4-3abb-4fcf-86a1-58e148676c81 req-88489af1-0126-4483-b8c3-f8ecf4c23731 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:30:49.880660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-dbbde0f4-3abb-4fcf-86a1-58e148676c81 req-88489af1-0126-4483-b8c3-f8ecf4c23731 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:30:49.892150 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-dbbde0f4-3abb-4fcf-86a1-58e148676c81 req-88489af1-0126-4483-b8c3-f8ecf4c23731 service nova] Creating event network-changed:45c78c0b-f883-40e5-b89a-6f92eda889a0 for instance df1f9bdc-841f-4a80-af92-22c20588df14 on n-h2-854653-7 Nov 03 05:30:49.903467 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-dbbde0f4-3abb-4fcf-86a1-58e148676c81 req-88489af1-0126-4483-b8c3-f8ecf4c23731 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037791 Nov 03 05:30:49.907462 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4049/7994] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:30:50.119170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:30:50.124849 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b96a8a31-f0ef-4b1a-9f13-07c6e0392716 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1562 microversion: 2.1 time: 0.268865 Nov 03 05:30:50.125586 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3946/7995] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:30:49 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:13.371583 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:13.372378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=42 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:13.376592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:13.378915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:13.385124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:13.385566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:13.386020 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:13.386725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:13.387192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:13.387672 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:13.439829 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8b502e47-a255-4a7b-9757-f6e609f4cae6 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action" status: 200 len: 24571 microversion: 2.1 time: 0.070038 Nov 03 05:31:13.440706 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4050/7996] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:31:13 2022] POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:31:24.343866 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:24.344463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:24.346961 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:31:24.347123 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action (ip 10.222.0.30) !!! Nov 03 05:31:24.348216 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:24.349677 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=38 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:24.356642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:24.362000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:24.362000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:24.362000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:24.362000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:24.362000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:24.383051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lazy-loading 'flavor' on Instance uuid df1f9bdc-841f-4a80-af92-22c20588df14 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:31:24.663150 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4166822e-2203-4f0b-ab57-ee946365bf68 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action" status: 202 len: 0 microversion: 2.1 time: 0.323379 Nov 03 05:31:24.663731 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3947/7997] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:31:24 2022] POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:31:24.672532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:24.673315 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:24.676346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:24.677038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:24.682199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:24.682706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:24.683172 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:24.683903 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:24.684384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:24.684842 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:24.825264 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:24.833848 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5fc62703-4d5d-4f5e-94fa-38e5486fe606 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1689 microversion: 2.1 time: 0.164981 Nov 03 05:31:24.839201 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4051/7998] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:24 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:25.859211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:25.859912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:25.866127 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:25.866613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:25.867051 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:25.867744 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:25.868198 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:25.868625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:26.000102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:26.007885 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-512a2759-9aee-4caf-a279-abbba4ac2243 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1672 microversion: 2.1 time: 0.154116 Nov 03 05:31:26.015077 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3948/7999] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:25 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:27.107606 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:27.109847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:27.118321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:27.118865 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:27.119295 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:27.119987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:27.120462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:27.120902 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:27.179015 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-84b0e4fd-8aa1-4415-8928-268134cfa55a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action" status: 200 len: 38180 microversion: 2.1 time: 0.075205 Nov 03 05:31:27.179830 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4052/8000] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:31:27 2022] POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action => generated 38180 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:31:27.191640 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:27.192185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:27.199012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:27.199530 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:27.199976 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:27.200675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:27.201163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:27.201603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:27.433126 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f877b934-53f2-47f1-bd56-e968832716c3 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action" status: 202 len: 0 microversion: 2.1 time: 0.245109 Nov 03 05:31:27.433710 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3949/8001] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:31:27 2022] POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:31:27.442689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:27.443418 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:27.450565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:27.451077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:27.451537 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:27.452258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:27.452737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:27.453247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:27.603810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:27.612300 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f9493bf1-25b6-4acd-bfc2-b33a0077343a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1678 microversion: 2.1 time: 0.173882 Nov 03 05:31:27.612891 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4053/8002] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:27 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:28.638303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:28.639037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:28.645307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:28.646388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:28.646828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:28.647517 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:28.647975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:28.648402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:28.779584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:28.787711 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cf386efa-806d-48ae-b0eb-3f4816067a01 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1678 microversion: 2.1 time: 0.154611 Nov 03 05:31:28.788290 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3950/8003] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:28 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:29.812441 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:29.813384 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:29.820830 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:29.821362 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:29.821819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:29.822538 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:29.823016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:29.823460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:29.956028 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:29.964455 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-576dcc1f-bcae-4a46-bc26-f8a464e6cf3b tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1681 microversion: 2.1 time: 0.157365 Nov 03 05:31:29.965050 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4054/8004] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:29 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:30.057783 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:30.059973 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:30.066823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:30.067802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:30.068246 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:30.068939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:30.069436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:30.069865 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:30.111968 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-97742702-7fef-41a5-9874-f8f35c331f5e tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action" status: 200 len: 38180 microversion: 2.1 time: 0.058038 Nov 03 05:31:30.113002 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3951/8005] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:31:30 2022] POST /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14/action => generated 38180 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 03 05:31:31.154880 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:31.156233 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:31.157764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-a9e9d1f7-aa8e-4866-aeef-357a0be8df4b req-9985c468-862b-4268-99d8-60a94c5e0061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1f9bdc-841f-4a80-af92-22c20588df14", "tag": "45c78c0b-f883-40e5-b89a-6f92eda889a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:31.164073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:31.164581 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:31.165049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:31.166061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:31.166535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:31.166980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:31.169604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a9e9d1f7-aa8e-4866-aeef-357a0be8df4b req-9985c468-862b-4268-99d8-60a94c5e0061 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:31.170348 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a9e9d1f7-aa8e-4866-aeef-357a0be8df4b req-9985c468-862b-4268-99d8-60a94c5e0061 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:31.170796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-a9e9d1f7-aa8e-4866-aeef-357a0be8df4b req-9985c468-862b-4268-99d8-60a94c5e0061 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:31.182626 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-a9e9d1f7-aa8e-4866-aeef-357a0be8df4b req-9985c468-862b-4268-99d8-60a94c5e0061 service nova] Creating event network-changed:45c78c0b-f883-40e5-b89a-6f92eda889a0 for instance df1f9bdc-841f-4a80-af92-22c20588df14 on n-h2-854653-7 Nov 03 05:31:31.187958 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-a9e9d1f7-aa8e-4866-aeef-357a0be8df4b req-9985c468-862b-4268-99d8-60a94c5e0061 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034425 Nov 03 05:31:31.188869 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3952/8006] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:31:31.194572 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:31:31.476722 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-6ccee427-8f83-4fbc-b0f5-f518b2aa70ed tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 204 len: 0 microversion: 2.1 time: 0.325967 Nov 03 05:31:31.477565 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4055/8007] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:31:31 2022] DELETE /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:31:31.487053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:31.487792 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:31.494183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:31.494682 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:31.495125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:31.495832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:31.496295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:31.496734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:31.631251 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:31.639308 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-faaa2755-56db-42fb-aedf-a53a4004af7a tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1687 microversion: 2.1 time: 0.157013 Nov 03 05:31:31.639893 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3953/8008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:31 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:32.665104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:32.665833 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:32.672878 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:32.673420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:32.673879 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:32.674644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:32.675116 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:32.675566 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:32.808589 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:32.816386 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5a119c6d-e411-4dbf-bc33-12028f984894 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1687 microversion: 2.1 time: 0.156292 Nov 03 05:31:32.816947 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4056/8009] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:32 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:33.728296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3bac5c57-bb3f-4e0a-b058-a73bbf6a2636 req-3cfdac09-ce65-4408-9b88-f6dd7567397b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1f9bdc-841f-4a80-af92-22c20588df14", "name": "network-vif-deleted", "tag": "45c78c0b-f883-40e5-b89a-6f92eda889a0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:33.738556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3bac5c57-bb3f-4e0a-b058-a73bbf6a2636 req-3cfdac09-ce65-4408-9b88-f6dd7567397b service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:33.746021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3bac5c57-bb3f-4e0a-b058-a73bbf6a2636 req-3cfdac09-ce65-4408-9b88-f6dd7567397b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:33.746021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3bac5c57-bb3f-4e0a-b058-a73bbf6a2636 req-3cfdac09-ce65-4408-9b88-f6dd7567397b service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:33.751073 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3bac5c57-bb3f-4e0a-b058-a73bbf6a2636 req-3cfdac09-ce65-4408-9b88-f6dd7567397b service nova] Creating event network-vif-deleted:45c78c0b-f883-40e5-b89a-6f92eda889a0 for instance df1f9bdc-841f-4a80-af92-22c20588df14 on n-h2-854653-7 Nov 03 05:31:33.756132 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3bac5c57-bb3f-4e0a-b058-a73bbf6a2636 req-3cfdac09-ce65-4408-9b88-f6dd7567397b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Nov 03 05:31:33.756708 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3954/8010] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:31:33.842748 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:33.843884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:33.851726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:33.852240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:33.852703 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:33.853460 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:33.853937 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:33.854389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:33.918785 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062fa477611040718370f855e0832151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9ab73bd2a894b2ba81937894e033fd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:33.926858 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5f0dd2c1-4233-43ff-b5b8-e2b8083ad4bf tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 200 len: 1349 microversion: 2.1 time: 0.088826 Nov 03 05:31:33.927362 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4057/8011] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:33 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 1349 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:34.949980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:34.950695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] [instance: df1f9bdc-841f-4a80-af92-22c20588df14] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:34.957910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:34.958403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:34.958855 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:34.959557 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:34.960027 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:34.960461 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:34.973688 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.wsgi [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] HTTP exception thrown: Instance df1f9bdc-841f-4a80-af92-22c20588df14 could not be found. Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Request method failure captured: Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: request: GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 HTTP/1.1 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: Accept: application/json Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: Accept-Encoding: identity Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: Connection: close Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: Content-Length: 0 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: Content-Type: application/json Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: Host: 10.222.0.30 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: Openstack-System-Scope: None Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: User-Agent: python-urllib3/1.26.12 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Auth-Token: gAAAAABjY0_dzUEqXCGMfjl2Nm1_zjjJUGvtN4CdLSbzLcws51Voz6SH5K-iaKq7w4Slra2ZxBNNbU3gFLnw8W1q0QQo7bomOczqJPu1MbTAbVcqGhsNnqvjsPQTRLM4PUZCvMld88wiXBf2J3HzTkQytXjU6T7YC7lECkYVrtJmEBWJRsnQdZI Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Id: None Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Domain-Name: None Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Identity-Status: Confirmed Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Is-Admin-Project: True Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Id: default Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Domain-Name: Default Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Role: member,reader Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Roles: member,reader Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a9ab73bd2a894b2ba81937894e033fd4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a9ab73bd2a894b2ba81937894e033fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a9ab73bd2a894b2ba81937894e033fd4"}]}] Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Id: a9ab73bd2a894b2ba81937894e033fd4 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-190966761 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-User: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Id: default Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Domain-Name: Default Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Id: 062fa477611040718370f855e0832151 Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: X-User-Name: tempest-TestNetworkAdvancedServerOps-190966761-project Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: method: > Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: exception: Instance df1f9bdc-841f-4a80-af92-22c20588df14 could not be found. Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: action_args: {'id': 'df1f9bdc-841f-4a80-af92-22c20588df14'} Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1f9bdc-841f-4a80-af92-22c20588df14 could not be found. Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1f9bdc-841f-4a80-af92-22c20588df14 could not be found. Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:31:34.975322 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1f9bdc-841f-4a80-af92-22c20588df14 could not be found. Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: ERROR nova.api.openstack.wsgi Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Returning 404 to user: Instance df1f9bdc-841f-4a80-af92-22c20588df14 could not be found. {{(pid=127593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7667cdae-41d9-4f9d-a77d-cd3efee8fdd5 tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14" status: 404 len: 111 microversion: 2.1 time: 0.031071 Nov 03 05:31:34.981785 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3955/8012] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:34 2022] GET /compute/v2.1/servers/df1f9bdc-841f-4a80-af92-22c20588df14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:31:38.658347 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0569c75f-9bce-456a-95e9-9643d63efe4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] Calling method '.version_select at 0x7ff7f95a31f0>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:38.743024 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0569c75f-9bce-456a-95e9-9643d63efe4f tempest-TestNetworkAdvancedServerOps-190966761 tempest-TestNetworkAdvancedServerOps-190966761-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-18295224" status: 202 len: 0 microversion: 2.1 time: 0.089111 Nov 03 05:31:38.743640 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4058/8013] 10.222.0.30 () {58 vars in 1278 bytes} [Thu Nov 3 05:31:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-18295224 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:31:53.961933 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=18 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:53.979252 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:54.149105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4c76e27d-02fc-4a5a-afce-b2a084f2d41e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'create', calling method: .version_select at 0x7ff7f3df70d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-739386565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwRTYGaZS1csIOhHHRastuJVglzXCv/7BiZ6u+bb3Cq1MGB0X42DazI1jzIU4Rg0+RouV289NA/1AIa7jjOg4pFlYuDriBq1HRmq2Ytlyg42YkN4u9d7Q3wNwLk/gM96Q=="}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:54.165658 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4c76e27d-02fc-4a5a-afce-b2a084f2d41e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for project a8bd3d800a4141ac8400074ff69b4153. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:31:54.171078 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-4c76e27d-02fc-4a5a-afce-b2a084f2d41e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for user e7590db567844aa7b802ee2796171810 and project a8bd3d800a4141ac8400074ff69b4153. Resources: {'key_pairs'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:31:54.283292 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4c76e27d-02fc-4a5a-afce-b2a084f2d41e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.323272 Nov 03 05:31:54.284207 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3956/8014] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:31:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:31:56.851567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-581065482", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-739386565", "security_groups": [{"name": "tempest-secgroup-smoke-1189789342"}], "networks": [{"uuid": "973d8568-726a-4cc5-a700-d6c265acd540"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:31:56.862516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:56.863919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:31:56.969741 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] validate_networks() for [('973d8568-726a-4cc5-a700-d6c265acd540', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:31:57.355160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:31:57.355604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:31:57.356188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:31:57.356622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:31:57.357123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:31:57.366313 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:57.366821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:57.367288 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:57.368037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:57.368513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:57.369006 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:57.387245 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for project a8bd3d800a4141ac8400074ff69b4153. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:31:57.392861 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for user e7590db567844aa7b802ee2796171810 and project a8bd3d800a4141ac8400074ff69b4153. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:31:57.406917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:31:57.409289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:31:57.533395 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d0114108-dfa9-4ce5-96ea-29c6ce3b4114 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.686269 Nov 03 05:31:57.534059 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4059/8015] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:31:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:31:57.548957 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fad362cb-210a-497e-8415-214e8dc93024 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:57.549870 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fad362cb-210a-497e-8415-214e8dc93024 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:57.625627 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fad362cb-210a-497e-8415-214e8dc93024 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:57.635666 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fad362cb-210a-497e-8415-214e8dc93024 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1245 microversion: 2.1 time: 0.093532 Nov 03 05:31:57.636257 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3957/8016] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:57 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:31:58.661098 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:58.661659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:58.668479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:58.668973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:58.669450 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:58.670159 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:58.670628 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:58.678138 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:58.732783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:58.741050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a09184b6-8237-4923-8d40-5613727a7f98 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1249 microversion: 2.1 time: 0.084863 Nov 03 05:31:58.741623 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4060/8017] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:58 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:31:59.764514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:31:59.765141 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:31:59.777081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:59.777586 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:59.778036 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:59.778757 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:31:59.779221 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:31:59.779654 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:31:59.851483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:31:59.860993 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-bd3d79bd-8410-4b7c-ac90-d85cc949feac tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1305 microversion: 2.1 time: 0.100402 Nov 03 05:31:59.861806 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3958/8018] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:31:59 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:00.884774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:00.886049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:00.893152 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:00.893786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:00.895058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:00.896128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:00.896772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:00.897280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:01.040844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:01.048721 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-22ece79f-1079-4031-8a36-c2ff62f96c0a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.168707 Nov 03 05:32:01.049575 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4061/8019] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:00 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:01.697752 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-6c07e534-ab5d-44f2-89d2-95d515691d96 req-95847c24-89fb-4879-956c-3341d137fcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:32:01.707840 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6c07e534-ab5d-44f2-89d2-95d515691d96 req-95847c24-89fb-4879-956c-3341d137fcd0 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:01.708330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6c07e534-ab5d-44f2-89d2-95d515691d96 req-95847c24-89fb-4879-956c-3341d137fcd0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:01.708804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-6c07e534-ab5d-44f2-89d2-95d515691d96 req-95847c24-89fb-4879-956c-3341d137fcd0 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:01.720346 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-6c07e534-ab5d-44f2-89d2-95d515691d96 req-95847c24-89fb-4879-956c-3341d137fcd0 service nova] Creating event network-changed:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h1-854653-7 Nov 03 05:32:01.725715 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-6c07e534-ab5d-44f2-89d2-95d515691d96 req-95847c24-89fb-4879-956c-3341d137fcd0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031754 Nov 03 05:32:01.726344 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3959/8020] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:32:02.073097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:02.073792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:02.080789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:02.081334 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:02.081796 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:02.082554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:02.083031 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:02.083468 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:02.219234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:02.227638 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3376c5ef-f239-4f8a-8170-1468dcd321c6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.158508 Nov 03 05:32:02.228214 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4062/8021] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:02 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:03.252749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:03.253489 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:03.260330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:03.260825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:03.261313 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:03.262024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:03.262625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:03.263060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:03.400077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:03.408070 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b07f9b79-82ae-42c9-9fb6-edcfeda001de tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.160439 Nov 03 05:32:03.408638 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3960/8022] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:03 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:04.430991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:04.431629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:04.438786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:04.439289 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:04.439747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:04.440466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:04.440940 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:04.441915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:04.570923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:04.578699 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-367e64b7-26d9-47dc-bfa4-062888db27e3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.151660 Nov 03 05:32:04.579286 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4063/8023] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:04 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:05.602278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:05.602935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:05.610040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:05.610534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:05.610993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:05.611689 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:05.613300 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:05.613741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:05.749982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:05.758495 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6bec6a15-b50e-4e82-acb4-9d10e1d651c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.160803 Nov 03 05:32:05.759067 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3961/8024] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:05 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:06.782301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:06.782933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:06.790841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:06.791344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:06.791802 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:06.792516 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:06.792994 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:06.793471 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:06.928604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:06.936590 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d38ddbd1-1b09-4d21-8de1-6a2bc25b6f58 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.158494 Nov 03 05:32:06.937186 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4064/8025] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:06 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:07.587671 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b8fabead-3094-454d-b0cc-c7db2b46b178 req-d6872243-b331-4ece-9b95-332bcb99b54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "name": "network-vif-plugged", "status": "completed", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:32:07.598696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b8fabead-3094-454d-b0cc-c7db2b46b178 req-d6872243-b331-4ece-9b95-332bcb99b54c service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:07.599168 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b8fabead-3094-454d-b0cc-c7db2b46b178 req-d6872243-b331-4ece-9b95-332bcb99b54c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:07.599604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b8fabead-3094-454d-b0cc-c7db2b46b178 req-d6872243-b331-4ece-9b95-332bcb99b54c service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:07.610599 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b8fabead-3094-454d-b0cc-c7db2b46b178 req-d6872243-b331-4ece-9b95-332bcb99b54c service nova] Creating event network-vif-plugged:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h1-854653-7 Nov 03 05:32:07.615725 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b8fabead-3094-454d-b0cc-c7db2b46b178 req-d6872243-b331-4ece-9b95-332bcb99b54c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031974 Nov 03 05:32:07.616312 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3962/8026] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:32:07.959932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:07.960593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:07.962507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:32:07.963355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:32:07.969564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:07.970058 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:07.970512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:07.975402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:07.975402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:07.975402 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:08.103193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:08.110740 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4bd1e7f7-7f4d-435d-90bd-64a281ae9af2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.154871 Nov 03 05:32:08.111306 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4065/8027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:07 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:09.131410 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=6 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:32:09.136453 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:09.137190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:09.143276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:09.146190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:09.146190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:09.146190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:09.146190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:09.146485 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:09.284527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:09.292851 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d834138f-48b2-4089-8ba6-e09bfd4de59a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1371 microversion: 2.1 time: 0.162462 Nov 03 05:32:09.293455 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3963/8028] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:09 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:10.315907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:10.316546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:10.323806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:10.324310 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:10.324767 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:10.325507 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:10.325990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:10.326436 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:10.457690 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:10.465503 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2c423af4-55ef-47d3-bb09-ea28154738ed tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1555 microversion: 2.1 time: 0.153565 Nov 03 05:32:10.466075 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4066/8029] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:10 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:10.488880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:32:10.489528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:32:10.496505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:10.496994 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:10.497479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:10.498175 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:10.498635 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:10.499113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:10.633056 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:32:10.640718 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-19dbc8d1-d582-4610-a27c-7939692b9087 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1555 microversion: 2.1 time: 0.156531 Nov 03 05:32:10.641335 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3964/8030] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:32:10 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:32:12.823819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-85097a55-6fb2-48d7-a49d-b1e97d376ff6 req-d84fd72c-fbb4-4ecd-8a41-65c0dce693fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:32:12.834712 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-85097a55-6fb2-48d7-a49d-b1e97d376ff6 req-d84fd72c-fbb4-4ecd-8a41-65c0dce693fb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:32:12.835206 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-85097a55-6fb2-48d7-a49d-b1e97d376ff6 req-d84fd72c-fbb4-4ecd-8a41-65c0dce693fb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:32:12.835656 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-85097a55-6fb2-48d7-a49d-b1e97d376ff6 req-d84fd72c-fbb4-4ecd-8a41-65c0dce693fb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:32:12.847060 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-85097a55-6fb2-48d7-a49d-b1e97d376ff6 req-d84fd72c-fbb4-4ecd-8a41-65c0dce693fb service nova] Creating event network-changed:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h1-854653-7 Nov 03 05:32:12.852191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-85097a55-6fb2-48d7-a49d-b1e97d376ff6 req-d84fd72c-fbb4-4ecd-8a41-65c0dce693fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032113 Nov 03 05:32:12.852834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4067/8031] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:34:38.906641 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:34:38.907522 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:34:38.908614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:34:38.909580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=34 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:34:38.910831 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:34:38.911004 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:34:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d/action (ip 10.222.0.30) !!! Nov 03 05:34:38.912429 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:34:38.912429 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:34:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d/action (ip 10.222.0.30) !!! Nov 03 05:34:38.916813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:34:38.917499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:38.926577 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:38.927104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:38.927590 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:38.928295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:38.928764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:38.929222 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:38.955463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lazy-loading 'flavor' on Instance uuid d1d979d1-e912-4e43-8a9a-9ec4713a7c8d {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:34:39.411375 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-27f176b0-59f3-4f71-9e63-e62738617dfd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d/action" status: 202 len: 0 microversion: 2.1 time: 0.506220 Nov 03 05:34:39.412288 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3965/8032] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:34:38 2022] POST /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:34:39.418782 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:34:39.419590 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:34:39.420241 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:34:39.421283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=46 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:34:39.422369 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:34:39.422516 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d (ip 10.222.0.30) !!! Nov 03 05:34:39.423713 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:34:39.423827 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d (ip 10.222.0.30) !!! Nov 03 05:34:39.431248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:39.432108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:39.447500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:39.448645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:39.448645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:39.449667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:39.450139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:39.450579 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:39.583742 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:39.591971 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7dad1827-4260-4156-b58b-a0d8a507236c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.175063 Nov 03 05:34:39.592553 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4068/8033] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:39 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:40.617523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:40.619234 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:40.626276 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:40.626759 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:40.627196 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:40.627893 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:40.628347 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:40.628804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:40.635933 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35224. Nov 03 05:34:40.636715 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35222. Nov 03 05:34:40.762756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:40.771106 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-20c37cac-e35f-4967-a248-0906e2665ad3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.159492 Nov 03 05:34:40.775957 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3966/8034] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:40 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:41.795999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:41.796634 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:41.806442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:41.806941 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:41.807397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:41.808114 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:41.809270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:41.809721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:41.813513 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35230. Nov 03 05:34:41.816562 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35228. Nov 03 05:34:41.947023 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:41.954864 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9efbccbc-cd5c-4d69-8a0a-96e5a9b007f0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.163428 Nov 03 05:34:41.955441 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4069/8035] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:41 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:42.978332 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:42.978953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:42.985879 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:42.986364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:42.986804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:42.987496 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:42.987952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:42.988377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:43.118228 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:43.125997 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-812989fd-cc8f-4673-8b9f-6f86982ceaf3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.151616 Nov 03 05:34:43.126570 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3967/8036] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:42 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:44.149792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:44.150434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:44.157084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:44.157597 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:44.158395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:44.159047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:44.159532 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:44.159984 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:44.295496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:44.303275 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d777f3e3-fc42-47f3-b04a-fed7c9bf3448 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.157559 Nov 03 05:34:44.303850 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4070/8037] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:44 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:45.327282 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:45.327877 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:45.334700 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:45.335183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:45.335617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:45.336306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:45.336758 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:45.337210 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:45.470825 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:45.478846 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8aa9effa-9ed6-448c-b661-75abeb2ce6bf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.156052 Nov 03 05:34:45.479422 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3968/8038] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:45 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:46.502534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:46.503234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:46.510429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:46.510936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:46.511396 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:46.512127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:46.512629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:46.513108 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:46.648124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:46.656412 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cfca53e2-9702-446e-86b1-fc1a6f1d1c76 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.157828 Nov 03 05:34:46.656987 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4071/8039] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:46 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:47.680611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:47.681262 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:47.688730 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:47.689250 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:47.689691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:47.690384 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:47.690839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:47.691267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:47.819459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:47.827247 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-186f01f4-7f22-4d87-a9bc-9ad22ce3019a tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.150828 Nov 03 05:34:47.827820 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3969/8040] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:47 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:48.850780 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:48.851405 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:48.858283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:48.858776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:48.859229 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:48.859930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:48.860400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:48.860844 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:48.990745 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:48.999361 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-df7927cd-dcf7-4911-8356-18d72a0781e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.152574 Nov 03 05:34:48.999931 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4072/8041] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:48 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:50.021756 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:50.022387 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:50.030112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:50.030613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:50.031064 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:50.031770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:50.032237 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:50.032674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:50.165819 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:50.173683 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fcd315c0-f185-4db5-8b6c-032148bba2db tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.155861 Nov 03 05:34:50.174272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3970/8042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:50 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:51.197314 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:51.197954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:51.205453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:51.205957 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:51.206413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:51.207119 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:51.207593 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:51.208038 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:51.338266 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:51.346613 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-aa201030-386c-4487-a8cf-62ee393732f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1700 microversion: 2.1 time: 0.153256 Nov 03 05:34:51.347189 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4073/8043] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:51 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:52.369742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:52.370358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:52.377245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:52.377733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:52.378169 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:52.378859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:52.379315 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:52.379796 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:52.521101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:52.530979 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c4c915e3-622b-4523-85ee-80152b6fe107 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1700 microversion: 2.1 time: 0.164938 Nov 03 05:34:52.531971 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3971/8044] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:52 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1700 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:53.555021 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:53.555663 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:53.563258 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:53.563762 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:53.564218 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:53.564930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:53.565429 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:53.565873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:53.697973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:53.705619 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4875204d-2a70-4a9a-8451-a37facdea6e7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1700 microversion: 2.1 time: 0.154575 Nov 03 05:34:53.706222 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4074/8045] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:53 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:54.289112 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-db7dfb78-7939-4b8a-9c3a-c5e9d5d88a96 req-07ab25ee-a0bb-44a7-afe9-334cbe7c2812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "name": "network-vif-plugged", "status": "completed", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:34:54.299249 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-db7dfb78-7939-4b8a-9c3a-c5e9d5d88a96 req-07ab25ee-a0bb-44a7-afe9-334cbe7c2812 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:54.299737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-db7dfb78-7939-4b8a-9c3a-c5e9d5d88a96 req-07ab25ee-a0bb-44a7-afe9-334cbe7c2812 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:54.300172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-db7dfb78-7939-4b8a-9c3a-c5e9d5d88a96 req-07ab25ee-a0bb-44a7-afe9-334cbe7c2812 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:54.311745 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-db7dfb78-7939-4b8a-9c3a-c5e9d5d88a96 req-07ab25ee-a0bb-44a7-afe9-334cbe7c2812 service nova] Creating event network-vif-plugged:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h1-854653-7 Nov 03 05:34:54.316714 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-db7dfb78-7939-4b8a-9c3a-c5e9d5d88a96 req-07ab25ee-a0bb-44a7-afe9-334cbe7c2812 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031440 Nov 03 05:34:54.317352 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3972/8046] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:34:54.729165 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:54.729805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:54.736702 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:54.737246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:54.737713 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:54.738432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:54.738908 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:54.739358 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:54.869931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:54.878236 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b796b9ac-437f-4563-8f5c-ba93f318c5af tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1700 microversion: 2.1 time: 0.153062 Nov 03 05:34:54.879003 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4075/8047] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:54 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:55.902278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:55.903707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:55.912861 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:55.913498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:55.914029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:55.914862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:55.915612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:55.916842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:56.067547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:56.076185 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ba4082c6-ed59-4abd-bdae-5f58cef0922d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.178744 Nov 03 05:34:56.077464 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3973/8048] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:55 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:57.102370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:57.103876 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:57.113521 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:57.114484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:57.114947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:57.115872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:57.116352 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:57.116971 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:57.278142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:57.287015 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-72796838-762e-4998-bcdf-0f5e0aeeb735 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.189555 Nov 03 05:34:57.298979 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4076/8049] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:57 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:58.311718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:58.312481 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:58.319903 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:58.320393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:58.320834 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:58.321570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:58.322024 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:58.322448 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:58.478886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:58.488366 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d04233c8-4730-4bae-8f82-794626841da3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.180644 Nov 03 05:34:58.489044 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3974/8050] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:58 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:34:59.512267 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:34:59.513316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:34:59.520355 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:59.520969 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:59.521453 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:59.522319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:34:59.522819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:34:59.523269 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:34:59.680174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:34:59.689535 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cf6d7127-7f68-43dd-9417-30cf168671d5 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.181488 Nov 03 05:34:59.702658 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4077/8051] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:34:59 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:00.713073 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:00.715737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:00.721289 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:00.721923 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:00.722487 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:00.723365 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:00.724526 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:00.725066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:00.894616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:00.902753 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5dacdecc-cca6-4ead-90eb-6c2352489b8b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.193783 Nov 03 05:35:00.903530 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3975/8052] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:00 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:01.927596 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:01.928228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:01.937124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:01.937669 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:01.938111 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:01.938846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:01.939472 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:01.939930 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:02.104283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:02.113512 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e6ca1f42-2b4c-4b0e-a07b-d979400c4043 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.190089 Nov 03 05:35:02.114090 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4078/8053] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:01 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:03.138133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:03.139477 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:03.146620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:03.147213 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:03.147749 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:03.148540 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:03.149103 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:03.149624 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:03.306014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:03.315187 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b38c4008-0123-4acc-aad6-09b0b22cbe71 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.180394 Nov 03 05:35:03.316118 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3976/8054] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:03 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:04.339692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:04.340336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:04.347776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:04.348207 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:04.348659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:04.349408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:04.349881 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:04.350320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:04.506513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:04.515536 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5042ba05-f673-4ac0-be90-c5950f38dafd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.179888 Nov 03 05:35:04.516163 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4079/8055] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:04 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:05.539509 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:05.540130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:05.547104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:05.547589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:05.548031 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:05.548722 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:05.549211 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:05.549694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:05.683200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:05.691332 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b9f07fc7-d065-45f1-ad04-bd8d9d26a842 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1695 microversion: 2.1 time: 0.155766 Nov 03 05:35:05.691912 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3977/8056] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:05 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:06.715321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:06.716097 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:06.724054 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:06.724588 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:06.725065 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:06.725788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:06.726261 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:06.726733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:06.866075 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:06.873942 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b6dbaad7-1d94-45db-8f60-29324d0717f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1677 microversion: 2.1 time: 0.162632 Nov 03 05:35:06.874538 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4080/8057] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:06 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:07.897547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:07.898245 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:07.905902 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:07.906417 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:07.906854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:07.907559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:07.908010 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:07.908439 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:08.043478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:08.051250 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-470670d5-6e45-4e7e-b9f4-cdd30d7d6433 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1677 microversion: 2.1 time: 0.157790 Nov 03 05:35:08.051844 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3978/8058] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:07 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:09.075033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:09.075662 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:09.082474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:09.082973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:09.083430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:09.084136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:09.084611 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:09.085082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:09.224202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:09.232206 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-83dad0f3-1f5f-4b25-8c94-d98f37e6e22e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1680 microversion: 2.1 time: 0.161154 Nov 03 05:35:09.232785 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4081/8059] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:09 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:09.255159 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:35:09.255824 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:09.258639 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=29 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:35:09.263397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:09.263888 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:09.264862 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:09.265587 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:09.266044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:09.266468 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:09.268864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:35:09.356504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127593) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 03 05:35:09.623434 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-38b297be-5709-4525-a28e-0ad325e784b4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d/action" status: 202 len: 0 microversion: 2.1 time: 0.372636 Nov 03 05:35:09.624628 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3979/8060] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:35:09 2022] POST /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:35:09.633283 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:09.633964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:09.636056 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=29 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:35:09.641599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:09.642134 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:09.642595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:09.643412 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:09.643851 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:09.644304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:09.647019 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=85 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:35:09.782524 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:09.790703 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-19a4857a-9ff0-4c96-8aaa-ca009864f30d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1628 microversion: 2.1 time: 0.161803 Nov 03 05:35:09.791370 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4082/8061] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:09 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1628 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:10.309620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-ac117de4-e279-4450-ab6f-50c509ce10f6 req-532467c7-e7bc-4905-ae45-86667d004f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "name": "network-vif-unplugged", "status": "completed", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:35:10.322596 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac117de4-e279-4450-ab6f-50c509ce10f6 req-532467c7-e7bc-4905-ae45-86667d004f55 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:10.326907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac117de4-e279-4450-ab6f-50c509ce10f6 req-532467c7-e7bc-4905-ae45-86667d004f55 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:10.326907 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-ac117de4-e279-4450-ab6f-50c509ce10f6 req-532467c7-e7bc-4905-ae45-86667d004f55 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:10.335442 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.compute.server_external_events [req-ac117de4-e279-4450-ab6f-50c509ce10f6 req-532467c7-e7bc-4905-ae45-86667d004f55 service nova] Unable to find a host for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d. Dropping event network-vif-unplugged {{(pid=127593) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 03 05:35:10.336347 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-ac117de4-e279-4450-ab6f-50c509ce10f6 req-532467c7-e7bc-4905-ae45-86667d004f55 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031049 Nov 03 05:35:10.337272 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3980/8062] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 03 05:35:10.814324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:10.814960 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:10.821822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:10.822317 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:10.822766 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:10.823466 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:10.823938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:10.824375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:10.965437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:10.973851 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-c9b26448-2997-4e97-80f0-5a96ce177a2f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1628 microversion: 2.1 time: 0.163538 Nov 03 05:35:10.974429 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4083/8063] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:10 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1628 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:11.997644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:11.998398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:12.004618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:12.005239 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:12.005755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:12.006566 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:12.007116 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:12.007618 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:12.219780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:12.227603 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-34a065b1-efa1-475a-82ef-deda270b90e8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.234251 Nov 03 05:35:12.228103 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3981/8064] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:11 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:12.985291 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:35:12.995464 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:12.995953 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:12.996397 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:13.008429 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] Creating event network-changed:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h2-854653-7 Nov 03 05:35:13.012140 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] [9d2482bf-81c5-4aba-9e03-eebe66d3d1cd] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:35:13.252425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:13.253063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:13.260068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:13.260592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:13.261102 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:13.261807 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:13.262267 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:13.262726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:13.430428 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:13.438519 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-752a5e10-fa7d-45eb-93a2-68c457260282 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.190937 Nov 03 05:35:13.439038 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3982/8065] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:13 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:35:14.019968 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] [9d2482bf-81c5-4aba-9e03-eebe66d3d1cd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35372. Nov 03 05:35:14.023407 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-b37fae2e-69c9-43f3-9f67-81e7d085d86b req-6810f8b6-1502-4fd4-b153-14779011ee17 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.042829 Nov 03 05:35:14.024033 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4084/8066] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:35:14.461859 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:14.462479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:14.468988 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:14.469499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:14.469939 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:14.470634 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:14.471092 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:14.477560 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:14.704324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:14.715761 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5890f2d2-85ca-4ff9-adb3-817bbc055faa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.257751 Nov 03 05:35:14.717193 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3983/8067] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:14 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:15.741346 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:15.742251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:15.749533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:15.750287 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:15.750887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:15.751774 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:15.752390 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:15.752978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:15.904929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:15.917963 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7073fcd9-9118-4ec9-a04a-f684a82ec6c2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.181870 Nov 03 05:35:15.918770 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4085/8068] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:15 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:16.944125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:16.945040 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:16.953831 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:16.955327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:16.955327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:16.955650 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:16.956309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:16.956785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:17.106785 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:17.115414 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aecd60c3-9593-4379-ad5e-f53eee559ee1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.176393 Nov 03 05:35:17.116232 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3984/8069] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:16 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:18.141296 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:18.141925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:18.149388 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:18.149901 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:18.150364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:18.151082 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:18.151565 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:18.152017 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:18.295322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:18.304494 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3f63f2ae-4997-4809-b94b-e0fd21810da8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.167880 Nov 03 05:35:18.305437 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4086/8070] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:18 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:19.328374 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:19.329001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:19.336714 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:19.337261 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:19.337710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:19.338458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:19.338885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:19.339318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:19.490065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:19.499297 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-eb9fe8f7-4804-4a6a-8785-fbfe94d6a458 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.174848 Nov 03 05:35:19.508990 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3985/8071] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:19 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:35:20.524042 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:20.524744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:20.535985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:20.536503 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:20.536967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:20.537734 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:20.538215 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:20.538666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:20.700890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:20.710488 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-219b1933-c547-4326-b159-cf2ee4e89584 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.190581 Nov 03 05:35:20.711928 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4087/8072] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:20 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:21.742104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:21.744912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:21.760021 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:21.760616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:21.761148 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:21.763391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:21.763875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:21.764334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:21.959080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:21.968244 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f58a4893-111c-4587-a292-a53956d022f3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.235688 Nov 03 05:35:21.968888 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3986/8073] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:21 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:22.993821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:22.994461 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:23.002232 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:23.002739 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:23.003202 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:23.003950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:23.004451 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:23.004898 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:23.135190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:23.143816 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ad088b5e-0880-4e61-87ed-b714a083497f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.153964 Nov 03 05:35:23.144382 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4088/8074] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:22 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:24.167077 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:24.167657 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:24.174355 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:24.174848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:24.175292 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:24.175986 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:24.176444 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:24.176874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:24.313613 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:24.321504 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c5deadd1-17ac-4599-906a-57d593112c1f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.158446 Nov 03 05:35:24.322083 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3987/8075] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:24 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:25.345155 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:25.345727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:25.352642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:25.353184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:25.353644 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:25.354359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:25.354831 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:25.355307 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:25.488247 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:25.496134 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-27829321-6259-4b3a-b7d0-f0d7656464cd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.155541 Nov 03 05:35:25.496703 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4089/8076] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:25 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:26.519309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:26.519925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:26.526857 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:26.527337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:26.527775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:26.528555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:26.529030 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:26.529456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:26.663260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:26.671392 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6407d1e6-b253-4480-9868-95252e437402 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.156052 Nov 03 05:35:26.671962 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3988/8077] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:26 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:27.696836 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:27.697491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:27.705037 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:27.705552 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:27.706003 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:27.706706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:27.707174 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:27.707615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:27.837535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:27.845222 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-381d5830-1f3c-46b2-962d-7dd91ea678a1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.152273 Nov 03 05:35:27.845801 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4090/8078] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:27 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:28.567808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-3a2a5781-5b4e-479e-a7d2-b313828cc235 req-0b23e237-0422-47a8-bd6a-5ae78f75e673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "name": "network-vif-plugged", "status": "completed", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:35:28.578367 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3a2a5781-5b4e-479e-a7d2-b313828cc235 req-0b23e237-0422-47a8-bd6a-5ae78f75e673 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:28.578858 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3a2a5781-5b4e-479e-a7d2-b313828cc235 req-0b23e237-0422-47a8-bd6a-5ae78f75e673 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:28.579295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-3a2a5781-5b4e-479e-a7d2-b313828cc235 req-0b23e237-0422-47a8-bd6a-5ae78f75e673 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:28.590144 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-3a2a5781-5b4e-479e-a7d2-b313828cc235 req-0b23e237-0422-47a8-bd6a-5ae78f75e673 service nova] Creating event network-vif-plugged:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h2-854653-7 Nov 03 05:35:28.595547 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-3a2a5781-5b4e-479e-a7d2-b313828cc235 req-0b23e237-0422-47a8-bd6a-5ae78f75e673 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031485 Nov 03 05:35:28.596129 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3989/8079] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:35:28.867824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:28.868456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:28.875311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:28.875810 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:28.876263 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:28.876973 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:28.877465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:28.877909 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:29.008205 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:29.016589 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-ef560be2-2c88-47f9-a671-035995e97e22 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.152806 Nov 03 05:35:29.017191 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4091/8080] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:28 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:30.041411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:30.042219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:30.049088 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:30.049740 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:30.050069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:30.050764 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:30.051218 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:30.051642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:30.191295 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:30.199372 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-447171b7-020c-4fad-a889-82c9b8e51d13 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1686 microversion: 2.1 time: 0.163097 Nov 03 05:35:30.199957 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3990/8081] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:30 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:35:31.223340 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:35:31.224016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:35:31.231061 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:31.231564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:31.232027 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:31.232746 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:35:31.233254 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:35:31.233705 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:35:31.373415 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:35:31.381313 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-94324afb-f827-4338-bd07-368defbde662 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1673 microversion: 2.1 time: 0.162204 Nov 03 05:35:31.381892 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4092/8082] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:35:31 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:36:45.732335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:36:45.733194 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:36:45.737946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:36:45.738460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:36:45.742962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=21 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:36:45.743737 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=61 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:36:45.756266 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:45.757823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:45.757823 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:45.758160 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:45.758522 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:45.758956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:45.790561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:36:45.810822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1add1247-2239-4c10-8528-47a81f3d7fad req-7cbc2bb5-908f-43f0-b7ab-6a1c71420702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:36:45.821423 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1add1247-2239-4c10-8528-47a81f3d7fad req-7cbc2bb5-908f-43f0-b7ab-6a1c71420702 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:45.822063 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1add1247-2239-4c10-8528-47a81f3d7fad req-7cbc2bb5-908f-43f0-b7ab-6a1c71420702 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:45.822360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1add1247-2239-4c10-8528-47a81f3d7fad req-7cbc2bb5-908f-43f0-b7ab-6a1c71420702 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:45.836137 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1add1247-2239-4c10-8528-47a81f3d7fad req-7cbc2bb5-908f-43f0-b7ab-6a1c71420702 service nova] Creating event network-changed:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h2-854653-7 Nov 03 05:36:45.841226 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1add1247-2239-4c10-8528-47a81f3d7fad req-7cbc2bb5-908f-43f0-b7ab-6a1c71420702 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100326 Nov 03 05:36:45.841859 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4093/8083] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:36:46.120574 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-cd043895-4335-493b-a4e4-5ea30a36cba1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 204 len: 0 microversion: 2.1 time: 0.390420 Nov 03 05:36:46.124381 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3991/8084] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:36:45 2022] DELETE /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:36:46.133529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:36:46.139904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:36:46.140951 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:46.141501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:46.141965 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:46.142683 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:46.143158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:46.143598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:46.419139 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:36:46.427565 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-88063be4-4cec-4870-8911-1277930bce80 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.298285 Nov 03 05:36:46.428447 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4094/8085] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:36:46 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:36:47.452545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:36:47.453293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:36:47.461616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:47.462109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:47.462555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:47.463259 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:47.463727 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:47.464178 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:47.761411 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:36:47.770398 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5202b772-0956-4081-a5af-2779eda5f79c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1679 microversion: 2.1 time: 0.322779 Nov 03 05:36:47.770983 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3992/8086] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:36:47 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1679 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:36:48.206059 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-5cee63fc-31c7-4be2-9cf5-278c3d078d61 req-b68fa4b9-759a-40e9-9ac0-4c4458ad00bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d979d1-e912-4e43-8a9a-9ec4713a7c8d", "name": "network-vif-deleted", "tag": "1b7d8875-c0df-4874-9594-973f38257d60"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:36:48.216522 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5cee63fc-31c7-4be2-9cf5-278c3d078d61 req-b68fa4b9-759a-40e9-9ac0-4c4458ad00bc service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:48.217039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5cee63fc-31c7-4be2-9cf5-278c3d078d61 req-b68fa4b9-759a-40e9-9ac0-4c4458ad00bc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:48.217496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-5cee63fc-31c7-4be2-9cf5-278c3d078d61 req-b68fa4b9-759a-40e9-9ac0-4c4458ad00bc service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:48.228306 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-5cee63fc-31c7-4be2-9cf5-278c3d078d61 req-b68fa4b9-759a-40e9-9ac0-4c4458ad00bc service nova] Creating event network-vif-deleted:1b7d8875-c0df-4874-9594-973f38257d60 for instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d on n-h2-854653-7 Nov 03 05:36:48.233369 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-5cee63fc-31c7-4be2-9cf5-278c3d078d61 req-b68fa4b9-759a-40e9-9ac0-4c4458ad00bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031135 Nov 03 05:36:48.233948 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4095/8087] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:36:48.794770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:36:48.795396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:36:48.802887 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:48.803372 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:48.803812 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:48.804534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:48.804992 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:48.805443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:48.836856 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:48.837378 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:48.837828 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:48.838330 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lazy-loading 'fault' on Instance uuid d1d979d1-e912-4e43-8a9a-9ec4713a7c8d {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:36:48.880760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:36:48.888746 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-e9a3a5fd-0d10-4682-aa5a-234c1ae1e308 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 200 len: 1335 microversion: 2.1 time: 0.097859 Nov 03 05:36:48.889235 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3993/8088] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:36:48 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:36:49.919609 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:36:49.920339 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: d1d979d1-e912-4e43-8a9a-9ec4713a7c8d] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:36:49.927319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:49.927821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:49.928276 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:49.928985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:36:49.929490 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:36:49.929936 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:36:49.943067 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] HTTP exception thrown: Instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d could not be found. Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Request method failure captured: Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d HTTP/1.1 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY1JDXFJMv0UdfCXLEy7mzPlO2jhrGRd7WmEJA_Q4M1wswzGEgqIIl7pxsrIDhiX83cXHtEgq1RujtL79lIg1PLe6YNYltdmnHwZeY6TjD8-GzkQQ89iu_o4WTK-mj69g1XVzP7GhuK664YQas6B1r64xFDeF9dU3KnZSykAnGVGfkD0 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a8bd3d800a4141ac8400074ff69b4153 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestShelveInstance-1130079653 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8bd3d800a4141ac8400074ff69b4153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8bd3d800a4141ac8400074ff69b4153", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8bd3d800a4141ac8400074ff69b4153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8bd3d800a4141ac8400074ff69b4153"}]}] Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestShelveInstance-1130079653 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a8bd3d800a4141ac8400074ff69b4153 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestShelveInstance-1130079653 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestShelveInstance-1130079653-project Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: e7590db567844aa7b802ee2796171810 Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestShelveInstance-1130079653-project Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d could not be found. Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': 'd1d979d1-e912-4e43-8a9a-9ec4713a7c8d'} Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d could not be found. Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d could not be found. Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:36:49.944696 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d could not be found. Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Returning 404 to user: Instance d1d979d1-e912-4e43-8a9a-9ec4713a7c8d could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-29f2f646-7e34-4f7d-aa38-0d4ef493b23b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d" status: 404 len: 111 microversion: 2.1 time: 0.031682 Nov 03 05:36:49.948926 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4096/8089] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:36:49 2022] GET /compute/v2.1/servers/d1d979d1-e912-4e43-8a9a-9ec4713a7c8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:36:50.160120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-3bf0718c-1c8d-47c3-b157-49e0a72c2da6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '.version_select at 0x7ff7f98a7670>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:36:50.247420 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-3bf0718c-1c8d-47c3-b157-49e0a72c2da6 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-739386565" status: 202 len: 0 microversion: 2.1 time: 0.091736 Nov 03 05:36:50.248110 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3994/8090] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 05:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-739386565 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:36:50.273698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4227f1ae-776b-4022-9c90-64459f694fba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'create', calling method: .version_select at 0x7ff7f8097940>, body: {"keypair": {"name": "tempest-TestShelveInstance-286349450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERpo7z4byFyh0jw/jnL+QgjU9DQ+2xHselO60mebY1GL7dhpKxTqUM6U/qhPpaFdpCaqXrPIOoe0rFrMriupa3k157PJJAAkYsSmtWlVXB8P9FQT39X6zQGrb3EWvmtbg=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:36:50.289772 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-4227f1ae-776b-4022-9c90-64459f694fba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for project a8bd3d800a4141ac8400074ff69b4153. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:36:50.294933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-4227f1ae-776b-4022-9c90-64459f694fba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for user e7590db567844aa7b802ee2796171810 and project a8bd3d800a4141ac8400074ff69b4153. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:36:50.406219 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4227f1ae-776b-4022-9c90-64459f694fba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.136418 Nov 03 05:36:50.406834 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4097/8091] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:36:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:37:13.453273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:13.454065 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:13.458636 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1288730531", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-286349450", "security_groups": [{"name": "tempest-secgroup-smoke-1214860565"}], "networks": [{"uuid": "973d8568-726a-4cc5-a700-d6c265acd540"}], "block_device_mapping_v2": [{"uuid": "a982a5cb-0e1f-4001-8558-d439afe4a595", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:37:13.573912 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] validate_networks() for [('973d8568-726a-4cc5-a700-d6c265acd540', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:37:13.962396 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:37:13.962829 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:37:13.963324 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:37:13.963742 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:37:13.964151 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:37:13.973172 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:13.973656 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:13.974097 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:13.974830 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:13.975286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:13.975713 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:13.993952 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for project a8bd3d800a4141ac8400074ff69b4153. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:37:13.999253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Getting quotas for user e7590db567844aa7b802ee2796171810 and project a8bd3d800a4141ac8400074ff69b4153. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:37:14.056720 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:37:14.058956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a982a5cb-0e1f-4001-8558-d439afe4a595',volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:37:14.511946 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2e832094-04f3-49ca-af3b-fe9401d13c8c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.060578 Nov 03 05:37:14.512682 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3995/8092] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:37:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:37:14.522033 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:14.522943 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:14.523678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:14.527740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-76e70d6b-6cd0-42b2-9c23-32da11c2d6cb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:14.528376 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-76e70d6b-6cd0-42b2-9c23-32da11c2d6cb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:14.584816 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-76e70d6b-6cd0-42b2-9c23-32da11c2d6cb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:14.591796 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-76e70d6b-6cd0-42b2-9c23-32da11c2d6cb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1088 microversion: 2.1 time: 0.071690 Nov 03 05:37:14.593213 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4098/8093] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:14 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:15.616943 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9803e03d-158d-4128-961f-6255780a4803 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:15.617616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9803e03d-158d-4128-961f-6255780a4803 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:15.673737 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9803e03d-158d-4128-961f-6255780a4803 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:15.681633 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9803e03d-158d-4128-961f-6255780a4803 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1088 microversion: 2.1 time: 0.069683 Nov 03 05:37:15.682195 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3996/8094] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:15 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:16.704700 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5277bbc5-c97a-405c-858c-7c3b0e44fa0e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:16.705365 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5277bbc5-c97a-405c-858c-7c3b0e44fa0e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:16.759005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5277bbc5-c97a-405c-858c-7c3b0e44fa0e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:16.766043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5277bbc5-c97a-405c-858c-7c3b0e44fa0e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1088 microversion: 2.1 time: 0.066144 Nov 03 05:37:16.766618 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4099/8095] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:16 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:17.790562 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1dc7116b-a581-4692-8123-b4d00392dec0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:17.791183 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1dc7116b-a581-4692-8123-b4d00392dec0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:17.848083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1dc7116b-a581-4692-8123-b4d00392dec0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:17.855034 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1dc7116b-a581-4692-8123-b4d00392dec0 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1088 microversion: 2.1 time: 0.068718 Nov 03 05:37:17.855603 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3997/8096] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:17 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:18.878570 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:18.879240 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:18.886814 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:18.887323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:18.887783 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:18.888506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:18.888985 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:18.889459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:18.950160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:18.957930 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4e9f5bc7-bf86-46ab-93a7-c05e145aaef1 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1138 microversion: 2.1 time: 0.083351 Nov 03 05:37:18.958498 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4100/8097] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:18 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:19.980579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:19.981254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:19.988602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:19.989119 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:19.989565 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:19.990268 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:19.990734 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:19.991171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:20.052868 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:20.060831 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0f778d36-e2f7-430b-ab88-eed2c2063f09 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1130 microversion: 2.1 time: 0.084160 Nov 03 05:37:20.061486 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3998/8098] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:19 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1130 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:21.089523 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:21.090395 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:21.097645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:21.098417 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:21.098884 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:21.099920 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:21.100573 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:21.101047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:21.172776 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:21.180841 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d77b0e65-9dc2-49f1-9508-c4dd968dfda3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1204 microversion: 2.1 time: 0.096218 Nov 03 05:37:21.181464 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4101/8099] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:21 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:22.204381 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:22.205136 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:22.215882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:22.215882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:22.215882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:22.215882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:22.215882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:22.215882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:22.356411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d383b11c-f8ea-4ee8-b762-8d006d449cee req-990a2036-ce5c-44dd-9051-02eaaaafd858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:37:22.367504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d383b11c-f8ea-4ee8-b762-8d006d449cee req-990a2036-ce5c-44dd-9051-02eaaaafd858 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:22.367999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d383b11c-f8ea-4ee8-b762-8d006d449cee req-990a2036-ce5c-44dd-9051-02eaaaafd858 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:22.368567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d383b11c-f8ea-4ee8-b762-8d006d449cee req-990a2036-ce5c-44dd-9051-02eaaaafd858 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:22.377591 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:22.380132 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d383b11c-f8ea-4ee8-b762-8d006d449cee req-990a2036-ce5c-44dd-9051-02eaaaafd858 service nova] Creating event network-changed:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h1-854653-7 Nov 03 05:37:22.385734 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d383b11c-f8ea-4ee8-b762-8d006d449cee req-990a2036-ce5c-44dd-9051-02eaaaafd858 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109053 Nov 03 05:37:22.386566 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4102/8100] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:37:22.390965 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-8291f207-b147-4171-824f-393107c1d07c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1272 microversion: 2.1 time: 0.190088 Nov 03 05:37:22.390965 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 3999/8101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:22 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:23.417335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:23.417987 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:23.424246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:23.424754 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:23.425251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:23.425991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:23.426456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:23.426922 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:23.563050 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:23.571106 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-30d157c7-f3d2-4d5c-973b-893b1edf4675 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1272 microversion: 2.1 time: 0.159745 Nov 03 05:37:23.571701 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4103/8102] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:23 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:24.594416 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:24.595035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:24.597717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:24.603838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:24.604360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:24.604880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:24.605589 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:24.606043 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:24.606464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:24.748129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:24.756808 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6ccb271d-f00a-41ec-af7a-8c67304b9ccf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1272 microversion: 2.1 time: 0.166190 Nov 03 05:37:24.757462 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4000/8103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:24 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:25.779883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:25.780645 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:25.789438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:25.789938 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:25.790391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:25.791106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:25.791577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:25.792014 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:25.927501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:25.935250 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7b167613-2035-49f8-9f07-36a8ec90751e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1272 microversion: 2.1 time: 0.159304 Nov 03 05:37:25.935812 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4104/8104] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:25 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:26.958391 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:26.958937 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:26.965842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:26.966335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:26.968294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:26.968294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:26.968294 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:26.968644 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:27.103104 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:27.110463 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-6478033c-e719-4eca-8637-0d58f05da5b9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.156163 Nov 03 05:37:27.111034 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4001/8105] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:26 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:28.134486 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:28.135118 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:28.137133 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=4 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:28.142756 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:28.145991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:28.145991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:28.145991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:28.145991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:28.145991 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:28.280890 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:28.289050 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dac9182a-15af-45d2-91a4-d877b6071913 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.158884 Nov 03 05:37:28.289676 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4105/8106] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:28 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:29.312290 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:29.312938 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:29.314832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=10 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:37:29.320982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:29.321499 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:29.321945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:29.322645 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:29.323107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:29.323544 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:29.455012 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:29.463386 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a82798a9-dfb0-4ae4-82f9-8d0611b6b487 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.154991 Nov 03 05:37:29.463968 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4002/8107] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:29 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:30.486204 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:30.486839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:30.493978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:30.494477 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:30.494929 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:30.495633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:30.496104 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:30.496545 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:30.629326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:30.636944 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fb112845-fbee-4555-be5a-32b49d7d1e18 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.154743 Nov 03 05:37:30.637561 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4106/8108] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:30 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:31.659946 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:31.660570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:31.668060 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:31.668556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:31.668999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:31.669715 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:31.670176 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:31.670606 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:31.800296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:31.808664 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aba2d500-325c-4351-89ae-b5b97d1aada4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.152564 Nov 03 05:37:31.809263 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4003/8109] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:31 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:32.831456 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:32.832382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:32.839801 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:32.840361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:32.851824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:32.851824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:32.851824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:32.851824 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:32.979246 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:32.986923 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-3eecd549-b5e9-4a5c-bc0b-20354024bc8f tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.159391 Nov 03 05:37:32.987495 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4107/8110] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:32 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:34.009431 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:34.010081 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:34.016894 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:34.017418 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:34.017860 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:34.018551 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:34.019005 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:34.019434 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:34.154839 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:34.162557 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-45cacbed-c121-44f5-b3cc-1c12610d05f7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.157032 Nov 03 05:37:34.163770 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4004/8111] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:34 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:35.186301 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:35.192391 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:35.194917 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:35.195432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:35.195883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:35.196617 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:35.197127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:35.197567 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:35.332744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:35.341198 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-8ae7fc75-3afb-4d1e-b216-02cddfba9a56 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.158914 Nov 03 05:37:35.341770 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4108/8112] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:35 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:37:36.363850 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:36.364397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:36.371360 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:36.371854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:36.372297 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:36.372995 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:36.373479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:36.373909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:36.509710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:36.517406 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-d17e1622-a9be-4426-b169-6f93014cf3a2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.157524 Nov 03 05:37:36.517999 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4005/8113] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:36 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:37.145435 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-d1bba4a6-2ea2-4f8d-b3af-d01e07d1962b req-ff4b8891-e01b-426a-9226-5122b995c3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "name": "network-vif-plugged", "status": "completed", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:37:37.155051 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1bba4a6-2ea2-4f8d-b3af-d01e07d1962b req-ff4b8891-e01b-426a-9226-5122b995c3ca service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:37.158378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1bba4a6-2ea2-4f8d-b3af-d01e07d1962b req-ff4b8891-e01b-426a-9226-5122b995c3ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:37.158378 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-d1bba4a6-2ea2-4f8d-b3af-d01e07d1962b req-ff4b8891-e01b-426a-9226-5122b995c3ca service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:37.170588 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-d1bba4a6-2ea2-4f8d-b3af-d01e07d1962b req-ff4b8891-e01b-426a-9226-5122b995c3ca service nova] Creating event network-vif-plugged:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h1-854653-7 Nov 03 05:37:37.175732 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-d1bba4a6-2ea2-4f8d-b3af-d01e07d1962b req-ff4b8891-e01b-426a-9226-5122b995c3ca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088986 Nov 03 05:37:37.176342 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4109/8114] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:37:37.540964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:37.541612 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:37.548460 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:37.548956 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:37.549433 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:37.550134 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:37.550603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:37.551037 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:37.681403 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:37.690003 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-10f7fa07-178e-4542-aaf2-3292ecbe9351 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.153771 Nov 03 05:37:37.690590 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4006/8115] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:37 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:38.714420 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:38.715083 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:38.721618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:38.723618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:38.723618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:38.723618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:38.723887 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:38.724234 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:38.860765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:38.869296 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-42b01414-a8cb-4221-abb4-614a03bc53bb tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1260 microversion: 2.1 time: 0.160262 Nov 03 05:37:38.869873 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4110/8116] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:38 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:39.891890 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:39.892511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:39.900145 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:39.900642 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:39.901113 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:39.901820 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:39.902279 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:39.902710 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:40.032817 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:40.040880 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2426a40c-7bcd-4b37-8c0f-f927c7180371 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1445 microversion: 2.1 time: 0.152982 Nov 03 05:37:40.041500 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4007/8117] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:39 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:40.065361 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:37:40.065993 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:37:40.073479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:40.073979 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:40.074437 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:40.075512 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:40.075695 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:40.077124 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:40.206564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:37:40.214406 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5761001f-5318-415a-9ab9-1ffab76f68ea tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1445 microversion: 2.1 time: 0.152992 Nov 03 05:37:40.214986 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4111/8118] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:37:40 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:37:42.117272 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-d0d3ec52-3951-435d-8672-c305ccbca008 req-ac90139c-30fb-49bb-b9ca-975ef50f6402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:37:42.127579 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d0d3ec52-3951-435d-8672-c305ccbca008 req-ac90139c-30fb-49bb-b9ca-975ef50f6402 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:37:42.128068 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d0d3ec52-3951-435d-8672-c305ccbca008 req-ac90139c-30fb-49bb-b9ca-975ef50f6402 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:37:42.128510 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-d0d3ec52-3951-435d-8672-c305ccbca008 req-ac90139c-30fb-49bb-b9ca-975ef50f6402 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:37:42.139795 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-d0d3ec52-3951-435d-8672-c305ccbca008 req-ac90139c-30fb-49bb-b9ca-975ef50f6402 service nova] Creating event network-changed:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h1-854653-7 Nov 03 05:37:42.144917 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-d0d3ec52-3951-435d-8672-c305ccbca008 req-ac90139c-30fb-49bb-b9ca-975ef50f6402 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032423 Nov 03 05:37:42.145557 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4008/8119] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:40:08.501551 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:40:08.502777 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:40:08.503375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=34 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:08.504171 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=64 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:08.505413 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:40:08.505562 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7/action (ip 10.222.0.30) !!! Nov 03 05:40:08.506550 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:40:08.506673 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7/action (ip 10.222.0.30) !!! Nov 03 05:40:08.510807 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:40:08.511360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:08.520326 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:08.526248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:08.526248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:08.526248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:08.526248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:08.526248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:08.548074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.objects.instance [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lazy-loading 'flavor' on Instance uuid 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 {{(pid=127594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:40:08.805141 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a4ea56c-6f9c-4804-abcf-ad4c66123407 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7/action" status: 202 len: 0 microversion: 2.1 time: 0.305230 Nov 03 05:40:08.805808 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4112/8120] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:40:08 2022] POST /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:40:08.812874 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:40:08.813762 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:40:08.814401 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:08.815165 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=64 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:08.816084 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:40:08.816211 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 (ip 10.222.0.30) !!! Nov 03 05:40:08.817436 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:40:08.817567 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 (ip 10.222.0.30) !!! Nov 03 05:40:08.818680 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:40:08.818785 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 (ip 10.222.0.30) !!! Nov 03 05:40:08.824755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:08.825514 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:08.835808 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:08.836308 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:08.836755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:08.837492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:08.837960 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:08.838397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:08.980029 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:08.988534 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-58c1de84-6b3e-4f2f-950d-96120f45a523 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.178199 Nov 03 05:40:08.989151 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4009/8121] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:08 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:10.013989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:10.014732 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:10.023569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:10.024071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:10.024528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:10.025272 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:10.025747 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:10.026191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:10.030975 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35826. Nov 03 05:40:10.031691 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35828. Nov 03 05:40:10.160574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:10.168648 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cc126dfe-e8c8-45ab-aa95-0ddf7acf18f4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.160278 Nov 03 05:40:10.169205 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4113/8122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:10 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:11.192254 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:11.192804 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:11.202609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:11.203706 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:11.204163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:11.204864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:11.205359 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:11.205797 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:11.210049 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35832. Nov 03 05:40:11.210854 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 35834. Nov 03 05:40:11.338229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:11.346043 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-61df048e-b30f-48e0-8910-13f330ee3dfc tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.157680 Nov 03 05:40:11.346617 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4010/8123] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:11 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:12.370692 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:12.371322 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:12.387788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:12.387788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:12.387788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:12.387788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:12.387788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:12.387788 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:12.850387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:12.858316 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-52516055-c760-47fd-9cc8-881e4471592b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.492721 Nov 03 05:40:12.858893 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4114/8124] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:12 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:13.881761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:13.882388 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:13.889306 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:13.889801 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:13.890780 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:13.891483 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:13.891944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:13.892393 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:14.026970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:14.034730 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a39790fe-5c3b-4f70-8030-232d193d878b tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.157011 Nov 03 05:40:14.035305 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4011/8125] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:13 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:15.058060 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:15.058686 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:15.065549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:15.066089 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:15.066554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:15.067270 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:15.067751 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:15.068200 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:15.204604 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:15.212335 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-71cfb243-4f17-4b76-8830-ac7c12219c4d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.158215 Nov 03 05:40:15.212913 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4115/8126] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:15 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:16.236181 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:16.236936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:16.244087 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:16.244578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:16.245038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:16.245745 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:16.246326 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:16.246818 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:16.380475 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:16.389005 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0e04edf1-ff1e-4415-8014-294f573526d7 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.157126 Nov 03 05:40:16.390238 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4012/8127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:16 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:17.411782 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:17.412443 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:17.419582 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:17.420106 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:17.420563 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:17.421799 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:17.422280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:17.422720 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:17.560360 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:17.568902 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-52e22b2e-e3fe-402b-8357-9417eff5f762 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.161072 Nov 03 05:40:17.569502 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4116/8128] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:17 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:18.592019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:18.592643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:18.600844 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:18.601389 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:18.601848 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:18.602555 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:18.603020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:18.603457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:18.733558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:18.741502 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-5cd7afba-2934-4909-94d5-ccd11a442ccd tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.153356 Nov 03 05:40:18.742117 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4013/8129] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:18 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:19.765795 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:19.766462 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:19.773459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:19.773977 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:19.774442 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:19.775158 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:19.775636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:19.776084 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:19.906534 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:19.914903 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2f9d5110-5a8e-4791-8ec1-ee331a9048da tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.153297 Nov 03 05:40:19.915197 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4117/8130] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:19 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:20.937925 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:20.938545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:20.945505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:20.945993 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:20.946436 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:20.947132 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:20.947593 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:20.948023 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:21.083733 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:21.091662 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a3991b3f-42f3-471a-a93c-0951b2ba7afe tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.157625 Nov 03 05:40:21.092235 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4014/8131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:20 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:22.115633 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:22.116297 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:22.123966 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:22.125190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:22.125190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:22.125701 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:22.126182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:22.126629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:22.262251 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:22.270887 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-4dad5955-44d0-4bbc-a680-b83a934918cf tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.159264 Nov 03 05:40:22.277051 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4118/8132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:22 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:23.294874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:23.295542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:23.303230 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:23.310402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:23.310402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:23.310402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:23.310402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:23.310402 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:23.444307 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:23.452157 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f9dbe445-8484-44a8-a324-9a5d08673b1d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.161827 Nov 03 05:40:23.453287 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4015/8133] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:23 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:23.781500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-643f1c2c-e8da-4ca3-9e86-1031dbcef312 req-442e4d68-08f4-4472-94d7-08d68b265f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "name": "network-vif-unplugged", "status": "completed", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:40:23.792110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-643f1c2c-e8da-4ca3-9e86-1031dbcef312 req-442e4d68-08f4-4472-94d7-08d68b265f16 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:23.792722 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-643f1c2c-e8da-4ca3-9e86-1031dbcef312 req-442e4d68-08f4-4472-94d7-08d68b265f16 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:23.793199 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-643f1c2c-e8da-4ca3-9e86-1031dbcef312 req-442e4d68-08f4-4472-94d7-08d68b265f16 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:23.805535 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-643f1c2c-e8da-4ca3-9e86-1031dbcef312 req-442e4d68-08f4-4472-94d7-08d68b265f16 service nova] Creating event network-vif-unplugged:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h1-854653-7 Nov 03 05:40:23.810820 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-643f1c2c-e8da-4ca3-9e86-1031dbcef312 req-442e4d68-08f4-4472-94d7-08d68b265f16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033990 Nov 03 05:40:23.811625 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4119/8134] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:40:24.476124 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:24.476735 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:24.483655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:24.484717 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:24.485185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:24.485875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:24.486333 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:24.486772 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:24.616067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:24.623872 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-72c87a19-262d-45fd-a892-9609a4f74c73 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1510 microversion: 2.1 time: 0.151667 Nov 03 05:40:24.624963 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4016/8135] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:24 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:24.647670 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:40:24.648379 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:24.654643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:24.655142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:24.655625 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:24.656333 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:24.656822 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:24.657281 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:24.749955 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127594) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 03 05:40:25.043193 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-5ed2653b-8c9b-45c9-a144-868751325b8d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "POST /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7/action" status: 202 len: 0 microversion: 2.1 time: 0.399793 Nov 03 05:40:25.044136 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4120/8136] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:40:24 2022] POST /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:40:25.052738 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:25.053494 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:25.059398 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:25.059885 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:25.060331 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:25.061044 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:25.061571 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:25.062622 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:25.243309 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:25.252459 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-935ed77c-4b22-4ec4-b343-b496ed04496d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1518 microversion: 2.1 time: 0.203466 Nov 03 05:40:25.257776 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4017/8137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:25 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1518 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:40:26.282459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:26.283201 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:26.291714 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:26.292224 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:26.292676 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:26.293413 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:26.294145 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:26.294586 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:26.432142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:26.440211 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-21ec3102-4722-493f-ae82-2abd88d40b26 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1520 microversion: 2.1 time: 0.163086 Nov 03 05:40:26.440792 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4121/8138] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:26 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:27.464456 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:27.465157 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:27.472061 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:27.472556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:27.473000 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:27.473726 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:27.474187 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:27.474623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:27.618718 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:27.627644 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-ed645fe6-5d22-4431-9107-c683ebd8df97 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1520 microversion: 2.1 time: 0.167075 Nov 03 05:40:27.628245 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4018/8139] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:27 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:28.651590 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:28.652228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:28.659852 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:28.660306 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:28.660765 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:28.661517 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:28.662026 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:28.662439 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:28.797547 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:28.805349 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-763404a8-3648-471d-8c20-9307b7310707 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1520 microversion: 2.1 time: 0.157765 Nov 03 05:40:28.805936 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4122/8140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:28 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:29.830429 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:29.831075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:29.837970 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:29.838466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:29.838915 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:29.839620 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:29.840086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:29.840523 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:29.979813 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:29.988922 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a774e3cd-45b8-4437-8d08-e737e47eb4a4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1520 microversion: 2.1 time: 0.162981 Nov 03 05:40:29.989582 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4019/8141] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:29 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:31.011939 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:31.012706 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:31.019740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:31.020244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:31.020726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:31.021474 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:31.021950 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:31.022392 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:31.154760 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:31.163069 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b1c5ac98-f97d-4874-a94c-d312facc194d tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1520 microversion: 2.1 time: 0.155083 Nov 03 05:40:31.163646 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4123/8142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:31 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:32.187647 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:32.188271 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:32.195311 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:32.195802 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:32.196248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:32.196953 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:32.197443 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:32.197882 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:32.460281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:32.468002 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-59db9988-ad1a-43bc-bf29-786d02497e9e tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.284851 Nov 03 05:40:32.468775 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4020/8143] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:32 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:33.160011 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-f9ba3322-a56e-4e75-97fc-a7a7e024f681 req-eb8e456a-859c-418c-843f-69054c173e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:40:33.171071 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f9ba3322-a56e-4e75-97fc-a7a7e024f681 req-eb8e456a-859c-418c-843f-69054c173e08 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:33.171562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f9ba3322-a56e-4e75-97fc-a7a7e024f681 req-eb8e456a-859c-418c-843f-69054c173e08 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:33.172016 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-f9ba3322-a56e-4e75-97fc-a7a7e024f681 req-eb8e456a-859c-418c-843f-69054c173e08 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:33.183390 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-f9ba3322-a56e-4e75-97fc-a7a7e024f681 req-eb8e456a-859c-418c-843f-69054c173e08 service nova] Creating event network-changed:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h2-854653-7 Nov 03 05:40:33.190379 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-f9ba3322-a56e-4e75-97fc-a7a7e024f681 req-eb8e456a-859c-418c-843f-69054c173e08 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034771 Nov 03 05:40:33.191001 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4124/8144] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:40:33.490394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:33.491020 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:33.498099 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:33.498625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:33.499570 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:33.500286 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:33.500753 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:33.501209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:33.713491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:33.721330 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-aedea2f2-1467-45e5-8830-83dc73399aaa tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.234848 Nov 03 05:40:33.721916 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4021/8145] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:33 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:34.746069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:34.746954 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:34.754212 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:34.754789 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:34.755268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:34.756035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:34.756455 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:34.756893 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:34.921222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:34.929168 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-950beb34-8d28-4b68-ac83-161873e75fa8 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.188348 Nov 03 05:40:34.929741 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4125/8146] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:34 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:35.954035 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:35.954655 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:35.961528 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:35.962019 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:35.962464 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:35.963164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:35.963625 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:35.964055 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:36.095479 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:36.103340 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b2ee390c-7e1c-4381-8050-54de97865d28 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.153986 Nov 03 05:40:36.103913 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4022/8147] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:35 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:37.125877 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:37.126506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:37.133433 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:37.134146 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:37.134371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:37.135074 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:37.135564 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:37.135980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:37.273998 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:37.277549 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:37.282655 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-2bccb697-66b6-48ab-8c98-9f9fb4c8c4ba tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.160863 Nov 03 05:40:37.283219 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4126/8148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:37 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:38.306527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:38.307154 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:38.314585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:38.315076 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:38.315516 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:38.316212 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:38.316675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:38.317128 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:38.449440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:38.457322 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-4f05da1c-b955-49e0-b13f-651144bb6912 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.154686 Nov 03 05:40:38.457891 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4023/8149] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:38 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:39.480394 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:39.481048 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:39.484667 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:39.489688 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:39.490191 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:39.490647 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:39.491387 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:39.491863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:39.492305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:39.626919 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:39.634607 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-b81a36c6-8352-495c-a575-d7217134b0f2 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.158146 Nov 03 05:40:39.635185 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4127/8150] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:39 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:40.661325 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:40.661944 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:40.664604 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=31 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:40.669611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:40.670096 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:40.670536 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:40.671798 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:40.672253 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:40.672680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:40.675227 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=91 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:40:40.807459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:40.815933 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c53eaace-7115-43dc-a2e4-a229f940c3d4 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.158588 Nov 03 05:40:40.816455 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4024/8151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:40 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:41.838643 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:41.839279 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:41.845999 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:41.846504 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:41.846964 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:41.847679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:41.848157 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:41.848598 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:41.982980 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:41.990989 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-dadda9b1-600d-4e43-a850-a76431281867 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.156580 Nov 03 05:40:41.991583 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4128/8152] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:41 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:43.015219 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:43.015853 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:43.022062 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:43.022552 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:43.022997 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:43.023701 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:43.024167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:43.024603 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:43.159694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:43.167653 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1f73ea63-2ae4-48a7-a185-3ad842f59f41 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.156770 Nov 03 05:40:43.168168 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4025/8153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:43 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:44.191758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:44.198228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:44.199226 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:44.199726 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:44.200184 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:44.200900 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:44.201400 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:44.201843 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:44.301296 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-1d939925-c998-47c0-aa33-f5b517ef0702 req-4b223e30-a9c2-4bd7-9b79-5b3920c8d871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "name": "network-vif-plugged", "status": "completed", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:40:44.313930 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d939925-c998-47c0-aa33-f5b517ef0702 req-4b223e30-a9c2-4bd7-9b79-5b3920c8d871 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:44.314419 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d939925-c998-47c0-aa33-f5b517ef0702 req-4b223e30-a9c2-4bd7-9b79-5b3920c8d871 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:44.314854 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-1d939925-c998-47c0-aa33-f5b517ef0702 req-4b223e30-a9c2-4bd7-9b79-5b3920c8d871 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:44.327678 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-1d939925-c998-47c0-aa33-f5b517ef0702 req-4b223e30-a9c2-4bd7-9b79-5b3920c8d871 service nova] Creating event network-vif-plugged:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h2-854653-7 Nov 03 05:40:44.335033 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-1d939925-c998-47c0-aa33-f5b517ef0702 req-4b223e30-a9c2-4bd7-9b79-5b3920c8d871 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037951 Nov 03 05:40:44.335650 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4026/8154] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:40:44.337639 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:44.345958 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-375fb5d3-6c00-469f-933a-87f635e4103c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.158469 Nov 03 05:40:44.346529 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4129/8155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:44 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:45.371838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:45.372584 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:45.379534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:45.380033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:45.380473 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:45.381207 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:45.381670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:45.383638 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:45.514674 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:45.522828 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-de1a8208-2c0a-4606-9e64-76458ed24865 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1576 microversion: 2.1 time: 0.156210 Nov 03 05:40:45.523414 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4027/8156] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:45 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:40:46.546848 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:40:46.547484 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:40:46.554373 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:46.556689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:46.556689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:46.556689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:40:46.556689 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:40:46.557131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:40:46.689110 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:40:46.696839 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-264b500e-c587-4246-a69b-f6598570562c tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1563 microversion: 2.1 time: 0.154199 Nov 03 05:40:46.697443 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4130/8157] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:40:46 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:42:24.176190 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=7 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:24.179849 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=7 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:24.180679 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=24 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:24.184376 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=19 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:24.192018 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:24.193293 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:24.199913 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:24.200412 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:24.201108 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:24.213004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:24.213004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:24.213004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:24.231231 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:42:24.310444 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-64b21525-e176-4d29-a29f-9b049ed97140 req-45822599-18fd-4d16-90a3-0cedea16e0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:42:24.321041 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-64b21525-e176-4d29-a29f-9b049ed97140 req-45822599-18fd-4d16-90a3-0cedea16e0e5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:24.321622 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-64b21525-e176-4d29-a29f-9b049ed97140 req-45822599-18fd-4d16-90a3-0cedea16e0e5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:24.322160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-64b21525-e176-4d29-a29f-9b049ed97140 req-45822599-18fd-4d16-90a3-0cedea16e0e5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:24.333897 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-64b21525-e176-4d29-a29f-9b049ed97140 req-45822599-18fd-4d16-90a3-0cedea16e0e5 service nova] Creating event network-changed:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h2-854653-7 Nov 03 05:42:24.339119 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-64b21525-e176-4d29-a29f-9b049ed97140 req-45822599-18fd-4d16-90a3-0cedea16e0e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160996 Nov 03 05:42:24.346090 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4131/8158] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:42:24.538939 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ce08758-7404-4ace-9b5f-4ba7032bf4ce tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 204 len: 0 microversion: 2.1 time: 0.364708 Nov 03 05:42:24.539952 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4028/8159] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:42:24 2022] DELETE /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:42:24.552487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:24.552487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:24.562336 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:24.562854 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:24.564005 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:24.564775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:24.565293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:24.565752 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:24.748222 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:24.756197 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-228fb412-b300-493e-b8df-762c047b8123 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.211849 Nov 03 05:42:24.756786 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4132/8160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:24 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:25.782167 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:25.782964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:25.789975 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:25.790466 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:25.790910 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:25.791614 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:25.792075 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:25.792505 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:26.030578 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:26.038877 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-48243e31-905e-4a28-aafe-1a878fceb935 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1569 microversion: 2.1 time: 0.261055 Nov 03 05:42:26.039454 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4029/8161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:25 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:26.814223 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-572b034c-dd41-4315-9ee9-e7bb330be9e2 req-db8be3ce-6957-42f5-95a1-96719f3f6dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39d9736e-be4d-4faa-8f9f-e2f3375db4f7", "name": "network-vif-deleted", "tag": "09f025fa-5ae8-487b-afff-7225efb7a4e2"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:42:26.824834 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-572b034c-dd41-4315-9ee9-e7bb330be9e2 req-db8be3ce-6957-42f5-95a1-96719f3f6dbb service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:26.829389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-572b034c-dd41-4315-9ee9-e7bb330be9e2 req-db8be3ce-6957-42f5-95a1-96719f3f6dbb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:26.829389 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-572b034c-dd41-4315-9ee9-e7bb330be9e2 req-db8be3ce-6957-42f5-95a1-96719f3f6dbb service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:26.837444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-572b034c-dd41-4315-9ee9-e7bb330be9e2 req-db8be3ce-6957-42f5-95a1-96719f3f6dbb service nova] Creating event network-vif-deleted:09f025fa-5ae8-487b-afff-7225efb7a4e2 for instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 on n-h2-854653-7 Nov 03 05:42:26.842371 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-572b034c-dd41-4315-9ee9-e7bb330be9e2 req-db8be3ce-6957-42f5-95a1-96719f3f6dbb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Nov 03 05:42:26.842959 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4133/8162] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:42:27.063390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:27.063969 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:27.070936 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:27.071430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:27.071881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:27.072585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:27.073069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:27.073504 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:27.139338 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:27.147607 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-c2fce5b1-3aeb-4e9a-8756-42602fb43d43 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1219 microversion: 2.1 time: 0.088754 Nov 03 05:42:27.148351 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4030/8163] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:27 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:28.171432 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:28.172470 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:28.179677 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:28.180185 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:28.180641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:28.181382 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:28.181860 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:28.182305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:28.248022 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:28.256403 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d23a7cfe-a549-49a1-abf7-17f42cdfa7e9 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1219 microversion: 2.1 time: 0.089400 Nov 03 05:42:28.256971 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4134/8164] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:28 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:29.279964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:29.280585 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:29.288200 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:29.288702 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:29.289248 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:29.289977 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:29.290440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:29.290881 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:29.359170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:29.367554 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1ecf89da-0fbd-4c4b-84dc-3743d60069d3 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1219 microversion: 2.1 time: 0.091212 Nov 03 05:42:29.367805 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4031/8165] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:29 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:30.390077 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:30.391211 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:30.398160 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:30.398666 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:30.399126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:30.399847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:30.400327 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:30.400784 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:30.466271 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:30.474329 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1ec64e4f-a22e-4cb9-865e-6f928545f331 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1219 microversion: 2.1 time: 0.088171 Nov 03 05:42:30.474908 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4135/8166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:30 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:31.497675 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:31.498368 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:31.506864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:31.507493 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:31.508208 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:31.509109 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:31.509633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:31.510069 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:31.557608 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:31.558105 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:31.558556 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:31.559017 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lazy-loading 'fault' on Instance uuid 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:42:31.600600 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7590db567844aa7b802ee2796171810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8bd3d800a4141ac8400074ff69b4153', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:31.608510 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2f7e5af8-b27a-4382-bf6b-6b23bcf73576 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 200 len: 1224 microversion: 2.1 time: 0.115143 Nov 03 05:42:31.609115 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4032/8167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:31 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 1224 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:32.632367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:32.632990 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] [instance: 39d9736e-be4d-4faa-8f9f-e2f3375db4f7] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:32.639858 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:32.640369 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:32.640872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:32.641619 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:32.642092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:32.642535 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:32.655937 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] HTTP exception thrown: Instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 could not be found. Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Request method failure captured: Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 HTTP/1.1 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY1JDXFJMv0UdfCXLEy7mzPlO2jhrGRd7WmEJA_Q4M1wswzGEgqIIl7pxsrIDhiX83cXHtEgq1RujtL79lIg1PLe6YNYltdmnHwZeY6TjD8-GzkQQ89iu_o4WTK-mj69g1XVzP7GhuK664YQas6B1r64xFDeF9dU3KnZSykAnGVGfkD0 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: a8bd3d800a4141ac8400074ff69b4153 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestShelveInstance-1130079653 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8bd3d800a4141ac8400074ff69b4153"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8bd3d800a4141ac8400074ff69b4153", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8bd3d800a4141ac8400074ff69b4153"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8bd3d800a4141ac8400074ff69b4153"}]}] Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestShelveInstance-1130079653 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: a8bd3d800a4141ac8400074ff69b4153 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestShelveInstance-1130079653 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestShelveInstance-1130079653-project Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: e7590db567844aa7b802ee2796171810 Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestShelveInstance-1130079653-project Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 could not be found. Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '39d9736e-be4d-4faa-8f9f-e2f3375db4f7'} Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 could not be found. Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 could not be found. Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:42:32.658213 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 could not be found. Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Returning 404 to user: Instance 39d9736e-be4d-4faa-8f9f-e2f3375db4f7 could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:42:32.662786 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-551933ce-f9cf-41c1-be7e-d660d064a191 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7" status: 404 len: 111 microversion: 2.1 time: 0.031269 Nov 03 05:42:32.663567 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4136/8168] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:32 2022] GET /compute/v2.1/servers/39d9736e-be4d-4faa-8f9f-e2f3375db4f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:42:32.919063 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07545b8d-765c-44b4-b4e5-c4c6b6ed1042 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] Calling method '.version_select at 0x7ff7f98ff8b0>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:33.020039 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07545b8d-765c-44b4-b4e5-c4c6b6ed1042 tempest-TestShelveInstance-1130079653 tempest-TestShelveInstance-1130079653-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-286349450" status: 202 len: 0 microversion: 2.1 time: 0.105917 Nov 03 05:42:33.020622 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4033/8169] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Nov 3 05:42:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-286349450 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 03 05:42:54.941904 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=12 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:54.942678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=24 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:55.125629 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-95ed7abb-eb32-4182-8609-5197140d9974 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Action: 'create', calling method: .version_select at 0x7ff7f9ad5af0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-269667388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDqujNqqq1MrzSFPYaRZ/sU6NGd57sbR1bj7HYIyJU7noS3IgQD+RYBViO8g58Tfl9Z8Qd/DFd8lVu/IxHkNQMTM9PSzXb3Vc7e+BhAybnqut+9cU4hMoovqeC0JGS10Q=="}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:42:55.141896 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-95ed7abb-eb32-4182-8609-5197140d9974 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Getting quotas for project 78ef67c0e5e343b799baa02ad74a391c. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:42:55.147380 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-95ed7abb-eb32-4182-8609-5197140d9974 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Getting quotas for user 84d9a981ee8b4aea99ca1aff5f254d13 and project 78ef67c0e5e343b799baa02ad74a391c. Resources: {'key_pairs'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:42:55.254660 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-95ed7abb-eb32-4182-8609-5197140d9974 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.317884 Nov 03 05:42:55.255267 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4137/8170] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Nov 3 05:42:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:42:57.620086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:57.621242 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:42:57.625291 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-752278511", "imageRef": "9282dbed-69cc-4288-b866-d4c7962a81f1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-269667388", "security_groups": [{"name": "tempest-secgroup-smoke-323452419"}], "networks": [{"uuid": "f4e3ae1c-4e21-413f-a2c8-7c3234661df1"}]}} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:42:57.748833 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.network.neutron [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] validate_networks() for [('f4e3ae1c-4e21-413f-a2c8-7c3234661df1', None, None, None, None, None)] {{(pid=127593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:42:58.230454 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Flavor limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:42:58.230880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Image limits 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:42:58.231385 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Flavor pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:42:58.231795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Image pref 0:0:0 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:42:58.232209 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.virt.hardware [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:42:58.241184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:58.241669 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:58.242107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:58.242842 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:42:58.243303 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:42:58.243760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:42:58.263202 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Getting quotas for project 78ef67c0e5e343b799baa02ad74a391c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:42:58.269558 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.quota [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Getting quotas for user 84d9a981ee8b4aea99ca1aff5f254d13 and project 78ef67c0e5e343b799baa02ad74a391c. Resources: {'instances', 'cores', 'ram'} {{(pid=127593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:42:58.282527 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Going to run 1 instances... {{(pid=127593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:42:58.284864 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9282dbed-69cc-4288-b866-d4c7962a81f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:42:58.403996 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-2faa2400-450d-4301-9496-21eee72f9a48 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.785721 Nov 03 05:42:58.404583 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4034/8171] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:42:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:42:58.415944 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-214e0017-1dc6-46ea-bb0f-47a49a96d2f5 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:58.416585 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-214e0017-1dc6-46ea-bb0f-47a49a96d2f5 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:58.473305 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-214e0017-1dc6-46ea-bb0f-47a49a96d2f5 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:58.480263 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-214e0017-1dc6-46ea-bb0f-47a49a96d2f5 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1247 microversion: 2.1 time: 0.068265 Nov 03 05:42:58.480829 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4138/8172] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:58 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:42:59.507407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-70308a6b-ef86-4ca2-8b2c-6fc929f9e4cd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:42:59.507407 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-70308a6b-ef86-4ca2-8b2c-6fc929f9e4cd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:42:59.564507 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-70308a6b-ef86-4ca2-8b2c-6fc929f9e4cd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:42:59.571632 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-70308a6b-ef86-4ca2-8b2c-6fc929f9e4cd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1247 microversion: 2.1 time: 0.072927 Nov 03 05:42:59.572291 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4035/8173] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:42:59 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:00.595112 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:00.596131 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:00.605364 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:00.606344 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:00.607009 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:00.607781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:00.608430 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:00.608888 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:00.675874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:00.683768 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-665cc7a8-904e-46e3-aef8-42c7edd5a4a9 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1307 microversion: 2.1 time: 0.092898 Nov 03 05:43:00.684435 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4139/8174] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:00 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:01.708413 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:01.709170 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:01.715909 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:01.716394 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:01.716838 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:01.717561 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:01.718014 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:01.718981 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:01.850066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:01.863262 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-a9d27dd5-ee6d-4a0a-9f23-aca858bc63b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.158802 Nov 03 05:43:01.863855 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4036/8175] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:01 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:02.246528 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-c2b8881a-e47b-4f56-95ec-265611e3a36c req-bf876c8d-a9b1-4956-994f-39f43e29083d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f3a0863-4f62-4235-9445-78c1c39e47ca", "tag": "321a5f8a-bfe1-413a-8bd0-2c374c26ada0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:43:02.256627 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c2b8881a-e47b-4f56-95ec-265611e3a36c req-bf876c8d-a9b1-4956-994f-39f43e29083d service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:02.257180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c2b8881a-e47b-4f56-95ec-265611e3a36c req-bf876c8d-a9b1-4956-994f-39f43e29083d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:02.257618 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-c2b8881a-e47b-4f56-95ec-265611e3a36c req-bf876c8d-a9b1-4956-994f-39f43e29083d service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:02.269895 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-c2b8881a-e47b-4f56-95ec-265611e3a36c req-bf876c8d-a9b1-4956-994f-39f43e29083d service nova] Creating event network-changed:321a5f8a-bfe1-413a-8bd0-2c374c26ada0 for instance 9f3a0863-4f62-4235-9445-78c1c39e47ca on n-h1-854653-7 Nov 03 05:43:02.275358 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-c2b8881a-e47b-4f56-95ec-265611e3a36c req-bf876c8d-a9b1-4956-994f-39f43e29083d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090662 Nov 03 05:43:02.275963 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4140/8176] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:43:02.887869 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:02.888490 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:02.895609 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:02.896107 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:02.896545 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:02.897278 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:02.897760 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:02.898193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:03.032424 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:03.040261 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-9c544f2b-da37-4e3a-b940-372904392b41 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.156180 Nov 03 05:43:03.040839 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4037/8177] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:02 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:04.063465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:04.064244 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:04.071321 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:04.071838 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:04.072274 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:04.072975 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:04.073479 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:04.073921 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:04.207252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:04.215059 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9a591521-caa2-446e-99a3-b32f551b5b09 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.155932 Nov 03 05:43:04.216314 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4141/8178] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:04 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:05.239171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:05.240459 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:05.247462 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:05.247964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:05.248408 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:05.251637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:05.251637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:05.251637 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:05.390695 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:05.398777 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-99c67eeb-c339-48ed-b7e5-1ac00a38ea1e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.163510 Nov 03 05:43:05.399502 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4038/8179] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:05 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:06.423725 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:06.424370 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:06.431350 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:06.431853 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:06.432311 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:06.433047 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:06.433514 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:06.433959 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:06.572164 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:06.580043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-fa218deb-28de-4052-942d-50e05905cc8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.161289 Nov 03 05:43:06.580644 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4142/8180] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:06 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:07.604149 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:07.604776 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:07.612323 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:07.612814 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:07.613280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:07.613982 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:07.614445 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:07.614886 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:07.744004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:07.752342 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7832f565-a4e8-43fd-a619-92656eaff84a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.152102 Nov 03 05:43:07.752921 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4039/8181] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:07 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:08.600192 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:43:08.654874 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-6c680a09-f7bc-4fb5-b8bd-b3c40f2f5803 req-4deb264e-5111-47d1-b0f6-1be461a03ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3a0863-4f62-4235-9445-78c1c39e47ca", "name": "network-vif-plugged", "status": "completed", "tag": "321a5f8a-bfe1-413a-8bd0-2c374c26ada0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:43:08.664972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6c680a09-f7bc-4fb5-b8bd-b3c40f2f5803 req-4deb264e-5111-47d1-b0f6-1be461a03ce5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:08.665495 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6c680a09-f7bc-4fb5-b8bd-b3c40f2f5803 req-4deb264e-5111-47d1-b0f6-1be461a03ce5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:08.665949 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-6c680a09-f7bc-4fb5-b8bd-b3c40f2f5803 req-4deb264e-5111-47d1-b0f6-1be461a03ce5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:08.678077 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-6c680a09-f7bc-4fb5-b8bd-b3c40f2f5803 req-4deb264e-5111-47d1-b0f6-1be461a03ce5 service nova] Creating event network-vif-plugged:321a5f8a-bfe1-413a-8bd0-2c374c26ada0 for instance 9f3a0863-4f62-4235-9445-78c1c39e47ca on n-h1-854653-7 Nov 03 05:43:08.683070 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-6c680a09-f7bc-4fb5-b8bd-b3c40f2f5803 req-4deb264e-5111-47d1-b0f6-1be461a03ce5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088305 Nov 03 05:43:08.683670 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4143/8182] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:43:08.774972 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:08.775599 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:08.777755 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:43:08.784240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:08.784741 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:08.785224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:08.785965 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:08.786846 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:08.786935 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:08.924631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:08.932270 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f0f4301a-dfe5-4a51-9da5-a36d64e89d05 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.161299 Nov 03 05:43:08.932846 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4040/8183] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:08 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:09.956214 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:09.956933 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:09.963259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:09.963755 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:09.964210 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:09.964915 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:09.965411 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:09.965850 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:10.102032 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:10.110043 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-85d9af9b-be97-4c41-afba-fdda06b07dae tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1372 microversion: 2.1 time: 0.158967 Nov 03 05:43:10.111269 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4144/8184] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:09 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:11.142766 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:11.143397 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:11.145334 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=8 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:43:11.151066 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:11.152773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:11.152773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:11.152773 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:11.153317 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:11.153762 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:11.288457 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:11.296330 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-75a1cdf2-1dab-4ac3-b1a6-99fd90dd067e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1558 microversion: 2.1 time: 0.158096 Nov 03 05:43:11.296899 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4041/8185] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:11 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:43:11.319554 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:43:11.320186 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:43:11.327039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:11.327569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:11.328036 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:11.328743 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:11.329248 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:11.329717 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:11.459775 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:43:11.467703 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d9e4c0f9-5064-48a3-9a52-dcfc5c00e2d0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1558 microversion: 2.1 time: 0.152021 Nov 03 05:43:11.468271 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4145/8186] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:43:11 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:43:13.722240 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-833402d0-b01d-474e-8618-e51f49a4bf85 req-6ddd0610-3bcc-45f7-b515-00ca8ebebd12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f3a0863-4f62-4235-9445-78c1c39e47ca", "tag": "321a5f8a-bfe1-413a-8bd0-2c374c26ada0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:43:13.732628 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-833402d0-b01d-474e-8618-e51f49a4bf85 req-6ddd0610-3bcc-45f7-b515-00ca8ebebd12 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:43:13.733139 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-833402d0-b01d-474e-8618-e51f49a4bf85 req-6ddd0610-3bcc-45f7-b515-00ca8ebebd12 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:43:13.733574 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-833402d0-b01d-474e-8618-e51f49a4bf85 req-6ddd0610-3bcc-45f7-b515-00ca8ebebd12 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:43:13.744609 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-833402d0-b01d-474e-8618-e51f49a4bf85 req-6ddd0610-3bcc-45f7-b515-00ca8ebebd12 service nova] Creating event network-changed:321a5f8a-bfe1-413a-8bd0-2c374c26ada0 for instance 9f3a0863-4f62-4235-9445-78c1c39e47ca on n-h1-854653-7 Nov 03 05:43:13.749797 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-833402d0-b01d-474e-8618-e51f49a4bf85 req-6ddd0610-3bcc-45f7-b515-00ca8ebebd12 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031781 Nov 03 05:43:13.750447 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4042/8187] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:45:39.802571 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:45:39.803983 n-d-854653-7 devstack@n-api.service[127594]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 03 05:45:39.804546 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:45:39.805343 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=34 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:45:39.806278 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:45:39.806397 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:45:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca/action (ip 10.222.0.30) !!! Nov 03 05:45:39.808320 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:45:39.808423 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:45:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca/action (ip 10.222.0.30) !!! Nov 03 05:45:39.810050 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 03 05:45:39.810162 n-d-854653-7 devstack@n-api.service[127594]: Thu Nov 3 05:45:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca/action (ip 10.222.0.30) !!! Nov 03 05:45:39.815046 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2133493927"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:45:39.817487 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:45:39.832932 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:45:39.833459 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:45:39.833914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:45:39.834665 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:45:39.835135 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:45:39.835574 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:45:40.156128 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-7d9380d7-f170-4a01-8a3e-3f4cefb16ea1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "POST /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca/action" status: 202 len: 0 microversion: 2.1 time: 0.355772 Nov 03 05:45:40.156706 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4146/8188] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:45:39 2022] POST /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 05:45:47.406749 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:45:47.407562 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 03 05:45:47.408197 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:45:47.409126 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=40 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:45:47.410079 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:45:47.410315 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:45:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 03 05:45:47.411772 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 03 05:45:47.411880 n-d-854653-7 devstack@n-api.service[127593]: Thu Nov 3 05:45:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Nov 03 05:45:47.417491 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-5e1d9ad6-bb87-4ab9-96b1-fbd09bfbdaae req-322b6674-a66d-4117-97b4-75ff6811c7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3a0863-4f62-4235-9445-78c1c39e47ca", "name": "network-vif-plugged", "status": "completed", "tag": "321a5f8a-bfe1-413a-8bd0-2c374c26ada0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:45:47.428643 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5e1d9ad6-bb87-4ab9-96b1-fbd09bfbdaae req-322b6674-a66d-4117-97b4-75ff6811c7b7 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:45:47.429171 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5e1d9ad6-bb87-4ab9-96b1-fbd09bfbdaae req-322b6674-a66d-4117-97b4-75ff6811c7b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:45:47.429611 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-5e1d9ad6-bb87-4ab9-96b1-fbd09bfbdaae req-322b6674-a66d-4117-97b4-75ff6811c7b7 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:45:47.441400 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-5e1d9ad6-bb87-4ab9-96b1-fbd09bfbdaae req-322b6674-a66d-4117-97b4-75ff6811c7b7 service nova] Creating event network-vif-plugged:321a5f8a-bfe1-413a-8bd0-2c374c26ada0 for instance 9f3a0863-4f62-4235-9445-78c1c39e47ca on n-h1-854653-7 Nov 03 05:45:47.446843 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-5e1d9ad6-bb87-4ab9-96b1-fbd09bfbdaae req-322b6674-a66d-4117-97b4-75ff6811c7b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041812 Nov 03 05:45:47.447503 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4043/8189] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:46:00.956493 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:46:00.957375 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:46:00.962043 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1860708650", "imageRef": "d1eee278-9c85-4dd1-98f5-ce1983ddd61e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-269667388", "security_groups": [{"name": "tempest-secgroup-smoke-323452419"}], "networks": [{"uuid": "f4e3ae1c-4e21-413f-a2c8-7c3234661df1"}]}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:46:00.986246 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [537d3be4-486c-46a1-b80b-0f8de3fd27e0] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36464. Nov 03 05:46:00.988003 n-d-854653-7 devstack@n-api.service[127594]: INFO oslo.messaging._drivers.impl_rabbit [-] [12a26e7f-a55c-483f-b05d-f4fcbf6a20d6] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36466. Nov 03 05:46:01.072304 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.network.neutron [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] validate_networks() for [('f4e3ae1c-4e21-413f-a2c8-7c3234661df1', None, None, None, None, None)] {{(pid=127594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 03 05:46:01.500736 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Flavor limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 03 05:46:01.501228 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Image limits 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 03 05:46:01.501727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Flavor pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 03 05:46:01.502162 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Image pref 0:0:0 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 03 05:46:01.502595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.virt.hardware [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 03 05:46:01.512277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:01.512781 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:01.513277 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:01.514024 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:01.514500 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:01.514947 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:01.531577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Getting quotas for project 78ef67c0e5e343b799baa02ad74a391c. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 03 05:46:01.536873 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.quota [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Getting quotas for user 84d9a981ee8b4aea99ca1aff5f254d13 and project 78ef67c0e5e343b799baa02ad74a391c. Resources: {'instances', 'cores', 'ram'} {{(pid=127594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 03 05:46:01.549316 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Going to run 1 instances... {{(pid=127594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 03 05:46:01.552092 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d1eee278-9c85-4dd1-98f5-ce1983ddd61e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 03 05:46:01.680224 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0f5cf1f4-2179-4aac-898b-c7dcfa15bb52 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725268 Nov 03 05:46:01.680884 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4147/8190] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Nov 3 05:46:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 03 05:46:01.696054 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-776bd636-cbf5-4d3c-8f69-f9f47bdc04d1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:01.696832 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-776bd636-cbf5-4d3c-8f69-f9f47bdc04d1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:01.711753 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36488. Nov 03 05:46:01.712447 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36486. Nov 03 05:46:01.765458 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-776bd636-cbf5-4d3c-8f69-f9f47bdc04d1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:01.772430 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-776bd636-cbf5-4d3c-8f69-f9f47bdc04d1 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1248 microversion: 2.1 time: 0.083961 Nov 03 05:46:01.773001 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4044/8191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:01 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:02.795280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:02.795907 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:02.802473 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:02.802978 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:02.803434 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:02.804678 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:02.805194 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:02.805636 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:02.868127 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:02.875777 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0571731a-ebf0-4730-ac5d-739b0563defb tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1252 microversion: 2.1 time: 0.085413 Nov 03 05:46:02.881821 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4148/8192] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:02 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1252 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:03.402373 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-9362bf0f-38d3-4925-93f6-8891f1b0e492 req-cece8a83-0d50-4563-ae7c-a27a8c592eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3a0863-4f62-4235-9445-78c1c39e47ca", "name": "network-vif-unplugged", "status": "completed", "tag": "321a5f8a-bfe1-413a-8bd0-2c374c26ada0"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:46:03.414314 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9362bf0f-38d3-4925-93f6-8891f1b0e492 req-cece8a83-0d50-4563-ae7c-a27a8c592eaf service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:03.415430 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9362bf0f-38d3-4925-93f6-8891f1b0e492 req-cece8a83-0d50-4563-ae7c-a27a8c592eaf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:03.415871 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-9362bf0f-38d3-4925-93f6-8891f1b0e492 req-cece8a83-0d50-4563-ae7c-a27a8c592eaf service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:03.426778 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-9362bf0f-38d3-4925-93f6-8891f1b0e492 req-cece8a83-0d50-4563-ae7c-a27a8c592eaf service nova] Creating event network-vif-unplugged:321a5f8a-bfe1-413a-8bd0-2c374c26ada0 for instance 9f3a0863-4f62-4235-9445-78c1c39e47ca on n-h1-854653-7 Nov 03 05:46:03.433243 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-9362bf0f-38d3-4925-93f6-8891f1b0e492 req-cece8a83-0d50-4563-ae7c-a27a8c592eaf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034729 Nov 03 05:46:03.433840 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4045/8193] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:46:03.899562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:03.900805 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:03.908262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:03.908769 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:03.909265 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:03.909967 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:03.910476 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:03.910923 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:03.994787 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:04.002560 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d34b30ae-9b79-4020-a23f-a0d3c5ec1dab tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1308 microversion: 2.1 time: 0.107293 Nov 03 05:46:04.003271 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4149/8194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:03 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:05.031602 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:05.033984 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:05.043337 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:05.044080 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:05.044694 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:05.045872 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:05.046646 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:05.047233 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:05.240392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:05.249532 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-498ae5a2-fe6f-496b-81e7-ebc580add3bd tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.226904 Nov 03 05:46:05.250683 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4046/8195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:05 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:06.274427 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:06.275440 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:06.284250 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:06.284856 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:06.285555 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:06.286408 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:06.287076 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:06.287733 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:06.447928 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:06.455945 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-e3def662-8186-48fe-b502-407b131fcd11 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.185342 Nov 03 05:46:06.456527 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4150/8196] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:06 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:07.479392 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:07.481083 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:07.489770 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:07.490765 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:07.491495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:07.492582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:07.493964 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:07.494696 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:07.639875 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:07.648455 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-fc44f738-3bb3-4f83-a1ea-8921586d8fc0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.172978 Nov 03 05:46:07.649432 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4047/8197] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:07 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:08.672190 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:08.673088 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:08.681595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:08.682193 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:08.682724 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:08.683529 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:08.684073 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:08.684592 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:08.839664 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:08.848114 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-efa0ba11-82f3-46b7-9876-80f068c12b82 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.180177 Nov 03 05:46:08.848679 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4151/8198] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:08 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:09.872243 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:09.873440 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:09.880164 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:09.880763 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:09.881281 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:09.882001 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:09.882463 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:09.882895 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:10.082623 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:10.091742 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f63b5615-cb83-478e-af91-e5dc5d524181 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.224834 Nov 03 05:46:10.092546 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4048/8199] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:09 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:11.115773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:11.139142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:11.139142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:11.139142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:11.139142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:11.139142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:11.139142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:11.139142 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:11.294571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:11.303154 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-50302fc7-bdf4-446a-a704-11f95e26137b tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.191574 Nov 03 05:46:11.304184 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4152/8200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:11 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:12.328390 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:12.330130 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:12.338484 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell0:SELECT=2 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:46:12.341038 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:12.341852 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:12.342598 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:12.343680 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:12.344441 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:12.345185 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:12.497547 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:12.506425 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-b145a571-85f9-4e95-b08c-d71c6b7e1c01 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.182812 Nov 03 05:46:12.507026 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4049/8201] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:12 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:13.529180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:13.529832 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:13.531914 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:46:13.532620 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell0:SELECT=6 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:46:13.538527 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:13.539078 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:13.539533 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:13.540260 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:13.540740 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:13.541773 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:13.717338 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:13.725388 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-d8c0b823-b352-4476-beb7-1bec8d321016 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.200133 Nov 03 05:46:13.725977 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4153/8202] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:13 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:14.022698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-66288347-399e-456d-aae8-699281bd9db5 req-3c0c014f-5a3a-4056-a9b2-b54bcd834544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe", "tag": "9855d075-8d09-46f8-943c-4f875c478393"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:46:14.033184 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-66288347-399e-456d-aae8-699281bd9db5 req-3c0c014f-5a3a-4056-a9b2-b54bcd834544 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:14.033668 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-66288347-399e-456d-aae8-699281bd9db5 req-3c0c014f-5a3a-4056-a9b2-b54bcd834544 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:14.034098 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-66288347-399e-456d-aae8-699281bd9db5 req-3c0c014f-5a3a-4056-a9b2-b54bcd834544 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:14.046296 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-66288347-399e-456d-aae8-699281bd9db5 req-3c0c014f-5a3a-4056-a9b2-b54bcd834544 service nova] Creating event network-changed:9855d075-8d09-46f8-943c-4f875c478393 for instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe on n-h2-854653-7 Nov 03 05:46:14.051238 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-66288347-399e-456d-aae8-699281bd9db5 req-3c0c014f-5a3a-4056-a9b2-b54bcd834544 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Nov 03 05:46:14.052109 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4050/8203] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:46:14.749594 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:14.750866 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:14.757569 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:14.758079 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:14.758541 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:14.759262 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:14.759735 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:14.760182 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:14.892660 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:14.901613 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-58af9ba6-7981-447e-82dd-c1e383116c34 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.154896 Nov 03 05:46:14.902085 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4154/8204] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:14 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:15.927033 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:15.927767 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:15.934619 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:15.935106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:15.935543 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:15.936232 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:15.936691 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:15.937142 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:16.071153 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:16.079047 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-0bcfdc64-a135-478e-881b-b1a0391e7d65 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.157619 Nov 03 05:46:16.080182 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4051/8205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:15 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:17.101335 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:17.101972 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:17.109126 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:17.109654 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:17.110107 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:17.110847 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:17.111320 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:17.111758 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:17.245761 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:17.253439 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-a5109d06-088a-46f0-a2bd-467a771cae54 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.156122 Nov 03 05:46:17.254011 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4155/8206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:17 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:18.277670 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:18.278395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:18.285633 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:18.286120 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:18.286559 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:18.287335 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:18.287788 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:18.288229 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:18.420698 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:18.428656 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-89a09ae9-c8e2-4c0e-b6c6-7bad5805d4ea tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.155579 Nov 03 05:46:18.429886 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4052/8207] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:18 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:46:19.451872 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:19.452501 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:19.459371 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:19.459867 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:19.460319 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:19.461039 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:19.461513 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:19.461948 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:19.600249 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:19.607916 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-063768f5-c8b8-44f2-90aa-1c127f0f9751 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.159954 Nov 03 05:46:19.608504 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4156/8208] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:19 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:20.066950 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-4f2a0749-9831-43d5-bbf9-e32e718ba167 req-a9e287db-cfea-43e1-a596-2553b00cd3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe", "name": "network-vif-plugged", "status": "completed", "tag": "9855d075-8d09-46f8-943c-4f875c478393"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:46:20.077795 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f2a0749-9831-43d5-bbf9-e32e718ba167 req-a9e287db-cfea-43e1-a596-2553b00cd3aa service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:20.078273 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f2a0749-9831-43d5-bbf9-e32e718ba167 req-a9e287db-cfea-43e1-a596-2553b00cd3aa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:20.078707 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-4f2a0749-9831-43d5-bbf9-e32e718ba167 req-a9e287db-cfea-43e1-a596-2553b00cd3aa service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:20.089537 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-4f2a0749-9831-43d5-bbf9-e32e718ba167 req-a9e287db-cfea-43e1-a596-2553b00cd3aa service nova] Creating event network-vif-plugged:9855d075-8d09-46f8-943c-4f875c478393 for instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe on n-h2-854653-7 Nov 03 05:46:20.094338 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-4f2a0749-9831-43d5-bbf9-e32e718ba167 req-a9e287db-cfea-43e1-a596-2553b00cd3aa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031127 Nov 03 05:46:20.094913 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4053/8209] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:46:20.633721 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:20.634497 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:20.642095 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:20.643004 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:20.643839 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:20.645188 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:20.646049 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:20.646615 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:20.780012 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:20.787683 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-9ada2abf-4d34-4f15-8712-b6fadb358a61 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1373 microversion: 2.1 time: 0.160781 Nov 03 05:46:20.788256 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4157/8210] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:20 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:46:21.813260 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:21.813874 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:21.820084 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:21.820567 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:21.821004 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:21.821711 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:21.822193 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:21.822616 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:21.970897 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:21.979605 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1bbfb903-d09b-453f-82bf-97d975a56e1f tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1558 microversion: 2.1 time: 0.171487 Nov 03 05:46:21.980212 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4054/8211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:21 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:22.002913 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:46:22.003616 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:46:22.011599 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:22.012113 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:22.012584 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:22.013359 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:22.013841 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:22.014324 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:22.145989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:46:22.154444 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-86cb6f52-cf85-4bee-a1a5-1718811f2b8e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1558 microversion: 2.1 time: 0.155591 Nov 03 05:46:22.155016 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4158/8212] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:46:21 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:46:24.312511 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-229168df-9b8f-49ae-b69b-cd28648519dc req-09a0babb-8a94-4ce8-ad01-a5231a187b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe", "tag": "9855d075-8d09-46f8-943c-4f875c478393"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:46:24.323498 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-229168df-9b8f-49ae-b69b-cd28648519dc req-09a0babb-8a94-4ce8-ad01-a5231a187b11 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:46:24.324082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-229168df-9b8f-49ae-b69b-cd28648519dc req-09a0babb-8a94-4ce8-ad01-a5231a187b11 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:46:24.324524 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-229168df-9b8f-49ae-b69b-cd28648519dc req-09a0babb-8a94-4ce8-ad01-a5231a187b11 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:46:24.335724 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-229168df-9b8f-49ae-b69b-cd28648519dc req-09a0babb-8a94-4ce8-ad01-a5231a187b11 service nova] Creating event network-changed:9855d075-8d09-46f8-943c-4f875c478393 for instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe on n-h2-854653-7 Nov 03 05:46:24.341445 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-229168df-9b8f-49ae-b69b-cd28648519dc req-09a0babb-8a94-4ce8-ad01-a5231a187b11 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032965 Nov 03 05:46:24.342057 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4055/8213] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:47:55.613648 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:47:55.614452 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=68 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:47:55.719698 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-534296813"}} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:47:55.722153 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:47:55.728123 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:47:55.728626 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:47:55.729109 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:47:55.729819 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:47:55.730293 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:47:55.730730 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:47:56.297143 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-1077c7ce-98d1-4ad7-9d2a-cf15f0a13ebf tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "POST /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe/action" status: 202 len: 0 microversion: 2.1 time: 0.685234 Nov 03 05:47:56.297799 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4159/8214] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Nov 3 05:47:55 2022] POST /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 03 05:48:02.421058 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 03 05:48:02.422713 n-d-854653-7 devstack@n-api.service[127593]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 03 05:48:02.423534 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_api:SELECT=28 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:48:02.424370 n-d-854653-7 devstack@n-api.service[127593]: DEBUG dbcounter [-] [127593] Writing DB stats nova_cell1:SELECT=52 {{(pid=127593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:48:02.431101 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-95a96bc5-cdd3-49d9-a265-12bbc5138a49 req-5601da87-f025-476a-8dd4-0e4c6f97e703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe", "name": "network-vif-plugged", "status": "completed", "tag": "9855d075-8d09-46f8-943c-4f875c478393"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:48:02.442922 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-95a96bc5-cdd3-49d9-a265-12bbc5138a49 req-5601da87-f025-476a-8dd4-0e4c6f97e703 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:02.443495 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-95a96bc5-cdd3-49d9-a265-12bbc5138a49 req-5601da87-f025-476a-8dd4-0e4c6f97e703 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:02.444016 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-95a96bc5-cdd3-49d9-a265-12bbc5138a49 req-5601da87-f025-476a-8dd4-0e4c6f97e703 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:02.458109 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-95a96bc5-cdd3-49d9-a265-12bbc5138a49 req-5601da87-f025-476a-8dd4-0e4c6f97e703 service nova] Creating event network-vif-plugged:9855d075-8d09-46f8-943c-4f875c478393 for instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe on n-h2-854653-7 Nov 03 05:48:02.463651 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-95a96bc5-cdd3-49d9-a265-12bbc5138a49 req-5601da87-f025-476a-8dd4-0e4c6f97e703 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044556 Nov 03 05:48:02.466622 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4056/8215] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:48:12.726577 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_api:SELECT=2 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:48:12.727792 n-d-854653-7 devstack@n-api.service[127594]: DEBUG dbcounter [-] [127594] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 03 05:48:12.732342 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:12.733034 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:12.740642 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:12.741280 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:12.741821 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:12.742624 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:12.743180 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:12.743697 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:12.771707 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Going to try to terminate instance {{(pid=127594) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:48:12.791699 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [6adff85d-d56b-49a5-bf61-f955e34e7e3c] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36792. Nov 03 05:48:12.793790 n-d-854653-7 devstack@n-api.service[127593]: INFO oslo.messaging._drivers.impl_rabbit [-] [70f74bd7-49cc-4f6b-96ff-919de9defd98] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 36790. Nov 03 05:48:12.880580 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-b2984224-dc1b-40cb-afee-259869180db4 req-6587315f-81c2-4bb3-904d-ccc07b517606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe", "tag": "9855d075-8d09-46f8-943c-4f875c478393"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:48:12.890106 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2984224-dc1b-40cb-afee-259869180db4 req-6587315f-81c2-4bb3-904d-ccc07b517606 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:12.891133 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2984224-dc1b-40cb-afee-259869180db4 req-6587315f-81c2-4bb3-904d-ccc07b517606 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:12.891573 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-b2984224-dc1b-40cb-afee-259869180db4 req-6587315f-81c2-4bb3-904d-ccc07b517606 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:12.903124 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-b2984224-dc1b-40cb-afee-259869180db4 req-6587315f-81c2-4bb3-904d-ccc07b517606 service nova] Creating event network-changed:9855d075-8d09-46f8-943c-4f875c478393 for instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe on n-h2-854653-7 Nov 03 05:48:12.908761 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-b2984224-dc1b-40cb-afee-259869180db4 req-6587315f-81c2-4bb3-904d-ccc07b517606 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132282 Nov 03 05:48:12.909421 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4057/8216] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 03 05:48:13.039382 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-943cc5fd-189b-4b34-8064-0bff77d30db6 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 204 len: 0 microversion: 2.1 time: 0.311313 Nov 03 05:48:13.045719 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4160/8217] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:48:12 2022] DELETE /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:48:13.051542 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:13.052486 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:13.059327 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:13.060059 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:13.060617 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:13.061492 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:13.062592 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:13.063180 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:13.290568 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:48:13.298912 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-1e43f365-f0a9-43d4-9a33-2158ae3043d4 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1682 microversion: 2.1 time: 0.251779 Nov 03 05:48:13.299500 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4058/8218] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:13 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:48:14.323989 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:14.324883 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:14.332136 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:14.332640 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:14.333128 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:14.333846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:14.334323 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:14.334806 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:14.475962 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:48:14.484266 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-cdcfe93d-c035-4474-93d1-20b6e0bca6fc tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1682 microversion: 2.1 time: 0.164564 Nov 03 05:48:14.487938 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4161/8219] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:14 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:48:14.488053 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [req-cd789cd3-f996-4bc1-874d-b4568f575f01 req-2965e252-23cb-4975-accd-07d8e6788692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe", "name": "network-vif-unplugged", "status": "completed", "tag": "9855d075-8d09-46f8-943c-4f875c478393"}]} {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:48:14.495395 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cd789cd3-f996-4bc1-874d-b4568f575f01 req-2965e252-23cb-4975-accd-07d8e6788692 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:14.495880 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cd789cd3-f996-4bc1-874d-b4568f575f01 req-2965e252-23cb-4975-accd-07d8e6788692 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:14.496318 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [req-cd789cd3-f996-4bc1-874d-b4568f575f01 req-2965e252-23cb-4975-accd-07d8e6788692 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:14.507672 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.compute.server_external_events [req-cd789cd3-f996-4bc1-874d-b4568f575f01 req-2965e252-23cb-4975-accd-07d8e6788692 service nova] Creating event network-vif-unplugged:9855d075-8d09-46f8-943c-4f875c478393 for instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe on n-h2-854653-7 Nov 03 05:48:14.512439 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [req-cd789cd3-f996-4bc1-874d-b4568f575f01 req-2965e252-23cb-4975-accd-07d8e6788692 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085300 Nov 03 05:48:14.519429 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4059/8220] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:48:15.483035 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-1eb9ab78-26bf-4c03-85a5-7fa62a27319c req-c852a33c-60e6-4de6-9c2a-62757dced128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe", "name": "network-vif-deleted", "tag": "9855d075-8d09-46f8-943c-4f875c478393"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:48:15.494498 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1eb9ab78-26bf-4c03-85a5-7fa62a27319c req-c852a33c-60e6-4de6-9c2a-62757dced128 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:15.495129 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1eb9ab78-26bf-4c03-85a5-7fa62a27319c req-c852a33c-60e6-4de6-9c2a-62757dced128 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:15.495610 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-1eb9ab78-26bf-4c03-85a5-7fa62a27319c req-c852a33c-60e6-4de6-9c2a-62757dced128 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:15.507624 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-1eb9ab78-26bf-4c03-85a5-7fa62a27319c req-c852a33c-60e6-4de6-9c2a-62757dced128 service nova] Creating event network-vif-deleted:9855d075-8d09-46f8-943c-4f875c478393 for instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe on n-h2-854653-7 Nov 03 05:48:15.509500 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:15.510224 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:15.515191 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-1eb9ab78-26bf-4c03-85a5-7fa62a27319c req-c852a33c-60e6-4de6-9c2a-62757dced128 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035390 Nov 03 05:48:15.516148 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4162/8221] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:48:15.516980 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:15.517575 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:15.518158 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:15.519067 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:15.519775 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:15.520280 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:15.590377 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:48:15.598869 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-7f8638db-be76-4911-9bc4-a2fce889b3aa tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 200 len: 1497 microversion: 2.1 time: 0.094605 Nov 03 05:48:15.599446 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4060/8222] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:15 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 1497 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 03 05:48:16.627840 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:16.628506 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:16.635562 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:16.636069 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:16.636525 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:16.637268 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:16.637744 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:16.638196 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:16.651490 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] HTTP exception thrown: Instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe could not be found. Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Request method failure captured: Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe HTTP/1.1 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY1TYbVLlarFCMshcAXHfMdnMNRYz8YJWH4idtGNDn6WpH5_Xen51T9EJMVOWTrom0DqDDnFhzamxVfGLH0kr_RDeYzFCheUqvqQ6Y_KcwtGc8yqm4DaOKa35oPwAM47JctvE9LoxYXP9yELR2hX7sSCyZKTM2zXTK8GYY1Qh8T3b75k Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 78ef67c0e5e343b799baa02ad74a391c Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestSnapshotPattern-952407223 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78ef67c0e5e343b799baa02ad74a391c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78ef67c0e5e343b799baa02ad74a391c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78ef67c0e5e343b799baa02ad74a391c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78ef67c0e5e343b799baa02ad74a391c"}]}] Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestSnapshotPattern-952407223 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 78ef67c0e5e343b799baa02ad74a391c Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestSnapshotPattern-952407223 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestSnapshotPattern-952407223-project Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 84d9a981ee8b4aea99ca1aff5f254d13 Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestSnapshotPattern-952407223-project Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe could not be found. Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe'} Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe could not be found. Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe could not be found. Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:48:16.653154 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe could not be found. Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Returning 404 to user: Instance 6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f6365394-4bf9-41cf-824b-0e60034383f0 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe" status: 404 len: 111 microversion: 2.1 time: 0.031750 Nov 03 05:48:16.657491 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4163/8223] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:16 2022] GET /compute/v2.1/servers/6ec8857e-ffd5-452b-8d30-d0d70c4a7fbe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 03 05:48:18.873161 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:18.873699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:18.875496 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-48586095-bc2e-44ff-8ffd-2df2394f2b5d req-4f2115eb-298a-4124-8ee7-9e03bdbcadf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f3a0863-4f62-4235-9445-78c1c39e47ca", "tag": "321a5f8a-bfe1-413a-8bd0-2c374c26ada0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:48:18.881983 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:18.882478 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:18.883100 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:18.883810 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:18.884597 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:18.885050 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:18.887870 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48586095-bc2e-44ff-8ffd-2df2394f2b5d req-4f2115eb-298a-4124-8ee7-9e03bdbcadf5 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:18.888438 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48586095-bc2e-44ff-8ffd-2df2394f2b5d req-4f2115eb-298a-4124-8ee7-9e03bdbcadf5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:18.889002 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-48586095-bc2e-44ff-8ffd-2df2394f2b5d req-4f2115eb-298a-4124-8ee7-9e03bdbcadf5 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:18.902237 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-48586095-bc2e-44ff-8ffd-2df2394f2b5d req-4f2115eb-298a-4124-8ee7-9e03bdbcadf5 service nova] Creating event network-changed:321a5f8a-bfe1-413a-8bd0-2c374c26ada0 for instance 9f3a0863-4f62-4235-9445-78c1c39e47ca on n-h1-854653-7 Nov 03 05:48:18.908539 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-48586095-bc2e-44ff-8ffd-2df2394f2b5d req-4f2115eb-298a-4124-8ee7-9e03bdbcadf5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036803 Nov 03 05:48:18.909750 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4164/8224] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:48:18.915782 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Going to try to terminate instance {{(pid=127593) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 03 05:48:19.177850 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-f73d6e8f-cb53-4309-8b59-629f5198ae20 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 204 len: 0 microversion: 2.1 time: 0.308148 Nov 03 05:48:19.182734 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4061/8225] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Nov 3 05:48:18 2022] DELETE /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 03 05:48:19.189259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:19.190252 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:19.196925 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:19.197465 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:19.197931 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:19.198659 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:19.199143 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:19.199595 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:19.334846 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.policy [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127594) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:48:19.342748 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-0dfe5b78-9029-4794-b266-2511142d5967 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1682 microversion: 2.1 time: 0.158413 Nov 03 05:48:19.343317 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4165/8226] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:19 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:48:20.366364 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:20.367358 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:20.374086 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:20.374629 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:20.375085 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:20.375761 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:20.376214 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:20.376945 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:20.513501 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:48:20.522174 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-07767371-da87-4a1a-8607-143e6502617a tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1564 microversion: 2.1 time: 0.160067 Nov 03 05:48:20.522761 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4062/8227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:20 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:48:20.772863 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [req-2175d41c-b422-4c4f-866b-96eee237b62a req-b9283395-4472-47e1-aa85-6ea6485b53d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f3a0863-4f62-4235-9445-78c1c39e47ca", "name": "network-vif-deleted", "tag": "321a5f8a-bfe1-413a-8bd0-2c374c26ada0"}]} {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 03 05:48:20.782641 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2175d41c-b422-4c4f-866b-96eee237b62a req-b9283395-4472-47e1-aa85-6ea6485b53d1 service nova] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:20.786197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2175d41c-b422-4c4f-866b-96eee237b62a req-b9283395-4472-47e1-aa85-6ea6485b53d1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:20.786197 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [req-2175d41c-b422-4c4f-866b-96eee237b62a req-b9283395-4472-47e1-aa85-6ea6485b53d1 service nova] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:20.795158 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.compute.server_external_events [req-2175d41c-b422-4c4f-866b-96eee237b62a req-b9283395-4472-47e1-aa85-6ea6485b53d1 service nova] Creating event network-vif-deleted:321a5f8a-bfe1-413a-8bd0-2c374c26ada0 for instance 9f3a0863-4f62-4235-9445-78c1c39e47ca on n-h1-854653-7 Nov 03 05:48:20.800142 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [req-2175d41c-b422-4c4f-866b-96eee237b62a req-b9283395-4472-47e1-aa85-6ea6485b53d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080620 Nov 03 05:48:20.800754 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4166/8228] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Nov 3 05:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 03 05:48:21.545082 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:21.545699 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.compute.api [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127593) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:21.553163 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:21.553996 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:21.554425 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:21.555125 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:21.555582 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:21.556011 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:21.587631 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:21.588129 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:21.588692 n-d-854653-7 devstack@n-api.service[127593]: DEBUG oslo_concurrency.lockutils [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:21.588999 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.objects.instance [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lazy-loading 'fault' on Instance uuid 9f3a0863-4f62-4235-9445-78c1c39e47ca {{(pid=127593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 03 05:48:21.630921 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.policy [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d9a981ee8b4aea99ca1aff5f254d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78ef67c0e5e343b799baa02ad74a391c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127593) authorize /opt/stack/nova/nova/policy.py:199}} Nov 03 05:48:21.638735 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-863f3227-ee51-46ff-a19f-7a5a2bfebb7e tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 200 len: 1337 microversion: 2.1 time: 0.097709 Nov 03 05:48:21.639307 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4063/8229] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:21 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 1337 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 03 05:48:22.663674 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '>' {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:22.664414 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.compute.api [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] [instance: 9f3a0863-4f62-4235-9445-78c1c39e47ca] Fetching instance by UUID {{(pid=127594) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 03 05:48:22.670571 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:22.671068 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:22.672025 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:22.672727 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Acquiring lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 03 05:48:22.673259 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 03 05:48:22.673699 n-d-854653-7 devstack@n-api.service[127594]: DEBUG oslo_concurrency.lockutils [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Lock "464d8109-3dad-41a5-aa6d-0cb4baaae295" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 03 05:48:22.687698 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.wsgi [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] HTTP exception thrown: Instance 9f3a0863-4f62-4235-9445-78c1c39e47ca could not be found. Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Request method failure captured: Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: request: GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca HTTP/1.1 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: Accept: application/json Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: Accept-Encoding: identity Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: Connection: close Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: Content-Length: 0 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: Content-Type: application/json Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: Host: 10.222.0.30 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: Openstack-System-Scope: None Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: User-Agent: python-urllib3/1.26.12 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Auth-Token: gAAAAABjY1TYbVLlarFCMshcAXHfMdnMNRYz8YJWH4idtGNDn6WpH5_Xen51T9EJMVOWTrom0DqDDnFhzamxVfGLH0kr_RDeYzFCheUqvqQ6Y_KcwtGc8yqm4DaOKa35oPwAM47JctvE9LoxYXP9yELR2hX7sSCyZKTM2zXTK8GYY1Qh8T3b75k Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Id: None Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Domain-Name: None Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Identity-Status: Confirmed Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Is-Admin-Project: True Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Id: default Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Domain-Name: Default Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Id: 78ef67c0e5e343b799baa02ad74a391c Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Project-Name: tempest-TestSnapshotPattern-952407223 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Role: member,reader Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Roles: member,reader Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78ef67c0e5e343b799baa02ad74a391c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_78ef67c0e5e343b799baa02ad74a391c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/78ef67c0e5e343b799baa02ad74a391c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/78ef67c0e5e343b799baa02ad74a391c"}]}] Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant: tempest-TestSnapshotPattern-952407223 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Id: 78ef67c0e5e343b799baa02ad74a391c Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-Tenant-Name: tempest-TestSnapshotPattern-952407223 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-User: tempest-TestSnapshotPattern-952407223-project Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Id: default Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Domain-Name: Default Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Id: 84d9a981ee8b4aea99ca1aff5f254d13 Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: X-User-Name: tempest-TestSnapshotPattern-952407223-project Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: method: > Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: exception: Instance 9f3a0863-4f62-4235-9445-78c1c39e47ca could not be found. Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: action_args: {'id': '9f3a0863-4f62-4235-9445-78c1c39e47ca'} Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: {{(pid=127594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f3a0863-4f62-4235-9445-78c1c39e47ca could not be found. Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f3a0863-4f62-4235-9445-78c1c39e47ca could not be found. Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 03 05:48:22.689367 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f3a0863-4f62-4235-9445-78c1c39e47ca could not be found. Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: ERROR nova.api.openstack.wsgi Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: DEBUG nova.api.openstack.wsgi [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Returning 404 to user: Instance 9f3a0863-4f62-4235-9445-78c1c39e47ca could not be found. {{(pid=127594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: INFO nova.api.openstack.requestlog [None req-f7ea9ff4-0ebb-480f-9794-be78ad4421b8 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca" status: 404 len: 111 microversion: 2.1 time: 0.032259 Nov 03 05:48:22.693544 n-d-854653-7 devstack@n-api.service[127594]: [pid: 127594|app: 0|req: 4167/8230] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Nov 3 05:48:22 2022] GET /compute/v2.1/servers/9f3a0863-4f62-4235-9445-78c1c39e47ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 03 05:48:22.970235 n-d-854653-7 devstack@n-api.service[127593]: DEBUG nova.api.openstack.wsgi [None req-acb77239-949e-47bf-aa1a-2c584f4ef633 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] Calling method '.version_select at 0x7ff7f3fa7c10>' {{(pid=127593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 03 05:48:23.058512 n-d-854653-7 devstack@n-api.service[127593]: INFO nova.api.openstack.requestlog [None req-acb77239-949e-47bf-aa1a-2c584f4ef633 tempest-TestSnapshotPattern-952407223 tempest-TestSnapshotPattern-952407223-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-269667388" status: 202 len: 0 microversion: 2.1 time: 0.093005 Nov 03 05:48:23.059106 n-d-854653-7 devstack@n-api.service[127593]: [pid: 127593|app: 0|req: 4064/8231] 10.222.0.30 () {58 vars in 1254 bytes} [Thu Nov 3 05:48:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-269667388 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)